HttpClusterServlet Proxy Load Balancing with Multiple Clusters

          How do I load balance JSPs and Servlets using the HttpClusterServlet proxy server
          approach when I have more than one cluster?
          It appears from the docs that there is a 1 to 1 relationship between the non-clustered
          managed proxy server that has the HttpClusterServlet and the cluster (1 proxy
          to 1 cluster).
          

Preferred method would be domain, domainhash, url or urlhash as described in:
http://www.cisco.com/univercd/cc/td/doc/product/webscale/css/bsccfggd/contrule.htm#xtocid2610122.
do not recommend to use round-robin method for load balancing internet proxies. It creates inefficient usage of the storage and bandwidth, as more proxies can have to cache the same objects.

Similar Messages

  • Load balancing with multiple clusters (HTTPProxyServlet)

              Hello!
              I'm newbie in Weblogic. I would like to have clustering and load balancing in
              development environment. I've created 2 clusters, with one managed server each.
              I've created a web application for deploying the http proxy servlet and put it
              under another managed server without clustering. Below is my configuration:
              managed server without cluster (as proxy) - Port 8002
              admin server - Port 8001
              cluster_1 - multicast address 237.0.0.11, multicast port 8004, cluster address
              - t3://localhost:8006, t3://localhost:8007
              cluster_2 - multicast address 237.0.0.10, multicast port 8014, cluster address
              - t3://localhost:8006, t3://localhost:8007
              managed_cluster1 - under cluster_1, port 8006
              managed_cluster2 - under cluster_2, port 8007
              in the web.xml of the proxy, i put the following parameters:
              <param-name>WebLogicCluster</param-name>
              <param-value>localhost:8006|localhost:8007</param-value>
              However, when i send the requests to http://localhost:8002/sms, the requests always
              go to the same server, for eg: managed_cluster2?
              If i configure using single cluster, the load balancing will be in proper. What's
              the cause fo the problem? and any solution?
              Thanx in advance.
              Regards,
              joey
              

    You have 2 options here Jordi, either you can use BGP loadbalancing, this requires multipath as BGP by default would only install one route from the BGP table to the RIB hence FIB.
    But this may result in excessive IRL (inter rack link) usage in the cluster when traffic coming in on rack0 wants to take the bGP path out on rack1
    You could also use ABF (access-list based forwarding) to forcelly push traffic received on rack0 out on the link on rack0 and use an ipsla tracker to fallback to rack1 in case the uplink is gone.
    Alternatively to extend this by IGP signaling to redirect traffic preferably to rack1 to start with to minimize the IRL usage.
    And then you also have the ability to use RPL in the uplink path to make one link more preferred on teh internet then the other in case you want to control a bit which link is preferably used on rack0 or rack1
    regards
    xander

  • Proxy Load Balancing with CSS

    Are there any chances to use CSS with 2 CE50x to implement proxy load balacing and improve the conection to the internet?

    Preferred method would be domain, domainhash, url or urlhash as described in:
    http://www.cisco.com/univercd/cc/td/doc/product/webscale/css/bsccfggd/contrule.htm#xtocid2610122.
    do not recommend to use round-robin method for load balancing internet proxies. It creates inefficient usage of the storage and bandwidth, as more proxies can have to cache the same objects.

  • Apache Proxy Plug-in with multiple clusters?

    We are using the Apache Proxy Plug-in , the
              basic question is if we can place multiple cluster
              IP's in the same Location definition or do we have
              to have a different definition for each cluster?
              Currently we have only 1 cluster, but if we decide
              to segment the large cluster into smaller clusters
              this is a critical network,url question.
              For example we have 4 clusters containing 2 IP:PORT pairs each.
              IP1:P1,IP2:P2 <== Cluster 1
              IP3:P3,IP4:P4 <== Cluster 2
              IP5:P5,IP6:P6 <== Cluster 3
              IP7:P7,IP8:P8 <== Cluster 4
              Can we have a single location "application" that services all of these clusters?
              <Location /webapp>
              SetHandler weblogic-handler
              WebLogicCluster IP1:P1,IP2:P2,IP3:P3,IP4:P4,IP5:P5,IP6:P6,IP7:P7,IP8:P8
              </Location>
              Or do we have to have distinct entries?
              <Location /webapp1>
              SetHandler weblogic-handler
              WebLogicCluster IP1:P1,IP2:P2
              </Location>
              <Location /webapp2>
              SetHandler weblogic-handler
              WebLogicCluster IP3:P3,IP4:P4
              </Location>
              <Location /webapp3>
              SetHandler weblogic-handler
              WebLogicCluster IP5:P5,IP6:P6
              </Location>
              <Location /webapp4>
              SetHandler weblogic-handler
              WebLogicCluster IP7:P7,IP8:P8
              </Location>
              Regards.

    you should define location for each cluster.This would be a proper setup.
              The setup with same location definition would work partially, all the requests would be roundrobined across all the servers (all the clusters) and most likely you wouldn't get a proper failover.(cluster1 does not know about cluster2 from weblogic perspective)
              Vijay

  • Load balancing with JSP

    Anyone and everyone,
    When configuring load balancing with Weblogic clusters, does load
    balancing take effect for all services or just EJB and RMI? Or another
    way of saying the same thing, can I setup weighted load balancing for
    the JSP engines across 2 weblogic servers.
    Thanks in advance,
    Mike

    The load-balancing documentation you read describing the different algorithms only applies to RMI stubs (e.g., EJB clients). Please see http://www.weblogic.com/docs51/cluster/concepts.html#1026091 for a description of how load-balancing/clustering works with servlets/JSPs.
    The short answer is that in using servlet clustering, most people want/need/use in-memory replication for HttpSession objects. In WLS 5.1 (and before), in-memory replication requires one or more proxy servers be set-up in front of the cluster. Typically, most people use something like BigIP to load-balance
    across the proxy servers and let the weblogic plug-in for the proxy server handle the routing to the cluster. The plug-in uses round-robin until an HttpSession is established for a user, then it always tries to route to the server where the user's session is located.
    Hope this helps,
    Robert
    Brian Lin wrote:
    All,
    I have a quesiton here regarding load balancing with DNS round robin. As of Chapter Adminstration of Clustering Weblogic server, Weblogic can be configured to balance by weight. How about Weblogic handle weight based balancing after DNS round robin ip response? or just can choose one way instead of both?
    What's the big difference between choosing BigIP and software balancing (WL)?
    Brian
    "Wei Guan" <[email protected]> wrote:
    I don't think you can configure this load balancing in weblogic in current
    release. However, if you have Big-IP or LocalDireoctr, you can set up
    weighted load-balancing there. Otherwise, weblogic proxy will use DNS round
    robin to do the load-balancing between JSP engins.
    My 2 cents.
    Cheers - Wei
    Michael Yakimisky <[email protected]> wrote in message
    news:[email protected]...
    Anyone and everyone,
    When configuring load balancing with Weblogic clusters, does load
    balancing take effect for all services or just EJB and RMI? Or another
    way of saying the same thing, can I setup weighted load balancing for
    the JSP engines across 2 weblogic servers.
    Thanks in advance,
    Mike

  • Load balancing across multiple machines

    I am looking for assistance in configuring Tuxedo to perform load balancing across
    multiple machines. I have successfully performed load balancing for a service
    across different servers hosted on one machine but not to another server that's
    hosted on a different machine.
    Any assistance in this matter is greatly appreciated.

    Hello, Christina.
    Load balancing with multiple machines is a little bit different than
    in the same machine. One of the important resource in this kind
    of application is network bandwidth, so tuxedo tries to keep the
    traffic among the machines as low as possible. So, it only
    balance the load (call services in other machine) in case all the
    services are busy in the machine where they are call.
    I mean, if you have workstation clients attached only to one
    machine, then tuxedo will call services in this machine untill
    all servers are busy.
    If you want load balancing, try to put one WSL in each machine,
    and the corresponding configuration in your WSC ( with the | to
    make tuxedo randomly choose one or the other) or spread your
    native clients among all the machines.
    And so, be carefull with the routing!
    Ramón Gordillo
    "Christina" <[email protected]> wrote:
    >
    I am looking for assistance in configuring Tuxedo to perform load balancing
    across
    multiple machines. I have successfully performed load balancing for a
    service
    across different servers hosted on one machine but not to another server
    that's
    hosted on a different machine.
    Any assistance in this matter is greatly appreciated.

  • Load balancing with HttpClusterServlet

              Hi,
              Could someone plz tell me how HttpClusterServlet achieves
              load balancing?
              Suppose there are 3 servers A,B,C (ordered list) in a cluster.
              When the servlet the receives the request for the 1st time will
              direct it to server A and let B be the secondary. Now, when the
              same client makes a 2nd request the servlet reads the cookie and
              directs the request to server A.
              Where is load balancing been achieved here?
              Or is it this way LB ( load balancing ) is done:
              if any other client (other than the one mentioned above) makes a
              request it is directed to server B (since it is the 2nd server
              in the cluster)
              thanx
              

    It is the second option you mention.
              -- Anand
              "pradeep bhat" <[email protected]> wrote in message
              news:3ca0409e$[email protected]..
              >
              > Hi,
              > Could someone plz tell me how HttpClusterServlet achieves
              > load balancing?
              >
              >
              > Suppose there are 3 servers A,B,C (ordered list) in a cluster.
              > When the servlet the receives the request for the 1st time will
              > direct it to server A and let B be the secondary. Now, when the
              > same client makes a 2nd request the servlet reads the cookie and
              > directs the request to server A.
              >
              >
              > Where is load balancing been achieved here?
              >
              >
              > Or is it this way LB ( load balancing ) is done:
              >
              > if any other client (other than the one mentioned above) makes a
              > request it is directed to server B (since it is the 2nd server
              > in the cluster)
              > thanx
              >
              >
              

  • CF 10 Load-Balancing with Remote Instances

    I was reading an article on Clustering/LB/HA using CF8, but have not found any updates for CF10.
    Using VM VirtualBox to setup a few virtual servers, I am looking to setup a load balancing of ColdFusion 10 on 2 remote instances. The goal would be have ColdFusion Cluster Manager be able to point http request to one of the two servers based on load/availability. Not really having a hardware cluster/failover setup, just managing resources on two CF instances instead of a standalone.
    The servers are Windows Server 2008 R2 with IIS7.5 and ColdFusion 10 Enterprise on installed on 3 of these machines. Let's call them CF-LBManager, CF-Web1, and CF-Web 2. In the CF Docs, they show the Cluster Manager adding the local CF instance and "if you want" a remote instance. However, this scenario would require the main instance to be running and not fail for it to direct to the other instance.
    I am trying to set this up now with CF-LBManager as just a manager of the requests coming in. In the Enterprise Manager >> Instance Manager, the local instance is shown and I add the two remote instances with the correct Remote Port, JVM Route, etc. I also made sure the <Cluster>...</Cluster> block was added to the two remote instances (CF-Web1 and CF-Web2) \runtime\conf\server.xml file too, Jetty Services also is running. Now under the Enterprise Manager >> Cluster Manager I add the two remote instances to the cluster, not the local instance on CF-LBManager with Multicast Port and Sticky Sessions enabled. On Submit, I get a green message "You must restart all the server instances and any configured webservers for these changes to take effect.". I go ahead and reboot the servers and come back.
    I now browse to the ColdFusion page as a test on CF-Web1 and CF-Web2 to make sure CF is running properly, they do. I then browse the IP of the CF-LBManager, however it only returns the local IIS web site and not redirect to one of the two cluster members. I am not seeing any message on the coldfusion-out.log on the remote instances. Am I not setting this up correctly or not enabling the Cluster Manager to take over and pass along the requests to those in the cluster?

    Unfortunatley I don't have a lot of experience with CF10 on Windows, but if you are running CF behind IIS I think  you will need to update the Tomcat connector configuraiton to do load balancing. I'm not sure if re-running the wsconfig tool on all of the servers will do this or not, but that is what I would suggest trying first. If that doesn't work you will need to update the Tomcat connector configuraiton manually. You can find more information on load balancing with the Tomcat connector here: http://tomcat.apache.org/connectors-doc/generic_howto/loadbalancers.html.

  • Sticky sessions and Load Balancing in WL Clusters

    We are using iPlanet Web Server 4.1 with WebLogic App Server; and would like
    to implement load balancing with sticky sessions and in-memory state
    replication.
    The documentation in Weblogic says that -
    When using in-memory state replication, your WebLogic Server Cluster must
    live behind one or more proxy servers. The proxy servers are smart enough to
    send servlet requests, belonging to the same HTTP session, back to the same
    server in the cluster that holds the session data.
    (Ref: http://www.weblogic.com/docs51/cluster/setup.html)
    Does this mean that the sticky session configuration has to be done on the
    iPlanet Web Server itself ?
    Also, if WebLogic is used as the Web server, does WebLogic provide any
    support for sticky sessions?
    Any help, suggestions or links to useful info are welcome.
    Regards,
    Milind.

    Mike,
    im curious as to why you would recomend using weblogic as a web server in 6.1?
    I would not for the following reasons:
    - it costs 10x more per cpu list
    - it doesnt support hardware accell cards (afaik, please let me know if this has
    changed)
    iplanet is really good a serving up static html and gif's, especially in ssl if you
    have a hardware accell card. So if you have a site with lots of graphics and you use
    ssl a lot, I think its still a better solution.
    -Joel
    Mike Reiche wrote:
    You get sticky round-robin by default.
    You need to have session tracking turned on (i think it is on by default). You
    need to have the WL plugin configured in iPlanet.
    When WL creates an httpSession, it writes a cookie (or rewrites the URL) back
    to the browser. On subsequent requests, the browser sends the cookie and iPlanet
    plug-in directs the request to the correct WL instance based on the ip address
    of the WL server embedded in the cookie.
    If you are using WLS 6.1, I would recommend using it as a web server (and not
    using iPlanet). I imagine that it supports stickly load balancing as well.
    Mike
    Joel Nylund <[email protected]> wrote:
    you get round robin by default, if you want a different scheme you can
    use one
    of the other 3 options (weight, random or parameter).
    -Joel
    I think weight can be set in weblogic properties. I havent used any other
    than
    round robin.
    Milind Prabhu wrote:
    We are using iPlanet Web Server 4.1 with WebLogic App Server; and wouldlike
    to implement load balancing with sticky sessions and in-memory state
    replication.
    The documentation in Weblogic says that -
    When using in-memory state replication, your WebLogic Server Clustermust
    live behind one or more proxy servers. The proxy servers are smartenough to
    send servlet requests, belonging to the same HTTP session, back tothe same
    server in the cluster that holds the session data.
    (Ref: http://www.weblogic.com/docs51/cluster/setup.html)
    Does this mean that the sticky session configuration has to be doneon the
    iPlanet Web Server itself ?
    Also, if WebLogic is used as the Web server, does WebLogic provideany
    support for sticky sessions?
    Any help, suggestions or links to useful info are welcome.
    Regards,
    Milind.

  • Multihomed eBGP load balancing with 3 ISP's

    We currently peer with 2 ISPs using BGP in an active/failover configuration.  My company wants to move to a 3 ISP model where Internet traffic is split across the 3 providers so that bandwidth is equally distributed on outgoing traffic across our 2 /22 ARIN IP ranges.  This is from our 2 edge switches that have VSS.  
    Within my limited knowledge of BGP, I have determined that we could do load sharing pretty easily by adding multiple default routes and breaking up our /22's into /24 and advertising them that way.  However, I don't think this satisfies the request that downtime must be seamless, should one link drop.  
    Currently, our ISP's advertise default routes.  From the research that I've done, we could get close to load balanced links if we receive full BGP routes and community settings and definitions.  I'm nervous about this because it looks really complicated, and I don't want our AS to turn into a transit AS.  I've been told the same can be accomplished with only partial BGP routes and community settings and definitions.  
    Personally, I think we just need a WAN load balancer.  However, given the request, is there a thread out there that can explain this, or can someone discuss this requested scenario a little bit?  
    Thanks!

    Hi there
    First question would be what is the required reconvergence time for the applications using the Internet? Should an outage occur, when do they lose their state? Once you know that, you then have a target to aim for in terms of recovery
    With regards load-balancing, with BGP we are always talking inbound and outbound.
    The outbound solution is relatively simple - each ISP advertises a default route to your Internet edge router(s). Create an eBGP session from each edge router to the core, advertise the default route and redistribute into the IGP. Ensure the IGP cost to each BGP next hop is equal and you have ECMP for outbound routing.
    Inbound influence is usually via MED (not likely in this case given 3 ISPs), adjusting local-pref in the ISP via BGP EXT communities configured your end, or via AS-PATH prepending for longer prefixes from your /22. Prepending would be simplest, but your unlikely to get an exact inbound traffic split, however a relatively even distribution should be sufficient. 

  • Load balancing with NAT

    Hello,
    If all the clients are behind an ISP and as a result coming in with a single NAT address is it still possible to attain load balancing across multiple servers using "predictor hash address dest 255.255.255.255"?
    Thanks,
    Murtaza

    Coming from a single NAT source IP address, you may want to consider some form of alternative load balancing besides source IP(such as cookie, x-forwarded-for header, etc). A source IP address is a source IP address and is not likely to give you the results you need if the NAT IP address doesnt change.

  • Load balancing over multiple E3s

    Hi all,
    For the same VP , can I make load balancing over multiple E3s connected bet the BPX 8600 and MGX 8850.
    Asking the question in another way:
    Is there a possibility for load balancing over multiple LSPs (multiple E3 interfaces) in Cell-Mode MPLS...and if possible,plz provide me with any good links for configuration.

    Following link might be useful to you
    http://www.cisco.com/univercd/cc/td/doc/product/wanbu/bpx8600/9_2/ref92/bpxrtag.htm

  • Load balancing with use of router 881.

    Hello,
    I have two MPLS line and i want load balancing with the help of CISCO router 881. is it necessary that i require two router on both location.? if one location have firewall and one location have cisco router 881 then can i do a load balancing or i require two router each on both location ? What are the basic requirement that i need.
    Thanks,
    Kuntal

    Disclaimer
    The Author of this posting offers the information contained within this posting without consideration and with the reader's understanding that there's no implied or expressed suitability or fitness for any purpose. Information provided is for informational purposes only and should not be construed as rendering professional advice of any kind. Usage of this posting's information is solely at reader's own risk.
    Liability Disclaimer
    In no event shall Author be liable for any damages whatsoever (including, without limitation, damages for loss of use, data or profit) arising out of the use or inability to use the posting's information even if Author has been advised of the possibility of such damage.
    Posting
    An 881 should be able to load share across multiple ports.  Many routing protocol support ECMP, including BGP, but you need "special" hidden/secret commands to enable.  EIGRP also supports unequal cost load sharing.
    If an 881 supports OER or PfR, those too will do unequal load sharing, dynamically.

  • Hardware load balancing with session stickiness

    Hello,
              We are looking for a hardware based solution to load balance 4
              unclustered weblogic servers. These servers are software replicas of
              each other and share a common database. We need a solution that
              provides session level server stickiness based on jsessionid as both a
              cookie and url rewrite. Currently we have Cisco load balancers which
              do not handle the url rewrite due to the fact the the load balancer
              only "sees" what is after the question mark in the url and the
              jsessionid is before the question mark. Example:
              http://somehost.com/some/url.jsp;jsessionid=26D5C566075663ABD8E17AD255974323?parm=value
              I'm sure we are not the only ones trying to do this. Any suggestions
              would be greatly appreciated.
              Thanks,
              Alan George
              

              Having worked on Cisco load balancer and WLS clustered, you would loose sessions
              when the requests are failed over.
              S
              "Shawn Kircher" <[email protected]> wrote:
              >
              >Has anyone got this type of scenario working where you load balance sticky
              >sessions
              >from a Cisco load balancer between non-clustered weblogic servers?
              >
              >Thanks,
              >
              >Shawn
              >
              >"Aravind Krishnasamy" <[email protected]> wrote:
              >>F5 or BigIp provides hardware level load balancing and it injects date
              >>inside weblogic cookie and maintains server affinity.
              >>Thanks
              >>Aravind
              >>"ageorge" <[email protected]> wrote in message
              >>news:[email protected]...
              >>> Hello,
              >>>
              >>> We are looking for a hardware based solution to load balance 4
              >>> unclustered weblogic servers. These servers are software replicas
              >>of
              >>> each other and share a common database. We need a solution that
              >>> provides session level server stickiness based on jsessionid as both
              >>a
              >>> cookie and url rewrite. Currently we have Cisco load balancers which
              >>> do not handle the url rewrite due to the fact the the load balancer
              >>> only "sees" what is after the question mark in the url and the
              >>> jsessionid is before the question mark. Example:
              >>>
              >>>
              >>http://somehost.com/some/url.jsp;jsessionid=26D5C566075663ABD8E17AD255974323
              >>?parm=value
              >>>
              >>> I'm sure we are not the only ones trying to do this. Any suggestions
              >>> would be greatly appreciated.
              >>>
              >>> Thanks,
              >>>
              >>> Alan George
              >>
              >>
              >
              

  • CSS Load Balancing with Cookies

    We are trying to load balance 2 backend servers hosted on Websphere with advance balance cookies method.
    Restrictions
    ServerA is unable to accept cookies generated from ServerB.
    ServerA and ServerB are generating random cookies
    Unable to modify cookie string with a constant.
    How can we load balance based on cookies considering the above restrictions?
    We have attempted to do hash based load balancing with cookies but the problem we run into is the servers do not accept cookies generated from another server.
    The configuration we tried is written below:
    service ServerA
    ip address 192.168.10.2
    keepalive type tcp
    keepalive port 80
    active
    service ServerB
    ip address 192.168.20.2
    keepalive type tcp
    keepalive port 80
    active
    content ABC
    url "/*"
    add service ServerA
    string prefix "JSESSIONID="
    advanced-balance cookies
    port 80
    add service ServerB
    string skip-length 5
    string process-length 16
    string operation hash-xor
    protocol tcp
    vip address 172.16.32.1
    active
    Can we change the string prefix to JSESSION instead of JSESSIONID= ?
    The only place the app guys can add a constant string to match on is before the = sign.
    Is it possible for CSS to match on a constant string before = sign e.g below:
    service ServerA
    ip address 192.168.10.2
    keepalive type tcp
    keepalive port 80
    string id567=
    active
    service ServerB
    ip address 192.168.20.2
    keepalive type tcp
    keepalive port 80
    string id123=
    active
    content ABC
    url "/*"
    add service ServerA
    string prefix "JSESSION"
    advanced-balance cookies
    port 80
    add service ServerB
    string skip-length 0
    string process-length 6
    protocol tcp
    vip address 172.16.32.1
    active

    It should work.
    There is no reason for it not to work...
    This is the best method you can have on the CSS for stickyness.
    Get a sniffer trace on the client and server with arrowpoint cookie configured on the CSS and capture a failure so we can see what is going on.
    also send me the config so I can verify everything is ok.
    If you have a service request open with the TAC, you can also give the SR # so I can review what has been done.
    Gilles.

Maybe you are looking for