<\/p>\n\n\n\n
In cloud data centers, stateful load balancers (LBs) are crucial for scaling applications and ensuring availability. Hardware load balancers (HLBs) implemented on programmable switches are increasingly adopted for their high throughput and low latency. However, existing approaches to scaling HLBs largely rely on VIP-based partitioning and ECMP-driven scale-out. Such methods do not adequately accommodate traffic dynamics or HLB-node heterogeneity, and are prone to per-connection consistency (PCC) violations. <\/p>\n\n\n\n
To address these issues, we present SlimeMold, a scale-out HLB architecture that provides a global and unified Giant Connection Table (GCT) across a multi-node HLB deployment. SlimeMold partitions the GCT into fine-grained segments and assigns segments to nodes in proportion to their capacities (CPS and connection-table size). To make this practical, we design low-overhead node lookup, efficient rebalancing with minimal state movement, and fast fault tolerance with low performance impact. We implement SlimeMold on the Broadcom BCM56788 SmartToR switch. Results from a real testbed demonstrate near-linear scalability up to four logical nodes and fast failover with minimal performance degradation. Large-scale simulations show that SlimeMold achieves over 98% resource utilization despite node heterogeneity and dynamic traffic.<\/p>\n\n\n\n
<\/p>\n","protected":false},"excerpt":{"rendered":"
In cloud data centers, stateful load balancers (LBs) are crucial for scaling applications and ensuring availability. Hardware load balancers (HLBs) implemented on programmable switches are increasingly adopted for their high throughput and low latency. However, existing approaches to scaling HLBs largely rely on VIP-based partitioning and ECMP-driven scale-out. Such methods do not adequately accommodate traffic […]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[{"type":"guest","value":"ziyuan-liu","user_id":"812629"},{"type":"user_nicename","value":"Zhixiong Niu","user_id":"38118"},{"type":"user_nicename","value":"Ran Shu","user_id":"37926"},{"type":"text","value":"Jianqin Zhang","user_id":0},{"type":"text","value":"Guohong Lai","user_id":0},{"type":"text","value":"Liang Gao","user_id":0},{"type":"text","value":"Na Wang","user_id":0},{"type":"text","value":"Zongying He","user_id":0},{"type":"user_nicename","value":"Jacob Nelson","user_id":"36275"},{"type":"user_nicename","value":"Dan Ports","user_id":"37404"},{"type":"text","value":"Lihua Yuan","user_id":0},{"type":"user_nicename","value":"Peng Cheng","user_id":"33225"},{"type":"user_nicename","value":"Yongqiang Xiong","user_id":"35049"}],"msr_publishername":"","msr_publisher_other":"","msr_booktitle":"","msr_chapter":"","msr_edition":"","msr_editors":"","msr_how_published":"","msr_isbn":"","msr_issue":"","msr_journal":"","msr_number":"","msr_organization":"","msr_pages_string":"","msr_page_range_start":"","msr_page_range_end":"","msr_series":"","msr_volume":"","msr_copyright":"","msr_conference_name":"","msr_doi":"","msr_arxiv_id":"","msr_mag_id":"","msr_other_authors":"","msr_other_contributors":"","msr_speaker":"","msr_award":"","msr_affiliation":"","msr_institution":"","msr_host":"","msr_version":"","msr_duration":"","msr_release_tracker_id":"","msr_highlight_type":"","msr_date_display_format":"","msr_main_download_label":"","msr_external_link_label":"","msr_doi_label":"","msr_published_date":"","msr_startdate":"","msr_presentation_date":"","msr_highlight_text":"","msr_notes":"","msr_longbiography":"","msr_publicationurl":"","msr_external_url":"","msr_secondary_video_url":"","msr_conference_url":"","msr_journal_url":"","msr_year":0,"msr_month":0,"msr_day":0,"msr_microsoftintellectualproperty":false,"msr_pub_id":"","msr_publication_uploader":[],"msr_related_uploader":[{"type":"file","title":"socc26-15-with-appendix-full.pdf","label_id":0,"id":1178435,"viewUrl":"https:\/\/find.codeghost.online\/en-us\/research\/wp-content\/uploads\/2026\/07\/socc26-15-with-appendix-full.pdf"}],"msr_original_fields_of_study":[],"msr_s2_paper_id":"","msr_s2_pdf_url":"","msr_citation_count_updated":"","msr_citation_count":0,"msr_influential_citations":0,"msr_reference_count":0,"msr_s2_open_access":false,"msr_s2_author_ids":[],"msr_pub_ids":[],"msr_hide_image_in_river":0,"footnotes":""},"msr-research-highlight":[],"research-area":[13547],"msr-publication-type":[193716],"msr-publisher":[],"msr-publication-cta":[],"msr-focus-area":[],"msr-locale":[268875],"msr-post-option":[],"msr-field-of-study":[270430],"msr-conference":[270431],"msr-journal":[],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-1178336","msr-research-item","type-msr-research-item","status-publish","hentry","msr-research-area-systems-and-networking","msr-locale-en_us","msr-field-of-study-computer-networks"],"msr_publishername":"","msr_edition":"","msr_affiliation":"","msr_published_date":"","msr_host":"","msr_duration":"","msr_version":"","msr_speaker":"","msr_other_contributors":"","msr_booktitle":"","msr_pages_string":"","msr_chapter":"","msr_isbn":"","msr_journal":"","msr_volume":"","msr_number":"","msr_editors":"","msr_series":"","msr_issue":"","msr_organization":"","msr_how_published":"","msr_notes":"","msr_highlight_text":"","msr_release_tracker_id":"","msr_original_fields_of_study":"","msr_download_urls":"","msr_external_url":"","msr_secondary_video_url":"","msr_longbiography":"","msr_microsoftintellectualproperty":0,"msr_main_download":"","msr_publicationurl":"","msr_doi":"","msr_publication_uploader":[],"msr_related_uploader":[{"type":"file","title":"socc26-15-with-appendix-full.pdf","label_id":0,"id":1178435,"viewUrl":"https:\/\/find.codeghost.online\/en-us\/research\/wp-content\/uploads\/2026\/07\/socc26-15-with-appendix-full.pdf"}],"msr_citation_count":0,"msr_citation_count_updated":"","msr_s2_paper_id":"","msr_influential_citations":0,"msr_reference_count":0,"msr_arxiv_id":"","msr_s2_author_ids":[],"msr_s2_open_access":false,"msr_s2_pdf_url":null,"msr_attachments":[{"id":1178435,"url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-content\/uploads\/2026\/07\/socc26-15-with-appendix-full.pdf"},{"id":1178337,"url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-content\/uploads\/2026\/07\/socc26-15-with-appendix.pdf"}],"msr-author-ordering":[{"type":"guest","value":"ziyuan-liu","user_id":812629,"rest_url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=ziyuan-liu"},{"type":"user_nicename","value":"Zhixiong Niu","user_id":38118,"rest_url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Zhixiong Niu"},{"type":"user_nicename","value":"Ran Shu","user_id":37926,"rest_url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Ran Shu"},{"type":"text","value":"Jianqin Zhang","user_id":0,"rest_url":false},{"type":"text","value":"Guohong Lai","user_id":0,"rest_url":false},{"type":"text","value":"Liang Gao","user_id":0,"rest_url":false},{"type":"text","value":"Na Wang","user_id":0,"rest_url":false},{"type":"text","value":"Zongying He","user_id":0,"rest_url":false},{"type":"user_nicename","value":"Jacob Nelson","user_id":36275,"rest_url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Jacob Nelson"},{"type":"user_nicename","value":"Dan Ports","user_id":37404,"rest_url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Dan Ports"},{"type":"text","value":"Lihua Yuan","user_id":0,"rest_url":false},{"type":"user_nicename","value":"Peng Cheng","user_id":33225,"rest_url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Peng Cheng"},{"type":"user_nicename","value":"Yongqiang Xiong","user_id":35049,"rest_url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Yongqiang Xiong"}],"msr_impact_theme":[],"msr_research_lab":[],"msr_event":[],"msr_group":[],"msr_project":[],"publication":[],"video":[],"msr-tool":[],"msr_publication_type":"inproceedings","related_content":[],"_links":{"self":[{"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/1178336","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item"}],"about":[{"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-research-item"}],"version-history":[{"count":3,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/1178336\/revisions"}],"predecessor-version":[{"id":1178340,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/1178336\/revisions\/1178340"}],"wp:attachment":[{"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/media?parent=1178336"}],"wp:term":[{"taxonomy":"msr-research-highlight","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-highlight?post=1178336"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=1178336"},{"taxonomy":"msr-publication-type","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-publication-type?post=1178336"},{"taxonomy":"msr-publisher","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-publisher?post=1178336"},{"taxonomy":"msr-publication-cta","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-publication-cta?post=1178336"},{"taxonomy":"msr-focus-area","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-focus-area?post=1178336"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=1178336"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=1178336"},{"taxonomy":"msr-field-of-study","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-field-of-study?post=1178336"},{"taxonomy":"msr-conference","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-conference?post=1178336"},{"taxonomy":"msr-journal","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-journal?post=1178336"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=1178336"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=1178336"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}