ELI5: What are Load Balancers and Proxies?

Picture a really popular ice cream shop with five windows. A load balancer is like a helper out front who sends each customer to the window with the shortest line, so nobody waits too long. A proxy is more like a middle-man — you tell the proxy what ice cream you want, and the proxy goes and gets it for you, so the shop never knows who you are. Both help things run smoothly and safely.

Overview

Load balancers distribute incoming network traffic across multiple servers to ensure availability, performance, and reliability. Proxies act as intermediaries between clients and servers, providing security, caching, and anonymity. Both are important components of a secure network architecture that supports high availability and controlled access.

Key Concepts

  • Load balancer types:
    • Layer 4 (transport) — distributes based on IP and port; fast, no content inspection
    • Layer 7 (application) — inspects content and routes based on URLs, headers, cookies; supports SSL offloading
  • Scheduling algorithms — round-robin, least connections, weighted, IP hash, health-based
  • Active-active vs. active-passive — active-active uses all nodes; active-passive has standby nodes for failover
  • TLS offloading — load balancer handles encryption/decryption, reducing server workload
  • Health checks — load balancers monitor backend server health and remove unhealthy nodes from rotation
  • Proxy types:
    • Forward proxy — sits in front of clients; controls outbound access, caches content, hides client IPs
    • Reverse proxy — sits in front of servers; protects backend servers, handles SSL, provides load balancing
    • Transparent proxy — intercepts traffic without client configuration
    • Open proxy — accessible to any user; security risk if unintended
  • Content filtering — proxies can inspect and block traffic based on URLs, categories, or content types
  • Caching — proxies store frequently accessed content to reduce bandwidth and improve response times

Exam Tips

Remember

Forward proxy = protects clients (outbound). Reverse proxy = protects servers (inbound). Load balancers improve availability and are part of high-availability design. SSL offloading reduces backend server load.

Connections

Practice Questions

Scenario

See case-load-balancers-and-proxies for a practical DevOps scenario applying these concepts.