Client load balancing technique in a distributed system