fix(distributed): route per request across loaded replicas + cache probeHealth#9968

mudler merged 3 commits into

mastermudler/LocalAI:masterfrom

fix/distributed-per-request-routingmudler/LocalAI:fix/distributed-per-request-routingCopy head branch name to clipboard