fix(model-loading): keep track of open GRPC Clients (#3377)
Due to a previous refactor we moved the client constructor tight to the model address, however that was just a string which we would use to build the client each time. With this change we make the loader to return a *Model which carries a constructor for the client and stores the client on the first connection. Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
E
Ettore Di Giacinto committed
7f069544257c8a8b39b744e949ba51cb40bb4b5b
Parent: 771a052
Committed by GitHub <noreply@github.com>
on 8/25/2024, 12:36:09 PM