feat: adding `rpc_servers` parameter to `Llama` class (#1477)
* passthru rpc_servers params wip * enable llama rpc by default * convert string to byte * add rpc package * Revert "enable llama rpc by default" This reverts commit 832c6dd56c979514cec5df224bf2d2014dccd790. * update readme * Only set rpc_servers when provided * Add rpc servers to server options --------- Co-authored-by: Andrei Betlen <abetlen@gmail.com>
N
nullname committed
d634efcdd91a0f79ae0fac13cfdf46eb47d0602d
Parent: 6e0642c
Committed by GitHub <noreply@github.com>
on 6/4/2024, 2:38:21 PM