#hybrid
1 post
- Hybrid inference: a local model with a hosted one behind it
One model name can now carry a local model and a hosted one. llmman serve picks a side per request, and everything that fits stays on your machine.
1 post
One model name can now carry a local model and a hosted one. llmman serve picks a side per request, and everything that fits stays on your machine.