News
Newest
Ask
Show
Jobs
Open on GitHub
Ask HN: Is anybody using llama.cpp for production?
Considering the server version of llama.cpp for a commercial use case over bulkier options like vllm. But wondering if it's been battle-tested in production environments.
11 points | by
HardikVala
2 days ago
3 comments
thanhdongnguyen
1 day ago
No, i think llama.cpp only using testing model
Unirely01
2 days ago
[dead]
asquithdenardis
2 days ago
[dead]
3 comments