Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
freakynit
9 days ago
|
parent
|
context
|
favorite
| on:
Show HN: 1-Bit Bonsai, the First Commercially Viab...
To the author: why is this taking 4.56GB ? I was expecting this to be under 1GB for 4B model.
https://ibb.co/CprTGZ1c
And this is when Im serving zero prompts.. just loaded the model (using llama-server).
help
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
And this is when Im serving zero prompts.. just loaded the model (using llama-server).