Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

To the author: why is this taking 4.56GB ? I was expecting this to be under 1GB for 4B model. https://ibb.co/CprTGZ1c

And this is when Im serving zero prompts.. just loaded the model (using llama-server).

 help



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: