It also fails on things that aren't actual words For example, the output for "ho... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		sealeck on Jan 1, 2025 \| parent \| context \| favorite \| on: 30% drop in O1-preview accuracy when Putnam proble... It also fails on things that aren't actual words For example, the output for "how many x's are there in xaaax" is 3. https://chatgpt.com/share/677591fe-aa58-800e-9e7a-81870387be...

Isinlor on Jan 1, 2025 | [–]

Transformers are very bad at counting in one feed forward pass, you need to explicitly tell them to use a counter in autoregressive fashion like here:

https://chatgpt.com/share/6775cb37-4198-8007-82cb-e897220827...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact