This guide explains how to count tokens for 3.5-turbo and beyond: https://github... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

tedsanders on April 5, 2023 | parent | context | favorite | on: OpenAI Tokenizer

This guide explains how to count tokens for 3.5-turbo and beyond: https://github.com/openai/openai-cookbook/blob/main/examples...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact