how do I not blow my token budget on every request?

Question

I send the whole conversation history each time and its getting expensive. whats the standard way to trim context?

Kenji Sato · Accepted Answer

do not overthink it — the simple version is fine for now, optimize once someone hits it.

Aria Mendes · Answer

shipped the same thing last month. the gotcha is the async bit. happy to look at your code.

2 answers