OTHMANE Merny

Last time I wrote about the small itch: one OpenAI bill, no idea which feature spent it, so I built a tiny logger. One line after every LLM call, sending model and token counts to my endpoint.

That line still exists. So the question I kept asking myself: if the integration is one line, what s an SDK for? (an "SDK" sounded very cool in my head at that time, someone who -before making this product- had no clue what an SDK is btw).

This started as a small itch.

My LLM provider (OpenAI, to be exact) gave me one number: total spend, aka a bill. But I wanted to know which function in my app spent more, and why. The code or the summarizer? Obviously the code, right?

There was no way for me to see my usage broken down. So I built a tiny thing for myself: one line after each API call, sending the token counts and a feature name. I only wanted visibility, nothing more.

Then I got curious whether anyone else cared, and went looking. My problem turned out to be the door into a rabbit hole.