Milliseconds.ai - Fast AI decisions on text and images, via one API

👋 Hey hunters!

Today we’re launching milliseconds.ai: fast AI decisions on text and images, through one API.

We spend a lot of time building software that needs small answers:

• Which team should get this email?

• What are the invoice number, supplier and total?

• Does this return request meet our policy?

• Is that a hot dog? (A critical enterprise workload)

Those answers usually end up in an if statement, a database field or a routing rule, and a whole paragraph beginning with “Certainly!” adds surprisingly little.

For months, we’ve been using small models inside our main product, CloudRaker’s Paperwork API, a platform to parse and classify documents, extract fields and check statements against source text. Our open-weight Vision Language model, rakedoc-nano, still ranks #2 among VLMs on the ParseBench benchmark, right behind Fable.

We always thought of all these features as components of something much bigger. Then TypeSafe AI launched Jev (I believe there's zero chance you missed this launch!)

Credit where it’s due: their launch made us realize how many developers wanted those capabilities on their own. We’d been using them for paperwork; people could use them throughout their apps.

So we gave them a home: milliseconds.ai.

Getting the standalone API live took two days.
The models, authentication and billing already existed. The work was rebuilding the request path so our infrastructure stopped taking longer than the inference itself. I wrote up the engineering story here.

What you can build with it today:

Classify, extract and make decisions with decision-machine-1
Send text or images; get labels, structured fields and decisions your app can use
Get started with the API, TypeScript/Python SDKs or CLI

$0.04 per million input tokens. Output tokens are free.
125M free input tokens every month on test keys. No card required.

It runs on our existing, battle-tested infrastructure, is SOC-2 Type 2 compliant, and since we run our own inference, we can answer the craziest compliance and enterprise needs (we've been there...)

We’re a small, bootstrapped team, and this grew directly out of tools we built because we needed them ourselves. I’d love to see where you take it.

Try the demos · Read the docs

Where in your app are you currently waiting for an LLM just to get a category, a field or a yes/no?

Bring us that use case. Super happy to answer questions about the tech behind, the rebuild or the economics!

— bap + the CloudRaker team