Skip to contentNewWe joined NVIDIA InceptionTokz Labs is now a member of the NVIDIA Inception program
tokz labs

Decision engine

Classify text without an LLM

Ask typed questions about text and get a probability for every option.

POST /v1/decide
endpoint
from $0.025
per 1M tokens
Apache-2.0
open weights, same as the API
4 question types
choice, tags, yes / no, score
Tokz API / POST /v1/decide · illustrative

Text “I was charged twice for my May invoice.”

Illustrative

Which team should handle this?

queue
  • billing (most likely)0.97
  • technical0.02
  • sales0.01

Is it urgent?

urgent
  • no (most likely)0.82
  • yes0.18
Request
POST /v1/decide
{
  "inputs": "I was charged twice for my May invoice.",
  "decisions": {
    "queue": {
      "type": "choice",
      "question": "Which team should handle this?",
      "options": ["billing", "technical", "sales"]
    },
    "urgent": { "type": "bool" }
  }
}
Raw response
200 · illustrative values
{
  "results": [
    {
      "queue": {
        "best": "billing",
        "policy": {
          "billing": 0.97,
          "technical": 0.02,
          "sales": 0.01
        }
      },
      "urgent": {
        "best": "no",
        "policy": {
          "yes": 0.18,
          "no": 0.82
        }
      }
    }
  ],
  "usage": {
    "billed_tokens": 46,
    "cost_usd": 0.000001656
  }
}
Figure 1. Illustrative: one request, two questions, example probabilities.

Four question types

Up to sixteen questions on up to sixty-four texts per request. No training run.

  1. Choice · choice

    Exactly one option. Routing, intent, sentiment.

  2. Tags · multilabel

    Any number, each with its own probability.

  3. Yes / no · bool

    One question, with how sure the model is.

  4. Score · score

    A value on your integer scale, with the full distribution.

Pick a model

On label sets they weren't trained on, JevK5, SemIf and Laya score higher. Test on your own data.

OpenDecision / Accuracy against GPU time
75808590102050100200↑ Suite macro-F1GPU-seconds per 1,000 decisions, one NVIDIA L4← log scale, lower is cheaperOpen-model frontierSmall79.3 · 17.5 GPU-sLayaLarge-Packed87.2 · 69.1 GPU-sLarge87.9 · 77.4 GPU-sGLiFormerSemIf · JevK5
Suite macro-F1 against GPU-seconds per 1,000 decisions
SystemSuite macro-F1GPU-seconds per 1,000 decisions
OpenDecision-Small79.2617.5
Laya81.4743.5
OpenDecision-Large-Packed87.2369.1
OpenDecision-Large87.9177.4
GLiFormer80.53109.5
JevK5 (4B LLM)86.27267.4
SemIf (4B LLM)86.32275.0
Figure 2. Suite macro-F1 against GPU-seconds per 1,000 decisions on one NVIDIA L4, model loading excluded. Open models only; GLiNER2.5 has no speed measurement. Measured 2026-10-04 and 2026-10-05 · Methodology.
OpenDecision / models
  • Smallopendecision-small$0.025Smallest, easy to self-host.
  • Large Packedopendecision-large-packed$0.025The default.
  • Largeopendecision-large$0.035Most accurate.
Parameters and weights →
Figure 3. The model id to send and its price per 1M tokens. Scores and GPU time are in Figure 2.

Open weights, same as the API

The API serves the Apache-2.0 weights we publish. Self-host them or call ours.

Start with $5 of credit

One key and one prepaid balance. No card.