scienthoon/jev-ood-calibration
Independent calibration test of TypeSafe's Jev on a task it cannot have seen: 900 rule-generated support tickets (choice / score / boolean) plus 3 public benchmarks via Vercel AI Gateway. Raw responses, ECE with noise floor, temperature refit, per-type sign of miscalibration. Reproducible for ~$0.06.
Key facts
- Category
- Research & reimplementation
- Stars
- 6
- Forks
- 0
- Language
- Python
- License
- MIT
Indexed in the Jev community ecosystem directory, data snapshot 2026-11-02.
Frequently asked questions
What is scienthoon/jev-ood-calibration?
scienthoon/jev-ood-calibration is a project in the "Research & reimplementation" category of the Jev ecosystem. Independent calibration test of TypeSafe's Jev on a task it cannot have seen: 900 rule-generated support tickets (choice / score / boolean) plus 3 public benchmarks via Vercel AI Gateway. Raw responses, ECE with noise floor, temperature refit, per-type sign of miscalibration. Reproducible for ~$0.06.
Is scienthoon/jev-ood-calibration open source, and under which license?
scienthoon/jev-ood-calibration is released under the MIT license; you may view, modify and redistribute it subject to those terms.
What language is scienthoon/jev-ood-calibration written in?
The primary language of scienthoon/jev-ood-calibration is Python.
How popular is scienthoon/jev-ood-calibration?
As of 2026-11-02, scienthoon/jev-ood-calibration has 6 stars and 0 forks on GitHub.
What are alternatives to scienthoon/jev-ood-calibration?
Other projects in the "Research & reimplementation" category include: Mapika/decider, wfzyx/von, YannQi/R-4B, kshetrajna12/reflex, ikermoel/open-alternative-jev.
More in this category
Keep going on this site
Try, docs, cases, and pricing link to each other. The next page is on this site.
- Site directoryThe full list of the pages above.
- EcosystemCommunity projects by category.
- Jev coverageEach entry names the decision and its evidence.
- Daily casesThe next batch of coverage cases, each day.
- CommunityPublic posts, each with its source.
- BuildsNotes on model and site updates.
- PrimitivesChoice, Noul, and Score together.
- PatternsRouting, fan-out, and composite scoring.
- SDKsHTTP, Python, and JavaScript.
Use clavue-jev
- Try a judgmentSend a state and read the answer.
- Live scenesTetris, six rapid judgments, and a sort. Copy the call and run it again.
- Judgment LabSupport triage, release review, compliance routing — edit and run on the spot.
- Compareclavue-jev and jev-1.13.0 answer the same question.
- DemosJudgment examples you can edit.
- PricingInput is $0.042 per million tokens. Output is free.
- APICall POST /v1/judge with a key.
Docs
- IntroductionWhat this model is for.
- Quick startThe smallest call that runs.
- System OneWritten here: a state plus one typed question. The model is clavue-jev.
- StateThe text you send in.
- ConfidenceHow sure the answer is, and when to act on it.
- ChoicePick one mutually exclusive option.
- NoulA yes/no question, returned as the probability of yes.
- ScoreRate along a scale.
- Intent routingOne Choice call dispatches the request.
- Confidence routingAct when confidence is high. Hand off when it is low.
- Fan-outAsk several questions of one state.
- Composite scoringFold several scores into one ranking.
- HTTP APIThe request shape without an SDK.
- Python SDKCall a judgment from Python.
- JavaScript SDKCall a judgment from JavaScript.
Cases
- Use-case mapWhich primitive people use for which job.
- GuardrailsA yes/no check before an action runs.
- Function callingPick which function to call.
- Classify with confidenceDo not act when the class is unsure.
- Semantic findFind the passages that match.
- Parallel questionsAsk the whole set in one call.
- Hierarchical classificationCoarse class first, then the fine one.
- Citation checkWhether a sentence is supported by the source.
- Entity alignmentWhether two names are the same thing.
- Skill suggestionChoose which skill fits the moment.