credence
5 TagsUpdated Apache-2.0by Txoka
Txoka's Credence v1: MiCA refinements of EldanRing's Winnow-E4B (Gemma 4), run from the author's Q8_0 GGUFs on llama.cpp. Two checkpoints trade public accuracy against calibration, each with a vision tag that adds Winnow-E4B's unchanged projector; neither beats original Winnow on every metric.
ollaya run credence --preset triage "I was charged twice for my subscription this month and want a refund."curl http://localhost:11435/api/decide \
-H "Content-Type: application/json" \
-d '{
"model": "credence",
"state": "I was charged twice for my subscription this month and want a refund.",
"questions": {
"department": {
"type": "choice",
"instructions": "Which team should handle this?",
"criteria": {
"billing": "Payments, invoices and refunds",
"technical": "Bugs, errors and outages",
"account": "Login, profile and settings"
}
},
"refund": {
"type": "noul",
"instructions": "Is the customer asking for a refund?"
}
}
}'# Already using a TypeSafe SDK? Set TYPESAFE_BASE_URL=http://localhost:11435 instead.
import requests
response = requests.post(
"http://localhost:11435/api/decide",
json={
"model": "credence",
"state": "I was charged twice for my subscription this month and want a refund.",
"questions": {
"department": {
"type": "choice",
"instructions": "Which team should handle this?",
"criteria": {
"billing": "Payments, invoices and refunds",
"technical": "Bugs, errors and outages",
"account": "Login, profile and settings"
}
},
"refund": {
"type": "noul",
"instructions": "Is the customer asking for a refund?"
}
}
},
)
answers = response.json()["answers"]
print(answers["department"]["choice"], answers["refund"]["noul"])const response = await fetch("http://localhost:11435/api/decide", {
method: "POST",
headers: { "Content-Type": "application/json" },
body: JSON.stringify({
model: "credence",
state: "I was charged twice for my subscription this month and want a refund.",
questions: {
department: {
type: "choice",
instructions: "Which team should handle this?",
criteria: {
billing: "Payments, invoices and refunds",
technical: "Bugs, errors and outages",
account: "Login, profile and settings"
}
},
refund: {
type: "noul",
instructions: "Is the customer asking for a refund?"
}
}
}),
});
const { answers } = await response.json();
console.log(answers.department.choice, answers.refund.noul);Models
Every tag| Name | Accuracy | Latency | |||
|---|---|---|---|---|---|
| Most accurateHighest typed-decisions accuracy of the family. | |||||
| credencelatestSame as credence:e4b. | 0.725 | 121 ms | |||
| FasterFastest first; accuracy as measured on the bench. | |||||
| credence:e4b-calibratedSeparate zero-synthetic checkpoint with a validation-fitted temperature: stronger public calibration, 72.20 % on typed decisions. | 0.724 | 114 ms | |||
| credence:e4bAccuracy-focused Q8_0 checkpoint, external temperature 1: 72.35 % on typed decisions. | 0.725 | 121 ms | |||
| credence:e4b-calibrated-visionCredence v1 Gemma4 E4B validation-calibrated, Q8_0 with Winnow-E4B's unchanged vision projector: PNG image decisions through libmtmd. | — | — | |||
| credence:e4b-visionCredence v1 Gemma4 E4B accuracy-focused, Q8_0 with Winnow-E4B's unchanged vision projector: PNG image decisions through libmtmd. | — | — | |||
Accuracy: typed-decisions, argmax against the majority label on 400 states (left out for a tag trained on that data). Latency: the median five-question request on an RTX 5090, Ollaya Bench.
Readme
Needs Ollaya 0.7.0 or newer for the text tags and 0.10.0 or newer for the vision tags (
ollaya --version).
Credence v1 by Txoka refines EldanRing's Winnow-E4B using MiCA. Both variants run their Q8_0 GGUF files through Ollaya's existing Winnow prompt and llama.cpp engine.
| Tag | Public accuracy | Public ECE ↓ | Typed accuracy | Typed ECE ↓ |
|---|---|---|---|---|
Original winnow:e4b | 73.46% | 7.09% | 72.30% | 2.51% |
credence:e4b | 74.12% | 5.48% | 72.35% | 4.83% |
credence:e4b-calibrated | 73.72% | 3.74% | 72.20% | 4.63% |
Local measurements through Ollaya: 13 public subsets/3,880 rows and 400 typed
states/2,000 questions. Public ECE is pooled ten-bin ECE. These are single-run
results, not significance claims. Neither variant improves every metric over
original Winnow. Full probability metrics and per-subset results are retained in
the repository's docs/measurements/credence/ directory. Over HTTP on an RTX 5090 it
answers five questions in 121 ms (winnow:e4b: 113 ms).
ollaya run credence:e4b --preset triage "My order never arrived. Please refund it."
ollaya run credence:e4b-calibrated --preset triage "My order never arrived. Please refund it."The accuracy tag was trained with 5% procedural synthetic questions; the calibrated tag is a separate 0%-synthetic checkpoint. Both start from calibrated Winnow. Their readout scaling is folded into the weights and softcap. The first uses external temperature 1; the second uses validation-fitted 1.0408574437121012. No temperature was fitted on benchmark data.
Weights are 8.72 GB each, downloaded from a commit-pinned public Hugging Face repository and verified by SHA256. Text tags support up to 64 candidate options with the existing Winnow context limits. Separate vision tags add the projector described below. Apache-2.0; preserve Winnow/Gemma4 notices and individual training-data attribution.
Both published files passed clean, unauthenticated downloads and SHA256 verification. Both packages match stock llama-server of the pinned build on the CPU, an RTX 4070 and an RTX 4090: 505/505 decisions each. Exact evidence and reproduction instructions are in the family documentation.
Vision variants
credence:e4b-vision and credence:e4b-calibrated-vision are the same checkpoints with Winnow-E4B's unchanged
projector (990 MB), pulled from EldanRing's repository, so a store that already has winnow:e4b-vision keeps one
copy. Winnow kept its vision weights frozen and Credence trained on text only. Both tags match stock llama-server
on images, on the CPU and on an RTX 4090: 65/65 decisions each; no visual accuracy or image calibration is claimed.
ollaya run credence:e4b-vision --image shelf.png --questions '{"blocked":{"type":"noul","instructions":"Is the aisle blocked?"}}' "A photo from the warehouse camera."Badge
For the model card or a README. Day-0 support for a new model
[](https://ollaya.dev/library/credence)