HaluEval · public · hallucination
0.9213
Best artifact AUROC0.9180
Final summary (step 3000)0.9213
G-1 is a non-invasive runtime that wraps your model with vLLM and lifts it to the safety bar of frontier closed models. Constitutional Intelligence aligned to European values. A compliance platform that auto-generates auditable documents for the EU AI Act, California SB 942, and 11 other AI frameworks. Days, not quarters, to production.
Three risks block every regulated AI rollout — and none of them are solved by training another model.
Mid-sized open models confidently fabricate citations, statistics, and clinical advice. In agentic pipelines a single hallucination cascades into irreversible action — and you have no idea which token caused it.
An open 8B model is not a frontier closed model. The frontier safety stack — refusals, jailbreak resilience, prompt-injection containment — is not in the weights. It has to be added at the runtime layer.
Article 27 FRIA. Article 12 audit logging. Article 50 disclosure. Article 14 human oversight. Fines up to 3% of global turnover. Generic LLM observability tools do not produce the documents a regulator asks for.
G-1 mounts on top of your existing open LLM — including fine-tuned checkpoints — via vLLM. Every prompt is intercepted before generation. Every response is scored before delivery. Every inference is signed, logged, and made auditable.
In a standard LLM deployment, a hallucinated response reaches one user. In an agentic AI system — where models orchestrate tools, databases, and other models — that same error becomes the next agent's trusted input.
By the time the error reaches a real-world action — a clinical recommendation, a financial execution, a legal document — it has been re-confirmed multiple times and is irreversible.
Geodesia G-1 mounted on Gemma 4 E2B — a model two orders of magnitude smaller than the closed frontier — matches and beats most frontier models on truthfulness and safety. Tested on HaluEval for hallucination resistance and on our adversarial-safety test set (validation in progress).
Numbers from the most recent training run on Gemma 4 E2B (~2B parameters). HaluEval is the public reference suite for hallucination; Phase 2b is our internal safety evaluation.
| Capability | Geodesia G-1 | Cloud AI API | Raw Open LLM | In-House Build |
|---|---|---|---|---|
| Frontier-grade safety on open models | ✓ | ✓ | ✗ | ~ |
| Data stays on-premise | ✓ | ✗ | ✓ | ✓ |
| Real-time hallucination scoring | ✓ | ✗ | ✗ | ~ |
| European Constitutional AI | ✓ | ✗ | ✗ | ✗ |
| Auto-generated EU AI Act reports | ✓ | ✗ | ✗ | ~ |
| Air-gap capable | ✓ | ✗ | ✓ | ✓ |
| Cryptographic audit chain | ✓ | ✗ | ✗ | ~ |
| Agentic pipeline forensics | ✓ | ~ | ✗ | ~ |
| Time to production | Days | Immediate | Weeks | 12–24 months |