Internal documents
Use your own knowledge.
Link answers to their sources.
Software development · Backend · Frontend · Browser
A question in natural language
Generate SQL from the schema
Check, execute, show results
“Show the highest air temperature for each shift manager.”
Model proposal
Statement policy
Jev
Read-only database
Is the query read-only and allowed?
Does it answer the question?
All and only the expected columns?
const questions = {
safety: createSafetyCheck(),
intent: createIntentCheck(),
columns: createColumnCheck(),
};Check the air temperature in Packaging hall.
Done! Alarm raised.
Raised an alarm for Packaging hall and notified the operator.
query_historian→raise_alarmonly a spinner
never asked what to do
no approval before raising the alarm
an action with no oversight
The human decision is missing.
query_historian
The UI needs progress, human input and results—not just the model response.
PredictThree agent backends, two UIs, and you add approval. How many pieces of work?
AG-UI defines the interaction protocol.
Change the view through chat
“Go back to the snapshot view.”
See the workflow advance
Approve before raising an alarm
Packaging hall · Air temperature
| Technology | Model management | Execution |
|---|---|---|
| Prompt APIBrowser-provided model | Browser downloads and manages itChrome: Gemini Nano | Browser-managedCPU or GPU in Chrome |
| WebLLMLLM runtime | Your app selects a compatible model | WebGPUGPU |
| ONNX Runtime WebUsed by Transformers.js | Your app selects a compatible model | WebAssembly or WebGPUCPU or GPU |
Our demo: Transformers.js → ONNX Runtime Web · E5 + Gemma
Compatible model
Transformers.js
On-device inference · WebGPU
Use your own knowledge.
Link answers to their sources.
Retrieve relevant passages
when the user asks.
Find relevant text even when
the wording differs.
Both models: Transformers.js → ONNX Runtime WebE5: WASM / CPU · Gemma: WebGPU / GPU
We would love your feedback.
soverius.ai/feedback/7654629aDemo code · Units 2, 3 & 4
github.com/Soverius-AI/