anofox-decide
Browser: precomputed results
Native: community extension and full toolkit
anofox-decide — decisions from text with a language model: probabilities, choices and scores per row, with calibration and quality metrics.
INSTALL anofox_decide FROM community;LOAD anofox_decide; LOAD anofox_visualization;Plot its results
Section titled “Plot its results”Its answers are per-row probabilities and choices; the metrics and curves made from them are contract tables:
-- runs: one row per text and model, with the model's probability and the true labelSELECT anofox_plot_summary(t) FROM decide_metrics_by('runs', model_id, p_refund, refund) t;SELECT anofox_plot_curve(t) FROM decide_roc_curve_by('runs', model_id, p_refund, refund) t;| Output | Plotted by |
|---|---|
decide_metrics_by (Brier, ECE, accuracy, …) |
anofox_plot_summary |
decide_roc_curve_by, decide_calibration_curve_by |
anofox_plot_curve |
probabilities through roc_curve_by / calibration_curve_by (anofox-statistics) |
anofox_plot_curve |
decide_choice_distribution |
anofox_plot_distribution |
anofox_plot(t) picks the macro from the table’s columns. The macros are aggregates: GROUP BY gives one SVG per group.
In the builder
Section titled “In the builder”Checked in CI
Section titled “Checked in CI”Every producer of the extension’s latest build is plotted on every push (scripts/decide_conformance.py): a SQL error, a missing SVG or a producer without a recipe fails the run. Reference →