Repository navigation
Move the panel rule and the Baseline condition into the harness - #49
Merged
Merged
Conversation
The panel (the top-K models by Epoch's Capabilities Index we can run, one seat per model family) and the Baseline condition (no system prompt, search offered and never required, top reasoning level) are now shared by more than one dashboard, so they live beside the ECI reader in packages/fri-forecaster: - fri_forecaster/panel.py: the table of runnable models, the selection rule, the reasoning levels, and a CLI (python -m fri_forecaster.panel). - fri_forecaster/baseline.py: the Baseline loop's settings and a run() helper. AIRO reads both from there. redlines/registry.py keeps what is AIRO's own (colors, chart roles, ForecastBench names) joined onto the shared rows; redlines/llm.py, redlines/pi_loop.py and code/run_unified.py import the shared constants. Nothing AIRO asks or publishes changes: registry.MODELS, the panel for every snapshot and the baseline prompt are identical to before, and tests/test_shared_panel.py pins that AIRO and the harness agree. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
The panel rule and the Baseline condition move into the harness (
packages/fri-forecaster), beside the ECI reader, because a second dashboard (EEAI, next PR) uses the same panel and the same condition.fri_forecaster/panel.py: the table of runnable models, the selection rule (top K by Epoch's Capabilities Index, one seat per model family), the reasoning levels, and a CLI (python -m fri_forecaster.panel).fri_forecaster/baseline.py: the Baseline loop's settings (no system prompt, search offered and never required, top reasoning level) and arun()helper.redlines/registry.pykeeps what is AIRO's own (colors, chart roles, ForecastBench names) joined onto the shared rows;redlines/llm.py,redlines/pi_loop.pyandcode/run_unified.pyimport the shared constants.What does not change
Nothing AIRO asks or publishes. Checked before and after the change:
registry.MODELSis identical, and so are the panel and its provenance for every Epoch snapshot indata/.--dry-runprompt is byte-identical, and its research tools equalbaseline.research_tools().python3 -m redlines build && python3 -m redlines assembleleaves the trackedindex.htmland results unchanged.One log line changes wording: the warning for a top model with no registry row now names
fri_forecaster/panel.py. It keeps the phrasescode/refresh_panel.shgreps for.Tests
tests/test_shared_panel.pypins that AIRO's rows and minimal instrument agree with the harness;packages/fri-forecaster/tests/test_panel.pycovers the rule, automatic rows and the Baseline loop. Full suite locally, with the EEAI PR on top: 524 passed, 16 skipped.Deploying
This touches AIRO's run path, so deploy it deliberately (
airo deploy), not as a side effect of something else. No data migration is needed.🤖 Generated with Claude Code