Simulation run on this device. Scenario values are not sent anywhere — the engine is fully local.
prompting studio · pro
Model Migration Regression Dashboard
Compare before/after runs across categories and gate the migration.
What broke when you moved providers?
Engine 1.0.0 · studio
- Cases
- 3
- Regressions
- 0
- Format changes
- 1
- Verbosity / knowledge
- 0 / 2
- Migration
- go
| # | Class | Similarity | Old | New |
|---|---|---|---|---|
| 1 | knowledge / wording | 0.67 | The refund window is 30 days. | The refund window is 30 days, subject to |
| 2 | formatting | 0.25 | {"verdict":"ok"} | Here is the result: verdict is ok |
| 3 | knowledge / wording | 0.67 | Paris is the capital of France. | Paris is the capital of France, which is |
- clearNo content regressions detected
Formatting differences only — still verify the JSON consumers.
Separate formatting drift from capability and knowledge changes; only the last two block a migration.
Method
- Aligns old/new outputs case by case, classifies each diff as formatting, capability, knowledge, or regression, and issues a go/hold read.
- Only content regressions and format breaks block a migration; wording drift is expected.