Understanding test results

Review diffs, interpret pass/fail status, and triage pricing, configurator, or approval regressions.

▶

Video coming soonReading regression test results

How to interpret diffs and triage pricing drift.

Run detail page

Open a run from Test Runs (/runs/[id]) to see the full results. The detail page shows:

• Overall status: pass (no drift) or fail (differences found)
• Category-specific diffs: pricing fields, configurator messages/steps, or approval chain changes
• Before/after values: snapshot baseline vs live data

Screenshot coming soontest-runs-diff-viewTest run diff view showing field-level changes

Differences are highlighted with the snapshot value and the current live value.

Approval reports

Approval runs render an approval-specific report with:

• Chain and step match counts
• High-risk routing diffs (missing steps, assignee changes, dependency changes)
• Evidence for the quote, flow API name, and preview context

See Approval testing for how to read those diffs.

Configurator reports

Configurator scenario runs show a Scenario Proof Timeline with attempt, assertion, correction, and save phases, plus collected configurator messages.

A multi-rule configurator snapshot run opens as a single run entry with each rule as a collapsible section: expand a rule to see its own full report.

See Configurator testing for how to read those results.

Live streaming

While a run is in progress, Revsnap streams status updates in real time. You can watch the run complete without refreshing the page.

Screenshot coming soontest-runs-live-streamLive run progress streaming on the test run detail page

Live streaming shows run progress as Revsnap fetches and compares data.

Interpreting results

Status	Meaning
Pass	Live data matches the snapshot, no pricing, configuration, or approval drift detected
Fail	One or more baseline values differ from live Salesforce data

A failing run is not necessarily a bug. It may reflect an intentional pricing, rule, or approval-routing change. Use the diff view to decide whether the change is expected.

Regressions queue

Failed runs appear in the Regressions queue on your dashboard. This gives you a single place to triage unexpected drift across all snapshots.

Exporting results

Depending on your plan, you may be able to export run results for sharing with your team or attaching to release notes.