Skip to main content

Test results

Test results answers one question at a glance: do the tests pass? It shows the totals of every suite, the history of the runs and, case by case, what the last run found.

Access: Liberty Next → Operate → Test results, for the holders of tests:view. The tests themselves are written and played in Logic → Tests.


At a glance​

Test resultsCASES14PASSED11FAILED1CHANGED1NOT RUN1LAST RUN2 h agoOrders — nightly checksorders · erp_api · 2 h ago · admin · 14 sOpen in TestsCASELAST RESULTSLAST RUNDURATIONWHAT THE LAST RUN FOUND●The order list has its columns2 h ago0.8 s●An order is created then cancelled2 h ago3.1 sTOTAL: 120.00 → 118.50●The price is computed2 h ago1.2 sfirst row: PRICE ≠ 42.00●An unknown id is refusednever—The totalsevery suite togetherOne line per caseit opens in TestsRuns as barsthe latest on the rightOpen in Teststhe suite, edited thereWhat was foundfailed check or difference

The totals​

Six tiles: Cases, Passed, Failed, Changed, Not run — never played, or skipped on the last run — and Last run.

The Overview page repeats them as a pill — Tests: N passed · N failed · N changed —, red when a case failed, orange when one changed, green otherwise.


A suite​

Each suite has its block: its label, its name and its connector, then when · who · how long for the last run.

  • The bars — one per run, the latest on the right, up to twenty: green for the cases passed, red for failed, orange for changed, grey for skipped.
  • The cases — one line each:
ColumnContent
CaseWhat the case checks.
Last resultsA strip of coloured squares, one per run.
Last runWhen it last ran — never for a case not played yet.
DurationThe time the last run took.
What the last run foundThe check that failed, or what differs from the reference.

Open in Tests opens the suite in the Tests page; a line opens its case there.


Reading a result​

ResultWhat to do
FailedOpen the case: the step in red says which check does not hold.
ChangedRead the difference. A wanted change: record the reference again. An unwanted one: a regression.
Not runA case that writes is skipped unless the run allows it; a case without step is skipped too.