| Case | Title | Verdict | Duration | Env | When |
|---|---|---|---|---|---|
| known |
-
No drafts. Run an Explore and use "Generate drafts" on its report.
-
| Section | Total | Done | |
|---|---|---|---|
| All sections |
| Engine | Cases | Ready 1st pass | Ready after repair | Automation blocked | Needs attention | Errors | Mean tokens in / out | Mean billed | Mean s | Project tokens in / out | Project billed | Hours |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Started | Source | By | Status | Cases | Created | Skipped | Errors | LLM mode |
|---|---|---|---|---|---|---|---|---|
| No imports recorded yet. | ||||||||
| Time | What | By | Detail |
|---|---|---|---|
| Nothing recorded for this case. | |||
- —
| Row | Sentence | What the run did | Evidence | Status |
|---|---|---|---|---|
| Case | Title | Verdict | Audited | Duration | Model | Owner | Env | When |
|---|---|---|---|---|---|---|---|---|
| known | — |
| Name | Started | Model | Total | Pass | Fail | Error | Inconclusive | Blocked | Duration | Env | Build | Owner |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
- As converted
-
- As converted
- As converted, matching no TestRail entry
own (C89762 / C90247, after a Create — the copy merely has to exist), inherited (C90249, after a Delete — there must be NO copy and both callers must read one row) and differs (C12398 — the copy exists and is NOT the super domain's; the verdict names one differing field on both sides). mailbox (C89805 / C89806, Email server) — the copy is the stand's test mailbox account from Settings → Stand services (host, port, SSL, login, password, sender) and differs from the super domain's row; a stand without a mailbox is inconclusive. A changed read is also held against the super domain's row as the pre-flight found it.
writable flag the portal greys the control on. A parameter neither caller has is a fail.
| Verdict | When | Took | Env | Owner |
|---|---|---|---|---|
| Portal | Total | |
|---|---|---|
| Gap | Source | Cases | Only gap | Sample |
|---|---|---|---|---|
| Case | Title | Mark | Reason | Note | By | When |
|---|---|---|---|---|---|---|
Each row = a navigation self-heal that repeated during runs: the converted test asked for one control, the real UI needed another. Accept stores the fix permanently (portal-scoped, applied at script generation — the test YAML is untouched). Dismiss hides the proposal forever.
| Portal | Converted step → what actually worked | Seen | Cases | |
|---|---|---|---|---|
| No pending navigation proposals — every learned fix is either promoted, dismissed, or no heals have repeated yet. | ||||
→
conflicting
not promotable
|
||||
Each row = the same test failed repeatedly with the same diagnosed durable cause (backend / TestRail / converter bug). Accept adds it to the known-issues registry so future diagnoses classify it instantly. Dismiss hides this signature.
| Case | Bucket | Signature / note | Seen | |
|---|---|---|---|---|
| No recurring-failure candidates right now. | ||||
|
||||
Every runtime navigation heal, grouped. Read-only — proposals above are derived from this.
| Case | Step | Target → healed action | Count |
|---|---|---|---|
| Journal is empty — no navigation heals recorded yet. | |||
→
|
|||
Central environment profiles (an env = a named settings blob). Pick a profile per run via the Env dropdown in the Tests tab; the worker is materialized with that env's settings for the run. Select a profile below, edit the fields, then press Save to store it back centrally on the gateway.
Make sure that environment is set to work with "ISP"="1"
precondition reaches the env as two knobs: the interface setting
IspEnable and the ACS setting ispMode —
Multi-Domain = 1, Multi-ISP = 2.
Set writes them before the test and restores them after, which is what a
shared stand needs. Verify only writes nothing and instead checks the env
already carries the mode the test asks for; a test written for the other mode is
reported blocked and never started, so running one half of the wave
on its own env does not turn the other half red.
Pick the group to run with GET /api/tests?isp=1 / ?isp=2
(?isp=none = the cases that work under either).
This is a property of the STAND — set it in the env profile, not per run.
emulatorUrl on every call
and queried directly for parameters, so an edit here is live from the next run: no sidecar restart.
IspEnable from settings.xml, ispMode from
acs_configuration.xml and so on). Preconditions write values here; empty =
the stand has no such service, so the legacy management/ACS REST path is used.
ftp://, http://,
https://) and end with /; uploads need a WebDAV-enabled HTTP server.
mail_delivery_verify looks for the mail the platform sent (C89816 / C89817); it
only reads — nothing is marked, moved or deleted. Leave the login blank when this stand has
no mailbox: the cases that need one then end as blocked, not failed.
0.5); capped at 60 s. Note it also stretches the whole run:
1 s across a 40-step case adds about 40 seconds.
DOMAIN_CANNOT_BE_DELETED…).
Devices under foreign domains ARE DELETED; super-domain devices
(our test-runner-*) are never touched.
On a shared stand, enable this only together with the skip list below.
| Username | Role | Created by | Status | Actions |
|---|---|---|---|---|
| No users found. | ||||
| disabled active | ||||
| Name | Env (pinned) | Display | Base URL | noVNC URL | Status | Busy | Actions |
|---|---|---|---|---|---|---|---|
| No workers configured. | |||||||
Show addressDirect address of the worker browser. It skips the gateway ticket check. To watch a run, use Live browser on the Runner tab.
|
disabled enabled | idle |
|
||||
| Time | Username | Action | Target | Detail | Source | Status |
|---|---|---|---|---|---|---|
| No activity entries. | ||||||
"How to test X on portal Y" documents written by the librarian as drafts. Only approved procedures are served to test execution. Review a draft, then Approve (publish) or Reject (roll back to the last approved version). Editing is not done here — corrections come via a new librarian draft or the REST API.
| Name | Portal | Status | Version | Updated | |
|---|---|---|---|---|---|
| No procedures. | |||||