* feat: add FreeBuff agent support for REA setup Register FreeBuff as a supported setup client using the shared user agents directory (~/.agents/mcp.json with mcpServers, skills in ~/.agents/skills), which matches what FreeBuff Desktop loads. Adds the client definition, boundary tests, supported-agent docs, and the skill reference client list. * fix(freebuff): detect FreeBuff from its profile directory, not shared .agents The ~/.agents marker made FreeBuff appear installed for any home where REA had installed shared skills (the default skill destination, also Gemini CLI's), producing false doctor failures. Detect FreeBuff from its own fixed profile directory ~/.config/freebuff-desktop instead, and add a regression test covering a home with only the shared agents skill directory. * fix(setup): require product evidence for FreeBuff discovery Address review findings at their producing boundaries and preserve directly affected consumers. Source inspection and git diff --check completed. Tests and automated checks were not run at the user’s explicit request. * fix(uninstall): retain unverified shared client configuration * fix(clients): preserve scoped removal evidence * fix(doctor): omit undefined selectedClientIds under exactOptionalPropertyTypes Passing selectedClientIds explicitly as undefined fails typecheck on this branch (TS2379), which blocks the focused test workflow before any test can run. Spread the option only when defined. * fix(update): separate ownership evidence from product applicability rea update's maintenance scope inspected only product applicability evidence, so when a FreeBuff profile was absent but REA already owned a version-pinned row in the shared ~/.agents/mcp.json, the plan omitted freebuff and left the integration stale. FreeBuff now declares its registration storage as shared, which proves ownership of an owned row but never product applicability, and maintenance requests ownership evidence through that declaration instead of reinterpreting the shared paths. Doctor and setup keep readiness evidence, foreign rows stay out of maintenance, and the Doctor exactOptionalPropertyTypes fix makes the focused test workflow runnable. * test(dotnet): split oversized operand extent diagnostics describe The describe callback reached 162 lines (max 150), failing max-lines-per-function and blocking the pre-push check for this branch. Move the single-case extent scenarios into their own describe; no test content or order changes. * fix(update): preserve ZCode's disabled shared registration during maintenance The shared user agents file doubles as ZCode's fallback, where `enable: false` disables the registration. Ownership-based maintenance read that row as a FreeBuff registration, whose format does not recognize the flag, so the row was selected and the emitted setup command rewrote it, dropping the flag and silently re-enabling a registration the user had disabled. registrationActivation now honors `enable: false` for any client whose registration storage is shared, because the activation fact binds every reader of that storage. Maintenance leaves such rows out; doctor reports them as stale, matching ZCode's own treatment. * fix(doctor): let explicit client selection authorize the config read When an ACL or an inaccessible shared parent made every access probe fail, a client selected by name was omitted before the configuration read could return its unreadable-config detail, so doctor reported it as not detected with installation remediation: an unresolved selected path collapsed to absence. An explicit selection now authorizes the read outright and the probes serve automatic discovery only. A selected client with an unreadable config reports invalid with the read failure; one with no config reports missing; automatic discovery still probes before inspecting. * fix(uninstall): share shared-storage checks between ZCode and FreeBuff clients() queued ~/.agents/mcp.json twice: once as zcode_fallback and once as freebuff. ZCode has no discoveryPaths, so its strict read still blocked uninstall on malformed shared text, despite FreeBuff's new retain-and-continue behavior. For a valid owned entry, ZCode removed it first, so FreeBuff reported skipped rather than removed. Make the shared file's checks and removal one shared decision: - Add zcodeDiscoveryPaths to ZCode so it has its own applicability evidence. - Gate zcode_fallback push on applicable, not just zcodeFallbackPath presence. - Report shared storage ownership as one decision for both clients: FreeBuff and ZCode now use clientOwnershipEvidencePaths together, so a recognizable REA-owned row proves ownership once for the shared storage, and both clients report the same result consistently. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix(uninstall): merge duplicated host and prove shared ownership from owned rows Uninstall.ts declared systemUninstallHost twice, preventing module load, with the exported copy returning only clients and the second copy missing clientWriteBlocker. Merge into one exported host carrying both blockers. hasOwnershipEvidence used access() existence, so an unrelated malformed ~/.agents/mcp.json established ownership and blocked every removal. Ownership now requires a readable, recognizable REA-owned row via the injected filesystem, so unrelated shared data stays retained. Also cover ZCode discoveryPaths in its path test. * fix(uninstall): keep denied product-local configurations fail-closed Unproven product applicability marked every configuration path of that client unverified, so a denied ZCode profile turned an unreadable product-local config into a retained item: uninstall continued and could report complete with REA still registered. The retain-and-continue exception now applies only to storage REA does not own, classified once by clientSharedRegistrationPaths (shared configuration plus another product's same-scope fallback). Covers the Greptile P1 on Uninstall.ts. Validation: the new test fails on the pre-fix Uninstall and passes after it; freebuff/zcode/updateMaintenance/bom/dsh suites green; clientLifecycle, clientRegistrationStatus and claudeDesktop keep the same 8 host failures as the pre-merge baseline (symlink EPERM, stale-vs-aligned on Windows). * fix(update): retain FreeBuff when ZCode reads the shared fallback Maintenance deduplicated clients on the path each inspection read, so ZCode's fallback view of ~/.agents/mcp.json marked that file "covered" and dropped FreeBuff from the scope. ZCode setup writes ~/.zcode/cli/config.json and deliberately leaves the fallback untouched (docs/client-configuration.md), so the emitted command refreshed only ZCode while the shared row both products load stayed pinned to the old package version. Each setup action rewrites only its own configuration path and no other action rewrites the shared row, so every selected client keeps its own maintenance action; the read-path covered/deduped filter is removed. Covers the Codex P2 on UpdateMaintenance.ts:104. Validation: the new regression fails one2fdec384with {clients:["zcode"]} and passes with {clients:["freebuff","zcode"]}; updateMaintenance 31/31, setupClientConfigCleanupOwnership, cliUpdateAlias, updateOutput, cliStartupImports green; tsc --noEmit, oxlint (0 errors) and oxfmt --check clean; clientRegistrationStatus keeps the same 4 symlink/stale-vs-aligned failures this Windows host has on basee2fdec384(verified by stashing the change). 🤖 Generated with Codebuff Co-Authored-By: Codebuff <noreply@codebuff.com> * fix(uninstall): preserve completed reads as shared ownership evidence hasOwnershipEvidence caught every read failure and kept scanning, so a handle-close failure after a successful read — a RegularFileCleanupFailure whose completed outcome still contains the exact shared-file text — was discarded as "no proof". FreeBuff's applicability-unverified storage therefore never got its ownership fact, and once the retained handle blocked later reads, readClientConfiguration downgraded them to retained: inspection passed, removals soft-failed, and runUninstall(true) could purge REA data while the active shared registration remained. The catch now parses the completed outcome for the ownership text while missing or unreadable storage and malformed data keep their proves-nothing semantics, so ownership holds and every later read failure stays blocking. Covers the Codex P2 on Uninstall.ts:252. Validation: the new regression fails on4dbfdf1a9(freebuff reports no blocking failure while the poisoned-scope error lands on claude_code) and passes after; setupClientConfigCleanupOwnership 25/25; the other 21 Uninstall-consumer suites are byte-identical to base4dbfdf1a9(61 pre-existing Windows-host failures: symlink EPERM, stale-vs-aligned); tsc --noEmit, oxlint (0 errors, same 6 warnings) and oxfmt --check clean. 🤖 Generated with Codebuff Co-Authored-By: Codebuff <noreply@codebuff.com> * fix(uninstall): keep owned-row proof through removal refusals hasOwnershipEvidence treated any clientRegistrationRemoval refusal as no ownership: an effective REA-owned rea member shadowed by an earlier foreign duplicate (shadowed_unowned_member), or an owned native row beside a foreign V1 fallback (foreign_legacy_fallback), discarded the already-parsed positive row fact. With FreeBuff unverified and close failures recurring on the preflight/removal rereads, those failures were then downgraded to retained, so runUninstall(true) removed the skill and purged REA data while the active owned row remained. The refusal now carries the owned rows that motivated it — the refusal only refuses the edit — and hasOwnershipEvidence evaluates that fact on both paths; preflight and removal keep refusing the unsafe edit exactly as before. Covers the Codex P2 on Uninstall.ts:269. Validation: the new regression fails on225cb214a(freebuff reports no blocking failure while the poisoned-scope error lands on claude_code) and passes after; setupClientConfigCleanupOwnership 26/26; the 21 Uninstall-consumer suites are byte-identical to the recorded225cb214abaseline (61 pre-existing Windows-host failures: symlink EPERM, stale-vs-aligned); tsc --noEmit, oxlint (0 errors, same 6 warnings) and oxfmt --check clean. 🤖 Generated with Codebuff Co-Authored-By: Codebuff <noreply@codebuff.com> * fix(uninstall): keep unresolved discovery probes from softening shared failures The discovery probe swallowed every stat failure, so a FreeBuff profile denied with EACCES/EIO was indistinguishable from an absent profile: shared storage was marked applicability-unverified and, when ~/.agents/mcp.json also remained unreadable, the ownership and removal reads softened to retained. runUninstall(true) then removed the skill and purged REA data while an installed FreeBuff could still hold an active registration — the regression even reports complete. Absence (ENOENT) is now the only state that leaves shared paths unverified; any other probe failure leaves applicability unresolved, and shared-config failures stay blocking. Covers the Codex P2 on Uninstall.ts:318. Validation: the new regression fails on7572a7082with status complete and purged data and passes after; freebuffClientConfiguration 13/13; the Uninstall-consumer batches are byte-identical to the recorded baselines (61 pre-existing Windows-host failures: symlink EPERM, stale-vs-aligned); tsc --noEmit, oxlint (0 errors, same warning rules) and oxfmt --check clean. 🤖 Generated with Codebuff Co-Authored-By: Codebuff <noreply@codebuff.com> * fix(uninstall): retain completed configuration reads as removal evidence A close failure after a completed read discarded the text that read produced, so an owned registration row the text proves softened to retained. The completed text now drives removal, keeping shared-config failures blocking when ownership evidence exists. Co-Authored-By: Anthropic <noreply@anthropic.com> * fix(uninstall): stop removal when a cleanup retry leaves a handle unreleased A completed reread whose handle the cleanup retry cannot release now fails blockingly instead of serving the text: with no owned row, the soft path let removeAll purge managed data before close() reported the incomplete cleanup. The completed text is served only after the retry releases the handle; an unreleased handle is REA's own failure, never applicability uncertainty, so it bypasses the retained softening. Co-Authored-By: Anthropic <noreply@anthropic.com> * fix(uninstall): keep the ZCode fallback when its profile probe is unresolved A denied or failed profile probe leaves ZCode's applicability unresolved, never absent, but the fallback branch dropped the shared row on applicability alone: with the native config and FreeBuff's profile both absent, an installed ZCode kept its uninspected registration while uninstall purged skill and data. Unresolved probes now keep the fallback in scope with the same fail-closed treatment as other unresolved shared paths; definitive absence still keeps ZCode out of another product's primary storage. Co-Authored-By: Anthropic <noreply@anthropic.com> * fix(setup): preserve a shared row's enable:false during FreeBuff repair The shared agents file doubles as ZCode's fallback, so its `enable: false` binds every reader: doctor now reports the disabled row as stale for FreeBuff, but following that remediation rebuilt the generic JSON entry without the flag and silently re-enabled a registration ZCode disabled. Repairs of shared storage now carry the activation fact forward, while a client's own native storage keeps its established single-reader repair contract; the denied-profile uninstall regression also pins the fallback's new fail-closed inspection beside the denied read. Co-Authored-By: Anthropic <noreply@anthropic.com> * test(uninstall): retarget the completed-reread regression to a released retry The concurrent-writer regression held the reread handle open forever, which the fail-closed path now serves: it duplicated the unreleased-handle regression while documenting the opposite contract. The fixture's close spy gains a failure limit so the cleanup retry releases the handle, and the test again proves the completed text drives removal of the concurrently added owned row, with purge verified against the cache layout purge actually removes. Co-Authored-By: Anthropic <noreply@anthropic.com> * fix(doctor): report a preserved shared disable as a manual conflict Preserving a shared row's enable:false left doctor recommending a setup run that registrationCurrent correctly treats as already current, so the scoped doctor returned needs_human forever. The shared-enable interpretation now has one owner, sharedEnableFlagBinds, used by both the activation rule and the remediation: a row disabled through the shared flag reports the manual conflict and states that rea setup will not change it, instead of an endlessly ineffective repair. Co-Authored-By: Anthropic <noreply@anthropic.com> * fix(doctor): keep a native ZCode disable on the setup repair path The manual-conflict remediation matched a native zcode row through sharedEnableFlagBinds, but setup drops enable:false on single-reader storage, so a native disabled registration was told setup would not change it. The remediation now reads setup's own writer rule, exported as setupPreservesDisabledActivation: shared storage and the zcode fallback view keep the manual-conflict message, while a native row keeps the working rea setup instruction. Regressions pin both remediations. 🤖 Generated with Codebuff Co-Authored-By: Codebuff <noreply@codebuff.com> * revert: drop the unrelated managed-CIL describe split The split does not belong to FreeBuff client support and only widens this PR's diff. 🤖 Generated with Codebuff Co-Authored-By: Codebuff <noreply@codebuff.com> * fix(uninstall): remove the shared agent registration once for both clients ZCode's ~/.agents/mcp.json fallback and FreeBuff's own configuration queued the same physical file twice, so ZCode removed the row and FreeBuff then reported it absent, losing the outcome for the client that owns the file. Resolve every configuration path to one owner -- the client whose configuration it is -- and project that single inspection and removal to each client that loads it. A fallback reader still contributes its discovery probe, so an installed or unresolved reader keeps the shared file fail-closed. Discovery also accepted a dangling ~/.config/freebuff-desktop link, which setup and doctor reject because they follow the target, so an unrelated malformed shared file blocked every other removal. Resolve the link before treating the profile as installation evidence, keeping lstat for removal safety. Also date the FreeBuff release wording against the published 6.7.0 package. * fix(uninstall): keep a row per client when two clients own one file OPENCODE_CONFIG can point OpenCode at FreeBuff's configuration file, where OpenCode writes `mcp.rea` and FreeBuff writes `mcpServers.rea`. Grouping by filename gave that path a single owner, so uninstall removed only OpenCode's row, reported that removal for FreeBuff, and could purge managed data with FreeBuff's registration still active. Share the decision only through a fallback view of another client's row: every client that declares the path as its own configuration keeps its own inspection and removal, and the fallback reader reports each of them. * fix(clients): preserve discovery and fallback registration identity Follow product discovery link targets without losing configuration entry presence or explicitly selected inspections. Associate fallback readers with the format owner's registration table and project outcomes by owner and path, so OpenCode removal cannot be reported as a ZCode fallback removal. All three new boundary regressions fail against the previous source and pass with the fixes. Validation: check:fast; 217 focused tests passed; the two changed test files were rerun with 50 passing tests. No installed FreeBuff client was launched. --------- Co-authored-by: morluto <76467478+morluto@users.noreply.github.com> Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> Co-authored-by: Kaoru0822 <208281322+kaoru0822-kitauji@users.noreply.github.com> Co-authored-by: Codebuff <noreply@codebuff.com>
1276 lines
41 KiB
TypeScript
1276 lines
41 KiB
TypeScript
import {
|
|
failBrowserScenarioOperation,
|
|
PlaywrightScenarioBrowserCleanupOwner,
|
|
} from "./PlaywrightScenarioBrowser.js";
|
|
import { AnalysisCleanupLease } from "../artifacts/AnalysisCleanupLease.js";
|
|
// Fake-backed composition coverage; real browser verification lives in
|
|
// `npm run verify:browser`.
|
|
import { describe, expect, it, vi } from "vitest";
|
|
|
|
import type { BrowserScenarioSessionPort } from "./BrowserScenarioSessionPort.js";
|
|
import { PlaywrightBrowserScenarioProvider } from "./PlaywrightBrowserScenarioProvider.js";
|
|
import { sanitizeBrowserUrl } from "../domain/browserObservation.js";
|
|
import {
|
|
browserScenarioSchema,
|
|
type BrowserScenario,
|
|
} from "../domain/browserScenario.js";
|
|
import type { BrowserScenarioAction } from "../domain/browserScenarioValues.js";
|
|
import {
|
|
browserStepArtifactsSchema,
|
|
type BrowserScenarioEvent,
|
|
type BrowserScenarioEventFamily,
|
|
type BrowserStepArtifacts,
|
|
} from "../domain/browserScenarioCaptureValues.js";
|
|
import { PLAYWRIGHT_RESPONSE_BODY_PROVENANCE_LIMITATION } from "../domain/browserNetworkEvidence.js";
|
|
import { projectAnalysisError } from "../domain/analysisErrorProjection.js";
|
|
import { compareBrowserScenarios } from "../domain/browserScenarioDiff.js";
|
|
import { compareBrowserScenariosInputSchema } from "../domain/browserScenarioDiffValues.js";
|
|
import {
|
|
AnalysisCancelledError,
|
|
AnalysisOutputError,
|
|
AnalysisTimeoutError,
|
|
} from "../domain/analysisErrorCore.js";
|
|
|
|
const scenario = (
|
|
options: {
|
|
readonly mode?: "launch" | "connect";
|
|
readonly captures?: readonly (
|
|
| "screenshot"
|
|
| "dom"
|
|
| "accessibility"
|
|
| "url"
|
|
| "history"
|
|
| "storage"
|
|
)[];
|
|
readonly events?: readonly (
|
|
| "console"
|
|
| "page-errors"
|
|
| "network"
|
|
| "websockets"
|
|
| "frames"
|
|
| "workers"
|
|
| "popups"
|
|
| "downloads"
|
|
)[];
|
|
readonly actions?: number;
|
|
} = {},
|
|
): BrowserScenario =>
|
|
browserScenarioSchema.parse({
|
|
browser:
|
|
options.mode === "connect"
|
|
? {
|
|
mode: "connect",
|
|
cdp_endpoint: "http://127.0.0.1:9222",
|
|
target_id: "page-1",
|
|
}
|
|
: {
|
|
mode: "launch",
|
|
executable_path: "/opt/chromium",
|
|
},
|
|
start_url: { url: "https://app.example.test/" },
|
|
actions: Array.from({ length: options.actions ?? 1 }, (_, index) => ({
|
|
step_id: `wait_${index}`,
|
|
action: "wait_for_timeout",
|
|
duration_ms: 1,
|
|
})),
|
|
storage: {},
|
|
secrets: [],
|
|
capture: {
|
|
after_each_step: options.captures ?? ["url"],
|
|
at_end: [],
|
|
events: options.events ?? [],
|
|
},
|
|
});
|
|
|
|
const connectedPlatformEmulationLimitation = expect.stringContaining(
|
|
"Detaching a CDP page session may clear caller-owned navigator.platform emulation",
|
|
);
|
|
|
|
type SnapshotKind = BrowserScenario["capture"]["after_each_step"][number];
|
|
|
|
interface FakeSessionFailures {
|
|
readonly incomplete?: boolean;
|
|
readonly action?: Error;
|
|
readonly capture?: { readonly call: number; readonly error: Error };
|
|
readonly close?: Error;
|
|
}
|
|
|
|
const artifactState = (
|
|
kind: SnapshotKind,
|
|
requested: ReadonlySet<SnapshotKind>,
|
|
incomplete: boolean,
|
|
) => {
|
|
if (!requested.has(kind)) return { state: "not_requested" as const };
|
|
if (kind === "url")
|
|
return {
|
|
state: "captured" as const,
|
|
value: sanitizeBrowserUrl("https://app.example.test/current"),
|
|
};
|
|
if (incomplete && kind === "screenshot")
|
|
return {
|
|
state: "truncated" as const,
|
|
observed: 2_048,
|
|
retained: 0,
|
|
reason: "fixture limit",
|
|
};
|
|
return { state: "missing" as const, reason: "fixture unavailable" };
|
|
};
|
|
|
|
class FakeSession implements BrowserScenarioSessionPort {
|
|
readonly product = "Fake Chromium";
|
|
readonly version = "1";
|
|
readonly initialUrl = "about:blank";
|
|
readonly processOwnership: "provider-owned" | "external";
|
|
cleanupLease = new AnalysisCleanupLease(async () => {
|
|
await this.close();
|
|
}, ["browser_transport"]);
|
|
closeCalls = 0;
|
|
performCalls = 0;
|
|
captureCalls = 0;
|
|
onPerform: (() => void) | undefined;
|
|
onClose: (() => void) | undefined;
|
|
eventGaps: readonly string[] = [];
|
|
storageGaps: readonly string[] = [];
|
|
eventItems: readonly BrowserScenarioEvent[] = [];
|
|
|
|
constructor(
|
|
readonly mode: "launch" | "connect",
|
|
private readonly failures: FakeSessionFailures = {},
|
|
) {
|
|
this.processOwnership = mode === "launch" ? "provider-owned" : "external";
|
|
}
|
|
|
|
currentUrl() {
|
|
return "https://app.example.test/current";
|
|
}
|
|
|
|
sanitizeUrl(value: string) {
|
|
return sanitizeBrowserUrl(value);
|
|
}
|
|
|
|
setStep(_index: number) {}
|
|
|
|
nextEventSequence() {
|
|
return 1;
|
|
}
|
|
|
|
lastEventSequence() {
|
|
return 0;
|
|
}
|
|
|
|
events(): ReturnType<BrowserScenarioSessionPort["events"]> {
|
|
return {
|
|
retained: this.eventItems.length,
|
|
dropped: 0,
|
|
items: this.eventItems,
|
|
omissions: {
|
|
by_kind: [],
|
|
network_transactions: [],
|
|
network_transaction_range: null,
|
|
},
|
|
};
|
|
}
|
|
|
|
eventLimitations(): readonly string[] {
|
|
return this.eventGaps;
|
|
}
|
|
|
|
storageLimitations(): readonly string[] {
|
|
return this.storageGaps;
|
|
}
|
|
|
|
async perform(_action: BrowserScenarioAction, signal?: AbortSignal) {
|
|
this.performCalls += 1;
|
|
this.onPerform?.();
|
|
if (signal?.aborted === true) throw new Error("request cancelled");
|
|
if (this.failures.action !== undefined) throw this.failures.action;
|
|
}
|
|
|
|
capture(
|
|
requested: ReadonlySet<SnapshotKind>,
|
|
_signal?: AbortSignal,
|
|
): Promise<BrowserStepArtifacts> {
|
|
this.captureCalls += 1;
|
|
if (this.failures.capture?.call === this.captureCalls)
|
|
return Promise.reject(this.failures.capture.error);
|
|
return Promise.resolve(
|
|
browserStepArtifactsSchema.parse({
|
|
screenshot: artifactState(
|
|
"screenshot",
|
|
requested,
|
|
this.failures.incomplete === true,
|
|
),
|
|
dom: artifactState("dom", requested, this.failures.incomplete === true),
|
|
accessibility: artifactState(
|
|
"accessibility",
|
|
requested,
|
|
this.failures.incomplete === true,
|
|
),
|
|
url: artifactState("url", requested, this.failures.incomplete === true),
|
|
history: artifactState(
|
|
"history",
|
|
requested,
|
|
this.failures.incomplete === true,
|
|
),
|
|
storage: artifactState(
|
|
"storage",
|
|
requested,
|
|
this.failures.incomplete === true,
|
|
),
|
|
}),
|
|
);
|
|
}
|
|
|
|
close() {
|
|
this.closeCalls += 1;
|
|
this.onClose?.();
|
|
if (this.failures.close !== undefined)
|
|
return Promise.reject(this.failures.close);
|
|
return Promise.resolve(
|
|
this.mode === "launch"
|
|
? ("terminated-owned-process" as const)
|
|
: ("disconnected-external" as const),
|
|
);
|
|
}
|
|
|
|
redactError(error: unknown) {
|
|
return error instanceof Error
|
|
? error.message.replaceAll("secret", "[REDACTED]")
|
|
: "fixture failure";
|
|
}
|
|
}
|
|
|
|
const capturedResponseBodyEvents = (): readonly BrowserScenarioEvent[] => [
|
|
{
|
|
sequence: 1,
|
|
step_index: 0,
|
|
kind: "response",
|
|
transaction_id: "request-1",
|
|
redirected_from_transaction_id: null,
|
|
method: "GET",
|
|
url: sanitizeBrowserUrl("https://app.example.test/main.js"),
|
|
resource_type: "script",
|
|
header_names: [],
|
|
status: 200,
|
|
failure: null,
|
|
},
|
|
{
|
|
sequence: 2,
|
|
step_index: 0,
|
|
kind: "network-content",
|
|
transaction_id: "request-1",
|
|
source_event_sequence: 1,
|
|
phase: "response",
|
|
headers: { state: "not_requested" },
|
|
body: {
|
|
state: "captured",
|
|
representation: "playwright-response-body-bytes",
|
|
encoding: "base64",
|
|
content: "",
|
|
bytes: 0,
|
|
sha256:
|
|
"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
|
|
media_type: "text/javascript",
|
|
redacted: false,
|
|
},
|
|
},
|
|
];
|
|
|
|
describe("PlaywrightBrowserScenarioProvider", () => {
|
|
it("reports response-body provenance uncertainty without marking event coverage missing", async () => {
|
|
const session = new FakeSession("launch");
|
|
const selected = scenario();
|
|
session.eventItems = capturedResponseBodyEvents();
|
|
const input = browserScenarioSchema.parse({
|
|
...selected,
|
|
capture: {
|
|
...selected.capture,
|
|
network: { ...selected.capture.network, response_body: true },
|
|
},
|
|
});
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
|
|
const result = await provider.captureScenario(input);
|
|
if (!result.ok) throw result.error;
|
|
expect(result.value.limitations).toContain(
|
|
PLAYWRIGHT_RESPONSE_BODY_PROVENANCE_LIMITATION,
|
|
);
|
|
expect(result.value.completeness.missing_sections).not.toContain("events");
|
|
expect(result.value.events.items[1]).toMatchObject({
|
|
kind: "network-content",
|
|
body: {
|
|
state: "captured",
|
|
representation: "playwright-response-body-bytes",
|
|
},
|
|
});
|
|
});
|
|
|
|
it("makes reported event gaps ineligible for equality even in launch mode", async () => {
|
|
const session = new FakeSession("launch");
|
|
session.eventGaps = ["Popup frames before discovery are unavailable"];
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(
|
|
scenario({ events: ["frames"] }),
|
|
);
|
|
if (!result.ok) throw result.error;
|
|
expect(result.value.completeness).toMatchObject({
|
|
status: "incomplete",
|
|
equality_eligible: false,
|
|
missing_sections: ["events"],
|
|
});
|
|
expect(result.value.limitations).toContain(session.eventGaps[0]);
|
|
});
|
|
|
|
it("retains completed observations while popup initial-storage coverage remains unknown", async () => {
|
|
const session = new FakeSession("launch");
|
|
session.storageGaps = [
|
|
"First-script seed coverage is unknown for popup top-level contexts",
|
|
];
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(scenario());
|
|
if (!result.ok) throw result.error;
|
|
expect(result.value.completeness).toMatchObject({
|
|
status: "incomplete",
|
|
equality_eligible: false,
|
|
missing_sections: ["storage"],
|
|
});
|
|
expect(result.value.steps.map(({ status }) => status)).toEqual([
|
|
"completed",
|
|
"completed",
|
|
]);
|
|
expect(result.value.limitations).toContain(session.storageGaps[0]);
|
|
});
|
|
|
|
it("returns an initial state and every step beyond the former action ceiling", async () => {
|
|
const session = new FakeSession("launch");
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(scenario({ actions: 129 }));
|
|
if (!result.ok) throw result.error;
|
|
expect(result.value.scenario.action_count).toBe(129);
|
|
expect(result.value.steps).toHaveLength(130);
|
|
expect(result.value.steps.at(-1)?.step_id).toBe("wait_128");
|
|
});
|
|
|
|
it("makes missing and truncated captures ineligible for equality", async () => {
|
|
const session = new FakeSession("launch", { incomplete: true });
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(
|
|
scenario({ captures: ["screenshot", "dom"] }),
|
|
);
|
|
if (!result.ok) throw result.error;
|
|
expect(result.value.completeness).toMatchObject({
|
|
status: "truncated",
|
|
equality_eligible: false,
|
|
missing_sections: ["dom"],
|
|
truncated_sections: ["screenshot"],
|
|
});
|
|
});
|
|
|
|
it("records one failed step, cancels later actions, and still cleans up", async () => {
|
|
const session = new FakeSession("launch", {
|
|
action: new Error("fixture secret action failure"),
|
|
});
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(scenario({ actions: 2 }));
|
|
if (!result.ok) throw result.error;
|
|
expect(result.value.steps.map(({ status }) => status)).toEqual([
|
|
"completed",
|
|
"failed",
|
|
"cancelled",
|
|
]);
|
|
expect(result.value.steps[1]?.error).toBe(
|
|
"fixture [REDACTED] action failure",
|
|
);
|
|
expect(result.value.steps[2]?.error).toBe(
|
|
"not executed after an earlier action failure",
|
|
);
|
|
expect(session.performCalls).toBe(1);
|
|
expect(session.closeCalls).toBe(1);
|
|
expect(result.value.completeness.equality_eligible).toBe(false);
|
|
});
|
|
});
|
|
|
|
describe("connected browser scenario captures", () => {
|
|
it("disconnects external CDP sessions and marks pre-attach events missing", async () => {
|
|
const session = new FakeSession("connect");
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(
|
|
scenario({ mode: "connect" }),
|
|
);
|
|
if (!result.ok) throw result.error;
|
|
expect(result.value.browser).toMatchObject({
|
|
process_ownership: "external",
|
|
cleanup: "disconnected-external",
|
|
});
|
|
expect(result.value.completeness).toMatchObject({
|
|
status: "incomplete",
|
|
equality_eligible: false,
|
|
missing_sections: ["events"],
|
|
});
|
|
expect(result.value.limitations).toEqual(
|
|
expect.arrayContaining([connectedPlatformEmulationLimitation]),
|
|
);
|
|
expect(session.closeCalls).toBe(1);
|
|
});
|
|
|
|
it("retains the attached platform-emulation limitation in partial observations", async () => {
|
|
const session = new FakeSession("connect", {
|
|
capture: { call: 1, error: new Error("fixture capture failure") },
|
|
});
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(
|
|
scenario({ mode: "connect" }),
|
|
);
|
|
|
|
expect(result.ok).toBe(false);
|
|
if (result.ok) return;
|
|
expect(projectAnalysisError(result.error)).toMatchObject({
|
|
details: {
|
|
partial_observation: {
|
|
capture: {
|
|
limitations: expect.arrayContaining([
|
|
connectedPlatformEmulationLimitation,
|
|
]),
|
|
},
|
|
},
|
|
},
|
|
});
|
|
});
|
|
});
|
|
|
|
describe("PlaywrightBrowserScenarioProvider timing", () => {
|
|
it("keeps capture elapsed values valid across a backward wall-clock jump", async () => {
|
|
let wallClock = 10_000;
|
|
vi.spyOn(Date, "now").mockImplementation(() => wallClock);
|
|
const session = new FakeSession("launch");
|
|
session.onPerform = () => {
|
|
wallClock = 1;
|
|
};
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
|
|
try {
|
|
const result = await provider.captureScenario(scenario());
|
|
if (!result.ok) throw result.error;
|
|
expect(wallClock).toBe(1);
|
|
expect(Number.isInteger(result.value.duration_ms)).toBe(true);
|
|
expect(result.value.duration_ms).toBeGreaterThanOrEqual(0);
|
|
expect(
|
|
result.value.steps.every(
|
|
({ elapsed_ms }) => Number.isInteger(elapsed_ms) && elapsed_ms >= 0,
|
|
),
|
|
).toBe(true);
|
|
} finally {
|
|
vi.restoreAllMocks();
|
|
}
|
|
});
|
|
});
|
|
|
|
describe("PlaywrightBrowserScenarioProvider comparison coverage", () => {
|
|
it("keeps quiet captures with different event families from comparing unchanged", async () => {
|
|
const capture = async (events: readonly BrowserScenarioEventFamily[]) => {
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(new FakeSession("launch")),
|
|
);
|
|
const result = await provider.captureScenario(scenario({ events }));
|
|
if (!result.ok) throw result.error;
|
|
return result.value;
|
|
};
|
|
const compare = async (
|
|
before: readonly BrowserScenarioEventFamily[],
|
|
after: readonly BrowserScenarioEventFamily[],
|
|
) =>
|
|
compareBrowserScenarios(
|
|
compareBrowserScenariosInputSchema.parse({
|
|
before_scenario: await capture(before),
|
|
after_scenario: await capture(after),
|
|
}),
|
|
);
|
|
|
|
const recorded = await capture(["page-errors", "console", "console"]);
|
|
expect(recorded.completeness.equality_eligible).toBe(true);
|
|
expect(recorded.scenario.event_families).toEqual([
|
|
"console",
|
|
"page-errors",
|
|
]);
|
|
for (const [before, after] of [
|
|
[[], ["console"]],
|
|
[["console"], ["page-errors"]],
|
|
] as const) {
|
|
const compared = await compare(before, after);
|
|
expect(compared.overall_status).toBe("unknown");
|
|
expect(
|
|
compared.steps.flatMap((step) => step.artifact_diffs),
|
|
).toContainEqual(
|
|
expect.objectContaining({
|
|
artifact: "events",
|
|
status: "unknown",
|
|
reason: expect.stringContaining("Event family selections differ"),
|
|
}),
|
|
);
|
|
}
|
|
expect(
|
|
(await compare(["console", "page-errors"], ["page-errors", "console"]))
|
|
.overall_status,
|
|
).toBe("unchanged");
|
|
});
|
|
});
|
|
|
|
describe("PlaywrightBrowserScenarioProvider cleanup", () => {
|
|
it("returns a cleanup failure with completed observations when close fails", async () => {
|
|
const session = new FakeSession("launch", {
|
|
action: new Error("fixture secret action failure"),
|
|
close: new Error("browser close failed"),
|
|
});
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(scenario());
|
|
|
|
expect(result.ok).toBe(false);
|
|
if (result.ok) return;
|
|
const projection = projectAnalysisError(result.error);
|
|
expect(projection).toMatchObject({
|
|
code: "cleanup_incomplete",
|
|
details: {
|
|
cleanup: "incomplete",
|
|
resources: ["browser_transport"],
|
|
partial_observation: {
|
|
kind: "browser-scenario-observation",
|
|
capture: {
|
|
browser: { cleanup: "incomplete" },
|
|
steps: [
|
|
{ step_id: "scenario_start" },
|
|
{ step_id: "wait_0", status: "failed" },
|
|
],
|
|
},
|
|
},
|
|
},
|
|
});
|
|
expect(session.closeCalls).toBe(1);
|
|
});
|
|
});
|
|
|
|
describe("PlaywrightBrowserScenarioProvider operation failures", () => {
|
|
it.each([{ cleanupFails: false }, { cleanupFails: true }])(
|
|
"retains typed partial data when operation fails and cleanupFails=$cleanupFails",
|
|
async ({ cleanupFails }) => {
|
|
const session = new FakeSession("launch", {
|
|
capture: {
|
|
call: 2,
|
|
error: new AnalysisOutputError(
|
|
"capture_browser_scenario",
|
|
"step capture failed",
|
|
{
|
|
capturedOutput: {
|
|
stdout: "partial stdout",
|
|
stderr: "",
|
|
truncated: false,
|
|
},
|
|
cleanup: {
|
|
reason: "capture cleanup is uncertain",
|
|
resources: ["capture_handle"],
|
|
},
|
|
},
|
|
),
|
|
},
|
|
...(cleanupFails ? { close: new Error("browser close failed") } : {}),
|
|
});
|
|
session.eventItems = [
|
|
{
|
|
sequence: 1,
|
|
step_index: 0,
|
|
kind: "console",
|
|
level: "log",
|
|
text: "navigation started",
|
|
url: sanitizeBrowserUrl("https://app.example.test/"),
|
|
},
|
|
];
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(scenario());
|
|
|
|
expect(result.ok).toBe(false);
|
|
if (result.ok) return;
|
|
const projection = projectAnalysisError(result.error);
|
|
expect(projection).toMatchObject({
|
|
code: "cleanup_incomplete",
|
|
details: {
|
|
...(cleanupFails
|
|
? {
|
|
diagnostics: {
|
|
primary_error: {
|
|
code: "cleanup_incomplete",
|
|
details: {
|
|
operation: "capture_browser_scenario",
|
|
diagnostics: {
|
|
primary_error: {
|
|
details: { reason: "step capture failed" },
|
|
},
|
|
},
|
|
},
|
|
},
|
|
cleanup_error: { code: "cleanup_incomplete" },
|
|
},
|
|
}
|
|
: { reason: "step capture failed" }),
|
|
partial_observation: {
|
|
kind: "browser-scenario-observation",
|
|
capture: {
|
|
browser: {
|
|
cleanup: cleanupFails
|
|
? "incomplete"
|
|
: "terminated-owned-process",
|
|
},
|
|
steps: [{ step_id: "scenario_start" }],
|
|
events: {
|
|
retained: 1,
|
|
dropped: 0,
|
|
items: [
|
|
expect.objectContaining({ text: "navigation started" }),
|
|
],
|
|
omissions: {
|
|
by_kind: [],
|
|
network_transactions: [],
|
|
network_transaction_range: null,
|
|
},
|
|
},
|
|
},
|
|
},
|
|
},
|
|
});
|
|
expect(result.error.capturedOutput).toEqual({
|
|
stdout: "partial stdout",
|
|
stderr: "",
|
|
truncated: false,
|
|
});
|
|
expect(result.error.cleanupResources).toEqual(
|
|
cleanupFails
|
|
? ["capture_handle", "browser_transport"]
|
|
: ["capture_handle"],
|
|
);
|
|
if (!cleanupFails)
|
|
expect(result.error.cleanup).toEqual({
|
|
reason: "capture cleanup is uncertain",
|
|
resources: ["capture_handle"],
|
|
});
|
|
expect(session.closeCalls).toBe(1);
|
|
},
|
|
);
|
|
});
|
|
|
|
describe("PlaywrightBrowserScenarioProvider cancellation and timeout", () => {
|
|
it.each([
|
|
{
|
|
name: "cancellation",
|
|
error: new AnalysisCancelledError("capture_browser_scenario"),
|
|
code: "cancelled",
|
|
category: "cancelled",
|
|
details: { operation: "capture_browser_scenario", cleanup: "complete" },
|
|
},
|
|
{
|
|
name: "timeout",
|
|
error: new AnalysisTimeoutError("capture_browser_scenario", 250),
|
|
code: "provider_timeout",
|
|
category: "timeout",
|
|
details: { operation: "capture_browser_scenario", timeout_ms: 250 },
|
|
},
|
|
])(
|
|
"preserves $name category and details when cleanup succeeds",
|
|
async ({ error, code, category, details }) => {
|
|
const session = new FakeSession("launch", {
|
|
capture: { call: 1, error },
|
|
});
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(scenario());
|
|
|
|
expect(result.ok).toBe(false);
|
|
if (result.ok) return;
|
|
const projection = projectAnalysisError(result.error);
|
|
expect(projection).toMatchObject({
|
|
code,
|
|
category,
|
|
details: {
|
|
...details,
|
|
partial_observation: {
|
|
kind: "browser-scenario-observation",
|
|
capture: { browser: { cleanup: "terminated-owned-process" } },
|
|
},
|
|
},
|
|
});
|
|
expect(session.closeCalls).toBe(1);
|
|
},
|
|
);
|
|
});
|
|
|
|
describe("PlaywrightBrowserScenarioProvider request cancellation", () => {
|
|
it("does not open a session for an already-cancelled request", async () => {
|
|
let opens = 0;
|
|
const provider = new PlaywrightBrowserScenarioProvider(() => {
|
|
opens += 1;
|
|
return Promise.resolve(new FakeSession("launch"));
|
|
});
|
|
const controller = new AbortController();
|
|
controller.abort();
|
|
const result = await provider.captureScenario(scenario(), {
|
|
signal: controller.signal,
|
|
});
|
|
expect(result.ok).toBe(false);
|
|
expect(opens).toBe(0);
|
|
});
|
|
|
|
it("cancels an active action and still closes the session", async () => {
|
|
const controller = new AbortController();
|
|
const cancellationReason = new Error("cancel active scenario");
|
|
const session = new FakeSession("launch");
|
|
session.onPerform = () => controller.abort(cancellationReason);
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
const result = await provider.captureScenario(scenario({ actions: 2 }), {
|
|
signal: controller.signal,
|
|
});
|
|
expect(result).toMatchObject({
|
|
ok: false,
|
|
error: {
|
|
_tag: "AnalysisCancelledError",
|
|
partialObservation: {
|
|
kind: "browser-scenario-observation",
|
|
capture: {
|
|
browser: { cleanup: "terminated-owned-process" },
|
|
steps: [
|
|
{ status: "completed" },
|
|
{ status: "cancelled" },
|
|
{
|
|
status: "cancelled",
|
|
error: "not executed after scenario request cancellation",
|
|
},
|
|
],
|
|
},
|
|
},
|
|
},
|
|
});
|
|
if (result.ok) throw new Error("Expected active scenario cancellation");
|
|
expect(session.performCalls).toBe(1);
|
|
expect(result.error.cause).toBe(cancellationReason);
|
|
expect(session.closeCalls).toBe(1);
|
|
});
|
|
|
|
it("retains the completed capture when cancellation arrives during final close", async () => {
|
|
const controller = new AbortController();
|
|
const cancellationReason = new Error("cancel final close");
|
|
const session = new FakeSession("launch");
|
|
session.onClose = () => controller.abort(cancellationReason);
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
|
|
const result = await provider.captureScenario(scenario(), {
|
|
signal: controller.signal,
|
|
});
|
|
|
|
expect(session.closeCalls).toBe(1);
|
|
expect(result).toMatchObject({
|
|
ok: false,
|
|
error: {
|
|
_tag: "AnalysisCancelledError",
|
|
partialObservation: {
|
|
kind: "browser-scenario-observation",
|
|
capture: {
|
|
browser: { cleanup: "terminated-owned-process" },
|
|
steps: [{ status: "completed" }, { status: "completed" }],
|
|
},
|
|
},
|
|
},
|
|
});
|
|
if (result.ok) throw new Error("Expected final-close cancellation");
|
|
expect(result.error.cause).toBe(cancellationReason);
|
|
});
|
|
|
|
it("retains final-close cancellation alongside failed cleanup", async () => {
|
|
const controller = new AbortController();
|
|
const session = new FakeSession("launch", {
|
|
close: new Error("fixture close failed"),
|
|
});
|
|
session.onClose = () => controller.abort();
|
|
const provider = new PlaywrightBrowserScenarioProvider(() =>
|
|
Promise.resolve(session),
|
|
);
|
|
|
|
const result = await provider.captureScenario(scenario(), {
|
|
signal: controller.signal,
|
|
});
|
|
|
|
expect(result).toMatchObject({
|
|
ok: false,
|
|
error: {
|
|
_tag: "ProviderAdapterError",
|
|
cleanupIncomplete: true,
|
|
partialObservation: {
|
|
kind: "browser-scenario-observation",
|
|
capture: {
|
|
browser: { cleanup: "incomplete" },
|
|
steps: [{ status: "completed" }, { status: "completed" }],
|
|
},
|
|
},
|
|
},
|
|
});
|
|
if (result.ok)
|
|
throw new Error("Expected final-close cancellation with cleanup");
|
|
let primary = result.error.cleanupPrimary;
|
|
while (primary?.cleanupPrimary !== undefined)
|
|
primary = primary.cleanupPrimary;
|
|
expect(primary).toMatchObject({ _tag: "AnalysisCancelledError" });
|
|
expect(primary?.cause).toBe(controller.signal.reason);
|
|
await expect(provider.close()).rejects.toMatchObject({
|
|
_tag: "ProviderAdapterError",
|
|
operation: "capture_browser_scenario",
|
|
});
|
|
expect(session.closeCalls).toBe(2);
|
|
});
|
|
});
|
|
|
|
it("shares concurrent close and retries browser cleanup after failure", async () => {
|
|
const browserClose = vi
|
|
.fn<() => Promise<void>>()
|
|
.mockRejectedValueOnce(new Error("browser close failed"))
|
|
.mockResolvedValue(undefined);
|
|
const removeProfile = vi
|
|
.fn<() => Promise<void>>()
|
|
.mockResolvedValue(undefined);
|
|
const finishEvents = vi
|
|
.fn<() => Promise<void>>()
|
|
.mockResolvedValue(undefined);
|
|
const cleanupSettlements: boolean[] = [];
|
|
const cleanup = new PlaywrightScenarioBrowserCleanupOwner({
|
|
closeBrowser: (disconnectAtBoundary) =>
|
|
disconnectAtBoundary(() => browserClose()),
|
|
removeProfile,
|
|
onSettled: (browserClosed) => cleanupSettlements.push(browserClosed),
|
|
});
|
|
|
|
const first = cleanup.close(finishEvents);
|
|
const concurrent = cleanup.close(finishEvents);
|
|
await expect(first).rejects.toMatchObject({ reason: "cleanup_failed" });
|
|
await expect(concurrent).rejects.toMatchObject({ reason: "cleanup_failed" });
|
|
expect(browserClose).toHaveBeenCalledTimes(1);
|
|
expect(removeProfile).not.toHaveBeenCalled();
|
|
expect(finishEvents).toHaveBeenCalledTimes(1);
|
|
expect(cleanupSettlements).toEqual([false]);
|
|
|
|
await expect(cleanup.close(finishEvents)).resolves.toBeUndefined();
|
|
await expect(cleanup.close(finishEvents)).resolves.toBeUndefined();
|
|
expect(browserClose).toHaveBeenCalledTimes(2);
|
|
expect(removeProfile).toHaveBeenCalledTimes(1);
|
|
expect(finishEvents).toHaveBeenCalledTimes(1);
|
|
expect(cleanupSettlements).toEqual([false, true]);
|
|
});
|
|
|
|
it("keeps failed event finalization failed across cleanup retries", async () => {
|
|
const finishEvents = vi
|
|
.fn<() => Promise<void>>()
|
|
.mockRejectedValue(new Error("event finalization failed"));
|
|
const closeBrowser = vi
|
|
.fn<() => Promise<void>>()
|
|
.mockResolvedValue(undefined);
|
|
const cleanup = new PlaywrightScenarioBrowserCleanupOwner({
|
|
closeBrowser: (disconnectAtBoundary) =>
|
|
disconnectAtBoundary(() => closeBrowser()),
|
|
removeProfile: undefined,
|
|
});
|
|
|
|
await expect(cleanup.close(finishEvents)).rejects.toMatchObject({
|
|
reason: "cleanup_failed",
|
|
});
|
|
await expect(cleanup.close(finishEvents)).rejects.toMatchObject({
|
|
reason: "cleanup_failed",
|
|
});
|
|
expect(finishEvents).toHaveBeenCalledTimes(1);
|
|
expect(closeBrowser).toHaveBeenCalledTimes(1);
|
|
});
|
|
|
|
it.each(["launch", "connect"] as const)(
|
|
"reports locale coverage in %s success and retained operation/cleanup failures",
|
|
async (mode) => {
|
|
const input = scenario({ mode });
|
|
input.environment.locale = "fr-FR";
|
|
for (const failures of [
|
|
{},
|
|
{
|
|
capture: {
|
|
call: 1,
|
|
error: new AnalysisCancelledError("capture_browser_scenario"),
|
|
},
|
|
},
|
|
{ close: new Error("fixture cleanup interrupted") },
|
|
]) {
|
|
const session = new FakeSession(mode, failures);
|
|
const provider = new PlaywrightBrowserScenarioProvider(
|
|
async () => session,
|
|
);
|
|
const result = await provider.captureScenario(input);
|
|
expect(result.ok).toBe(!("capture" in failures || "close" in failures));
|
|
const expected = {
|
|
limitations:
|
|
mode === "connect"
|
|
? expect.arrayContaining([
|
|
"Attached locale fr-FR applies to Intl formatting only; navigator.language(s) and Accept-Language remain caller-controlled. Use launch mode for matching page and request languages.",
|
|
])
|
|
: expect.not.arrayContaining([
|
|
expect.stringContaining("Attached locale"),
|
|
]),
|
|
};
|
|
if (result.ok) expect(result.value).toMatchObject(expected);
|
|
else
|
|
expect(projectAnalysisError(result.error)).toMatchObject({
|
|
details: {
|
|
partial_observation: {
|
|
kind: "browser-scenario-observation",
|
|
capture: expected,
|
|
},
|
|
},
|
|
});
|
|
expect(session.closeCalls).toBe(1);
|
|
}
|
|
},
|
|
);
|
|
|
|
it.each([false, true])(
|
|
"follows the browser owner through provider recovery (operation failed: %s)",
|
|
async (operationFailed) => {
|
|
const reason = { caller: "authored capture cancellation" };
|
|
const primary = new AnalysisCancelledError("capture_browser_scenario", {
|
|
cause: reason,
|
|
});
|
|
const session = new FakeSession(
|
|
"launch",
|
|
operationFailed ? { capture: { call: 1, error: primary } } : {},
|
|
);
|
|
let denied = true;
|
|
const owner = new PlaywrightScenarioBrowserCleanupOwner({
|
|
closeBrowser: (disconnectAtBoundary) =>
|
|
disconnectAtBoundary(async () => undefined),
|
|
removeProfile: async () => {
|
|
if (denied) throw new Error("profile removal denied");
|
|
},
|
|
});
|
|
session.cleanupLease = owner.cleanupLease;
|
|
session.close = async () => {
|
|
await owner.close();
|
|
return "terminated-owned-process";
|
|
};
|
|
const provider = new PlaywrightBrowserScenarioProvider(async () => session);
|
|
try {
|
|
const result = await provider.captureScenario(scenario());
|
|
if (result.ok) throw new Error("Expected retained cleanup");
|
|
expect(result.error.cleanupIncomplete).toBe(true);
|
|
expect(result.error.cleanupResources).toEqual(["browser_profile"]);
|
|
const partial = result.error.partialObservation;
|
|
await expect(provider.close()).rejects.toMatchObject({
|
|
cleanupIncomplete: true,
|
|
});
|
|
denied = false;
|
|
await provider.close();
|
|
expect(result.error.cleanupIncomplete).toBe(false);
|
|
expect(result.error.cleanupResources).toEqual([]);
|
|
expect(result.error.partialObservation).toBe(partial);
|
|
if (operationFailed) {
|
|
let restored = result.error.cleanupPrimary;
|
|
while (restored?.cleanupPrimary !== undefined)
|
|
restored = restored.cleanupPrimary;
|
|
expect(restored).toBe(primary);
|
|
expect(primary.cause).toBe(reason);
|
|
expect(projectAnalysisError(result.error)).toMatchObject({
|
|
code: "cancelled",
|
|
});
|
|
}
|
|
} finally {
|
|
denied = false;
|
|
await provider.close();
|
|
}
|
|
},
|
|
);
|
|
|
|
it("resolves the returned failure after retrying a plain session cleanup capability", async () => {
|
|
const session = new FakeSession("launch");
|
|
let denied = true;
|
|
session.close = async () => {
|
|
if (denied) throw new Error("authored session cleanup denial");
|
|
return "terminated-owned-process";
|
|
};
|
|
const provider = new PlaywrightBrowserScenarioProvider(async () => session);
|
|
try {
|
|
const result = await provider.captureScenario(scenario());
|
|
if (result.ok) throw new Error("Expected cleanup failure");
|
|
expect(result.error.cleanupIncomplete).toBe(true);
|
|
const failed: unknown = await provider
|
|
.close()
|
|
.catch((cause: unknown) => cause);
|
|
expect(failed).toMatchObject({ cleanupIncomplete: true });
|
|
denied = false;
|
|
await provider.close();
|
|
expect(result.error).toMatchObject({
|
|
cleanupIncomplete: false,
|
|
cleanupResources: [],
|
|
});
|
|
expect(failed).toMatchObject({
|
|
cleanupIncomplete: false,
|
|
cleanupResources: [],
|
|
});
|
|
} finally {
|
|
denied = false;
|
|
await provider.close();
|
|
}
|
|
});
|
|
|
|
it("retries every retained opening cleanup and preserves the original failure through mixed recovery", async () => {
|
|
let denied = true;
|
|
let healthyCloses = 0;
|
|
const physical = new AnalysisOutputError(
|
|
"capture_browser_scenario",
|
|
"authored open failure",
|
|
);
|
|
const provider = new PlaywrightBrowserScenarioProvider(
|
|
async (_scenario, options) => {
|
|
options.retainCleanup?.(
|
|
new AnalysisCleanupLease(async () => {
|
|
if (denied) throw new Error("first cleanup denied");
|
|
}, ["first cleanup"]),
|
|
);
|
|
options.retainCleanup?.(
|
|
new AnalysisCleanupLease(async () => {
|
|
healthyCloses++;
|
|
}, ["healthy cleanup"]),
|
|
);
|
|
throw physical;
|
|
},
|
|
);
|
|
try {
|
|
const result = await provider.captureScenario(scenario());
|
|
if (result.ok) throw new Error("Expected opening failure");
|
|
const failed: unknown = await provider
|
|
.close()
|
|
.catch((cause: unknown) => cause);
|
|
expect(failed).toMatchObject({ cleanupIncomplete: true });
|
|
expect(result.error.cleanupIncomplete).toBe(true);
|
|
expect(healthyCloses).toBe(1);
|
|
denied = false;
|
|
await provider.close();
|
|
expect(result.error).toMatchObject({
|
|
cleanupIncomplete: false,
|
|
cleanupResources: [],
|
|
});
|
|
expect(failed).toMatchObject({
|
|
cleanupIncomplete: false,
|
|
cleanupResources: [],
|
|
});
|
|
expect(result.error.cleanupPrimary).toBe(physical);
|
|
expect(healthyCloses).toBe(1);
|
|
} finally {
|
|
denied = false;
|
|
await provider.close();
|
|
}
|
|
});
|
|
|
|
it("keeps a cancelled opening incomplete until its retained late cleanup finishes", async () => {
|
|
let finish: () => void = () => {};
|
|
const late = new Promise<void>((resolve) => {
|
|
finish = resolve;
|
|
});
|
|
const reason = { caller: "cancelled opening before late handshake" };
|
|
const primary = new AnalysisCancelledError("capture_browser_scenario", {
|
|
cause: reason,
|
|
});
|
|
const provider = new PlaywrightBrowserScenarioProvider(
|
|
async (_scenario, options) => {
|
|
options.retainCleanup?.(
|
|
new AnalysisCleanupLease(() => late, ["late opening"]),
|
|
);
|
|
throw primary;
|
|
},
|
|
);
|
|
try {
|
|
const result = await provider.captureScenario(scenario());
|
|
if (result.ok) throw new Error("Expected cancelled opening");
|
|
expect(result.error.cleanupIncomplete).toBe(true);
|
|
const closing = provider.close();
|
|
await Promise.resolve();
|
|
expect(result.error.cleanupIncomplete).toBe(true);
|
|
finish();
|
|
await closing;
|
|
expect(result.error).toMatchObject({
|
|
cleanupIncomplete: false,
|
|
cleanupResources: [],
|
|
});
|
|
expect(result.error.cleanupPrimary).toBe(primary);
|
|
expect(primary.cause).toBe(reason);
|
|
expect(projectAnalysisError(result.error)).toMatchObject({
|
|
code: "cancelled",
|
|
});
|
|
} finally {
|
|
finish();
|
|
await provider.close();
|
|
}
|
|
});
|
|
|
|
it.each([false, true])(
|
|
"follows late browser acknowledgement without another retry (cancelled during close: %s)",
|
|
async (cancelled) => {
|
|
vi.useFakeTimers();
|
|
let acknowledge: () => void = () => {};
|
|
const acknowledgement = new Promise<void>((resolve) => {
|
|
acknowledge = resolve;
|
|
});
|
|
const caller = new AbortController();
|
|
const reason = { caller: "during final browser close" };
|
|
const owner = new PlaywrightScenarioBrowserCleanupOwner({
|
|
closeBrowser: (disconnectAtBoundary) =>
|
|
disconnectAtBoundary(() => acknowledgement),
|
|
removeProfile: undefined,
|
|
});
|
|
const session = new FakeSession("launch");
|
|
session.cleanupLease = owner.cleanupLease;
|
|
session.close = async () => {
|
|
if (cancelled) caller.abort(reason);
|
|
await owner.close();
|
|
return "terminated-owned-process";
|
|
};
|
|
const provider = new PlaywrightBrowserScenarioProvider(async () => session);
|
|
try {
|
|
const pending = provider.captureScenario(scenario(), {
|
|
signal: caller.signal,
|
|
});
|
|
await vi.advanceTimersByTimeAsync(30_000);
|
|
const result = await pending;
|
|
if (result.ok) throw new Error("Expected timed out cleanup response");
|
|
expect(result.error.cleanupIncomplete).toBe(true);
|
|
const partial = result.error.partialObservation;
|
|
acknowledge();
|
|
await owner.cleanupLease.release();
|
|
expect(result.error).toMatchObject({
|
|
cleanupIncomplete: false,
|
|
cleanupResources: [],
|
|
});
|
|
expect(result.error.partialObservation).toBe(partial);
|
|
if (cancelled) {
|
|
expect(projectAnalysisError(result.error)).toMatchObject({
|
|
code: "cancelled",
|
|
});
|
|
let primary = result.error.cleanupPrimary;
|
|
while (primary?.cleanupPrimary !== undefined)
|
|
primary = primary.cleanupPrimary;
|
|
expect(primary?.cause).toBe(reason);
|
|
}
|
|
} finally {
|
|
acknowledge();
|
|
await provider.close();
|
|
vi.useRealTimers();
|
|
}
|
|
},
|
|
);
|
|
|
|
it("retains a profile-only opening lease without adding transport labels or waiting for another retry", async () => {
|
|
let denied = true;
|
|
let releases = 0;
|
|
const primary = new AnalysisOutputError(
|
|
"capture_browser_scenario",
|
|
"authored opening failure",
|
|
);
|
|
const lease = new AnalysisCleanupLease(async () => {
|
|
releases++;
|
|
if (denied) throw new Error("profile removal denied");
|
|
}, ["browser_profile"]);
|
|
const provider = new PlaywrightBrowserScenarioProvider(
|
|
async (_scenario, options) => {
|
|
try {
|
|
return await failBrowserScenarioOperation(lease, primary);
|
|
} catch (cause: unknown) {
|
|
options.retainCleanup?.(lease);
|
|
throw cause;
|
|
}
|
|
},
|
|
);
|
|
try {
|
|
const result = await provider.captureScenario(scenario());
|
|
if (result.ok) throw new Error("Expected opening failure");
|
|
expect(result.error).toMatchObject({
|
|
cleanupIncomplete: true,
|
|
cleanupResources: ["browser_profile"],
|
|
});
|
|
denied = false;
|
|
await lease.release();
|
|
expect(result.error).toMatchObject({
|
|
cleanupIncomplete: false,
|
|
cleanupResources: [],
|
|
});
|
|
expect(projectAnalysisError(result.error)).toMatchObject({
|
|
code: "unreadable_output",
|
|
});
|
|
await provider.close();
|
|
expect(releases).toBe(2);
|
|
} finally {
|
|
denied = false;
|
|
await provider.close();
|
|
}
|
|
});
|
|
|
|
it("keeps an earlier physical failure primary when final cleanup also observes cancellation", async () => {
|
|
const caller = new AbortController();
|
|
const physical = new Error("physical capture failure");
|
|
const primary = new AnalysisOutputError(
|
|
"capture_browser_scenario",
|
|
physical.message,
|
|
{ cause: physical },
|
|
);
|
|
const session = new FakeSession("launch", {
|
|
capture: { call: 1, error: primary },
|
|
});
|
|
let denied = true;
|
|
session.close = async () => {
|
|
caller.abort({ caller: "later during final cleanup" });
|
|
if (denied) throw new Error("cleanup denied");
|
|
return "terminated-owned-process";
|
|
};
|
|
const provider = new PlaywrightBrowserScenarioProvider(async () => session);
|
|
try {
|
|
const result = await provider.captureScenario(scenario(), {
|
|
signal: caller.signal,
|
|
});
|
|
if (result.ok) throw new Error("Expected physical failure");
|
|
denied = false;
|
|
await provider.close();
|
|
expect(result.error.cleanupIncomplete).toBe(false);
|
|
expect(projectAnalysisError(result.error)).toMatchObject({
|
|
code: "unreadable_output",
|
|
});
|
|
let restored = result.error.cleanupPrimary;
|
|
while (restored?.cleanupPrimary !== undefined)
|
|
restored = restored.cleanupPrimary;
|
|
expect(restored).toBe(primary);
|
|
expect(primary.cause).toBe(physical);
|
|
} finally {
|
|
denied = false;
|
|
await provider.close();
|
|
}
|
|
});
|