* feat(environment): extract the initial state a capture's reads observed Add the environment-state analysis view. From the parents the environment manifest accepts, it extracts the data the capture's reads observed before the first related write: entity types with an identity field (proved by a path parameter or inferred from an identity name), entities with their recorded values and provenance, documents for written non-entity paths, and a render plan per read tool that is kept only when it reproduces the tool's latest initial recordings from the state; every other read tool is a recorded view with the reason. The Evidence is always inferred. Response-body decoding moves to a domain owner shared with replay, exact JSON parsing moves to the owner of the exact-number policy, the manifest and state views share parent admission and record grouping, and projectAnalysisView takes its accumulators as one object. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * fix(environment): bound state at redacted writes; infer identity only from items A scenario write whose URL was redacted has no request line, so it was dropped and reads after it counted as initial state. Such a successful write now joins the timeline with an empty path, whose root relates to every type, so it ends every type's state; a limitation counts them. A list whose recordings were all empty passed the "every listed item carries it" check vacuously and published an identity field nothing showed; it now needs at least one item, else the view stays recorded as no-identity. A value that differed between two request lines of one item tool, such as a query variant, was called volatile, and the gate then substituted each recording's own value; only repeats of one request line now show volatility, so differing lines go through fields-differ. List membership is compared only while a list can still be the whole collection, and merged entities are indexed by type and collection once, so paged captures no longer cost pages times entities (8,000 pages of 40,000 entities: 5.7 s to 0.23 s). Docs and the tool contract say scenario state keeps the capture's redaction markers and how redacted writes bound it. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * fix(environment): keep first sightings, one list pointer and linear field unions Entities took the order of the first plan observed, and item plans run before list plans, so a complete list read before its detail reads came out reordered and lost "all" membership; each entity now keeps its earliest recorded sighting. A list plan reused the first recording's pointer for later recordings, so a later response that was itself an entity wrapping a list was read as that list; every recording must now locate the same list. The field union scanned its ordered list for every key, quadratic in an object's width; a set now answers membership. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * fix(environment): keep post-write values and partial lists out of the initial state A value that changed between repeats of one request line was named volatile whenever no write under the type's own root lay between, so a write under another root (for example POST /api/dashboards/db before a second GET /api/search) left its effect in the initial state. Any recorded write between the two observations now leaves every tool of the type recorded with reason fields-differ instead. A list was published with membership "all" even when a total or count envelope member exceeded the number it listed. Such a counter now makes the membership "recorded". Also drop a stale doc comment on ObservedEntity.order. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * docs(environment): scope item-shaped and deleted written paths out of documents State documents are held only for list-shaped paths a POST, PUT or PATCH tool writes. Reads of item-shaped written paths and of paths that are only deleted stay recorded views; the guide now says so and the spec defers them to a later increment of #4933. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * fix(environment): count writes in flight when a value changes between reads The volatility check compared write start positions with the two reads, so a write already in flight when the earlier read started was missed and its effect was named volatile. A write now counts when its interval overlaps the span from the earlier read's start to the later read's end. The check also ran once per changed field and scanned every write. It now runs once per pair of observations, answered by a binary search over the writes in timeline order and the latest end among each prefix. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * fix(environment): catch cross-tool changes across writes; read only item totals A value that changed across a write was caught only between repeats of one tool's request line, so a list read before a write and an item read after it put the post-write value into the initial state. Changes are now classified per entity in timeline order after observation: across any recorded write, a change between repeats of a line or between two lines of the type rewrites the type (every tool recorded as fields-differ); with no write between, a repeat's change is volatile. The classification lives in environmentStateMerge.ts. Any numeric member whose name contained "total" or "count" counted as an item total, so total_pages, account_id or page_count made complete lists partial. Item totals are now members whose name tokens include total or count and none of page, pages or per; a string of digits counts as a number; and a set has_more, next or next-page token member also marks the list partial. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> * fix(environment): keep post-write observations out of initial state * fix(environment): retain field provenance and bound state inference work --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> Co-authored-by: Kaoru0822 <208281322+kaoru0822-kitauji@users.noreply.github.com> Co-authored-by: gensokyo-dev <gensokyo-dev@users.noreply.github.com>
762 lines
25 KiB
TypeScript
762 lines
25 KiB
TypeScript
import {
|
|
apiSurfaceHar,
|
|
environmentManifestHar,
|
|
} from "../../fixtures/historicalHar.js";
|
|
import { inspectAnalysisView } from "../../../src/application/analysisView/AnalysisViewService.js";
|
|
import { createHash } from "node:crypto";
|
|
import { mkdir, unlink, writeFile } from "node:fs/promises";
|
|
import { join } from "node:path";
|
|
|
|
import { expect } from "vitest";
|
|
import { TextReader, Uint8ArrayWriter, ZipWriter } from "@zip.js/zip.js";
|
|
|
|
import { createTestTempDirectory } from "../../fixtures/temporaryDirectory.js";
|
|
import { cliTest } from "../../support/cli/cliFixture.js";
|
|
|
|
import {
|
|
analysisViewLayoutEvidence,
|
|
analysisViewCaptureFixture,
|
|
analysisViewCaptureEvidence,
|
|
analysisViewObjectDenseCapture,
|
|
analysisViewJavaScriptEvidence,
|
|
analysisViewJavaScriptAnalysisWithSource,
|
|
analysisViewNativeEvidence,
|
|
environmentManifestCaptureFixture,
|
|
environmentStateCaptureFixture,
|
|
} from "../../fixtures/analysisView.js";
|
|
import { createEvidence, parseEvidence } from "../../../src/domain/evidence.js";
|
|
import { ghidraFunctionDossier } from "../../../src/domain/ghidraValues.fixture.js";
|
|
import { createEvidenceBundle } from "../../../src/domain/evidenceBundle.js";
|
|
import { inspectEvidenceBundle } from "../../../src/application/investigation/InspectEvidenceBundle.js";
|
|
|
|
cliTest(
|
|
"preserves native relationship coverage independently of exhausted CLI pages",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-native-coverage-cli-");
|
|
const parent = analysisViewNativeEvidence({
|
|
status: "partial",
|
|
limited_directions: ["callees"],
|
|
limitations: ["Callees: fixture read limit"],
|
|
diagnostics: ["Fixture relationship diagnostic"],
|
|
});
|
|
const parentBefore = JSON.stringify(parent);
|
|
const request = join(root, "request.json");
|
|
await writeFile(
|
|
request,
|
|
JSON.stringify({
|
|
source: { kind: "inline", evidence: parent },
|
|
view: { kind: "native", facet: "callees", offset: 0, limit: 1 },
|
|
}),
|
|
);
|
|
const response = await cli.run({
|
|
arguments: ["inspect-analysis-view", request, "--json"],
|
|
});
|
|
expect(response.exitCode).toBe(0);
|
|
const evidence = parseEvidence(response.json);
|
|
expect(evidence.relationship_coverage).toEqual(
|
|
parent.relationship_coverage,
|
|
);
|
|
expect(evidence.normalized_result).toMatchObject({
|
|
item: [],
|
|
coverage: { total: 0, exhausted: true },
|
|
limitations: expect.arrayContaining(["Fixture dossier caveat"]),
|
|
});
|
|
expect(evidence.evidence_links).toEqual([parent.evidence_id]);
|
|
expect(JSON.stringify(parent)).toBe(parentBefore);
|
|
},
|
|
);
|
|
|
|
cliTest(
|
|
"reads typed module references through the public CLI with canonical Evidence",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-module-reference-cli-");
|
|
const request = join(root, "request.json");
|
|
const parent = analysisViewJavaScriptEvidence(
|
|
analysisViewJavaScriptAnalysisWithSource(),
|
|
);
|
|
const input = {
|
|
source: { kind: "inline", evidence: parent },
|
|
view: {
|
|
kind: "javascript",
|
|
collection: "modules",
|
|
projection: "references",
|
|
where: { path: "renderer.js" },
|
|
limit: 1,
|
|
},
|
|
};
|
|
const expected = inspectAnalysisView(input);
|
|
if (!expected.ok) throw expected.error;
|
|
await writeFile(request, JSON.stringify(input));
|
|
const response = await cli.run({
|
|
arguments: ["inspect-analysis-view", request, "--json"],
|
|
});
|
|
expect(response.exitCode).toBe(0);
|
|
const evidence = parseEvidence(response.json);
|
|
expect(evidence.normalized_result).toEqual(
|
|
expected.value.normalized_result,
|
|
);
|
|
expect(evidence.evidence_id).toBe(expected.value.evidence_id);
|
|
expect(evidence.evidence_links).toEqual([parent.evidence_id]);
|
|
},
|
|
);
|
|
cliTest(
|
|
"projects opted-in query names through compiled CLI without query values",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-query-names-cli-");
|
|
const path = join(root, "view.json");
|
|
const capture = analysisViewCaptureFixture();
|
|
capture.records = capture.records.slice(0, 2);
|
|
capture.total_records = 2;
|
|
capture.records.forEach((record, index) => {
|
|
record.reported = {
|
|
request: {
|
|
method: "GET",
|
|
url:
|
|
index === 0
|
|
? "https://api.test/products?category=books&page=1&category=repeat"
|
|
: "https://api.test/products?category=games&sort=price#ignored",
|
|
},
|
|
};
|
|
});
|
|
await writeFile(
|
|
path,
|
|
JSON.stringify({
|
|
source: {
|
|
kind: "inline",
|
|
evidence: analysisViewCaptureEvidence(capture),
|
|
},
|
|
view: { kind: "api-surface", include_query_parameter_names: true },
|
|
}),
|
|
);
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", path, "--json"],
|
|
});
|
|
expect(result.exitCode).toBe(0);
|
|
const evidence = parseEvidence(result.json);
|
|
expect(evidence.normalized_result).toMatchObject({
|
|
groups: [
|
|
{
|
|
query_parameter_names: [
|
|
{ name: "category", record_ordinals: [0, 1] },
|
|
{ name: "page", record_ordinals: [0] },
|
|
{ name: "sort", record_ordinals: [1] },
|
|
],
|
|
},
|
|
],
|
|
});
|
|
for (const value of ["books", "games", "repeat", "price", "ignored"])
|
|
expect(result.stdout).not.toContain(value);
|
|
},
|
|
);
|
|
|
|
cliTest(
|
|
"projects portable artifact inventory after the original ZIP is removed",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-inventory-view-cli-");
|
|
const archive = join(root, "fixture.zip");
|
|
const writer = new ZipWriter(new Uint8ArrayWriter());
|
|
await writer.add("main.js", new TextReader("console.log('portable');\n"));
|
|
await writeFile(archive, await writer.close());
|
|
const inspected = await cli.run({
|
|
arguments: ["inspect-artifact", archive, "--json"],
|
|
});
|
|
expect(inspected.exitCode).toBe(0);
|
|
const parent = parseEvidence(inspected.json);
|
|
await unlink(archive);
|
|
const request = join(root, "view.json");
|
|
await writeFile(
|
|
request,
|
|
JSON.stringify({
|
|
source: { kind: "inline", evidence: parent },
|
|
view: {
|
|
kind: "inventory",
|
|
collection: "occurrences",
|
|
logical_paths: ["main.js"],
|
|
},
|
|
}),
|
|
);
|
|
const projected = await cli.run({
|
|
arguments: ["inspect-analysis-view", request, "--json"],
|
|
});
|
|
expect(projected.exitCode).toBe(0);
|
|
expect(projected.json).toMatchObject({
|
|
operation: "inspect_analysis_view",
|
|
evidence_links: [parent.evidence_id],
|
|
normalized_result: {
|
|
parent_evidence_id: parent.evidence_id,
|
|
kind: "inventory",
|
|
source_complete: true,
|
|
artifact: { path: archive, sha256: parent.subject?.digest.sha256 },
|
|
items: [expect.objectContaining({ logical_path: "main.js" })],
|
|
coverage: { total: 1, exhausted: true, next_offset: null },
|
|
},
|
|
});
|
|
},
|
|
);
|
|
|
|
cliTest(
|
|
"admits portable captures before parsing and preserves capture caveats",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-inline-capture-cli-");
|
|
const path = join(root, "view.json");
|
|
const environment = {
|
|
HOME: root,
|
|
XDG_CONFIG_HOME: root,
|
|
XDG_CACHE_HOME: root,
|
|
};
|
|
await writeFile(
|
|
path,
|
|
JSON.stringify({
|
|
source: {
|
|
kind: "inline",
|
|
evidence: analysisViewCaptureEvidence(
|
|
analysisViewObjectDenseCapture(),
|
|
),
|
|
},
|
|
view: { kind: "api-surface" },
|
|
}),
|
|
);
|
|
const refused = await cli.run({
|
|
arguments: ["inspect-analysis-view", path, "--json"],
|
|
environment,
|
|
});
|
|
expect(refused.exitCode).toBe(1);
|
|
expect(refused.json).toMatchObject({
|
|
code: "resource_constraint",
|
|
details: { resource: "memory" },
|
|
});
|
|
|
|
const capture = analysisViewCaptureFixture();
|
|
capture.records = capture.records.slice(0, 1);
|
|
capture.total_records = 1;
|
|
const caveat = "Producer omitted exchanges before capture startup.";
|
|
capture.limitations = [caveat, caveat];
|
|
capture.records[0]!.reported = {
|
|
request: { method: "GET", url: "https://api.test/a" },
|
|
response: {
|
|
status: 200,
|
|
content: { mimeType: "\u000btext/plain\u000b" },
|
|
},
|
|
};
|
|
const parent = analysisViewCaptureEvidence(capture);
|
|
expect(parent.limitations).not.toContain(caveat);
|
|
await writeFile(
|
|
path,
|
|
JSON.stringify({
|
|
source: { kind: "inline", evidence: parent },
|
|
view: { kind: "api-surface" },
|
|
}),
|
|
);
|
|
const response = await cli.run({
|
|
arguments: ["inspect-analysis-view", path, "--json"],
|
|
environment,
|
|
});
|
|
expect(response.exitCode, response.stdout).toBe(0);
|
|
const result = parseEvidence(response.json);
|
|
expect(result.limitations.filter((value) => value === caveat)).toEqual([
|
|
caveat,
|
|
]);
|
|
expect(result.normalized_result).toMatchObject({
|
|
groups: [{ content_types: [], flags: ["single-sample"] }],
|
|
limitations: expect.arrayContaining([caveat]),
|
|
unknowns: [
|
|
"Some retained records have unavailable status or content type values.",
|
|
],
|
|
});
|
|
},
|
|
);
|
|
|
|
cliTest(
|
|
"discovers native records from a complete portable bundle using the shared workflow",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-evidence-discovery-cli-");
|
|
const parent = createEvidence(
|
|
{ path: "/fixtures/native.exe", format: "pe", sha256: "a".repeat(64) },
|
|
{ id: "ghidra", name: "Ghidra", version: "12.1.4" },
|
|
{
|
|
operation: "analyze_function",
|
|
parameters: {},
|
|
result: ghidraFunctionDossier(),
|
|
},
|
|
);
|
|
const bundle = createEvidenceBundle([parent]);
|
|
const path = join(root, "evidence.json");
|
|
await writeFile(path, JSON.stringify(bundle));
|
|
const options = {
|
|
detail: "summary" as const,
|
|
filters: { evidence_id: parent.evidence_id },
|
|
};
|
|
const result = await cli.run({
|
|
arguments: [
|
|
"inspect-evidence-bundle",
|
|
JSON.stringify({ path, ...options }),
|
|
"--json",
|
|
],
|
|
environment: { HOME: root, XDG_CONFIG_HOME: root, XDG_CACHE_HOME: root },
|
|
});
|
|
expect(result.exitCode).toBe(0);
|
|
const expected = inspectEvidenceBundle(bundle, options);
|
|
if (!expected.ok) throw expected.error;
|
|
expect(result.json).toEqual(expected.value);
|
|
const complete = await cli.run({
|
|
arguments: [
|
|
"inspect-evidence-bundle",
|
|
JSON.stringify({ path }),
|
|
"--json",
|
|
],
|
|
environment: { HOME: root, XDG_CONFIG_HOME: root, XDG_CACHE_HOME: root },
|
|
});
|
|
expect(complete.exitCode).toBe(0);
|
|
expect(complete.json).toEqual(bundle);
|
|
},
|
|
);
|
|
cliTest(
|
|
"projects one section from a JSON file of inline layout Evidence",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-analysis-view-cli-");
|
|
const parent = analysisViewLayoutEvidence();
|
|
const request = {
|
|
source: { kind: "inline", evidence: parent },
|
|
view: {
|
|
kind: "item",
|
|
collection: "sections",
|
|
selector: { name: ".data" },
|
|
},
|
|
};
|
|
const input = join(root, "view.json");
|
|
await mkdir(root, { recursive: true });
|
|
await writeFile(input, JSON.stringify(request));
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", input, "--json"],
|
|
environment: {
|
|
HOME: root,
|
|
XDG_CONFIG_HOME: root,
|
|
XDG_CACHE_HOME: root,
|
|
},
|
|
});
|
|
expect(result.exitCode).toBe(0);
|
|
expect(result.json).toMatchObject({
|
|
operation: "inspect_analysis_view",
|
|
normalized_result: {
|
|
kind: "item",
|
|
parent_evidence_id: parent.evidence_id,
|
|
item: { name: { display: ".data" } },
|
|
},
|
|
});
|
|
},
|
|
);
|
|
|
|
cliTest(
|
|
"projects native function pseudocode without requiring Ghidra",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-native-view-cli-");
|
|
const parent = createEvidence(
|
|
{ path: "/fixtures/native.exe", format: "pe", sha256: "a".repeat(64) },
|
|
{ id: "ghidra", name: "Ghidra", version: "12.1.4" },
|
|
{
|
|
operation: "analyze_function",
|
|
parameters: { address: "0x401000" },
|
|
result: ghidraFunctionDossier(),
|
|
},
|
|
);
|
|
const input = join(root, "native-view.json");
|
|
await writeFile(
|
|
input,
|
|
JSON.stringify({
|
|
source: { kind: "inline", evidence: parent },
|
|
view: { kind: "native", facet: "pseudocode", offset: 0, limit: 12 },
|
|
}),
|
|
);
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", input, "--json"],
|
|
environment: { HOME: root, XDG_CONFIG_HOME: root, XDG_CACHE_HOME: root },
|
|
});
|
|
expect(result.exitCode).toBe(0);
|
|
expect(result.json).toMatchObject({
|
|
operation: "inspect_analysis_view",
|
|
normalized_result: {
|
|
kind: "native",
|
|
parent_evidence_id: parent.evidence_id,
|
|
procedure_address: "0x401000",
|
|
item: { text: "int fixture_", unit: "utf16-code-units" },
|
|
},
|
|
locations: [
|
|
{ kind: "artifact-path", path: "/fixtures/native.exe" },
|
|
{ kind: "address", address: "0x401000" },
|
|
],
|
|
});
|
|
},
|
|
);
|
|
|
|
cliTest("rejects malformed JSON before projection", async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-analysis-view-cli-bad-");
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", "{", "--json"],
|
|
environment: {
|
|
HOME: root,
|
|
XDG_CONFIG_HOME: root,
|
|
XDG_CACHE_HOME: root,
|
|
},
|
|
});
|
|
expect(result.exitCode).toBe(1);
|
|
expect(result.json).toMatchObject({
|
|
code: "invalid_request",
|
|
category: "invalid_input",
|
|
details: { operation: "inspect-analysis-view" },
|
|
});
|
|
});
|
|
|
|
cliTest("rejects a request that omits source", async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-analysis-view-cli-missing-");
|
|
const input = join(root, "missing-source.json");
|
|
await writeFile(input, JSON.stringify({ view: { kind: "summary" } }));
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", input, "--json"],
|
|
environment: {
|
|
HOME: root,
|
|
XDG_CONFIG_HOME: root,
|
|
XDG_CACHE_HOME: root,
|
|
},
|
|
});
|
|
expect(result.exitCode).toBe(1);
|
|
expect(result.json).toMatchObject({
|
|
code: "invalid_request",
|
|
category: "invalid_input",
|
|
details: { operation: "inspect-analysis-view" },
|
|
});
|
|
});
|
|
|
|
for (const [view, reason] of [
|
|
[{ kind: "unknown-view" }, "invalid_value"],
|
|
[{}, "missing_argument"],
|
|
] as const) {
|
|
cliTest(
|
|
`reports correction details for ${reason} view kind`,
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-view-variant-");
|
|
const input = join(root, "view.json");
|
|
await writeFile(
|
|
input,
|
|
JSON.stringify({
|
|
source: {
|
|
kind: "inline",
|
|
evidence: analysisViewLayoutEvidence(),
|
|
},
|
|
view,
|
|
}),
|
|
);
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", input, "--json"],
|
|
environment: {
|
|
HOME: root,
|
|
XDG_CONFIG_HOME: root,
|
|
XDG_CACHE_HOME: root,
|
|
},
|
|
});
|
|
expect(result.exitCode).toBe(1);
|
|
expect(result.json).toMatchObject({
|
|
code: "invalid_request",
|
|
details: {
|
|
issues: [
|
|
{
|
|
path: ["view", "kind"],
|
|
reason,
|
|
expected: expect.arrayContaining(["summary", "page"]),
|
|
},
|
|
],
|
|
},
|
|
});
|
|
expect(JSON.stringify(result.json)).not.toContain("unknown-view");
|
|
},
|
|
);
|
|
}
|
|
|
|
cliTest(
|
|
"decodes HAR credentials and projects recorded API paths through the compiled workflows",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-surface-cli-");
|
|
const fixture = apiSurfaceHar();
|
|
const entry = fixture.log.entries[0]!;
|
|
const urls = [
|
|
"https://user:password@api.example.test/a/%2e%2e/admin?token=ordinary#fragment",
|
|
"https://api.example.test/admin",
|
|
"https:user:password@api.example.test/path",
|
|
"https:///user:password@api.example.test/path",
|
|
];
|
|
fixture.log.entries.push(
|
|
...urls.map((url) => ({
|
|
...entry,
|
|
request: { ...entry.request, url },
|
|
})),
|
|
);
|
|
const bytes = JSON.stringify(fixture);
|
|
const capturePath = join(root, "capture.har");
|
|
const input = join(root, "view.json");
|
|
const environment = {
|
|
HOME: root,
|
|
XDG_CONFIG_HOME: root,
|
|
XDG_CACHE_HOME: root,
|
|
};
|
|
await writeFile(capturePath, bytes);
|
|
const capture = await cli.run({
|
|
arguments: ["inspect-web-network-capture", capturePath, "har", "--json"],
|
|
environment,
|
|
});
|
|
expect(capture.exitCode, capture.stdout).toBe(0);
|
|
const parent = parseEvidence(capture.json);
|
|
expect(parent.subject?.digest.sha256).toBe(
|
|
createHash("sha256").update(bytes).digest("hex"),
|
|
);
|
|
expect(JSON.stringify(parent)).not.toContain("password");
|
|
await writeFile(
|
|
input,
|
|
JSON.stringify({
|
|
source: { kind: "inline", evidence: parent },
|
|
view: { kind: "api-surface" },
|
|
}),
|
|
);
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", input, "--json"],
|
|
environment,
|
|
});
|
|
expect(result.exitCode, result.stdout).toBe(0);
|
|
expect(result.json).toMatchObject({
|
|
confidence: "inferred",
|
|
evidence_links: [parent.evidence_id],
|
|
normalized_result: {
|
|
kind: "api-surface",
|
|
records: { examined: 17, total: 17, excluded: 2 },
|
|
coverage: { total: 14, exhausted: true },
|
|
groups: expect.arrayContaining([
|
|
expect.objectContaining({
|
|
path_template: "/a/%2e%2e/admin",
|
|
record_ordinals: [13],
|
|
}),
|
|
expect.objectContaining({
|
|
path_template: "/admin",
|
|
record_ordinals: [14],
|
|
}),
|
|
]),
|
|
excluded_records: [
|
|
{ ordinal: 15, reason: "url-redacted" },
|
|
{ ordinal: 16, reason: "url-redacted" },
|
|
],
|
|
},
|
|
});
|
|
expect(JSON.stringify(result.json)).not.toContain("password");
|
|
expect(JSON.stringify(result.json)).not.toContain("ordinary");
|
|
},
|
|
);
|
|
|
|
cliTest(
|
|
"projects an environment manifest from an Evidence file through the compiled CLI",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-evidence-file-cli-");
|
|
const capturePath = join(root, "capture.json");
|
|
const parent = analysisViewCaptureEvidence(
|
|
environmentManifestCaptureFixture(),
|
|
);
|
|
await writeFile(capturePath, JSON.stringify(parent));
|
|
const requestPath = join(root, "view.json");
|
|
const view = {
|
|
kind: "environment-manifest",
|
|
template_rules: ["opaque-token", "sibling-pair-variance"],
|
|
} as const;
|
|
await writeFile(
|
|
requestPath,
|
|
JSON.stringify({
|
|
source: { kind: "evidence-file", path: capturePath },
|
|
view,
|
|
}),
|
|
);
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", requestPath, "--json"],
|
|
});
|
|
expect(result.exitCode, result.stdout).toBe(0);
|
|
const evidence = parseEvidence(result.json);
|
|
expect(evidence.parameters).toMatchObject({
|
|
parent_evidence_id: parent.evidence_id,
|
|
});
|
|
// The file source projects exactly what the same Evidence projects inline.
|
|
const inline = inspectAnalysisView({
|
|
source: { kind: "inline", evidence: parent },
|
|
view,
|
|
});
|
|
if (!inline.ok) throw inline.error;
|
|
expect(evidence.normalized_result).toEqual(inline.value.normalized_result);
|
|
expect(evidence.normalized_result).toMatchObject({
|
|
kind: "environment-manifest",
|
|
origin: "http://grafana.example",
|
|
});
|
|
},
|
|
);
|
|
|
|
cliTest(
|
|
"projects an environment manifest through the compiled CLI without recorded values",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-environment-manifest-cli-");
|
|
const path = join(root, "view.json");
|
|
await writeFile(
|
|
path,
|
|
JSON.stringify({
|
|
source: {
|
|
kind: "inline",
|
|
evidence: analysisViewCaptureEvidence(
|
|
environmentManifestCaptureFixture(),
|
|
),
|
|
},
|
|
view: {
|
|
kind: "environment-manifest",
|
|
template_rules: [
|
|
"after-uid-literal",
|
|
"opaque-token",
|
|
"sibling-variance",
|
|
],
|
|
},
|
|
}),
|
|
);
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", path, "--json"],
|
|
});
|
|
expect(result.exitCode, result.stdout).toBe(0);
|
|
const evidence = parseEvidence(result.json);
|
|
expect(evidence.confidence).toBe("inferred");
|
|
expect(evidence.normalized_result).toMatchObject({
|
|
kind: "environment-manifest",
|
|
origin: "http://grafana.example",
|
|
name: "grafana-example",
|
|
coverage: { total: 19, exhausted: true },
|
|
excluded: expect.arrayContaining([
|
|
expect.objectContaining({ reason: "other-origin" }),
|
|
]),
|
|
});
|
|
for (const template of [
|
|
"/api/dashboards/uid/{uid}",
|
|
"/api/folders/{uid}",
|
|
"/api/plugins/{plugin_id}/settings",
|
|
"/api/datasources/uid/{uid}/health",
|
|
])
|
|
expect(result.stdout).toContain(JSON.stringify(template));
|
|
for (const value of ["probe folder", "Main Org", "JFIF", "console.log"])
|
|
expect(result.stdout).not.toContain(value);
|
|
await writeFile(
|
|
path,
|
|
JSON.stringify({
|
|
source: {
|
|
kind: "inline",
|
|
evidence: analysisViewCaptureEvidence(
|
|
analysisViewObjectDenseCapture(),
|
|
),
|
|
},
|
|
view: { kind: "environment-manifest" },
|
|
}),
|
|
);
|
|
const refused = await cli.run({
|
|
arguments: ["inspect-analysis-view", path, "--json"],
|
|
});
|
|
expect(refused.exitCode).toBe(1);
|
|
expect(refused.json).toMatchObject({
|
|
code: "resource_constraint",
|
|
details: { resource: "memory" },
|
|
});
|
|
},
|
|
);
|
|
|
|
cliTest(
|
|
"extracts an environment state through the compiled CLI with recorded values",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-environment-state-cli-");
|
|
const path = join(root, "view.json");
|
|
await writeFile(
|
|
path,
|
|
JSON.stringify({
|
|
source: {
|
|
kind: "inline",
|
|
evidence: analysisViewCaptureEvidence(
|
|
environmentStateCaptureFixture(),
|
|
),
|
|
},
|
|
view: {
|
|
kind: "environment-state",
|
|
template_rules: [
|
|
"after-uid-literal",
|
|
"opaque-token",
|
|
"sibling-variance",
|
|
],
|
|
},
|
|
}),
|
|
);
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", path, "--json"],
|
|
});
|
|
expect(result.exitCode, result.stdout).toBe(0);
|
|
const evidence = parseEvidence(result.json);
|
|
expect(evidence.confidence).toBe("inferred");
|
|
expect(evidence.normalized_result).toMatchObject({
|
|
kind: "environment-state",
|
|
origin: "http://grafana.example",
|
|
timeline: "recorded-start-time",
|
|
types: expect.arrayContaining([
|
|
expect.objectContaining({
|
|
collection_template: "/api/folders",
|
|
id_field: "uid",
|
|
}),
|
|
]),
|
|
});
|
|
for (const value of ["probe folder", "probe@example.test"])
|
|
expect(result.stdout).toContain(value);
|
|
},
|
|
);
|
|
|
|
cliTest(
|
|
"decodes a Grafana-shaped HAR and projects its environment manifest through the compiled workflows",
|
|
async ({ cli }) => {
|
|
const root = await createTestTempDirectory("rea-manifest-chain-cli-");
|
|
const capturePath = join(root, "capture.har");
|
|
await writeFile(capturePath, JSON.stringify(environmentManifestHar()));
|
|
const capture = await cli.run({
|
|
arguments: ["inspect-web-network-capture", capturePath, "har", "--json"],
|
|
});
|
|
expect(capture.exitCode, capture.stdout).toBe(0);
|
|
const parent = parseEvidence(capture.json);
|
|
const input = join(root, "manifest.json");
|
|
await writeFile(
|
|
input,
|
|
JSON.stringify({
|
|
source: { kind: "inline", evidence: parent },
|
|
view: { kind: "environment-manifest" },
|
|
}),
|
|
);
|
|
const result = await cli.run({
|
|
arguments: ["inspect-analysis-view", input, "--json"],
|
|
});
|
|
expect(result.exitCode, result.stdout).toBe(0);
|
|
expect(result.json).toMatchObject({
|
|
confidence: "inferred",
|
|
evidence_links: [parent.evidence_id],
|
|
normalized_result: {
|
|
kind: "environment-manifest",
|
|
name: "grafana-example",
|
|
templated_groups: 6,
|
|
coverage: { total: 22, exhausted: true },
|
|
artifact: { path: capturePath, sha256: parent.subject?.digest.sha256 },
|
|
records: expect.arrayContaining([
|
|
{
|
|
ordinal: 3,
|
|
method: "GET",
|
|
path: "/api/org",
|
|
status: 200,
|
|
content_type: "application/json",
|
|
},
|
|
]),
|
|
unknowns: [
|
|
expect.objectContaining({ kind: "authorization-model" }),
|
|
expect.objectContaining({ kind: "response-semantics" }),
|
|
expect.objectContaining({ kind: "state-transition" }),
|
|
],
|
|
},
|
|
});
|
|
expect(JSON.stringify(result.json)).not.toContain("probe folder");
|
|
},
|
|
);
|