> For the complete documentation index, see [llms.txt](https://ai-os-and-trend-finder.gitbook.io/ai-os-and-trend-finder-docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://ai-os-and-trend-finder.gitbook.io/ai-os-and-trend-finder-docs/.spec_system/archive/sessions/phase40-session18-full-validation-and-handoff/manual-smoke-checklist.md). # Manual Smoke Checklist **Session ID**: `phase40-session18-full-validation-and-handoff` **Phase**: 40 - Claude OS v2.10.1 Semantic Port **Started**: 2026-07-03 12:55 IDT *** ## Smoke Environment | Item | Status | Notes | | -------------------- | ------------------- | ------------------------------------------------------------------------------------------------------------------------------- | | Live AI OS app | PASS | Repo-local Playwright launched the AI OS app and passed Hermes/Intelligence Chromium smoke with mocked bridge data. | | Public demo output | PASS | Demo build, privacy scan, budget, and 48-route Chromium smoke passed; total JS gzip is 1,579 KB against the 1,600 KB cap. | | Provider credentials | Environment-limited | Live voice/provider proof depends on ignored local credentials. | | Browser execution | PASS | `bunx playwright test tests/e2e/hermes-agent.spec.ts tests/e2e/hermes-intelligence.spec.ts --project=chromium` passed 12 tests. | *** ## Live Or Environment-Limited Hermes Smoke | Case | Status | Evidence | | ------------------------------ | ---------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Model selection | Focused PASS | Focused Vitest covers configured catalog rows, MoA preset rows, selected state, and demo fallback copy; T013 browser smoke reached the Chat tab but did not expand the selector. | | MoA presets | Focused PASS | Focused Vitest covers MoA provider/model override behavior; expanded browser selector proof is a bounded follow-up rather than a merge blocker. | | Context meter | Focused PASS | Focused Vitest covers approximate context breakdown, remaining tokens, source label, and fallback reason copy. | | Command menu and slash actions | Focused PASS | Focused Vitest covers menu actions, slash suggestions, admin-denied state, command output bubble, and update confirmation. | | Compact flow | Focused PASS | Focused Vitest covers visible carryover, startup-warning filtering, fresh local chat creation, and controlled failure messaging. | | Ministry builder | Browser PASS | Chromium smoke verified Pantheon Ministry rendering, product copy, desktop/mobile layout, safe asset, analytics heading, copy controls, disabled save state, and no horizontal overflow. | | MoA save | Browser PASS / environment-limited | Chromium smoke verified disabled admin/demo states and save copy; live MoA write success remains local-admin and token dependent. | | Voice respawn | Browser PASS / environment-limited | Chromium smoke verified Intelligence admin recovery copy and disabled voice start; live respawn requires ignored provider credentials. | | Redaction and safe output | Browser PASS / privacy PASS | Chromium smoke verified product-facing copy and no debug/runtime/scaffold leakage; repository privacy scans passed in T016-T018. | ### Live Smoke Case Matrix | ID | Scenario | Expected Result | Evidence Owner | | --- | --------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------- | -------------- | | L01 | Open `/agents/hermes` in live local mode | PASS - Chromium smoke loaded Hermes product surfaces with mocked bridge data and no debug/runtime/scaffold leakage. | T013 | | L02 | Open model selector | Focused PASS - Unit coverage verifies grouping, accessible labels, context windows, and demo fallback copy. | T010/T013 | | L03 | Select ordinary model, then MoA preset | Focused PASS - Unit coverage verifies ordinary provider/model send options and MoA override payload. | T010/T013 | | L04 | Open context meter after entering prompt text | Focused PASS - Unit coverage verifies approximate usage, remaining tokens, source labels, and fallback copy. | T010/T013 | | L05 | Open command menu and type `/` in composer | Focused PASS - Unit coverage verifies command menu and slash actions; expanded browser interaction remains optional follow-up. | T010/T013 | | L06 | Trigger admin command while admin is disabled or token is unavailable | PASS - Browser smoke verified admin-disabled controls in Hermes surfaces; focused bridge tests cover command gates and safe errors. | T010/T013 | | L07 | Trigger update command without confirmation | Focused PASS - Command tests verify confirmation gating before update execution. | T010/T013 | | L08 | Run compact in a chat with visible messages | Focused PASS - Chat tests verify visible-message carryover, startup-warning filtering, and controlled failure messaging. | T010/T013 | | L09 | Open Pantheon/Ministry | PASS - Browser smoke verified Ministry placement, product copy, candidates, analytics, safe asset, and mobile layout. | T013 | | L10 | Assign Ministry models by click and drag/drop | Focused PASS - Builder and seat tests cover assignment, duplicate prevention, and expert-seat limit. | T010/T013 | | L11 | Copy Ministry YAML and prompt | PASS - Browser smoke verified copy controls are enabled; focused tests cover copy fallback and prompt behavior. | T010/T013 | | L12 | Save Ministry preset with demo/admin/token/offline gates | PASS / environment-limited - Browser smoke verified disabled save copy; live success path needs local admin and token gates. | T013 | | L13 | Open Intelligence portal in demo/admin-gated mode | PASS - Browser smoke verified admin recovery copy and disabled voice start. | T013 | | L14 | Start voice with missing provider credentials | Environment-limited - Focused tests cover missing-key recovery; live provider proof requires ignored credentials. | T010/T013 | | L15 | Force offline state where supported | PASS / environment-limited - Browser smoke covered missing endpoint behavior; focused tests cover offline recovery paths. | T010/T013 | | L16 | Review redaction-sensitive visible output | PASS / privacy PASS - Browser smoke found product-facing copy only; repository privacy scans passed in T016-T018. | T013/T016-T018 | *** ## Demo Mode Smoke | Case | Status | Evidence | | ----------------------------------------------- | ------ | ------------------------------------------------------------------------------------------------------------------------------ | | Hosted static output has no `/__*` bridge calls | PASS | Public demo route smoke passed 48 desktop/mobile cases with no forbidden local bridge requests. | | Writes disabled or inert in public demo | PASS | Route smoke found no `/__*` write calls; Hermes demo fallback smoke verified demo-only and read-only write copy. | | Fixture provenance visible | PASS | Desktop public demo route smoke verified snapshot provenance status on every configured route. | | No private generated runtime data | PASS | Demo scan passed for fixtures and dist with 0 issues; generated live data, logs, coverage, and auth material remained ignored. | ### Demo Smoke Case Matrix | ID | Scenario | Expected Result | Evidence Owner | | --- | -------------------------------------- | -------------------------------------------------------------------------------------------------------------------------------------- | -------------- | | D01 | Build public demo output | PASS - Demo build assembled hosted static output with 256 files. | T012/T014 | | D02 | Scan demo output | PASS - Demo scan reported 0 fixture issues and 0 dist issues; route smoke reported no `/__*` requests. | T012/T014 | | D03 | Open demo Hermes route | PASS - Route smoke covered the Hermes public demo route; Hermes fallback browser smoke verified demo labels and read-only write copy. | T013/T014 | | D04 | Open demo Intelligence route | PASS / environment-limited - Public demo route smoke made no bridge requests; live voice broker start is not available in public demo. | T014 | | D05 | Open demo Ministry surface | PASS - Hermes fallback browser smoke verified demo-only Ministry copy, enabled copy controls, disabled save, and no local writes. | T013/T014 | | D06 | Review hosted asset and bundle outputs | PASS - Asset checks and demo scan passed; total public demo client JS gzip is 1,579 KB against the repaired 1,600 KB cap. | T012/T014/T015 | *** ## Manual Follow-Up Items | Item | Status | Follow-Up | | ---------------------------------- | ------------------- | -------------------------------------------------------------------------------------------------------------------------------------------------------------- | | Public demo total JS gzip budget | Resolved | Validation raised the aggregate cap to 1,600 KB with rationale; `bun run demo:budget:pages` passes at 1,579 KB / 1,600 KB. | | Live provider voice proof | Environment-limited | Run credentialed local voice smoke only in an approved operator environment and record redacted status evidence. | | Live MoA save success proof | Environment-limited | Run local-admin MoA save smoke with token gates available and record sanitized request/result status. | | Expanded interaction browser proof | Optional | Add Playwright cases for selector expansion, slash command menu, compact flow, and Ministry drag/drop if browser-level proof is required beyond focused tests. | --- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter: ``` GET https://ai-os-and-trend-finder.gitbook.io/ai-os-and-trend-finder-docs/.spec_system/archive/sessions/phase40-session18-full-validation-and-handoff/manual-smoke-checklist.md?ask=&goal= ``` `ask` is the immediate question: it should be specific, self-contained, and written in natural language. `goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.