Files
Linux_post_install/tests/README.md
T
Your Name 9ef42c5fd1
gates / consistency-and-conventions (push) Successful in 27s
fix: pos ai — honor legacy AI_API_KEY as fallback (provider key stays primary)
Architect decision C on the API-key contract mismatch: docs claimed
AI_API_KEY was the required primary key, but resolve_key() only read
provider-specific keys (7ae2e77 removed shared-key priority to fix
cross-provider leakage; docs never updated).

- bin/pos-ai resolve_key(): provider key wins, legacy AI_API_KEY honored
  read-only when the provider's own key is empty, llamacpp unchanged;
  cmd_providers() configured check mirrors the same set
- require_key() error messages byte-stable (test-locked)
- AI_API_KEY NOT re-added to the # POS_CONFIG:/# PROVIDER_CONFIG: registry
- Docs reworded: POS.md rows 91/96/98 + precedence sentence, howto/ai.md
  first-run hints, HOWTO.md row, AGENT_Context prose (2 spots), config/ai.env
  legacy comment
- New regression tests/t-ai-key-resolution.sh: 24 checks / 10 cases
  (provider-key-only, AI_API_KEY-only, both -> provider wins, env-wins,
  llamacpp no-key, missing-key message, providers configured status)

Verified: suite 19 files / 440 checks / 0 fail / 0 skip; make gen
byte-idempotent; make check OK; make lint 0 FAIL, 0 WARN; bash -n clean;
git diff --check clean; Reviewer APPROVE_WITH_NOTES (mutation disproof:
inverted precedence -> C3/C6 fail)
2026-09-07 13:32:42 -04:00

3.1 KiB

tests/ — regression test suite

Zero-dependency Bash regression tests for the Linux_post_install repository.

Run

make test          # discover tests/t-*.sh, run everything
./tests/run-tests.sh                     # same
./tests/run-tests.sh t-telegram-auth.sh  # run one file

Exit code is non-zero if any check failed. The suite is designed to be deterministic: tests stub every external dependency they touch (curl, gpg, sudo, systemctl, llama-server, nvidia-smi…) and run against sandbox temp dirs. No network, no sudo, no system changes.

Adding a test

  1. Create tests/t-<what>.sh with a run_test() function. set -euo pipefail is already active (the runner re-asserts it); $ROOT is the repo root, $TEST_TMP a per-test temp dir that is cleaned automatically.
  2. Use the helpers in tests/test-lib.sh for every assertion: check, check_eq, check_rc, check_contains, check_not_contains, check_file_exists, check_file_absent, test_run / test_run_env, mksandbox, tracked_tree_copy, count_token.
  3. If a case cannot run in the current environment (missing binary, missing analyzer), call skip_case "<desc>" "<reason>" — never fake a pass and never silently return.
  4. Keep total suite runtime under 90 seconds.

Skip contract (hard)

A test that cannot run must say [SKIP] reason. The runner counts skips in the summary and a file whose run_test() produced zero checks and zero skips is reported as FAIL ("no assertions") — a broken harness can never pass silently.

Suite contents

File What it verifies
t-ai-server-flags.sh pos-ai-server ExecStart flag set: defaults, CLI, config, dedupe, one-token-per-flag
t-ai-hf-download.sh pos ai hf download success + failure honesty (no .hf-meta on partial failure, rc != 0)
t-ai-key-resolution.sh pos ai API-key contract: provider key > legacy AI_API_KEY fallback > error; leakage guard, env-wins, providers status sync
t-ai-llama-detect.sh pos ai-server status version detection, "unknown", missing-binary failure
t-unsupported-flags.sh unsupported-option handling: CLI/config/env hard errors, dropped defaults, word-boundary match
t-systemd-unit.sh generated unit: one ExecStart, quoted paths, systemd-analyze verify
t-telegram-auth.sh Telegram listener chat+owner gate and owner-unset fail-closed
t-matrix-auth.sh Matrix listener room+owner gate and room-unset fail-closed
t-gpg-password.sh backup passphrase on fd 3 (never argv), plaintext/corrupt cleanup
t-config-precedence.sh load_env_file contract + CLI > env > file > defaults across tools
t-uninstall-manifest.sh install.sh ↔ POS_LIBS symmetry, user-unit discovery, marker-driven plugin removal
t-gen-docs-drift.sh make gen idempotence on a pristine tracked tree (CI drift gate)
t-lint-gate.sh make lint green on the real tree; planted violations are caught and named
t-share-mountpoint.sh share-client ask_mountpoint UX: existing/new/declined/rejected paths, confirm gate, mkdir side effects, non-TTY stdin contract, static nt guards