Files

T

gates / consistency-and-conventions (push) Successful in 2m14s

Details

feat: pos media grab — smart URL classifier for auto-download

New tool that classifies URLs by domain and delegates to pos media mp3
(audio) or pos media mp4 (video). Listener gains URL detection step
between prefix map and AI bridge — bare URLs auto-download.

Domain rules: music.youtube.com/soundcloud/bandcamp → mp3,
youtube/vimeo/twitch → mp4 --best, unknown → configurable default.

28 test cases / 70 assertions / 0 failed.
make gen && make check green, make lint 0 FAIL / 0 WARN.

2026-09-04 10:48:49 -04:00

45 KiB

Raw Blame History

AGENT Context — Linux_post_install Project

Purpose: Single-source context document so any AI agent can understand the project, navigate the codebase, and make correct contributions.

Document Map

Auto-generated section index (line ranges). Run make gen to refresh.

| ## 1. Project Overview | 28–43 | | ## 2. Directory Structure | 44–205 | | ## 3. Installation Flow | 206–259 | | ## 4. The pos CLI System | 260–338 | | ## 5. Shared Library — lib/common.sh | 339–370 | | ## 6. Docker Compose / ScaleTail | 371–413 | | ## 7. Optional Apps (apps/) | 414–443 | | ## 8. Entertainment Module | 444–457 | | ## 9. Systemd Services | 458–469 | | ## 10. Configuration Files | 470–496 | | ## 11. Coding Conventions | 497–529 | | ## 12. Development Workflow | 530–582 | | ## 13. Key File Quick Reference | 583–655 | | ## 14. Common Tasks for Agents | 656–689 |

1. Project Overview

Linux_post_install is a personal bootstrap and homelab toolkit for Debian/Ubuntu. One command turns a bare install into a fully productive machine:

Automated system package installation (25+ packages)
A unified CLI (pos) for network, Docker, media, system, and SSH tasks
Optional desktop application installers (15 apps)
Docker Compose service management via ScaleTail templates (119+ self-hosted services with Tailscale sidecar)
Systemd service management for boot-time automation

Repository: https://gitea.skink-platy.ts.net/admin/Linux_post_install Target OS: Debian / Ubuntu (uses apt) Shell: Bash (#!/usr/bin/env bash)

2. Directory Structure

Linux_post_install/
├── install.sh              # Main orchestrator — entry point
├── preinstall.sh           # Phase 1: system packages via apt + yt-dlp
├── postinstall.sh          # Phase 3: PATH, bash completion, systemd services
│
├── lib/
│   ├── common.sh           # Shared library (colors, logging, spinner, timer, run, load_system_env)
│   ├── flags.sh            # Feature flag store (flag_set/clear/is_set/value/list/status)
│   ├── notify.sh           # Multi-platform alerting (notify_send) — sourced opt-in, silent-fails
│   ├── entertainment-lib.sh # Entertainment module lib (ENABLED list, last-run state, scheduler sync)
│   ├── entertainment-plugin-lib.sh # Message-safe helpers for plugins (config load, require, fetch+retry)
│   ├── scheduler-lib.sh    # System scheduler lib (job parsing, notify policies, per-job user timers)
│   └── user-timers-lib.sh  # Shared systemd **user** timer machinery (interval→OnCalendar, unit pair, linger)
│
├── bin/                    # CLI tools — installed to /usr/local/bin/
│   ├── pos                 # Main dispatcher — smart arg matching to pos-* scripts
<!-- GEN:START tree -->
│   ├── pos-ai-alias                        # manage AI agent aliases
│   ├── pos-ai-gemini                       # Forward to pos ai --provider gemini (backward compat)
│   ├── pos-ai-openrouter                   # Forward to pos ai --provider openrouter (backward compat)
│   ├── pos-communication-matrix-listener   # Matrix listener: map /command → bash, run them on room messages
│   ├── pos-communication-matrix-sender     # Send messages to a Matrix room via the client-server API (send, test, login)
│   ├── pos-communication-scrcpy            # Mirror/control an Android device via scrcpy+adb (mirror, devices, record, tcpip, connect, push, pull, screenshot, info)
│   ├── pos-communication-telegram-listener # Telegram bot listener: map /command → bash and <prefix> → app, run them on chat messages
│   ├── pos-communication-telegram-sender   # Send Telegram messages/files/links/stickers via Bot API (send, test)
│   ├── pos-docker-compose                  # Docker Compose service manager (ls/up/down/restart/logs/update/config)
│   ├── pos-docker-health                   # One-glance container health dashboard (exits 1 if unhealthy)
│   ├── pos-docker-ps                       # Enhanced container overview (health, IPs, ports, uptime)
│   │   [deps: docker]
│   ├── pos-docker-stack                    # Containers grouped by compose stack (project); standalone group; -a/--all includes stopped
│   ├── pos-docker-vbox                     # Disposable Docker-based VMs (create/enter/start/stop/rm/ls)
│   ├── pos-entertainment-config            # Show or edit the entertainment config (ENABLED auto-trigger list, weather location)
│   ├── pos-entertainment-disable           # Disable a plugin's auto-trigger (remove it from ENABLED)
│   ├── pos-entertainment-enable            # Enable an auto-trigger for a plugin on a schedule
│   ├── pos-entertainment-send              # Run a public-API plugin and send its output via the configured notify platforms
│   ├── pos-entertainment-status            # Show enabled plugins and scheduler state
│   ├── pos-media-grab                      # Auto-download URL as audio or video (classify + route)
│   ├── pos-media-mp3                       # Download audio as MP3 (yt-dlp)
│   ├── pos-media-mp4                       # Download video as MP4 (smart/interactive format select)
│   ├── pos-media-sync                      # Incremental Music → USB sync (mp3/mp4, add/update only)
│   │   [deps: lsblk jq]
│   ├── pos-media-ytsync                    # Incrementally sync YouTube channels/playlists into ~/Videos
│   ├── pos-network-checkport               # Check TCP/UDP port reachability (nmap, or bash/nc fallback) + local interface view
│   ├── pos-network-download                # aria2 RPC daemon + queue control (add/torrent/metalink, watch, limits)
│   │   [deps: aria2c jq curl]
│   ├── pos-network-hotspot                 # Wi-Fi hotspot via create_ap + wihotspot-gui
│   ├── pos-network-ip                      # Show interfaces, routes, public IP + location
│   ├── pos-network-scan                    # Parallel ping sweep of CIDR
│   ├── pos-share-nfs-client                # Mount NFS shares (ephemeral or persistent systemd mount units)
│   ├── pos-share-nfs-server                # Manage the NFS kernel server (status, share/unshare exports, enable/disable)
│   ├── pos-share-smb-client                # Mount SMB/CIFS shares (ephemeral or persistent systemd mount units)
│   ├── pos-share-smb-server                # Manage the Samba server (status, share/unshare exports, users, enable/disable)
│   ├── pos-share-usb-server                # USB Redirector server control (--ls, --share; prompts when args omitted)
│   ├── pos-ssh-load-keys                   # Load all SSH keys into the agent
│   ├── pos-system-backup                   # Encrypted (AES-256) folder snapshots (tar + gpg)
│   │   [deps: tar]
│   ├── pos-system-firewall                 # Interactive UFW management
│   ├── pos-system-health                   # Host health dashboard (disk, RAM, services, backup age, fail2ban, docker); exit 1 if any FAIL
│   ├── pos-system-schedule                 # Scheduled jobs: run a command on a timer; notify on threshold/change/error/always or silently
│   ├── pos-system-uninstall                # Remove pos toolkit binaries, services, shell integration, config, and data
│   ├── pos-ai                              # AI assistant: ask, chat, sessions, capture, models, providers
│   ├── pos-config                          # Interactive editor for the tools' runtime config (reads # POS_CONFIG: registry)
│   ├── pos-tree                            # Show the pos CLI command tree: categories, commands, and subcommands
<!-- GEN:END tree -->
│   ├── flag-reader         # Inspect feature flags (list/status/--raw)
│   ├── flag-set            # Set a feature flag (optionally with a value)
│   ├── flag-clear          # Unset a feature flag
│   ├── wr-*                # Legacy wrappers → pos (backward compat)
│   ├── mp3, mp4, vbox      # Legacy convenience wrappers → pos
│   └── ssh-load-all        # Legacy wrapper → pos ssh load-keys
│
├── features/               # User-customizable scripts (installed via --feature)
│   ├── autostart.sh        # Boot-time script (via systemd, flag-gated)
│   └── usb-automount.sh    # USB automount (udev rule + flag-gated service)
│
├── entertainment/          # Public-API plugins for pos entertainment send (→ /usr/local/bin)
│   ├── weather.sh          # Current weather via Open-Meteo (no API key)
│   ├── joke.sh             # Random dad joke via icanhazdadjoke (no API key)
│   └── gold.sh             # Gold spot (XAU/USD) via goldprice.dev (no API key)
│
├── templates/              # Dev-only scaffolds — NOT installed by install.sh
│   ├── pos-tool.sh         # New `pos` CLI tool (→ bin/pos-<cat>-<cmd>)
│   ├── app.sh              # New optional app installer (→ apps/<cat>/<name>.sh)
│   └── feature.sh          # New feature script (→ features/<name>.sh)
│
├── x64_bin/                # Precompiled binaries, copied to /usr/local/bin on x86_64
│   ├── create_ap           # Wi-Fi AP CLI (bash script)
│   ├── wihotspot           # Wrapper → wihotspot-gui
│   └── wihotspot-gui       # GTK3 hotspot GUI (x86-64 ELF)
│                           # future: arm64_bin/ picked up automatically on aarch64
│
├── apps/                   # Optional desktop app installers (by category)
│   ├── install.sh          # Interactive picker / orchestrator
│   ├── browsers/
│   │   └── brave.sh       # Brave Browser (APT repo)
│   ├── development/
│   │   ├── opencode.sh    # opencode AI agent (official script)
│   │   └── vscode.sh      # VS Code (Microsoft APT repo)
│   ├── media/
│   │   ├── obs.sh         # OBS Studio (apt)
│   │   ├── scrcpy.sh      # scrcpy Android mirror (GitHub release)
│   │   └── vlc.sh         # VLC media player (apt)
│   ├── networking/
│   │   ├── netbird.sh     # NetBird VPN (official script)
│   │   ├── tailscale.sh   # Tailscale VPN (official script)
│   │   └── zerotier.sh    # ZeroTier VPN (official script)
│   ├── remote-access/
│   │   ├── termius.sh     # Termius SSH client (.deb)
│   │   └── vnc-viewer.sh  # TigerVNC Viewer (apt)
│   ├── system/
│   │   ├── docker.sh      # Docker Engine (get.docker.com)
│   │   └── qemu.sh        # QEMU + libvirt + KVM (apt)
│   └── utilities/
│       ├── affine.sh      # AFFiNE knowledge base (AppImage)
│       ├── btop.sh        # btop resource monitor (apt)
│       ├── localsend.sh   # LocalSend (flatpak)
│       └── tsui.sh        # Tailscale config TUI (official install script)
│
├── completions/
│   └── pos.bash            # Bash tab-completion for the pos CLI
│
├── config/
│   ├── authorized_keys     # SSH public keys (gitignored)
│   ├── entertainment.env   # Weather location template (auto-installed by postinstall)
│   └── ai.env              # Gemini API key + model template (auto-installed by postinstall)
│
├── compose/
│   └── scale-tail/         # Git submodule → ScaleTail templates (119+ services)
│
├── systemd/
│   ├── autostart.service   # Runs autostart.sh on boot
│   ├── ssh-agent.service   # System-wide SSH agent socket
│   └── usb-automount.service # Auto-mounts USB sticks (usb-automount feature)
│
├── scripts/                # Dev tooling
│   ├── gen-docs.sh         # Regenerates code-derived doc sections + completion flags
│   ├── check-sync.sh       # `make check` gate (syntax, exec bits, doc/code sync, smoke)
│   └── install-hooks.sh    # Installs the opt-in pre-commit hook (`make hook`)
│
├── README.md               # User-facing intro + quick start (links into DOC/)
│
├── DOC/                    # All documentation
│   ├── README.md           # Docs index
│   ├── SCRIPTS.md          # Installer scripts, libs, features — reference
│   ├── POS.md              # pos CLI reference
│   ├── APPS.md             # Optional apps reference
│   ├── SYSTEMD.md          # Systemd units + completion
│   ├── DEV.md              # Developer guide
│   ├── HOWTO.md            # Hands-on guides index (per-category tutorials)
│   ├── howto/              # Per-category tutorials (network, docker, media, system, ssh, share, communication, entertainment)
│   ├── AGENT_Context_Project.md  # This file — AI agent context
│   └── algorithm.md        # Algorithm diagrams
│
├── .gitignore              # Excludes secrets, Python artifacts, OS files
└── .gitmodules             # Submodule: compose/scale-tail → ScaleTail

3. Installation Flow

User runs: ./install.sh [--apps|--full|--feature|--dry-run|--skip <phase>|--steps <spec>]
│
├─ Phase 1: preinstall.sh        (requires root)
│   └─ apt update + installs 25+ packages + yt-dlp + fail2ban
│
├─ Phase 2: install.sh           (requires root)
│   └─ Copies bin/* → /usr/local/bin/ (chmod 755)
│   └─ Copies lib/*.sh (common, flags, notify, registry, entertainment-lib,
│      scheduler-lib, config-ui, user-timers-lib, entertainment-plugin-lib,
│      usb-lib, share-lib, menu-lib) → /usr/local/bin/ (chmod 644)
│   └─ Copies x64_bin/* → /usr/local/bin/ on x86_64 (arm64_bin/ on aarch64)
│   └─ [if --feature] Copies features/* → /usr/local/bin/ (asks before overwriting),
│                      then sets the matching feature flag
│
├─ Phase 3: postinstall.sh       (runs as user)
│   └─ Configures fail2ban (SSH jail: 5 retries, 1h ban)
│   └─ PATH export in ~/.bashrc
│   └─ Bash completion for pos CLI
│   └─ Copies systemd/*.service + systemd/*.timer → /etc/systemd/system/, enables them
│      (autostart.service and usb-automount.service only when their feature flags are set)
│
├─ Phase 4: ScaleTail clone
│   └─ Shallow-clones ScaleTail templates to /usr/local/share/linux_post_install/scale-tail
│
└─ [if --apps or --full]: apps/install.sh
    └─ Interactive picker (or --all for non-interactive)

After install, the repo can be deleted — all tools live in /usr/local/bin/ and templates in /usr/local/share/linux_post_install/.

install.sh Flags

Flag	Purpose
`--apps`	Run interactive app picker after core install
`--full`	Core install + all apps (non-interactive)
`--feature`	Install `features/` scripts to `/usr/local/bin/` (asks before overwriting), set their flags
`--dry-run`	Preview without executing
`--skip <phase>`	Skip a phase (repeatable): `preinstall`, `scripts`, `postinstall`, `scalepoint`, `apps`
`--steps <spec>`	Run only specific phases. Format: `1,3,4` or `1-3`
`--no-color`	Disable colored output

pos Output Logging

All non-interactive pos commands log output to ~/.local/share/linux_post_install/logs/:

Per-command files: YYYYMMDD_HHMMSS_pos_<cmd>.log (full stdout+stderr)
Main log: pos.log (command + timestamp + exit code for every invocation)
Interactive commands (system-firewall, media-mp4) only log invocation, not output

4. The `pos` CLI System

How It Works

bin/pos is the main dispatcher. It:

Scans its own directory for all executable pos-* files
Extracts category-subcommand names from filenames
Uses variable-length argument matching to find the right script

Example: pos docker compose up jellyfin

Tries pos-docker-compose-up-jellyfin (not found)
Tries pos-docker-compose-up (not found)
Finds pos-docker-compose (runs with args up jellyfin)

Available Commands

Category	Command	Script	Description	Deps	Examples
ai	alias	`pos-ai-alias`	manage AI agent aliases
ai	gemini	`pos-ai-gemini`	Forward to pos ai --provider gemini (backward compat)
ai	openrouter	`pos-ai-openrouter`	Forward to pos ai --provider openrouter (backward compat)
communication	matrix-listener	`pos-communication-matrix-listener`	Matrix listener: map /command → bash, run them on room messages
communication	matrix-sender	`pos-communication-matrix-sender`	Send messages to a Matrix room via the client-server API (send, test, login)
communication	scrcpy	`pos-communication-scrcpy`	Mirror/control an Android device via scrcpy+adb (mirror, devices, record, tcpip, connect, push, pull, screenshot, info)
communication	telegram-listener	`pos-communication-telegram-listener`	Telegram bot listener: map /command → bash and → app, run them on chat messages
communication	telegram-sender	`pos-communication-telegram-sender`	Send Telegram messages/files/links/stickers via Bot API (send, test)
docker	compose	`pos-docker-compose`	Docker Compose service manager (ls/up/down/restart/logs/update/config)
docker	health	`pos-docker-health`	One-glance container health dashboard (exits 1 if unhealthy)
docker	ps	`pos-docker-ps`	Enhanced container overview (health, IPs, ports, uptime)	docker
docker	stack	`pos-docker-stack`	Containers grouped by compose stack (project); standalone group; -a/--all includes stopped
docker	vbox	`pos-docker-vbox`	Disposable Docker-based VMs (create/enter/start/stop/rm/ls)
entertainment	config	`pos-entertainment-config`	Show or edit the entertainment config (ENABLED auto-trigger list, weather location)
entertainment	disable	`pos-entertainment-disable`	Disable a plugin's auto-trigger (remove it from ENABLED)
entertainment	enable	`pos-entertainment-enable`	Enable an auto-trigger for a plugin on a schedule
entertainment	send	`pos-entertainment-send`	Run a public-API plugin and send its output via the configured notify platforms
entertainment	status	`pos-entertainment-status`	Show enabled plugins and scheduler state
media	grab	`pos-media-grab`	Auto-download URL as audio or video (classify + route)
media	mp3	`pos-media-mp3`	Download audio as MP3 (yt-dlp)
media	mp4	`pos-media-mp4`	Download video as MP4 (smart/interactive format select)
media	sync	`pos-media-sync`	Incremental Music → USB sync (mp3/mp4, add/update only)	lsblk jq	pos media sync --mp3 → Sync only MP3 files to USB · pos media sync --mp4 --dry-run → Preview MP4 sync without copying
media	ytsync	`pos-media-ytsync`	Incrementally sync YouTube channels/playlists into ~/Videos
network	checkport	`pos-network-checkport`	Check TCP/UDP port reachability (nmap, or bash/nc fallback) + local interface view
network	download	`pos-network-download`	aria2 RPC daemon + queue control (add/torrent/metalink, watch, limits)	aria2c jq curl	pos network download add https://example.com/file.zip → Enqueue an HTTP download (auto-starts daemon) · pos network download status → Daemon health + global transfer stats · pos network download watch → Live progress view
network	hotspot	`pos-network-hotspot`	Wi-Fi hotspot via create_ap + wihotspot-gui
network	ip	`pos-network-ip`	Show interfaces, routes, public IP + location
network	scan	`pos-network-scan`	Parallel ping sweep of CIDR
share	nfs-client	`pos-share-nfs-client`	Mount NFS shares (ephemeral or persistent systemd mount units)
share	nfs-server	`pos-share-nfs-server`	Manage the NFS kernel server (status, share/unshare exports, enable/disable)
share	smb-client	`pos-share-smb-client`	Mount SMB/CIFS shares (ephemeral or persistent systemd mount units)
share	smb-server	`pos-share-smb-server`	Manage the Samba server (status, share/unshare exports, users, enable/disable)
share	usb-server	`pos-share-usb-server`	USB Redirector server control (--ls, --share; prompts when args omitted)
ssh	load-keys	`pos-ssh-load-keys`	Load all SSH keys into the agent
system	backup	`pos-system-backup`	Encrypted (AES-256) folder snapshots (tar + gpg)	tar
system	firewall	`pos-system-firewall`	Interactive UFW management
system	health	`pos-system-health`	Host health dashboard (disk, RAM, services, backup age, fail2ban, docker); exit 1 if any FAIL
system	schedule	`pos-system-schedule`	Scheduled jobs: run a command on a timer; notify on threshold/change/error/always or silently
system	uninstall	`pos-system-uninstall`	Remove pos toolkit binaries, services, shell integration, config, and data
	ai	`pos-ai`	AI assistant: ask, chat, sessions, capture, models, providers
	config	`pos-config`	Interactive editor for the tools' runtime config (reads # POS_CONFIG: registry)
	tree	`pos-tree`	Show the pos CLI command tree: categories, commands, and subcommands

Legacy Wrappers

These forward to pos transparently: wr-ip, wr-checkport, wr-scan-ping, wr-docker, wr-compose, wr-ufw, mp3, mp4, vbox, ssh-load-all.

pos docker vbox Details

pos-docker-vbox manages disposable Docker containers as lightweight VMs:

Container labeling: All created containers get linux_post_install.vbox=true label
ls filtering: docker ps --filter label=linux_post_install.vbox=true — only shows vbox-managed containers
Post-create prompt: After create, asks "Enter now? [Y/n]" using confirm helper
Working dir detection: enter auto-detects bind mount path from container labels
Custom dirs: --dir <path> or --dir . for current directory

5. Shared Library — `lib/common.sh`

Sourced by most scripts. Provides:

Function	Purpose
`log "msg"`	Green `[+]` status message
`warn "msg"`	Yellow `[!]` warning
`err "msg"`	Red `ERROR:` + exit 1
`ok "msg"`	Green `OK` prefix
`section "title"`	Cyan-bordered section header
`step N T "msg"`	Numbered step header (e.g., `[1/4] Installing`)
`run cmd`	Executes command, respects `$DRY_RUN`
`spawn "msg" cmd`	Runs with animated braille spinner, elapsed time, OK/FAIL status; respects `$DRY_RUN`
`timer_start` / `timer_stop`	Elapsed time tracking
`confirm "prompt" [default]`	y/N or Y/n prompt
`load_system_env`	Loads `~/.config/linux_post_install/system.env` (env already exported wins)

Auto-detects TTY — disables colors when piped.

Source pattern:

source "$(dirname "$0")/../lib/common.sh"

Scripts that do NOT source common.sh (self-contained):

pos, pos-ai-gemini, pos-ai-openrouter, pos-communication-matrix-listener, pos-communication-matrix-sender, pos-communication-telegram-listener, pos-communication-telegram-sender, pos-network-checkport, pos-network-hotspot, pos-network-ip, pos-network-scan, pos-ssh-load-keys, pos-system-firewall.

6. Docker Compose / ScaleTail

Architecture

ScaleTail provides 119+ Docker Compose templates with a Tailscale sidecar pattern (network_mode: service:tailscale). Each service gets a tail-xxxxx.ts.net URL with optional automatic HTTPS.

/usr/local/share/linux_post_install/scale-tail/    # Templates (git repo)
└── services/<name>/
    ├── compose.yaml
    └── .env

~/.config/linux_post_install/compose.env           # Global defaults (TS_AUTHKEY, TZ, DNS_SERVER, SERVICES_BASE)

/srv/<service>/                         # Active deployments (default base)
    ├── compose.yaml                    # From template (refreshed on update)
    ├── .env                            # User config (preserved across updates)
    ├── config/
    └── data/

Key Commands

Command	Description
`pos docker compose ls`	List all available ScaleTail services
`pos docker compose up <svc>`	Deploy service to SERVICES_BASE
`pos docker compose down <svc>`	Stop a deployed service
`pos docker compose restart <svc>`	Restart a service
`pos docker compose logs <svc> [-f]`	View/follow logs
`pos docker compose update`	Pull latest templates, refresh compose.yaml (preserves .env)
`pos docker compose config set K=V`	Set global config value
`pos docker compose config show`	Display current config

Global Config Keys

TS_AUTHKEY — Tailscale auth key (required)
TZ — Timezone
DNS_SERVER — Custom DNS
SERVICES_BASE — Deployment root (default: /srv)

7. Optional Apps (`apps/`)

How They Work

apps/install.sh auto-discovers all apps/<category>/*.sh files (excluding itself)
Three modes: interactive (default), --all, or specific app names as arguments
--uninstall switches to uninstall mode (same selection, invokes app scripts with uninstall argument)
Interactive TUI groups apps by category with section headers
Each app script is standalone, idempotent, sources lib/common.sh
Every app script defines install_<name>() and uninstall_<name>(), dispatched via case "${1:-}" in uninstall) ...

Installation Methods

Method	Apps
`apt install`	btop, obs, vlc, vnc-viewer, qemu
APT repo (GPG + repo)	brave, vscode
Official `curl \| sh`	docker, tailscale, netbird, zerotier, opencode
AppImage	affine
GitHub release binary	scrcpy
Flatpak	localsend
.deb package	termius

Adding a New App

Create apps/<category>/<name>.sh following the template in DOC/DEV.md
It auto-appears in the interactive picker — no registration needed

8. Entertainment Module

Public-API "entertainment" plugins (weather, joke, gold) that can auto-send their output to the configured notify platforms (default Telegram) on a schedule.

CLI: pos entertainment {config|enable|disable|send|status} — see the dispatch table in §4 and POS.md entertainment.
Library: lib/entertainment-lib.sh — config-file helpers, ENABLED-list parsing, plugin lookup, per-plugin last-run state, and scheduler sync. Timer machinery (interval→OnCalendar, unit pair writer, linger) is shared via lib/user-timers-lib.sh with the system scheduler.
Plugins: entertainment/*.sh — standalone scripts that fetch a public API and print the message to stdout (what gets sent). Each declares its name with a # POS_PLUGIN: <name> header; a new plugin is auto-discovered. Plugins may source lib/entertainment-plugin-lib.sh (message-safe: no stdout chatter).
Config: ~/.config/linux_post_install/entertainment.env (ENABLED auto-trigger list, weather location). Template: config/entertainment.env, auto-installed by postinstall.
Sending: pos entertainment send <plugin> [--print] [--markdown] runs the plugin and delivers via notify_send (follows NOTIFY_PLATFORM, default Telegram). Last-run rc/timestamp is recorded per plugin and shown by status; a timer-context failure also notifies.
Auto-trigger: pos entertainment enable <plugin> <interval> writes the plugin into ENABLED and syncs a systemd user timer (allowed intervals: 5m 10m 15m 30m 45m hourly 2h 6h 12h daily weekly, or OnCalendar=…); disable removes it.
Docs: DEV.md "Adding an Entertainment Plugin" (§1 step list) and POS.md entertainment.

9. Systemd Services

Service	File	Purpose
`ssh-agent.service`	`systemd/ssh-agent.service`	System-wide SSH agent, socket at `/run/ssh-agent/socket`
`autostart.service`	`systemd/autostart.service`	Runs `autostart.sh` on boot
`usb-automount.service`	`systemd/usb-automount.service`	Auto-mounts USB sticks at `/media/<label>` (usb-automount feature)

All .service files in systemd/ are automatically copied to /etc/systemd/system/ and enabled by postinstall.sh (timers too, when present).

10. Configuration Files

Gitignored Secrets

config/rclone.conf — rclone remote config (OAuth tokens)
config/authorized_keys — SSH public keys

Runtime Config

~/.config/linux_post_install/compose.env — Docker Compose global defaults
~/.config/linux_post_install/entertainment.env — entertainment plugin defaults: weather location + ENABLED auto-trigger list (plugin, interval pairs scheduled via pos entertainment enable/disable, systemd user timers); auto-installed from config/entertainment.env by postinstall.sh (no clobber, template printed)
~/.config/linux_post_install/system.env — shared "system" tool settings (loaded by pos system health / pos system backup via load_system_env() in lib/common.sh; env already exported wins over the file); template config/system.env
~/.config/linux_post_install/notify.env — alerting platform selection (NOTIFY_PLATFORM=telegram,matrix, comma-separated = fan out); read by lib/notify.sh; template config/notify.env
~/.config/linux_post_install/ai.env — AI provider config (AI_PROVIDER, AI_API_KEY secret, AI_MODEL, AI_SYSTEM_PROMPT, plus legacy fallbacks AI_GEMINI_API_KEY, AI_GEMINI_MODEL, OPENROUTER_API_KEY, OPENROUTER_MODEL); read by pos ai; template config/ai.env, auto-installed by postinstall, edit with pos config ai
~/.bashrc — Modified by postinstall (PATH, bash completion)

Feature Flags

System-wide flag store at /usr/local/share/linux_post_install/flags/:

One file per flag; presence = set, file content = optional value (dir 755, files 644).
Library: lib/flags.sh (installed as /usr/local/bin/flags.sh) — flag_set <name> [value], flag_clear <name>, flag_is_set <name>, flag_value <name>, flag_list, flag_status <name>.
CLI: flag-reader (list / status / --raw), flag-set, flag-clear.
Set by ./install.sh --feature; read by postinstall.sh to gate systemd enablement (e.g. autostart.service requires the autostart flag).
Writes use run + sudo, so they respect --dry-run. FLAGS_DIR is env-overridable for tests.

11. Coding Conventions

Script Standards

Shebang: #!/usr/bin/env bash
Strict mode: set -euo pipefail
Help: Every script accepts -h/--help via case pattern
Idempotency: Check existence before creating/modifying
Exit codes: 0 = success, 1 = error

Naming Conventions

pos-<category>-<command> — canonical tool names
wr-* — legacy wrappers
apps/<category>/<name>.sh — optional app installers
Hyphens for word separation, lowercase always

Error Handling

command -v <tool> &>/dev/null to check tool availability
set -euo pipefail for fail-fast
err() for fatal errors, warn() for non-fatal
Confirmation prompts for destructive actions

Security

Never hardcode secrets in scripts
Use chmod 600 for sensitive files
Validate user input before shell commands
Use sudo only where necessary

12. Development Workflow

Adding a New Feature

Create features/<name>.sh from templates/feature.sh (installed on demand via ./install.sh --feature; never overwritten without asking)
install.sh auto-discovers it and sets its flag — no registration needed
If a systemd service depends on it, gate the service on flag_is_set <name> in postinstall.sh
Update DOC/AGENT_Context_Project.md file table if line counts change

Adding a New App

Create apps/<category>/<name>.sh from templates/app.sh (per DOC/DEV.md)
It auto-appears in the interactive picker — no registration needed
Update DOC/APPS.md catalog table (name, category, purpose, install method)
Test: bash -n apps/<cat>/<name>.sh && shellcheck apps/<cat>/<name>.sh

Adding a New Tool

Define the exact CLI verb (pos <category> <command> [<subcommand>]) and its runtime context before writing code: a dev/repo-only tool (e.g. reads repo files, like pos tree) or a runtime tool that must work from /usr/local/bin after the repo is deleted. Category-less bin/pos-<cmd> is for dispatcher/dev-level commands that fit no category (pos-config, pos-tree); everything else goes in a category.
Create bin/pos-<category>-<command> (or bin/pos-<cmd> for category-less) from templates/pos-tool.sh — must be executable (100755); it auto-appears in pos <category> --help (filename-derived, no registration)
Add the # POS: <cat> <cmd> — <one-line description> header right after the shebang (plus # POS_FLAGS: ... for flag-style tools and # POS_SUBCMDS: ... for multi-command tools) — this is the single source of truth for the generated docs; nested tools (pos-<cat>-<a>-<b>) auto-list under their parent tool
Add to INTERACTIVE_CMDS in bin/pos if it reads stdin
Add system deps to PACKAGES array in preinstall.sh (if needed); non-apt/manual installers → command -v guard in the tool instead
Add config logic to postinstall.sh (if needed, with .gitignore for secrets); runtime tool config → ~/.config/linux_post_install/<tool>.env (600)
Update docs: DOC/POS.md (section table + detail — hand-written); DOC/HOWTO.md index row + a section in DOC/howto/<category>.md (recipes/troubleshooting); DOC/AGENT_Context_Project.md generated sections (bin tree, dispatch table, self-contained list, line-count table) and completion flags update via make gen — never hand-edit between GEN:START/GEN:END markers, but hand-add a row to the "Common Tasks for Agents" table; AGENTS.md Quick facts if a structural fact changed; root README.md only if the category list changes; move the task to AGENT_TODO.md Done (dated) in the same commit
Test: make gen && make check && make lint — make check (bash -n + doc/code sync + smoke) and make lint (0 FAIL / 0 WARN, scripts/lint-conventions.sh) together are the definition of done; also bin/pos help <full command> && bin/pos <category> --help. For tools needing root/systemd/absent deps, behaviour-test via env-override paths + stub PATH (see DEV.md "Testing tools that need root / systemd / missing deps"). Pushing to Gitea re-runs the same four gates on the live Actions runner (.gitea/workflows/lint.yml) — a red run is a merge-blocker.

Testing

# Syntax check all scripts
for f in bin/* apps/*/*.sh lib/common.sh install.sh preinstall.sh postinstall.sh; do
    bash -n "$f" || echo "FAIL: $f"
done

# ShellCheck linting
shellcheck bin/my-script

# Test in Docker
docker run --rm -it -v $PWD:/repo ubuntu:22.04 bash
# inside: cd /repo && ./install.sh

# Test apps interactively
./apps/install.sh --all
./apps/install.sh docker vscode

Commit Conventions

Use conventional prefixes: feat:, fix:, docs:, refactor:, chore:

13. Key File Quick Reference

File	Lines	Purpose
`install.sh`	248	Main orchestrator — 4 phases with CLI flags, `--feature`, prebuilt arch bins
`preinstall.sh`	76	System packages + hotspot deps + yt-dlp + fail2ban
`postinstall.sh`	168	fail2ban config, PATH, bash completion, systemd (flag-gated)
`lib/common.sh`	151	Shared library (log/warn/err/run/spawn, dry-run aware, `load_system_env`, CONFIG_DIR)
`lib/flags.sh`	60	Feature flag store (set/clear/is_set/value/list/status)
`lib/notify.sh`	87	Multi-platform alerting (`notify_send`) — opt-in source, silent-fails
`lib/entertainment-lib.sh`	311	Entertainment module lib (ENABLED parsing, last-run state, scheduler sync via user-timers-lib)
`lib/entertainment-plugin-lib.sh`	67	Message-safe helpers for plugins (config load, require, fetch+retry) — plugins MAY source it
`lib/scheduler-lib.sh`	760	Scheduler lib (job parsing, notify policies, per-job user timers via user-timers-lib, legacy migrate)
`lib/user-timers-lib.sh`	112	Shared systemd user timer machinery (interval→OnCalendar, unit pair writer, linger)
`lib/usb-lib.sh`	205	Shared USB-storage detection + pick flow (detect/mount-offer/`usb_pick_root`; EFI system partitions excluded; picker shows size/label/fs) — used by `pos system backup` + `pos media sync`
`lib/share-lib.sh`	318	Domain layer for the share suite (usbsrv/smbclient record parsers, folder+mountpoint candidates, remote listings, service/firewall advisories; EOF-safe) + compat shims to `lib/menu-lib.sh` — used by all five `pos share *` tools
`lib/menu-lib.sh`	362	Category-neutral interactive menu primitives (`menu_guard` tty guard, `menu_run` looping boxed menu, `menu_pick` type-to-filter picker, `menu_ask_value` prompt-with-default via raw-mode bracketed-paste-safe `menu_read_value`; stderr render, fail-closed on non-tty/EOF) — sourced by `share-lib.sh`, open to any category
`lib/registry.sh`	199	Shared query API for POS tool metadata headers (`# POS_*:`) — `reg_scan`/`reg_list`/`reg_lookup`/`reg_each`/config scope helpers; used by `pos-tree` and `gen-docs.sh`
`bin/flag-reader`	58	Inspect flags (list/status/`--raw`)
`bin/flag-set`	21	Set a flag (optionally with a value)
`bin/flag-clear`	21	Unset a flag
`features/autostart.sh`	50	Boot-time feature (moved from `bin/`, flag-gated service)
`features/usb-automount.sh`	138	USB automount feature (udev rule + flag-gated service)

| apps/install.sh | 171 | App install/uninstall picker/orchestrator |

14. Common Tasks for Agents

Task	Where to Edit
Add a new CLI tool	Create `bin/pos-<cat>-<cmd>` with a `# POS:` header, chmod +x, add deps (apt → `preinstall.sh` PACKAGES; non-apt → `command -v` guard), then `make gen && make check`
Regenerate doc tables / completion flags	`make gen` (see `scripts/gen-docs.sh`; never hand-edit between `GEN:START`/`GEN:END` markers)
Verify repo self-consistency	`make check` (runs `scripts/check-sync.sh`; also the pre-commit hook after `make hook`)
Add a new app installer	Create `apps/<name>.sh` (auto-discovered)
Add a feature	Create `features/<name>.sh` (installed on demand via `./install.sh --feature`)
Add a systemd service	Create `systemd/<name>.service` (auto-installed by postinstall; gate on a flag if it backs a feature)
Add a precompiled binary	Drop it in `x64_bin/` (or `arm64_bin/` later) — auto-copied by Phase 2
Inspect/set feature flags	`flag-reader`, `flag-set`, `flag-clear` (or source `lib/flags.sh`)
Modify package list	Edit `PACKAGES` array in `preinstall.sh`
Change PATH or bash config	Edit `postinstall.sh`
Modify fail2ban config	Edit jail.local section in `postinstall.sh`
Add bash completion	Edit `completions/pos.bash`
Modify Docker Compose logic	Edit `bin/pos-docker-compose`
Modify Docker health check	Edit `bin/pos-docker-health`
Modify Docker stack (grouped container) view	Edit `bin/pos-docker-stack`
Modify vbox (Docker VM) logic	Edit `bin/pos-docker-vbox`
Modify USB forwarding logic	Edit `bin/pos-share-usb-server`
Modify aria2 download daemon / queue logic	Edit `bin/pos-network-download`
Modify NFS share logic	Edit `bin/pos-share-nfs-server` / `bin/pos-share-nfs-client`
Modify SMB share logic	Edit `bin/pos-share-smb-server` / `bin/pos-share-smb-client`
Modify scrcpy mirroring logic	Edit `bin/pos-communication-scrcpy` (config scope `scrcpy` via `pos config scrcpy`; `SCRCPY_*` keys in `~/.config/linux_post_install/scrcpy.env`)
Modify Music→USB sync logic	Edit `bin/pos-media-sync` / shared USB layer `lib/usb-lib.sh` (seams `MEDIA_SYNC_SOURCE`/`MEDIA_SYNC_DEST`/`USB_MOUNT_BASE`/`USB_BYID` in `~/.config/linux_post_install/system.env`)
Modify YouTube channel sync logic	Edit `bin/pos-media-ytsync` (state in `~/.local/share/linux_post_install/ytsync`; config scope `ytsync` via `pos config ytsync`; research notes `tools-docs/ytsync.md`)
Modify the scheduler / scheduled jobs	Edit `bin/pos-system-schedule` / `lib/scheduler-lib.sh` (jobs in `~/.config/linux_post_install/schedule.d/`)
Modify AI logic	Edit `bin/pos-ai` (main tool) + `lib/ai-providers/*.sh` (provider adapters); config scope `ai` via `pos config ai`; `AI_API_KEY`/`AI_MODEL`/`AI_PROVIDER` in `~/.config/linux_post_install/ai.env`
Modify UFW/firewall logic	Edit `bin/pos-system-firewall`
Modify pos logging	Edit log setup in `bin/pos`
Modify install phases/flags	Edit arg parsing in `install.sh`
Update documentation	Edit the relevant doc under `DOC/` (index: `DOC/README.md`)
Add a secret config file	Add to `config/`, update `.gitignore`, add copy logic in `postinstall.sh`

45 KiB Raw Blame History Unescape Escape

AGENT Context — Linux_post_install Project

Document Map

1. Project Overview

2. Directory Structure

3. Installation Flow

install.sh Flags

pos Output Logging

4. The pos CLI System

How It Works

Available Commands

Legacy Wrappers

pos docker vbox Details

5. Shared Library — lib/common.sh

6. Docker Compose / ScaleTail

Architecture

Key Commands

Global Config Keys

7. Optional Apps (apps/)

How They Work

Installation Methods

Adding a New App

8. Entertainment Module

9. Systemd Services

10. Configuration Files

Gitignored Secrets

Runtime Config

Feature Flags

11. Coding Conventions

Script Standards

Naming Conventions

Error Handling

Security

12. Development Workflow

Adding a New Feature

Adding a New App

Adding a New Tool

Testing

Commit Conventions

13. Key File Quick Reference

14. Common Tasks for Agents

45 KiB

Raw Blame History

4. The `pos` CLI System

5. Shared Library — `lib/common.sh`

7. Optional Apps (`apps/`)