Files
Linux_post_install/config/ai.env
T
he 5e312b3207
gates / consistency-and-conventions (push) Successful in 1m38s
feat: pos ai server — llama.cpp local inference server
Service manager (start/stop/status/models/logs) with systemd user
service generation, GPU auto-detection, model selection from pos ai hf
downloads. Provider adapter integrates with pos ai ask as --provider
llamacpp. Config extends existing ai scope with LLAMACPP_* keys.

87 test cases / 0 failed. make gen/check/lint 0 FAIL / 0 WARN.
2026-09-04 12:40:50 -04:00

27 lines
1.3 KiB
Bash

# ~/.config/linux_post_install/ai.env — AI provider config for 'pos ai'
# Copied to ~/.config/linux_post_install/ai.env on install (no clobber).
# Edit with: pos config ai
#
# Provider selection:
# AI_PROVIDER=gemini # provider: gemini|openrouter (default gemini)
#
# API keys (each provider needs its own):
# AI_GEMINI_API_KEY=<key> # Gemini API key from aistudio.google.com
# OPENROUTER_API_KEY=<key> # OpenRouter API key from openrouter.ai
#
# Model overrides (optional, defaults per provider):
# AI_GEMINI_MODEL=<model> # Gemini model id (default: gemini-2.5-flash)
# OPENROUTER_MODEL=<model> # OpenRouter model id (default: openrouter/auto)
# AI_MODEL=<model> # Override for all providers (takes priority)
#
# System prompt:
# AI_SYSTEM_PROMPT=<prompt> # Custom system prompt (overrides built-in; empty to reset)
#
# llama.cpp local inference server (pos ai server):
# LLAMACPP_PORT=8088 # Server port (default 8088)
# LLAMACPP_HOST=127.0.0.1 # Bind address (default 127.0.0.1)
# LLAMACPP_MODEL=<path> # Default model path (GGUF file)
# LLAMACPP_CTX_SIZE=4096 # Context window size (default 4096)
# LLAMACPP_GPU_LAYERS=-1 # GPU layers: -1=auto, 0=CPU only (default -1)
# LLAMACPP_THREADS=<n> # CPU threads (default: nproc)