CubelaPetar/infra-phytron
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update TODO after compose stack and rename

Browse Source 
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
CubelaPetar
2026-09-03 14:54:34 +02:00
co-authored by Claude Opus 4.8
parent b6b242196d
commit 922352ae61
1 changed files with 8 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files
TODO.md
+8 -5
View File
@@ -22,21 +22,24 @@ Server is delivered; base setup + NVIDIA driver are done (see `SETUP.md`).
### Server / Ansible ### Server / Ansible
- [ ] Add the three secrets to `group_vars/secrets.yml` (`just vault edit`):
`vault_owui_secret_key`, `vault_owui_db_password`, `vault_ldap_bind_password`
- [ ] Fill the real LDAP bind DN / base DN in `group_vars/phy_srv_gpu01.yml`
- [ ] Pin `vllm_image` to a build verified on SM120, then `just compose phy_srv_gpu01`
and start the stack manually (see `ansible/services/phy-srv-gpu01/README.md`)
- [ ] Role `cifs_mounts` — read-only mounts, credentials from `group_vars/secrets.yml` - [ ] Role `cifs_mounts` — read-only mounts, credentials from `group_vars/secrets.yml`
- [ ] Role `llm_stack` — docker compose: vLLM (fixed `--gpu-memory-utilization`), - [ ] oikb sync (share → knowledge base) once the corpus scope is decided
embedding server, Open WebUI + pgvector, reverse proxy, oikb timer.
Tag compose tasks with `compose` so `just compose` works.
- [ ] Smoke-test a vLLM container on the server (official images may not support SM120) - [ ] Smoke-test a vLLM container on the server (official images may not support SM120)
— pin the working image, then build `llm_stack`. Start model: Qwen3-32B FP8 — pin the working image, then build `llm_stack`. Start model: Qwen3-32B FP8
- [ ] OCR pipeline for ~166k scanned PDFs (§2.1) — own work block, competes with vLLM for the GPU - [ ] OCR pipeline for ~166k scanned PDFs (§2.1) — own work block, competes with vLLM for the GPU
- [ ] TLS: currently plain HTTP on `chat.phytron.local`; retrofit an internal CA - [ ] TLS: currently plain HTTP on `chat.phytron.local`; retrofit an internal CA
certificate (AD passwords travel in clear text until then) certificate (AD passwords travel in clear text until then)
- [ ] Hostname mismatch: server reports `phy-srv-gpu01`, repo/inventory/label use
`phy-srv-gpu01` — align
- [ ] Finish base hardening in `SETUP.md` (ssh, updates) via `just run phy_srv_gpu01` - [ ] Finish base hardening in `SETUP.md` (ssh, updates) via `just run phy_srv_gpu01`
### Done ### Done
- [x] Renamed host/group/folder to `phy-srv-gpu01` everywhere
- [x] LLM compose stack written (`ansible/services/phy-srv-gpu01/`) — not deployed
- [x] Share analysis script → `scripts/share-analysis.ps1`, run on 2026-07-14 (§2.1) - [x] Share analysis script → `scripts/share-analysis.ps1`, run on 2026-07-14 (§2.1)
- [x] Storage decision (§2.3) — 876 GB usable, no extra disks needed - [x] Storage decision (§2.3) — 876 GB usable, no extra disks needed
- [x] NVIDIA driver via role `nvidia_gpu` (595 open kernel modules) - [x] NVIDIA driver via role `nvidia_gpu` (595 open kernel modules)