Three fixes after the first cd-brouter run on the dedicated host: 1. **BRouter 1.7.8 → 1.7.9** (`docker/brouter/Dockerfile`). Planet RD5 segments on brouter.de are now version 11; 1.7.8's `lookups.dat` is v10, causing `lookup version mismatch (old rd5?) lookups.dat=10 E10_N45.rd5=11` on every route request. 2. **cd-brouter.yml: docker login to ghcr.io before pull**. ghcr.io/trails-cool/brouter is private, and the dedicated host's Docker daemon isn't logged in by default. Extract DEPLOY_GHCR_TOKEN from SOPS at runner side, pass to the SSH step via envs, and `docker login` before `docker compose pull`. Credential is `::add-mask::`-ed so it doesn't show in logs. 3. **Drop custom healthcheck** on the brouter service. The image strips wget/curl post-build, and /bin/sh in the base doesn't support /dev/tcp, so there's no in-image way to do an HTTP probe. Real health is observed via Caddy's upstream 502 behavior on outage and the Planner-side `brouter_request_duration_seconds` metric. caddy's `depends_on` drops from service_healthy to service_started. End-to-end verified on the dedicated host after applying the compose fix manually: - Caddy enforces auth: 403 without header, proxies with. - BRouter 1.7.9 will resolve the segment-version error once the image is rebuilt. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
128 lines
4.2 KiB
YAML
128 lines
4.2 KiB
YAML
# BRouter host compose project — runs on the dedicated Hetzner Robot
|
|
# server `ullrich.is` under the `trails` user. See README.md for first-time
|
|
# provisioning notes.
|
|
#
|
|
# Exposed surface: Caddy listens on 10.0.1.10:17777 (vSwitch IP only).
|
|
# BRouter itself is not published to the host — only reachable via the
|
|
# internal Docker network from the Caddy sidecar.
|
|
#
|
|
# Logging: the host's default logging driver is `loki` (user's personal
|
|
# Loki). Every service here explicitly overrides to `json-file` so logs
|
|
# stay local and are picked up by the promtail sidecar (section 6.3) for
|
|
# shipping to trails.cool's Loki.
|
|
|
|
services:
|
|
brouter:
|
|
image: ghcr.io/trails-cool/brouter:latest
|
|
container_name: trails-brouter
|
|
restart: unless-stopped
|
|
# Planet-scale coverage: segments live on the host and are mounted in.
|
|
# 8 GB heap for segment cache; -Xms generous because routing is
|
|
# memory-heavy and we don't benefit from a slow JVM warmup.
|
|
environment:
|
|
JAVA_OPTS: "-Xmx8g -Xms512M"
|
|
volumes:
|
|
- ./segments:/data/segments:ro
|
|
networks:
|
|
- trails-brouter-internal
|
|
# Scope logs to json-file so we don't leak to the host's default Loki
|
|
logging:
|
|
driver: json-file
|
|
options:
|
|
max-size: "10m"
|
|
max-file: "3"
|
|
labels:
|
|
trails.cool.service: "brouter"
|
|
# No custom healthcheck: the BRouter image strips wget/curl post-build,
|
|
# and /bin/sh in the base image doesn't support /dev/tcp. Real health
|
|
# is observed via Caddy upstream (502 on outage) and the Planner-side
|
|
# brouter_request_duration_seconds metric.
|
|
|
|
caddy:
|
|
image: caddy:2-alpine
|
|
container_name: trails-brouter-caddy
|
|
restart: unless-stopped
|
|
depends_on:
|
|
brouter:
|
|
condition: service_started
|
|
# Bind ONLY to the vSwitch IP on the host — the dedicated host's
|
|
# public IP remains unaffected. UFW further restricts this to traffic
|
|
# sourced from the flagship's private IP (10.0.0.2).
|
|
ports:
|
|
- "10.0.1.10:17777:17777"
|
|
environment:
|
|
BROUTER_AUTH_TOKEN: ${BROUTER_AUTH_TOKEN:?BROUTER_AUTH_TOKEN must be set}
|
|
volumes:
|
|
- ./Caddyfile:/etc/caddy/Caddyfile:ro
|
|
- caddy-data:/data
|
|
- caddy-config:/config
|
|
networks:
|
|
- trails-brouter-internal
|
|
logging:
|
|
driver: json-file
|
|
options:
|
|
max-size: "10m"
|
|
max-file: "3"
|
|
labels:
|
|
trails.cool.service: "brouter-caddy"
|
|
|
|
# cAdvisor — container metrics scraped by flagship Prometheus over the
|
|
# vSwitch. We set container label filters so the exposed metrics only
|
|
# cover trails-labeled containers (brouter + caddy), not the operator's
|
|
# other workloads on this shared host.
|
|
cadvisor:
|
|
image: gcr.io/cadvisor/cadvisor:latest
|
|
container_name: trails-brouter-cadvisor
|
|
restart: unless-stopped
|
|
privileged: true
|
|
ports:
|
|
- "10.0.1.10:8080:8080"
|
|
volumes:
|
|
- /:/rootfs:ro
|
|
- /var/run:/var/run:ro
|
|
- /sys:/sys:ro
|
|
- /var/lib/docker:/var/lib/docker:ro
|
|
- /dev/disk/:/dev/disk:ro
|
|
command:
|
|
# Only consider containers (not the host) and only those that carry
|
|
# our label; filters out everything else on the shared host.
|
|
- --docker_only=true
|
|
- --store_container_labels=false
|
|
- --whitelisted_container_labels=trails.cool.service
|
|
logging:
|
|
driver: json-file
|
|
options:
|
|
max-size: "10m"
|
|
max-file: "3"
|
|
labels:
|
|
trails.cool.service: "brouter-cadvisor"
|
|
|
|
# Promtail — tails Docker logs for trails-labeled containers only and
|
|
# pushes to flagship Loki over the vSwitch. Does NOT scrape other
|
|
# containers' logs on this host.
|
|
promtail:
|
|
image: grafana/promtail:latest
|
|
container_name: trails-brouter-promtail
|
|
restart: unless-stopped
|
|
volumes:
|
|
- /var/run/docker.sock:/var/run/docker.sock:ro
|
|
- ./promtail-config.yml:/etc/promtail/config.yml:ro
|
|
- promtail-positions:/tmp
|
|
command: ["-config.file=/etc/promtail/config.yml"]
|
|
logging:
|
|
driver: json-file
|
|
options:
|
|
max-size: "10m"
|
|
max-file: "3"
|
|
labels:
|
|
trails.cool.service: "brouter-promtail"
|
|
|
|
volumes:
|
|
caddy-data:
|
|
caddy-config:
|
|
promtail-positions:
|
|
|
|
networks:
|
|
trails-brouter-internal:
|
|
driver: bridge
|
|
# Container-to-container only; no host-level exposure via this net
|