This repo is my Kubernetes cluster in a declarative state. Flux and Helm Operator watch my clusters folder and makes the changes to my cluster based on the yaml manifests. Renovate auto updates images and helm charts based on upstream changes.
Feel free to join our Discord if you have any questions.
Currently using talos by PXE booting for initial install. PXE server is a local netboot.xyz container running on my NixOS-based NAS.
- Boot machines
- They either start Talos from disk if already installed, or PXE boot to the installer.
- Get kubeconfig:
talosctl kubeconfig - Deploy Cilium CNI to
kube-systemnamespace:
helm install cilium cilium/cilium -f provision/cilium/production.yaml
- Boot machines
- They boot to Talos via PXE
- If there is a pre-existing Talos install, nodes just boot to the disk
- PXE server configurations: NixOS PXE
- Machines should boot, install, and set up the cluster
task talos:gen-talosconfigoutputs a talosconfig togitignore/talosconfigtask talos:kubeconfigoutputs a kubeconfig togitignore/kubeconfigtask talos:install-ciliuminstalls cilium CNI to the clustertask flux:bootstrapbootstraps the cluster with the flux configs in this repo
All my nodes below are running bare metal Talos
| Device | Count | OS Disk Size | Data Disk Size | Ram | Purpose |
|---|---|---|---|---|---|
| Bmax B3 (Intel N5095) | 3 | 256GB SSD | N/A | 8 GB | k8s Control Plane |
| Minisforum MS-01 (Intel 12600H) | 3 | 1x 1TB NVME | 1x 2TB NVME (rook-ceph) | 64GB | k8s Workers |
| Supermicro MBD-H12SSL-NT-B with AMD EPYC 7282 | 1 | 1x 1TB NVME | N/A | 128GB | Ceph Bulk Storage & AI/ML |
| Supermicro 216BE1C-R741JBOD | 1 | N/A | 24x 1TB SSD | N/A | Disk Shelf |
- Opnsense DEC2750 Router
- TP-Link TL-SG3428XMP Core Switch
- TP-Link SX3206HPP Garage Distribution
- TP-Link SX3008F 10Gig Distribution
- TP-Link SG2210XMP-M2 2.5Gig Managed Access
- x3 TP-Link EAP725-Wall Wi-Fi 7 Access Points
- x2 TP-Link TL-SG105S-M2 Desktop Access Switch
- x2 TL-PD30G-M2 2.5Gig PoE Splitter for power
Can generally be viewed at settings.yaml
A lot of inspiration for my cluster came from the people that have shared their cluster configuration with me. Thanks to all the people who donate their time to the Home Operations community. Join us on Discord!