v1.24.4

• Kubernetes v1.24.4
• Update CoreDNS from v1.8.6 to v1.9.3
• Update Cilium from v1.11.7 to v1.12.1
• Update Calico from v3.23.1 to v3.23.3
• Switch Kubernetes registry from k8s.gcr.io to registry.k8s.io (#1206)
• Remove use of deprecated Terraform template provider (#1194)

Flatcar Linux

• Migrate Flatcar Linux from Ignition spec v2.3.0 to v3.3.0 (#1196) (action required)
  • Flatcar Linux 3185.0.0+ supports Ignition v3.x specs (which are rendered from Butane Configs, like Fedora CoreOS)
  • poseidon/ct v0.11.0 supports the flatcar Butane Config variant
  • Require poseidon/ct v0.11+ and Flatcar Linux 3185.0.0+
• Please modify any Flatcar Linux snippets to use the Butane Config format (action required)

variant: flatcar
version: 1.0.0
...

Fedora CoreOS

• Remove ineffective /etc/fedora-coreos/iptables-legacy.stamp (#1201)
  • Typhoon already uses iptables v1.8.7 (nf_tables) since FCOS 36
  • Staying on legacy iptables required a file in /etc/coreos instead

AWS

• Refresh instances in autoscaling group when launch configuration changes (#1208) (docs, important)
  • Worker launch configuration changes start an autoscaling group instance refresh to replace instances
  • Instance refresh creates surge instances, waits for a warm-up period, then deletes old instances
  • Changing worker_type, disk_*, worker_price, worker_target_groups, or Butane worker_snippets on existing worker nodes will replace instances
  • New AMIs or changing os_stream will be ignored, to allow Fedora CoreOS or Flatcar Linux to keep themselves updated
  • Previously, new launch configurations were made in the same way, but not applied to instances unless manually replaced
• Rename worker autoscaling group ${cluster_name}-worker (#1202)
  • Rename launch configuration ${cluster_name}-worker instead of a random id

Google

• Roll instance template changes to worker managed instance groups (#1207) (docs, important)
  • Worker instance template changes roll out by gradually replacing instances
  • Automatic rollouts create surge instances, wait for health checks, then delete old instances (0 unavailable instances)
  • Changing worker_type, disk_size, worker_preemptible, or Butane worker_snippets on existing worker nodes will replace instances
  • New compute images or changing os_stream will be ignored, to allow Fedora CoreOS or Flatcar Linux to keep themselves updated
  • Previously, new instance templates were made in the same way, but not applied to instances unless manually replaced
• Add health checks to worker managed instance groups (i.e. "autohealing") (#1207)
  • Use health checks to probe kube-proxy every 30s
  • Replace worker nodes that fail the health check 6 times (3min)
• Name kube-apiserver and worker health checks consistently (#1207)
  • Use name ${cluster_name}-apiserver-health and ${cluster_name}-worker-health
• Rename managed instance group from ${cluster_name}-worker-group to ${cluster_name}-worker (#1207)
• Fix bug provisioning clusters with multiple controller nodes (#1195)

Addons

• Update Prometheus from v2.37.0 to v2.38.0
• Update Grafana from v9.0.3 to v9.1.0

v1.24.3

• Kubernetes v1.24.3
• Update Cilium from v1.11.6 to v1.11.7

Addons

• Update ingress-nginx from v1.2.1 to v1.3.0
• Update Prometheus from v2.36.1 to v2.37.0
• Update Grafana from v8.5.6 to v9.0.3

Notes

• Poseidon repos will soon change their default branch from master to main

v1.24.2

• Kubernetes v1.24.2
• Update Cilium from v1.11.5 to v1.11.6
• Update Calico from v3.22.2 to v3.23.1

Addons

• Update Prometheus from v2.36.0 to v2.36.1
• Update Grafana from v8.5.3 to v8.5.6
• Update kube-state-metrics from v2.4.2 to v2.5.0

Known Issues

• Skip AWS Terraform provider v4.17.0 to v4.19.0, which had a regression affecting workers joining (#1173)

v1.24.1

• Kubernetes v1.24.1
• Update Cilium from v1.11.4 to v1.11.5

Addons

• Update Prometheus from v2.35.0 to v2.36.0
• Update Grafana from v8.5.1 to v8.5.3
• Update nginx-ingress from v1.2.1 to v1.2.1

v1.24.0

• Kubernetes v1.24.0
• Update etcd from v3.5.2 to v3.5.4
• Add Kubelet mounts to enable relabeling workload volumes (#1152)
  • StorageClass no longer require explicit SELinux mount contexts

Addons

• Update nginx-ingress from v1.1.3 to v1.2.0
• Update Prometheus from v2.34.0 to v2.35.0
• Update Grafana from v8.4.5 to v8.5.1

v1.23.6

• Kubernetes v1.23.6
• Update Cilium from v1.11.2 to v1.11.4
• Rename Cilium DaemonSet from cilium-agent to cilium to match Cilium CLI tools (#303)
• Update Calico from v3.22.1 to v3.22.2
• Mount /etc/machine-id from host into Kubelet (#1143)
• Remove deprecated use of key_algorithm in hashicorp/tls resources

Azure

• Allow upgrading Azure Terraform provider to v3.x (#1144)
• Rename worker_address_prefix output to worker_address_prefixes

Google Cloud

• Fix issue on Flatcar Linux with controller nodes not ignoring os image changes (#1149)
  • Nodes will auto-update, Terraform should not attempt to delete/recreate them

Addons

• Update nginx-ingress from v1.1.2 to v1.1.3
• Update Prometheus from v2.33.5 to v2.34.0
• Update Grafana from v8.4.4 to v8.4.5

v1.23.5

• Kubernetes v1.23.5
• Update Cilium from v1.11.1 to v1.11.2
• Update Calico from v3.21.2 to v3.22.1
  • Fix calico#5011, broken since v1.23.0

Addons

• Refresh Prometheus rules and Grafana dashboards (#1136)
• Update nginx-ingress from v1.1.1 to v1.1.2
• Update Prometheus from v2.33.3 to v2.33.5
• Update Grafana from v8.4.1 to v8.4.3
• Update kube-state-metrics from v2.3.0 to v2.4.2

v1.23.4

• Kubernetes v1.23.4
• Update etcd from v3.5.1 to v3.5.2
• Change default CNI networking provider from calico to cilium (#1114)

AWS

• Allow upgrading AWS Terraform Provider to v4.x

Addons

• Align nginx-ingress --controller-class with IngressClass
  • Watch only public IngressClass objects, better example
• Update Prometheus from v2.32.1 to v2.33.3
• Update Grafana from v8.3.6 to v8.4.1

v1.23.3

• Kubernetes v1.23.3

Flatcar Linux

Google Cloud

• Switch to using official Kinvolk Flatcar Linux images
• Promote Typhoon on Flatcar Linux / Google Cloud to stable
• Change os_image to flatcar-stable, flatcar-beta, or flatcar-alpha (action required)

v1.23.2

Many thanks to Poseidon's Sponsors. Please consider supporting this project.

• Kubernetes v1.23.2
• Update Cilium from v1.11.0 to v1.11.1
• Remove Kubelet flag --network-plugin. Unused since docker-shim isn't used (#1106)

DigitalOcean

• Upgrade DigitalOcean Terraform provider to v2.x (#1109)

Fedora CoreOS

• Switch Kubernetes Container Runtime from docker to containerd (#1101)
• Mask docker.service to prevent it from being socket activated (#1105)

Flatcar Linux

AWS

• Add experimental Flatcar Linux ARM64 support (docs, #1102)
  • Add arch variable to AWS kubernetes and workers modules
  • Allow arm64 full-cluster or mixed/hybrid cluster with arm64 workers
  • Requires flannel or cilium CNI provider

Addons

• Update nginx-ingress from v1.1.0 to v1.1.1
• Update Grafana from v8.3.3 to v8.3.4

Known Issues

• Calico does not yet support Kubernetes v1.23, use flannel or cilium (calico#5011)