Observability and Auto Scaling for AKS with Terraform with the following logging and metrics configuration:
- Container Insights
- ContainerLogV2
- Log Analytics Workspace
- OMS Agent
- Monitoring Metrics Publisher
Container Insights live dashboard:
terraform -chdir='infrastructure' init
terraform -chdir='infrastructure' apply -auto-approveOnce done get the credentials:
az aks get-credentials -n aks-icecream -g rg-icecreamTest the metrics components:
# Confirm agent deployment
kubectl get ds omsagent --namespace=kube-system
# Confirm solution deployment
kubectl get deployment omsagent-rs -n=kube-systemSet Container Insights to use ContainerLogV2:
kubectl apply -f container-azm-ms-agentconfig.yamlSetup ContainerLogV2 to Basic Logs to save costs.
az monitor log-analytics workspace table update --resource-group 'rg-icecream' --workspace-name 'log-icecream' --name 'ContainerLogV2' --plan 'Basic'Deploy to Kubernetes:
kubectl apply -f kubernetes.yamlService should be running on the external address:
curl 'http://<CLUSTER_EXTERNAL_IP>:30000/api/icecream/5'That's it 👍 services should be ready for load testing.
Check autoscaler status:
kubectl describe configmap --namespace kube-system cluster-autoscaler-status
AzureDiagnostics
| where Category == "cluster-autoscaler"
To load test it with K6 on Docker:
docker run \
-e "CLUSTER_EXTERNAL_IP=<EXTERNAL_IP>" \
-e "API=/api/fibonacci/40" \
-e "VUS=10" \
-e "DURATION=300s" \
-e "K6_SLEEP=1" \
--rm -i grafana/k6 run - <k6.jsWatch for the autoscale behavior on HPA:
kubectl get hpaWatch for AKS autoscaler:
kubectl describe configmap --namespace kube-system cluster-autoscaler-statusMake sure you're in the app directory:
cd appSet up the local environment:
cp config/example.env .envStart the Rust server:
cargo build
cargo runTest the app:
curl 'http://localhost:8080/api/icecream/5'docker build -t icecream .
docker run -it -p 8080:8080 --rm --name icecream icecream If you upload a new image simply force a pull with this:
kubectl rollout restart deployment/icecream-deploymenthttps://docs.microsoft.com/en-us/azure/aks/monitor-aks
https://docs.microsoft.com/en-us/azure/azure-monitor/containers/container-insights-onboard
https://docs.microsoft.com/en-us/azure/aks/tutorial-kubernetes-scale?tabs=azure-cli