Skip to content
Optimizing resource usage on Kubernetes
Goal: Use resources optimally with low p99 latency
Pod resources:
- CPU
- Memory
Internal:
- Number of threads
- Memory limit per thread
Metrics:
- requests/sec
- CPU utilization
- CPU throttling
- Memory utilization
=> How to optimize this?
Scalability of software systems
Sources
- How to cold start fast a java service on k8s (EKS)
- how to measure the time it takes to launch a java* container?
- how to measure the time/resources it takes for the JVM to start?
- how to measure the time it take to launch a java HTTP server
- Optimizing docker images for faster image download
- Google best practices
These notes are unpolished collections of thoughts, unfinished ideas, and things I want to remember later. In the spirit of learning in public, I'm sharing them here. Have fun exploring, if you want!