Skip to content

Optimizing resource usage on Kubernetes

Goal: Use resources optimally with low p99 latency

Pod resources:

  • CPU
  • Memory

Internal:

  • Number of threads
  • Memory limit per thread

Metrics:

  • requests/sec
  • CPU utilization
  • CPU throttling
  • Memory utilization

=> How to optimize this?

Scalability of software systems

Sources

  • How to cold start fast a java service on k8s (EKS)
    • how to measure the time it takes to launch a java* container?
    • how to measure the time/resources it takes for the JVM to start?
    • how to measure the time it take to launch a java HTTP server
  • Optimizing docker images for faster image download
  • Google best practices

#published

These notes are unpolished collections of thoughts, unfinished ideas, and things I want to remember later. In the spirit of learning in public, I'm sharing them here. Have fun exploring, if you want!
© 2022 by Adrian Philipp