Here is a sample code repository implementing some guards against out-of-memory errors / crashes on components using Node.js. It is using health-check mechanism that could be taken advantage by load balancer. Also, it has a request rejector and counter.
What do you think? What do you use/do? Or do you just let your processes crash?!
Note: auto-scaling up based on average CPU usage is not sufficient and it is very slow; load balancing based on round-robin or connection count is not great either.
Ref: https://github.com/muratyaman/node-express-health-avoid-oom
Image ref: https://unsplash.com/photos/rGVxtVVtv7E
Categories: