Here is a sample code repository implementing some guards against out-of-memory errors / crashes on components using Node.js. It is using health-check mechanism that could be taken advantage by load balancer. Also, it has a request rejector and counter.

What do you think? What do you use/do? Or do you just let your processes crash?!

Note: auto-scaling up based on average CPU usage is not sufficient and it is very slow; load balancing based on round-robin or connection count is not great either.


Image ref: