An aggressive bot crawling one of our c5 sites from hundreds of different IPs (around 180 hits per minute) keeps crashing our servers. Our sysadmin tells me that as aggressive as the bot is, the resources available on the applicable VM node means that the site should easily be able to cope with such bots. He tells me that the site is obviously using an unexpectedly high rate of resources and that I need to get a breakdown of exactly what is using memory in the site.

Has anyone successfully managed to get a memory profiler running with a c5 site, and if so, what did you use and how did you use it, please?