Load Balanced Bot-split Approach to Counter Excessive Bot Traffic. When Search Engines Work Against You!

Instead of increasing your hardware fleet to several folds your current needed capacity for the sole purpose of absorbing search engine traffic, you can leverage a dirt-cheap high-density RAM server to cache as much of your content on a separate server where all bot traffic will be “trapped.”