Analyzing server logs to understand how web crawlers interact with your site's product feeds.