docs.semactic › FAQ

What is the Log Analyzer?

The Log Analyzer lets you import and analyze your server log files to understand how search engine bots and AI bots crawl your website. It is available to Admins, from Log Analyzer in the sidebar.

Key features:

  • Import log files or connect a server (Data sources, in the Settings tab)
  • See Bot visits over time by family: search engines, AI bots, social networks, SEO tools
  • See the Most crawled parts of the site and which pages each bot visits most or least
  • Spot the HTTP status codes returned to bots, such as 404 and 500 errors
  • Compare with the previous period to spot changes in crawl behavior, and compare the pages bots visit with those known to the Semactic crawler (Crawler tab)

Bot categories tracked:

  • Search engines (Googlebot, Bingbot…)
  • AI bots (GPTBot, ClaudeBot, PerplexityBot…)
  • SEO tools
  • Social media crawlers

See How do I import a log file? Learn more: Log Analyzer.