about.readthedocs.com/blog/2024/07/ai-crawlers-abuse

Preview meta tags from the about.readthedocs.com website.

Linked Hostnames

17

Thumbnail

Search Engine Appearance

Google

https://about.readthedocs.com/blog/2024/07/ai-crawlers-abuse

AI crawlers need to be more respectful

We talk a bit about the AI crawler abuse we are seeing at Read the Docs, and warn that this behavior is not sustainable.



Bing

AI crawlers need to be more respectful

https://about.readthedocs.com/blog/2024/07/ai-crawlers-abuse

We talk a bit about the AI crawler abuse we are seeing at Read the Docs, and warn that this behavior is not sustainable.



DuckDuckGo

https://about.readthedocs.com/blog/2024/07/ai-crawlers-abuse

AI crawlers need to be more respectful

We talk a bit about the AI crawler abuse we are seeing at Read the Docs, and warn that this behavior is not sustainable.

  • General Meta Tags

    17
    • title
      AI crawlers need to be more respectful - Read the Docs
    • charset
      utf-8
    • generator
      Pelican
    • viewport
      width=device-width, initial-scale=1
    • twitter:title
      AI crawlers need to be more respectful

  • Open Graph Meta Tags

    5
    • og:site_name
      Read the Docs
    • og:type
      article
    • og:title
      AI crawlers need to be more respectful
    • og:description
      We talk a bit about the AI crawler abuse we are seeing at Read the Docs, and warn that this behavior is not sustainable.
    • og:image
      https://about.readthedocs.com/images/headers/ai-crawlers.jpg

  • Link Tags

    8
    • alternate
      https://about.readthedocs.com//feeds/atom.xml
    • alternate
      https://about.readthedocs.com//feeds/engineering.atom.xml
    • apple-touch-icon
      https://about.readthedocs.com/theme/img/apple-touch-icon.png
    • icon
      https://about.readthedocs.com/theme/img/favicon-32x32.png
    • icon
      https://about.readthedocs.com/theme/img/favicon-24x24.png

Links

45