# MathDB — https://mathdb.com
#
# Search and AI crawlers are welcome on public, read-only pages: the site exists
# to make open problems findable. Please identify your crawler, use a reasonable
# request rate, and follow the Terms of Service at https://mathdb.com/terms.
# Per-user, write, moderation and internal-search surfaces are excluded because
# they are not useful crawler destinations.

User-agent: *
Disallow: /new
Disallow: /bookmarks
Disallow: /moderation
Disallow: /search

Sitemap: https://mathdb.com/sitemap.xml