# Yarl IT Hub - Robots.txt User-agent: * Allow: / # Sitemap Sitemap: https://yarlithub.org/sitemap.xml # Crawl delay (optional) Crawl-delay: 1