# Single source for robots.txt. # # A file in public/ wins over an app/robots.ts Metadata Route, so the two # used to coexist with contradictory rules while only this one was ever # served. robots.ts has been removed. It could not replace this file in any # case: MetadataRoute.Robots cannot express Clean-param, which Yandex needs. # # /r/ is the referral redirector. It already answers X-Robots-Tag: # noindex, nofollow (next.config.mjs), and is kept out of the crawl here too. User-agent: * Allow: / Allow: /*.js$ Allow: /*.css$ Allow: /*.png$ Allow: /*.jpg$ Allow: /*.svg$ Allow: /*.webp$ Disallow: /admin Disallow: /json/r.json Disallow: /r/ Clean-param: code&adv&tgchatbangtao&utm_source&utm_medium&utm_campaign&utm_term&utm_content&session_utm_id Sitemap: https://arbi.exchange/sitemap.xml