blog/static/robots.txt

# https://www.robotstxt.org/robotstxt.html
User-agent: *
Disallow: /*.json$
Disallow: /*.xml$
Disallow: /404.html
Disallow: /css/
Disallow: /js/
Disallow: /lib/

Sitemap: /sitemap.xml
Changed some configs 2024-04-17 00:19:18 +02:00			`# https://www.robotstxt.org/robotstxt.html`
			`User-agent: *`
Added the "Hello World!" article 2024-04-22 11:20:53 +02:00			`Disallow: /*.json$`
			`Disallow: /*.xml$`
			`Disallow: /404.html`
			`Disallow: /css/`
			`Disallow: /js/`
			`Disallow: /lib/`

			`Sitemap: /sitemap.xml`