Merge pull request #242 from utxostack/develop

Merge develop to main (20241008)
utxostack · Oct 8, 2024 · 5498796 · 5498796 · vercel · Oct 8, 2024
2 parents fa2fd38 + 0c9271e
commit 5498796
Showing 1 changed file with 6 additions and 0 deletions.
diff --git a/frontend/public/robots.txt b/frontend/public/robots.txt
@@ -1,3 +1,9 @@
+User-agent: meta-externalagent
+Disallow: /
+
+User-agent: DataForSeoBot
+Disallow: /
+
 User-agent: *
 Disallow: /en/explorer/btc
 Disallow: /en/explorer/ckb