Invoriment:
Odoo 17 CE
Ubuntu 22.04, Docker
I have updated the robots.txt file from Settings >> Website >> Robots.txt to this
Disallow: /web/login
Allow: *
But Still, when I visit the UR: https://mydomain.com/robots.txt, I see this
User-agent: *
Disallow: /
Google is not crawling the website, and I can see the same issue with Webmaster tools.
Any Idea How can I fix it?
I really appreciate any help you can provide.