By default, /robots.txt on an Odoo installation with website module installed will allow indexing by webcrawlers.
This module will overwrite view that generates /robots.txt and won't allow to index.
Table of contents
- You can enable crawler by editing the default system parameter "website.crawler.disable" (in the menu Settings > Parameters > System Parameters).
No useable features for an user are available. To view the results, visit /robots.txt on your site.
Bugs are tracked on GitHub Issues. In case of trouble, please check there if your issue has already been reported. If you spotted it first, help us to smash it by providing a detailed and welcomed feedback.
Do not contact contributors directly about support or help with technical issues.
- B-Informed B.V.
- Ooops
- Roel Adriaans <[email protected]>
- Tecnativa:
- Ernesto Tejeda
- Kaushal Prajapati <[email protected]>
- Ooops:
- Giovanni Serra <[email protected]>
This module is maintained by the OCA.
OCA, or the Odoo Community Association, is a nonprofit organization whose mission is to support the collaborative development of Odoo features and promote its widespread use.
This module is part of the OCA/website project on GitHub.
You are welcome to contribute. To learn how please visit https://odoo-community.org/page/Contribute.