DB Robots.txt

Сүрөттөө

DB Robots.txt is an easy (i.e. automated) solution to creating and managing a robots.txt file for your site. It is easy to create a robots.txt without FTP access.

If the plugin detects one or several Sitemap XML files it will include them into robots.txt file.

Орнотуу

  1. Upload bisteinoff-robots-txt folder to the /wp-content/plugins/ directory
  2. Activate the plugin through the ‘Plugins’ menu in WordPress
  3. Enjoy

FAQ.KG

Will it conflict with any existing robots.txt file?

If a physical robots.txt file exists on your site, WordPress won’t process any request for one, so there will be no conflict.

Will this work for sub-folder installations of WordPress?

Out of the box, no. Because WordPress is in a sub-folder, it won’t “know” when someone is requesting the robots.txt file which must be at the root of the site.

Сын-пикирлер

Сентябрь 17, 2023-ж.
As a SEO specialist, I can say that this plugin is indispensable in everyday work. with it, I can quickly generate the desired file without unnecessary labor.it is convenient that there are different blocks for entering information for different search engines, since often different indexing rules may be relevant for different search engines.
Сентябрь 16, 2023-ж.
easy to use, it generates a big file robots.txt for google that includes almost all possible issues for your website
Read all 3 reviews

Contributors & Developers

“DB Robots.txt” is open source software. The following people have contributed to this plugin.

Мүчөлөрү

“DB Robots.txt” has been translated into 1 locale. Thank you to the translators for their contributions.

Translate “DB Robots.txt” into your language.

Interested in development?

Browse the code, check out the SVN repository, or subscribe to the development log by RSS.

Өзгөртүүлөр

3.7

  • Security issues

3.6

  • Compatible with WordPress 6.3
  • Security issues

3.5

  • Compatible with multisites

3.4.2

  • Corrected errors in the functions for translation of the plugin

3.4.1

  • Now the translations are automatically downloaded from https://translate.wordpress.org/projects/wp-plugins/db-robotstxt/ If there is not a translation into your language, please, don’t hesitate to contribute!

3.4

  • Compatible with GlotPress

3.3

  • New options to rename or delete the existing robots.txt file

3.2

  • New option to disable the rules for Yandex
  • Design of the Settings page in admin panel

3.1

  • New basic regular rules for Googlebot and Yandex
  • Now more possibilities to manage your robots.txt: you can add custom rules for Googlebot, Yandex and other User-agents
  • More information about your robots.txt on the settings page

3.0

  • Added a settings page in admin panel for custom rules

2.3

  • Tested with WordPress 6.2.
  • The code is optimized
  • Added the robots directives for new types of images WebP, Avif

2.2

  • Fixed Sitemap option

2.1

  • Tested with WordPress 5.5.
  • Added wp-sitemap.xml

2.0

  • Tested with WordPress 5.0.
  • The old Host directive is removed, as no longer supported by Yandex.
  • The robots directives are improved and updated.
  • Added the robots directives, preventing indexind duplicate links with UTM, Openstat, From, GCLID, YCLID, YMCLID links

1.0

  • Initial release.