Title: Bisteinoff SEO Robots.txt
Author: Denis Bisteinov
Published: <strong>1 Tháng 12, 2016</strong>
Last modified: 19 Tháng 12, 2025

---

Tìm kiếm plugin

![](https://ps.w.org/db-robotstxt/assets/banner-772x250.png?rev=2956960)

![](https://ps.w.org/db-robotstxt/assets/icon.svg?rev=2956961)

# Bisteinoff SEO Robots.txt

 Bởi [Denis Bisteinov](https://profiles.wordpress.org/bisteinoff/)

[Tải về](https://downloads.wordpress.org/plugin/db-robotstxt.4.0.3.zip)

 * [Chi tiết](https://vi.wordpress.org/plugins/db-robotstxt/#description)
 * [Đánh giá](https://vi.wordpress.org/plugins/db-robotstxt/#reviews)
 *  [Cài đặt](https://vi.wordpress.org/plugins/db-robotstxt/#installation)
 * [Nhà phát triển](https://vi.wordpress.org/plugins/db-robotstxt/#developers)

 [Hỗ trợ](https://wordpress.org/support/plugin/db-robotstxt/)

## Mô tả

Have you encountered an obstacle while creating and editing robots.txt file on your
website?

Bisteinoff SEO Robots.txt is an easy-to-use plugin that helps you generate and configure
a correct robots.txt file, which is essential for search engine optimization (SEO).
This file defines crawling rules for search engine bots such as Google, Bing, Yahoo!,
Yandex, and others.

The plugin works perfectly both if the file robots.txt has never been created or
if it already exists. Once installed the plugin makes an optimized robots.txt file
that includes special rules common for WordPress websites. After that you can proceed
further customization specific for your own website if needed.

If the plugin detects one or several Sitemap XML files it will include them into
robots.txt file.

No FTP access, manual coding or file editing is required that makes managing settings
easy and convenient!

#### Key Features

 * Automatic generation of optimized robots.txt with WordPress-specific rules
 * Special rules for Google and Yandex search engines
 * Custom rules support for any search engine bot
 * Automatic sitemap detection and inclusion
 * WooCommerce compatibility with specific rules
 * Multisite support
 * Easy-to-use admin interface
 * Modern PHP architecture with namespaces for conflict-free operation

## Ảnh màn hình

 * [[
 * The Settings Page.
 * [[
 * Error message if a non-virtual file robots.txt exists and the functionality to
   fix it.
 * [[
 * The message when the problem is fixed.

## Cài đặt

 1. Upload db-robotstxt folder to the `/wp-content/plugins/` directory
 2. Activate the plugin through the ‘Plugins’ menu in WordPress
 3. The plugin will automatically create a virtual robots.txt file
 4. Go to Settings > SEO Robots.txt to customize rules

## Hỏi đáp

### Will it conflict with any existing robots.txt file?

No, it will not. If the file robots.txt is found in the root folder it will not 
be overridden. On the Settings page you will see a notification with two options:
rename or delete the existing file robots.txt. The plugin provides this functionality
directly in the admin interface.

### Could I accidentally block all search robots?

Once the plugin is installed it will work fine for all search engine robots. If 
you are not aware of the rules for fine-tuning a robots.txt it is better to leave
the file as is or read first a corresponding manual to learn more about the directives
used for robots.txt.

Note: the following directives would block the corresponding search robot(s):

    ```
    Disallow:
    Disallow: /
    Disallow: *
    Disallow: /*
    Disallow: */
    ```

You should use any of these directives only if you do not want any page of your 
website to be accessible for crawling.

### Where can I read the up-to-date guide on robots.txt?

 * [Guide by Google](https://developers.google.com/search/docs/crawling-indexing/robots/robots_txt)
 * [Guide WordPress SEO](https://wordpress.org/documentation/article/search-engine-optimization/#robots-txt-optimization)

### What happens when I update to version 4.0?

**For regular users:** Nothing changes! The plugin will automatically migrate all
your settings. Everything continues to work exactly as before.

**For developers:** Version 4.0 introduces a complete code refactoring with modern
PHP classes and namespaces. If you have custom code that references this plugin’s
functions, constants, or options, please review the migration information below.

### Migration to v.4.0 – Information for Developers

If you have custom code that integrates with this plugin, please note these changes:

_Checking for deprecation notices:_ All deprecated elements will trigger `_doing_it_wrong()`
notices when `WP_DEBUG` is enabled. Enable debug mode to identify any issues:
 define(‘
WP_DEBUG’, true);

_Changed option names:_
 * `db_robots_custom`  `bisteinoff_plugin_robots_custom`*`
db_robots_custom_google`  `bisteinoff_plugin_robots_custom_google` * `db_robots_if_yandex``
bisteinoff_plugin_robots_enable_yandex` * `db_robots_custom_yandex`  `bisteinoff_plugin_robots_custom_yandex`*`
db_robots_custom_other`  `bisteinoff_plugin_robots_custom_other`

Note: Options are migrated automatically. Old option names are removed from the 
database after successful migration.

_Changed constants:_
 * `DB_PLUGIN_ROBOTSTXT_VERSION`  `BISTEINOFF_PLUGIN_ROBOTS_VERSION`*`
DB_PLUGIN_ROBOTSTXT_DIR`  `BISTEINOFF_PLUGIN_ROBOTS_DIR`

Note: Old constants remain defined for backward compatibility.

_Changed functions (now deprecated):_
 * `publish_robots_txt()`  Use `\Bisteinoff\
Plugin\RobotsTXT\Generator::generate()` instead * `db_robots_admin()`  Use `\Bisteinoff\
Plugin\RobotsTXT\Admin::add_menu_page()` instead * `db_robotstxt_admin_settings()`
Use `\Bisteinoff\Plugin\RobotsTXT\Admin::render_settings_page()` instead * `db_settings_link()`
Use `\Bisteinoff\Plugin\RobotsTXT\Loader::add_settings_link()` instead

Note: Deprecated functions continue to work with backward compatibility.

**Action required:**
 Update your custom code to use the new naming conventions.
All deprecated elements will be removed after Feb 16th 2027.

## Đánh giá

![](https://secure.gravatar.com/avatar/f2949e1420c186ba7fe9eafb8f5c406b6b29ddebb639e7c7da6f93d39b784643?
s=60&d=retro&r=g)

### 󠀁[Interesting concept, nicely implemented](https://wordpress.org/support/topic/interesting-concept-nicely-implemented/)󠁿

 [Martin Sauter](https://profiles.wordpress.org/martinsauter/) 12 Tháng 1, 2026

This plugin lets you manage your robots.txt through the WordPress backend and adds
some common configurations to improve your SEO. Very clean interface, easy to use.
What else can you ask for? BTW: After updating your robots.txt configuration you
may need to flush your server cache to see the changes.

![](https://secure.gravatar.com/avatar/463503d802990cc276266c4d7a96dc93b05c737f5f2c505c89fe86481e9bcf7c?
s=60&d=retro&r=g)

### 󠀁[Very convenient!!!](https://wordpress.org/support/topic/very-convenient-84/)󠁿

 [t04e4ka](https://profiles.wordpress.org/t04e4ka/) 17 Tháng 9, 2023

As a SEO specialist, I can say that this plugin is indispensable in everyday work.
with it, I can quickly generate the desired file without unnecessary labor.it is
convenient that there are different blocks for entering information for different
search engines, since often different indexing rules may be relevant for different
search engines.

![](https://secure.gravatar.com/avatar/7e7b0eb15fce03a0a075b79b9e9ad0a30ca88b9858daab39ecb6b32157608416?
s=60&d=retro&r=g)

### 󠀁[Seems to be rather complete](https://wordpress.org/support/topic/seems-to-be-rather-complete/)󠁿

 [Valéry](https://profiles.wordpress.org/valgaldes/) 16 Tháng 9, 2023

easy to use, it generates a big file robots.txt for google that includes almost 
all possible issues for your website

![](https://secure.gravatar.com/avatar/f6fadd832b73e4a08afd2bc8d4c373bec0b3b1e2d75d904ca9c6ea87929e08fe?
s=60&d=retro&r=g)

### 󠀁[Nice!](https://wordpress.org/support/topic/nice-933/)󠁿

 [daskel](https://profiles.wordpress.org/daskel/) 8 Tháng 12, 2016

Very simple

 [ Đọc tất cả 4 đánh giá ](https://wordpress.org/support/plugin/db-robotstxt/reviews/)

## Người đóng góp & Lập trình viên

“Bisteinoff SEO Robots.txt” là mã nguồn mở. Những người sau đã đóng góp vào plugin
này.

Những người đóng góp

 *   [ Denis Bisteinov ](https://profiles.wordpress.org/bisteinoff/)

“Bisteinoff SEO Robots.txt” đã được dịch qua 5 ngôn ngữ. Cảm ơn [những người tham gia dịch](https://translate.wordpress.org/projects/wp-plugins/db-robotstxt/contributors)
vì đóng góp của họ.

[Dịch “Bisteinoff SEO Robots.txt” sang ngôn ngữ của bạn.](https://translate.wordpress.org/projects/wp-plugins/db-robotstxt)

### Muốn tham gia phát triển?

[Duyệt code](https://plugins.trac.wordpress.org/browser/db-robotstxt/), check out
[SVN repository](https://plugins.svn.wordpress.org/db-robotstxt/), hoặc theo dõi
[nhật ký phát triển](https://plugins.trac.wordpress.org/log/db-robotstxt/) qua [RSS](https://plugins.trac.wordpress.org/log/db-robotstxt/?limit=100&mode=stop_on_copy&format=rss).

## Nhật ký thay đổi

#### 4.0

 * **MAJOR UPDATE: Complete code refactoring with modern PHP architecture**
 * Compatible with WordPress 6.9
 * Compatible with WordPress Theme Bisteinoff 2.4+
 * Compatible with PHP 7.0 through PHP 8.4 (no deprecated PHP features used)
 * Feature: Modern PHP namespaces (`Bisteinoff\Plugin`) to prevent conflicts with
   other plugins
 * Feature: Seamless integration with Bisteinoff WordPress themes and plugins
 * Feature: Efficient class-based architecture with lazy loading
 * Feature: Automatic migration system for settings and options
 * Fix: Undefined variable warnings for `$db_renamed` and `$db_deleted`
 * **Backward Compatibility:** All old function names preserved until at least February
   16, 2027
 * **Backward Compatibility:** Old constant names (DB_PLUGIN_ROBOTSTXT_*) preserved
 * **Backward Compatibility:** Options automatically migrated from old to new names
 * **For Developers:** See FAQ section “Migration to v.4.0” for detailed technical
   information

#### 3.12

 * Compatible with WordPress 6.7
 * Rewritten the code with depricated and discouraged functions
 * Security issues

#### 3.11

 * Design of the Settings page in admin panel

#### 3.10

 * Custom rules for WooCommerce if the plugin is installed and activated
 * Fixing ampersand symbol

#### 3.9

 * Security issues

#### 3.8

 * Compatible with WordPress 6.5

#### 3.7

 * Security issues

#### 3.6

 * Compatible with WordPress 6.3
 * Security issues

#### 3.5

 * Compatible with multisites

#### 3.4.2

 * Corrected errors in the functions for translation of the plugin

#### 3.4.1

 * Now the translations are automatically downloaded from https://translate.wordpress.
   org/projects/wp-plugins/db-robotstxt/ If there is not a translation into your
   language, please, don’t hesitate to contribute!

#### 3.4

 * Compatible with GlotPress

#### 3.3

 * New options to rename or delete the existing robots.txt file

#### 3.2

 * New option to disable the rules for Yandex
 * Design of the Settings page in admin panel

#### 3.1

 * New basic regular rules for Googlebot and Yandex
 * Now more possibilities to manage your robots.txt: you can add custom rules for
   Googlebot, Yandex and other User-agents
 * More information about your robots.txt on the settings page

#### 3.0

 * Added a settings page in admin panel for custom rules

#### 2.3

 * Tested with WordPress 6.2.
 * The code is optimized
 * Added the robots directives for new types of images WebP, Avif

#### 2.2

 * Fixed Sitemap option

#### 2.1

 * Tested with WordPress 5.5.
 * Added wp-sitemap.xml

#### 2.0

 * Tested with WordPress 5.0.
 * The old Host directive is removed, as no longer supported by Yandex.
 * The robots directives are improved and updated.
 * Added the robots directives, preventing indexind duplicate links with UTM, Openstat,
   From, GCLID, YCLID, YMCLID links

#### 1.0

 * Initial release.

## Meta

 *  Phiên bản **4.0.3**
 *  Cập nhật lần cuối **5 tháng trước**
 *  Số lượt cài đặt **500+**
 *  Phiên bản WordPress ** 4.6 hoặc cao hơn **
 *  Đã kiểm tra lên đến **6.9.4**
 *  Phiên bản PHP ** 7.0 hoặc cao hơn **
 *  Ngôn ngữ
 * [Dutch](https://nl.wordpress.org/plugins/db-robotstxt/), [English (US)](https://wordpress.org/plugins/db-robotstxt/),
   [French (France)](https://fr.wordpress.org/plugins/db-robotstxt/), [German](https://de.wordpress.org/plugins/db-robotstxt/),
   [German (Switzerland)](https://de-ch.wordpress.org/plugins/db-robotstxt/), và
   [Russian](https://ru.wordpress.org/plugins/db-robotstxt/).
 *  [Dịch sang ngôn ngữ của bạn](https://translate.wordpress.org/projects/wp-plugins/db-robotstxt)
 * Thẻ
 * [crawler](https://vi.wordpress.org/plugins/tags/crawler/)[google](https://vi.wordpress.org/plugins/tags/google/)
   [robots](https://vi.wordpress.org/plugins/tags/robots/)[robots.txt](https://vi.wordpress.org/plugins/tags/robots-txt/)
   [seo](https://vi.wordpress.org/plugins/tags/seo/)
 *  [Nâng cao](https://vi.wordpress.org/plugins/db-robotstxt/advanced/)

## Đánh giá

 5 trên 5 sao.

 *  [  4 5-star reviews     ](https://wordpress.org/support/plugin/db-robotstxt/reviews/?filter=5)
 *  [  0 4-star reviews     ](https://wordpress.org/support/plugin/db-robotstxt/reviews/?filter=4)
 *  [  0 3-star reviews     ](https://wordpress.org/support/plugin/db-robotstxt/reviews/?filter=3)
 *  [  0 2-star reviews     ](https://wordpress.org/support/plugin/db-robotstxt/reviews/?filter=2)
 *  [  0 1-star reviews     ](https://wordpress.org/support/plugin/db-robotstxt/reviews/?filter=1)

[Your review](https://wordpress.org/support/plugin/db-robotstxt/reviews/#new-post)

[Xem tất cả đánh giá](https://wordpress.org/support/plugin/db-robotstxt/reviews/)

## Những người đóng góp

 *   [ Denis Bisteinov ](https://profiles.wordpress.org/bisteinoff/)

## Hỗ trợ

Có điều gì muốn nói? cần giúp đỡ?

 [Xem diễn đàn hỗ trợ](https://wordpress.org/support/plugin/db-robotstxt/)

## Ủng hộ

Bạn có muốn hỗ trợ vào sự phát triển của plugin này?

 [ Ủng hộ plugin này ](https://bisteinoff.com)