|
 john-sampson rated 11 months ago- From the page: "One of the main reasons for creating a robots.txt file is to prevent the search engines from reaching your content from more than one location (i.e. in your monthly archives, your category folders, your xml feed and on your front page) because this could lead to duplicate conten...
|
|
3 Reviews
-
-
- nyirendac rated 10 months ago
- Very informative article about robot.txt in wordpress
- john-sampson rated 11 months ago
- From the page: "One of the main reasons for creating a robots.txt file is to prevent the search engines from reaching your content from more than one location (i.e. in your monthly archives, your category folders, your xml feed and on your front page) because this could lead to duplicate content issues."
- gerardmcgarry rated 11 months ago
- That's right, I'm delving into the world of robots.txt today in the hopes that I can fix some ranking issues with my website. Twenty Steps is always a great read, so this looks good.
|
