Check The Robots.txt File For Potential WordPress SEO Issues | WP Learning Lab

Grab Your Free 17-Point WordPress Pre-Launch PDF Checklist:
Download our exclusive 10-Point WP Hardening Checklist:

Check The Robots.txt File For Potential WordPress SEO Issues | WP Learning Lab

The Robots.txt is an important file for controlling access to your website. Inside this file you can block access from different user agents, IP addresses or block access to specific files and folders.

Here’s where it can be a problem.

When a website is in development the developer often restricts access to your site to just a few IPs so that they can work on it and you can view it, but regular traffic isn’t able to access it.

It makes sense, you don’t want your visitors and future customers to see a half-finished website.

On the rare occasion a website will launch without these restrictions being removed from the robots.txt. That destroys your SEO and organic traffic because your site can’t be accessed! Even though everything looks fine to you because your IP is allowed access.

Luckily it’s easy to fix. There are two ways.

You can log into your website’s root folder via FTP or the file manager in your hosting account. Then open the robots.txt file (this file is always in the root folder)

If you have Google Webmaster Tools (GWT) installed you can access and edit your Robots.txt file from there.

For most websites you can delete the robots.txt file or delete it’s contents. If you’re not sure if you should do this check out this website:

You’ll find all the robots.txt file info you’ll ever need. So if your robots.txt file contains a bunch of code that you want to understand, visit that URL.

I hope this information helps you! If you have any questions leave a comment below or ping me @WPLearningLab on Twitter.


If you want more excellent WordPress information check out our website where we post WordPress tutorials daily.

Connect with us:

WP Learning Lab Channel:



Google Plus:


Fuente – Source

Check The Robots.txt File For Potential WordPress SEO Issues | WP Learning Lab

Necesitas ayuda con wp? Entonces WPVideo es tu sitio.
Encuentra lo que buscas entre cientos de miles de videos y experiencias personales de otros usuarios. Todos los que empezamos con wp deberíamos tener acceso a esta web, ojalá yo hubiera tenido algo así cuando empecé mi camino como webmaster 🙂
Pero ahora quiero y puedo poner esta web a vuestra disposición.
Disfrutadla 😉

Need help with wp? Then WPVideo is your site.
Find what you are looking for among hundreds of thousands of videos and personal experiences of other users. All of us who started with wp should have access to this website, I wish I had something like that when I started my journey as webmaster 🙂
But now I want and I can put this website at your disposal.
Enjoy it 😉

Publicado en SEO, Soluciones (Problems solved), Tutoriales (Tutorials), Wordpress y etiquetado .

Deja un comentario

Tu dirección de correo electrónico no será publicada. Los campos obligatorios están marcados con *