WordPress robots.txt file – how to optimize it for SEO (in Hindi)

WordPress robots.txt file – how to optimize it for SEO (in Hindi)
Main points that we will cover in this video on WordPress robots.txt are:
1) What is robots.txt?
2) Where is robots.txt located?
3) How to create and optimize robots.txt?
4) Example of a robots.txt file.
What is robots.txt?
As you see robots.txt is a text file that instructs search engine bots which parts of your site to crawl and which parts not to crawl.
Useful posts:
High PR Blog Submission Sites List –
High PR Video Submission Sites List –
Top 180+ High DA PR Profile Creation Sites List –
Utmost List of 125 Plus High DA Blog Commenting Sites [Must Have] –

Where is robots.txt located?
By default, this file does not exist. And in that case, bots crawl all the content of your site.
This file has to be located in the root directory of your website. If you place it somewhere else, then bots will consider that you do not have the robots.txt file.
Bots always look for this file at www.yoursite.com/robots.txt. For example, my domain name is hariforyou.com and you can find my robots.txt file at hariforyou.com/robots.txt.
Normally, the public_html folder is your website’s root directory and robots.txt file should reside there.
How to create and optimize robots.txt file?
There are two ways to create a robots.txt file.
a) By using the Yoast SEO plugin, or
b) By using FTP and directly placing it in the root directory of your website.

How to optimize a robots.txt file?
The best practices for a robots.txt file are:
• Allow all bots to crawl your site. So, the first line should read – User-agent: *
• You may want your images to be indexed so the second line may read – Allow: /wp-content/uploads/
• For the rest of the lines, you may refer my robots.txt file.
• Lastly, you should tell the bots about the URL(s) of your sitemaps. So, list them also.
Special tip: You may refer some high domain authority sites’ robots.txt file before finalizing your own file.

Fuente – Source

WordPress robots.txt file – how to optimize it for SEO (in Hindi)

Necesitas ayuda con wp? Entonces WPVideo es tu sitio.
Encuentra lo que buscas entre cientos de miles de videos y experiencias personales de otros usuarios. Todos los que empezamos con wp deberíamos tener acceso a esta web, ojalá yo hubiera tenido algo así cuando empecé mi camino como webmaster 🙂
Pero ahora quiero y puedo poner esta web a vuestra disposición.
Disfrutadla 😉

Need help with wp? Then WPVideo is your site.
Find what you are looking for among hundreds of thousands of videos and personal experiences of other users. All of us who started with wp should have access to this website, I wish I had something like that when I started my journey as webmaster 🙂
But now I want and I can put this website at your disposal.
Enjoy it 😉


Publicado en Plugins, SEO, Wordpress y etiquetado .

Deja un comentario

Tu dirección de correo electrónico no será publicada. Los campos obligatorios están marcados con *