Robots txt Tutorial 2019 – SEO Best Practices Explained

Your robots.txt file is something you should always consider when staring and SEO campaign on your website.

in this robots.txt tutorial, I will explain the best practices that will ensure you don’t block the wrong crawlers from accessing and indexing pages of your site.

If you set up the robots txt file incorrectly then it could have significant negative consequences to your SEO in the short term. It can be fixed in future but it is best to get it right.

It is a simple file to create, upload and edit and in this robots txt tutorial, you’ll know exactly what you should and shouldn’t do!

If you liked this video, don’t forget to subscribe and follow me on Twitter & LinkedIn via the below.

And as always, if you have a questions, or want me to cover a particular subject or marketing challenge you’re facing, head over to my website and get in touch. I would love to hear from you!



  1. The Big Marketer says:

    *This video is part of the “Ultimate SEO Checklist” a video guide and checklist for SEO which you can get here*

  2. Michael Ortega says:

    Hey I just came across your channel and I’m not savvy on websites or anything. Have you made any video on how to better manage on artist website or how to engage more with people in hopes that they will buy your product thanks?

    • The Big Marketer says:

      I have done a video about leveraging online communities

      but audience development depends on which social media channel you want to grow with.

Leave a Comment