Robots.txt disallow all

To prevent google to reference your dev website, you can add a robots.txt file to your web root directory and fill it with

User-agent: *
Disallow: /

The “User-agent: *” means that the file applies to all robots. The “Disallow: /” means the robot will not visit any pages on the website.

Leave a Reply