In order to test to see if Stop Web Crawlers is working on your website and to ensure that it is protecting your website from a specific Referrer spam bot. You will need to download a Browser plug-in or application like:
Postman is the swiss army knife of API tools, allowing you to design, build, test, document and monitor your services, all in one place. You will need to download Postman, it used to available as a Chrome browser plugin, but now it is a stand alone application which requires download.
If you are going to be developing or exploring API’s to use, it is a really handy tool to get to know. It is also a free tool!
Testing Stop Web Crawlers with Postman is extremely easy.
- Enter Your URL
- Select Headers
- Enter Referer
- add a domain you would like to test to block
- click send
- Check the result. You should see 403 Forbidden
Our personal favourite is Http Requester due to its ease of use and friendly user interface. However most REST clients work in much the same way.
The Instructions below will guide you through making use of Http Requester . Complete the form as below:
[thumbnail target=”_self” alt=”Http Request Configuration” src=”https://threenine.co.uk/wp-content/uploads/2016/07/Arc.png”]
Once complete click GET
[thumbnail target=”_self” alt=”Test Referer spam result” src=”https://threenine.co.uk/wp-content/uploads/2016/07/Test-Response.png”]
A unique background as business owner, marketing, software development and business development ensures that he can offer the optimum business consultancy services across a wide spectrum of business challenges.
Latest posts by Gary Woodfine (see all)
- How to start a new Python Project using Pycharm and Conda on ubuntu - January 11, 2019
- How to add Vuetify to Laravel Project - January 7, 2019
- Getting Started with Python on Ubuntu - December 5, 2018