Robots Spiders and Bots
- Dr Bunsen Honeydew
- Posts: 30758
- Joined: Wed Jul 11, 2012 7:26 pm
- Location: Muppet Labs
- Has thanked: 0
- Been thanked: 48 times
Robots Spiders and Bots
For some reason since the forum upgrade we have lost just about all of them. The only regular visitor now is Baidu from China. It has mystified Terry, does anyone here have knowledge of how we get them back.
-
- Posts: 934
- Joined: Tue Jun 14, 2016 1:58 pm
- Has thanked: 0
- Been thanked: 18 times
Re: Robots Spiders and Bots
Have you looked on the manage bot page in the phpbb admin section checking they are activated.
- terrybooth
- Posts: 4399
- Joined: Wed Jul 11, 2012 6:49 pm
- Location: West Yorkshire
- Has thanked: 499 times
- Been thanked: 252 times
Re: Robots Spiders and Bots
Yes. All bots are activated.
Pioneer PL71/DL103/ Phono2/HiFiPi/P90SA/TIS/CubixPro
- terrybooth
- Posts: 4399
- Joined: Wed Jul 11, 2012 6:49 pm
- Location: West Yorkshire
- Has thanked: 499 times
- Been thanked: 252 times
Re: Robots Spiders and Bots
94 guests online at the moment - looking at them, many appear to be bots. But they are not registered.
Pioneer PL71/DL103/ Phono2/HiFiPi/P90SA/TIS/CubixPro
- Dr Bunsen Honeydew
- Posts: 30758
- Joined: Wed Jul 11, 2012 7:26 pm
- Location: Muppet Labs
- Has thanked: 0
- Been thanked: 48 times
Re: Robots Spiders and Bots
Ah! that would explain it, how do we register them or are they nasty fishing bots.
- terrybooth
- Posts: 4399
- Joined: Wed Jul 11, 2012 6:49 pm
- Location: West Yorkshire
- Has thanked: 499 times
- Been thanked: 252 times
Re: Robots Spiders and Bots
The one's we want are the search engine ones. I've created a robots.txt file to see if that makes a difference.
Pioneer PL71/DL103/ Phono2/HiFiPi/P90SA/TIS/CubixPro
-
- Posts: 934
- Joined: Tue Jun 14, 2016 1:58 pm
- Has thanked: 0
- Been thanked: 18 times
- Dr Bunsen Honeydew
- Posts: 30758
- Joined: Wed Jul 11, 2012 7:26 pm
- Location: Muppet Labs
- Has thanked: 0
- Been thanked: 48 times
Re: Robots Spiders and Bots
Yes. i just copied a few but only the top three have been here and only two today.
Baidu [Spider] Tue Nov 14, 2017 11:33 pm Deactivate Edit Delete
Exabot [Bot] Tue Nov 14, 2017 3:22 am Deactivate Edit Delete
Alexa [Bot] Fri Nov 10, 2017 6:49 am Deactivate Edit Delete
AdsBot [Google] Never Deactivate Edit Delete
Alta Vista [Bot] Never Deactivate Edit Delete
Ask Jeeves [Bot] Never Deactivate Edit Delete
Bing [Bot] Never Deactivate Edit Delete
FAST Enterprise [Crawler] Never Deactivate Edit Delete
FAST WebCrawler [Crawler] Never Deactivate Edit Delete
Francis [Bot] Never Deactivate Edit Delete
Gigabot [Bot] Never Deactivate Edit Delete
Google Adsense [Bot] Never Deactivate Edit Delete
Google Desktop Never Deactivate Edit Delete
Google Feedfetcher Never Deactivate Edit Delete
There is about 100 more listed as never visited. Obviously the formatting is wrong but I am sure you can see what I mean.
Baidu [Spider] Tue Nov 14, 2017 11:33 pm Deactivate Edit Delete
Exabot [Bot] Tue Nov 14, 2017 3:22 am Deactivate Edit Delete
Alexa [Bot] Fri Nov 10, 2017 6:49 am Deactivate Edit Delete
AdsBot [Google] Never Deactivate Edit Delete
Alta Vista [Bot] Never Deactivate Edit Delete
Ask Jeeves [Bot] Never Deactivate Edit Delete
Bing [Bot] Never Deactivate Edit Delete
FAST Enterprise [Crawler] Never Deactivate Edit Delete
FAST WebCrawler [Crawler] Never Deactivate Edit Delete
Francis [Bot] Never Deactivate Edit Delete
Gigabot [Bot] Never Deactivate Edit Delete
Google Adsense [Bot] Never Deactivate Edit Delete
Google Desktop Never Deactivate Edit Delete
Google Feedfetcher Never Deactivate Edit Delete
There is about 100 more listed as never visited. Obviously the formatting is wrong but I am sure you can see what I mean.
-
- Posts: 934
- Joined: Tue Jun 14, 2016 1:58 pm
- Has thanked: 0
- Been thanked: 18 times
Re: Robots Spiders and Bots
Try adding the website into googles search list.
https://www.google.com/webmasters/tools ... -url?pli=1
https://www.google.com/webmasters/tools ... -url?pli=1
- Dr Bunsen Honeydew
- Posts: 30758
- Joined: Wed Jul 11, 2012 7:26 pm
- Location: Muppet Labs
- Has thanked: 0
- Been thanked: 48 times
Re: Robots Spiders and Bots
Done, should everyone here do this at it seems to be an individual choice.
I have a thought, could it be they are all going to a Portal that is no longer there !!!!
I have a thought, could it be they are all going to a Portal that is no longer there !!!!