Let me start with a little background so maybe the "PRO's" in this tread will give me a shred of credibility. If a tech says its working and you still get Fatal Error, ask for a more experienced linux administrator to help you. htaccess for this reason.Ĥ) Any service (like MOZ) can spoof their useragent and so that is why with SS PRO we can block entire IP ranges.ĥ) If you get a Fatal Error you need to ask your host to install ION CUBE Loaders, its free, its easy and requires not maint. htacess to block spiders for some reason it doesn't always work and most people will fry their site trying to edit. Blocking them on your money site is not enough and Spyder Spanker only stop bots from crawling sites that you put it on.ģ) SS PRO does not use. PBN's are not cheap and if your competition knows what they all are then they can try and take them down with ddos or other evil ways. htacess file from the web.Ģ) Spyder Spanker PRO (for SEO's) is designed to stop the Backlink checkers from crawling your private blog network and seeing where you are linking to. Since I started the Seo Hosting craze in 2004, Ive been blocking bot ever since.ġ) Google now anyone can read your. Unless they are not showing the real date they found the backlink and did find it early just they didn't publish it on their site or something I don't see why it takes a few months, Majestic indicates they found the link after I implemented the htaccess block. Guess I will have to do the robots.txt too but that is public then, but I noted that someone else said their robots.txt doesn't block it and another person said it takes a few months to go into effect. So either Majestic is not identifying itself all the time or they are getting around it somehow? I did a little PHP test to fake a majestic bot and my site indeed blocks themĬurl_setopt($ch1, CURLOPT_USERAGENT, '^MJ12bot') Īdditionally, a 500 Internal Server ErrorĮrror was encountered while trying to use an ErrorDocument to handle the request. Has this happened to anyone else? I'm wondering how the bot can get around this? I can see the date that Majestic indicates that they have first seen and indexed the backlink is after the date I implemented the htaccess blocks. I implemented the htaccess block accross all my sites but I can see majestic has picked up all of them
0 Comments
Leave a Reply. |