angie828 Author Level X3 December 1, 2011, 2:54 pm Select a reason you're reporting this comment Cyberbullying and Harassment Threats to Personal Safety Hate Speech Sexually Explicit Content Breach of User Privacy Illegal Service/Offer Spam Scam Or Submit Write the reason you're deleting this FAQ Delete Is there a way to prevent a spider from attaching itself to a URL that you do not want on the search engines? 0 4 Share
robertman11 robertman11 15 years ago 2011-12-01T17:02:58-0500 Use your robots.txt file or use .htaccess to actually blog the spider (you can block by IP or by user-client).Use your robots.txt file or use .htaccess to actually blog the spider (you can block by IP or by user-client). 0 Select a reason you're reporting this commentCyberbullying and HarassmentThreats to Personal SafetyHate SpeechSexually Explicit ContentBreach of User PrivacyIllegal Service/OfferSpamScam OrSubmit Enter a reason for deleting this commentDelete Post Comment
Light Light 15 years ago 2011-12-02T06:50:08-0500 Thanks for the information guys. Thanks for the information guys. :) 0 Select a reason you're reporting this commentCyberbullying and HarassmentThreats to Personal SafetyHate SpeechSexually Explicit ContentBreach of User PrivacyIllegal Service/OfferSpamScam OrSubmit Enter a reason for deleting this commentDelete Post Comment