Silk Road forums

Discussion => Off topic => Topic started by: Boba Fett on September 08, 2011, 04:29 am

Title: Forums Indexed in Google
Post by: Boba Fett on September 08, 2011, 04:29 am
noticed the forums are being indexed in Google via tor2web.org.  this can't be a good thing.
Title: Re: Forums Indexed in Google
Post by: johnwholesome on September 08, 2011, 04:31 am
damn....wtf......
Title: Re: Forums Indexed in Google
Post by: profspudhed on September 08, 2011, 11:04 am
we need to find a way to put a stop to that sharpish
Title: Re: Forums Indexed in Google
Post by: Modoki on September 08, 2011, 12:09 pm
bump for fix (robots.txt?)
this has to cease now
Title: Re: Forums Indexed in Google
Post by: 46&2 on September 10, 2011, 12:02 am
so the forum address, pmii.onion, is indexed?
there is also the tor network directory that is on clearnet that lists most .onions
Title: Re: Forums Indexed in Google
Post by: NevilleNobody on September 10, 2011, 12:53 am
Not good. Is there any way to actually stop the google bots?
Title: Re: Forums Indexed in Google
Post by: bp on September 10, 2011, 01:00 am
I think you can forbid them in the  .htaccess file on Apache servers but I could be wrong, I'm no cyber expert.
I didn't even stay in a Holiday Inn Express recently.

I hope this can be fixed. Has anyone sent this to SR?
Title: Re: Forums Indexed in Google
Post by: profspudhed on September 10, 2011, 10:18 am
Not good. Is there any way to actually stop the google bots?

rather than the google bots why not just take out tor2web, ddos isnt a permanent solution but it is a temporary one.
Title: Re: Forums Indexed in Google
Post by: 72289 on September 10, 2011, 02:19 pm
I think you can forbid them in the  .htaccess file on Apache servers but I could be wrong, I'm no cyber expert.
I didn't even stay in a Holiday Inn Express recently.

I hope this can be fixed. Has anyone sent this to SR?

You can do that it that way or just download and upload the plug-in to the forum that SMF offers which keeps bots off your message board. Most forum and blogging softwares have the ability these days to keep Google and other SE bots from browsing your site.

I'm not sure if this has been brought up or not. I feel like this is something that should have been done as soon as the forum was open. Whether we're on TOR or not forums and blogs are known for being crawled quickly, thoroughly, and often by SE bots.

Damnit. =/
Title: Re: Forums Indexed in Google
Post by: Ineluctable on September 11, 2011, 01:33 am
We could always use a robots.txt file, or one of the SMF plugins that can do the same thing. To be honest though I'd be more worried about the search engines that ignore the robots.txt file.

It appears that you can file a complaint with tor2web, I assume after enough complaints that our URL would be blacklisted...again limiting it to Tor access.

https://dkn255hz262ypmii.tor2web.org/proxyg7n6l6m302/contact.php?t=problem