Robots.txt?

[y00tz]

If we added a robots.txt to the top level domain with:

Code: [Select]

Disallow: /testwiki1/
It should cut down on *some* wiki spam, yes?

[bctrainers]

Sadly, most indexers do not follow the robots.txt rules any more.

Best is to set certain IP ranges to being able to view it via .ht file.

[sk89q]

What incentive do spam bots have to follow robots.txt?

User-agent: Spambot*
Disallow: /

Search engines, however, do follow robots.txt.

However, the easiest and most effective way is just to require editors to type in a string (i.e. "jitspoer0x") into a text field.

[y00tz]

Spam bots don't use Google anymore?  Wow I'm getting old..

I just get tired of clearing the revisions of the DP wiki pages (the community guide just broke 1,000 spam revisions), eventually with the new wiki I'd like to see CAPTCHA.

I'm surprised one of our community members hasn't stepped up and made a wiki for Digital Paint, after all, it's not something that needs to be done specifically by Jitspoe.

[Zorchenhimer]

I'm surprised one of our community members hasn't stepped up and made a wiki for Digital Paint, after all, it's not something that needs to be done specifically by Jitspoe.

http://dplogin.com/forums/index.php?topic=9795.0

[lekky]

I don't think he meant that Z

[sk89q]

Spam bots *can* spider on their own, so blocking a search engine is not 100% effective.

Like I said... just entering static text into a field works.

[jitspoe]

I just need to get mediawiki set up.  It has anti-spam provisions built in.