Marketing Tips for New Media Marketers

vBulletin Spam Prevention Tips and Tricks

|  Print This Post Print This Post | Eric Heikkinen   
vBulletin Spam Prevention Tips and Tricks

vBulletin is probably the best commercial solution for starting a forum available today because it offers a wide variety of features, an excellent administration panel and a variety of both free and commercial plugins and “products”. I have been using vBulletin’s software for the Pligg Forums for nearly two and a half years and through that time I have had to deal with a lot of spam, especially in the past few months. At first it was a rare enough problem that I was able to maintain the spam by manually removing a thread here and there once a week. Through a vigorous program of spam bot registration prevention and keyword monitoring from new users posts I have been able to keep most spam off the general forums, but it’s taken a lot of plugins and continuous work to do so.

User Registration

Stop spam at the starting point.

The first tip that I have is that you should turn on email confirmation for new user registrations. This in combination with the captcha system will stop most bots at the gates before they even have a chance to post anything on your forum. Unfortunately some servers and users will have issues with sending and receiving emails, so email verification isn’t always the answer.

The next step is to prevent users who use “one time” email accounts. These types of email accounts are set up to prevent users from receiving spam email from suspicious websites, but they can also be used by spammers and just plain lazy no-good users. I prefer that users give me a legitimate email address when signing up, not one of these spam prevention email services. Users who bring quality content to your site should at least be willing to offer a valid email address. Spammers can also abuse these free short term email services so I decided recently to ban the use of many “short term” email domains for all future registrations. You can do this easily by navigating to your vBulletin administraton panel, click on “vBulletin Options”, then select from the drop down menu “User Banning Options”. The second field should be for inserting “Banned Email Addresses”, here you can just copy and paste my domain blacklist below.

Banned Email Domains:

@001.md

@123mail.org

@126.com

@163.com

@1net.gr

@21cn.com

@arcor.de

@atlantmail.com

@bestmail.us

@bigmir.net

@bk.ru

@bluebottle.com

@dbzmail.com

@discardmail.com

@dodgeit.com

@e4ward.com

@elfox.net

@elite1000.org

@emailias.com

@emails.ru

@fastacura.com

@fastchevy.com

@fastchrysler.com

@fastkawasaki.com

@fastmazda.com

@fastmitsubishi.com

@fastnissan.co

@fastsubaru.com

@fastsuzuki.com

@fasttoyota.com

@fastyamaha.com

@freenet.de

@gawab.com

@gala.net

@getresponse.com

@gmx.de

@gmx.net

@go2.pl

@guerrillamail.net

@humlog.com

@i.ua

@inbox.ru

@inmail.sk

@inmail24.com

@jetable.com

@jetable.net

@jetable.org

@kasmail.com

@krovatka.su

@link2mail.net

@lviv.in

@mail.bg

@mail.net

@mail.ru

@mail.zp.ua

@mail15.com

@mail333.com

@maileater.com

@mailexpire.com

@mailinater.com

@mailinator.com

@mailmoat.com

@mailnull.com

@mailshell.com

@mailzilla.com

@me.by

@megabox.ru

@messagebeamer.de

@mymail-in.net

@mytrashmail.com

@netmails.net

@netzidiot.de

@nm.ru

@nobulk.com

@nurfuerspam.de

@o2.pl

@oneoffemail.com

@peugeot-club.org

@pisem.net

@pochta.ru

@pochta.ws

@pookmail.com

@rambler.ru

@runbox.com

@sibmail.com

@sneakemail.com

@sofort-mail.de

@sogetthis.com

@spam.la

@spamex.com

@spamgourmet.com

@spaml.com

@spamtrail.com

@telegraf.by

@tempemail.net

@temporaryinbox.com

@tlen.pl

@trash-mail.de

@trashmail.net

@ukr.net

@ulmail.net

@unlimail.net

@vfemail.net

@walala.org

@web.de

@wh4f.org

@xmail.net

@zoemail.com

The “Restrict usernames to alphanumeric and underscore” plugin for vBulletin lets you have better control over username character options. I suggest not allowing spaces in usernames (vBulletin default) and I haven’t seen any spammers using underscores thus far so I have left that option on for now. I believe that I installed this product originally to make the usernames compatible with Mediawiki integration.

No Spaces in Username

Profile Signature Spam

Linking to external spam urls from the user profile page

This is the latest an probably the most difficult spam problem that I have had to deal with. It’s a rather clever trick that spammers came up with to improve their site’s search engine performance and get better search traffic. Spammers sign up for dozens of accounts using keywords like “Buy DrugX Here”, where DrugX is replaced with a variety of prescription drug names. They then place as many links as they can fit in their user signature directing to their sites. The reason that spammers have been using this method is because my site is seen as reputable through the eyes of Google, so placing text on my site for the traditionally disreputable pharmaceutical drug websites gives more credibility and they often appear high up on search results because of my vBulletin SEO methods (Thanks to vBSEO).

What’s so tricky about this problem is that there’s really no way to easily see when a user is doing this, unlike traditional thread or post spam that appears on the general forum where users will often flag it. The only way to check for this type of spam is to go through each days user registration log looking for suspicious names. I have about a hundred signups each day, and it would be a waste of my time to check each name and signature for this type of abuse so I had to find a better method. The two methods for fighting this type of spam is banning certain words from usernames and stopping new accounts from being able to place links or even text in their signatures.

Similar to the above topic of email spam, a blacklist is probably the best option for preventing username abuse. Under the vBulletin Options >> User Registration Options, you will have an “Illegal Usernames” input box. There you can list a space separated list of usernames you don’t want to allow. A new user will be denied any variation of a username with one of those words.

SM Signature

To prevent signature spam from non-active users there are two options. The first method is built into vBulletin, just create a new usergroup for users with 0-however many posts and don’t give that usergroup permission to have a signature. The downside to this method is that it isn’t retroactive and past users will keep their existing signatures. The second option comes in the form of a simple vBulletin product SM Limit Editing Signature Before X Posts product (pictured above). It stops anyone with fewer than X threads from creating a signature. The vBSEO Conditional Signatures product allows you to set more precise settings to prevent signature spam abuse in your threads along with other useful features.

Spam Keyword Detection

Moderate keywords automatically

Spambuster is a plugin that checks all new threads and compares the content to a list of keywords that are marked as spam-like. Each keyword is given a number to rank how spammy it might be and if the total number of keywords tallies high enough the post is held for moderation and moderators are alerted to it. This is probably the most advanced and useful plugin for vBulletin spam prevention and it has been extremely helpful in stopping spam appear on my forums.

Spambuster Settings

One of the downsides to Spambuster is that it doesn’t come with the best list, but it offers a good starting point. You will want to modify the list so that it doesn’t flag common items and add a few words yourself. To help you out I am offering my modified Spambuster Keyword Definitions. I suggest using this list and setting your spam trigger level to 10 and the Post count threshold to 5.

Use Nofollow Links

Stop search engines from following spam links

Even though Pagerank Sculpting/Pagerank Leak are debated concepts among SEO professionals, I find it useful to use nofollow formatted links for less important links among my sites. Forums and blog comments are abused just to get search engine traffic, so I will often use plugins or design elements to automatically parse urls with a nofollow attribute to prevent search engines from following the links off my site. To do this automatically with vBulletin, it just takes the NuHIT URLs plugin. This plugin can also be set to open external urls in a new window. An intro guide to the theory of Linkjuice is covered through this video entry on SEOmoz.

Nuhit URL Plugin

I imagine with all of these tools, spammers will have a difficult time taking advantage of your site. It may not be necessary to run all of these plugins, but I have learned from experience that it’s better to not give a spammer a fighting chance or else they will exploit every hole possible.

If you know if any other useful vBulletin tricks, tips or products that I might have forgotten please leave a comment. I’d be glad to learn about some other great tricks for stopping spam before it starts.

Make a Robots.txt File

Tell Search Engines Not to Index Member Profiles

One final bonus trick is probably something that you should do sooner rather than later. This tip will save you from a lot of the above problems because it will stop search engines from indexing member profiles which makes spamming your profile pages useless for spammers. Open up Notepad and copy/paste the code below and then save it to a file robots.txt, then upload that file to your forum root. This file will remove several vBulletin tools that Google doesn’t need to index and should ignore when it crawls your site. Most important are the members.php and /members/ lines which tell Google to ignore the member profiles. The other lines are optional with the exception of the first.

My Robots.txt File:

User-agent: *

Disallow: /vbgooglemapme.php

Disallow: /ajax.php

Disallow: /attachment.php

Disallow: /calendar.php

Disallow: /cron.php

Disallow: /editpost.php

Disallow: /global.php

Disallow: /image.php

Disallow: /inlinemod.php

Disallow: /joinrequests.php

Disallow: /login.php

Disallow: /member.php

Disallow: /misc.php

Disallow: /moderator.php

Disallow: /newattachment.php

Disallow: /newreply.php

Disallow: /newthread.php

Disallow: /online.php

Disallow: /poll.php

Disallow: /postings.php

Disallow: /printthread.php

Disallow: /private.php

Disallow: /profile.php

Disallow: /register.php

Disallow: /report.php

Disallow: /reputation.php

Disallow: /search.php

Disallow: /sendmessage.php

Disallow: /showgroups.php

Disallow: /spiders.php

Disallow: /subscription.php

Disallow: /threadrate.php

Disallow: /usercp.php

Disallow: /usernote.php

Disallow: /admincp/

Disallow: /images/

Disallow: /modcp/

Disallow: /members/

Responses

8 total comments, leave your comment or trackback.
  1. Very nicely documented!

    (Report comment)

  2. awesome post, thanks :)

    (Report comment)

  3. Very cool glad I fond this as i had problems as soon as the site was placed back on line your list is a big help and i may try the spambuster plugin as well thanks for the tips I hope more are posted …

    (Report comment)

  4. Hi and thanks again I just installed spambuster and I am testing it with yor mod rules seems to be an excelent plugin … thanks for leting us know as we got so much spam on our old VB that we were considering getting rid of the board all together now we have set up a newer version and added this plugin, I hope it works as well as it does in my test …

    (Report comment)

  5. Updated the Spambuster keyword list. Corrected some existing items and added some words that have been trouble for me recently. Thanks to everyone for their comments.

    (Report comment)

  6. FYI, the “SM Limit Editing Signature Before X Posts” plugin does not seem to be working. I’ve tried it both on 3.6.x and 3.7.x with no success.

    (Report comment)

  7. I found this very very useful.. Thanks,

    (Report comment)

  8. Nice post you have here. I want to share my 2 cents. Lately Vbulletin forums are hit with tons of fake automated signs up, they came from China and use normally Gmail accounts. Everybody should had them for now, they register, and even confirm the registration, wait some days after registration and then start to spam the forums. When we published our forum online with 0 users, we already had like 5 to 10 chinese spammers sign ups per day. Its pretty easy to identify them since they always use as the birthday date the first option available.
    This trick is ratter drastic but in our case we don’t need Chinese users, so we blocked slowly their IPs including their whole range from their ISP. The more they signed up the more IPs we had for blocking so they made us a favor. Now after 3 months and some IPs we don’t receive this registrations anymore. Here is the list you have to put on your Vbulletin to not allow this Chinese bots to sign up:
    221.223
    222.68.17
    58.83
    220.178
    218.104.68
    222.176
    222.183
    60.175
    58.65.232
    125.122
    61.140
    61.146
    211.158
    58.56
    58.57
    58.58
    58.59
    121.224
    121.225
    121.226
    121.227
    121.228
    121.229
    121.230
    121.231
    121.232
    121.233
    121.234
    121.235
    121.236
    121.237
    121.238
    121.239

    Hope it helps.

    (Report comment)


Leave a Reply