Are People Using TMDA to Kill Spam? 87
NewtonsLaw writes "With spam becoming an increasingly frustrating part of life in the Net, I have to ask why more ISPs aren't implementing systems such as the excellent Open Source Tagged Mail Delivery Agent (TMDA) strategy? Using this system would mean that only those spammers who used bonafide email addresses in their headers would get through -- and means virtually all the penis enlargement, weight-loss and other scams would be blocked. Even the those habbitual "brand name" spammers (like Real, PayPal, etc) could still be blocked by adding them to the blacklist. With TMDA, email to and from regular correspondents is passed transparently and there's no risk of genuine messages being accidentally discarded by over-active filters. If enough ISPs at least offered TMDA as an option to their users, the effectiveness of spamming could be shattered almost overnight -- oh, wouldn't that be lovely?"
Re:Simple answer (Score:1)
Most ISPs are lazy and incompetant and only interested in collecting your money. The rest are in bed with the spammers.
Actually, there are a few of us that offer TMDA [tmda.net] to our customers.
I also don't buy the argument that "Most ISPs are lazy an incompetant." Spam is a very real problem, an most of the big ISPs are already beginning to take action, both technically and
Re:Simple answer (Score:1)
How about... (Score:2, Insightful)
Re:How about... (Score:3, Informative)
Re:How about... (Score:2)
Re:How about... (Score:2)
Re:How about... (Score:2)
Re:How about... (Score:2)
Dictionary attacks against recipient addresses are quite feasible - you already know the domain part. Dict attacks against whitelists though have a much much wider space to crack. Your chances of brute forcing a match are far far slimmer than for the recipient case.
Re:How about... (Score:1)
No spam blocker is perfect... (Score:5, Interesting)
A second reason is false positives. Users have really quite different view on them. Some people hate spam so much that to avoid it, they are willing to block a real message every once in a while, and spend lot of time configuring and tuning their filters. For others, hitting "Delete" 30 times a day is less trouble than the nuisance in losing real legitimate messages.
Re:No spam blocker is perfect... (Score:3, Informative)
at least *READ* about it before you dismiss it out of hand.
Re:No spam blocker is perfect... (Score:2)
but tmda allows *spammers* to deal with "false positives." and they only need to do it once per address (in a sane tmda config)
The other features such a temporary email addresses are nice though.
Re:No spam blocker is perfect... (Score:2)
try reading the faq.
yes, a spammer *can* send mail from a valid email address and they *can* respond to each of the tmda generated confirms. however the more people who use tmda, the more bandwidth of the spammer that will consume. and since the spammer would be using a valid email address, the spammer can be traced.
Re:No spam blocker is perfect... (Score:2)
And I dont see how much easier a spammer could be traced by using a valid email address if they provided false details to the isp providing the address. Even when using a false email address, a MTA will usually give the ip address of the original sender in the headers, and if it doesnt help now, then it wo
Re:No spam blocker is perfect... (Score:2)
if what you say proves right - and in two years it hasn't - then a simple change to tmda allows you to make the confirm process less easy to automate. send back a jpeg and have them type in the numbers of the jpeg in the response.
include a question they have to answer or instruction they have to follow:
"in order to confirm this message, you need to reply to this message AND type my last name in the message body."
everyone could do something slightly different which m
Re:No spam blocker is perfect... (Score:5, Insightful)
I'm talking widespread use of TDMA now, with non computer literate users who probably havent ever come across mailing lists and having to confirm subscriptions. And for the more technical users, there are a great many who use text based clients over SSH, with which viewing a jpeg would be troublesome to say the least. Other methods could be used as you mentioned, but I doubt there are that many that would cause minimum trouble for legitimate users while preventing spammers from being able to write some sort of heuristic algorithm to be able to get at least some confirmation replies correct (remember, they wont be bothered about getting every one through).
As to the reason spammers havent yet resorted to using valid email addresses is that they dont have to! Email confirmation currently isnt widespread for the spammers to go through the extra hassle. When it does get so widespread as to hinder spammers, then they will start using valid email addresses and autoresponders (or perhaps deliberately setting up email bounce replies to save them the hassle of writing replies).
Dont get me wrong, its a great idea, and I especially like the idea of being able to just create time delayed email addresses with nothing more than a program to work out the cryptographic hash (i.e. nothing needed server side). However, I think that if TDMA does become widespread enough for spammers, they will find some way around it, and combating what they do will become increasingly complex and time consuming for users. If I am proved wrong hoever, all the better. No more spam
Re:No spam blocker is perfect... (Score:2)
- spammers arent traceable, we dont know who they are
- if TMDA made them come out into the open, then we could get them.
They are traceable. The spammers are by and large mostly known. The problem is there is no broad legal consensus against spam and there is no strong economic disincentive against spamming for either the spammers or the pink-contract ISPs. You cant "get them", unless you blacklist ISPs (but hey, we can already do that and do, so why did
Re:No spam blocker is perfect... (Score:2)
Not really, unless you're constantly receiving e-mail from new sources on a daily basis. Most of the legitimate mail I get comes from known sources (mailing lists, my friends/colleagues, service notices from my ISP, etc.).
I don't see it being that much more difficult than having to know and then
Re:No spam blocker is perfect... (Score:2)
I whitelisted all my buddies and people who I have mailed previously so they can't even tell I use it. I added my mailing lists in there as well so they're unaffected. I set up the SMTP proxy so anyone who I mail to will automatically get whitelisted. There have been two occassions in the last two montsh where someone failed to
Re:No spam blocker is perfect... (Score:2)
But i'm not doubting it stops spam getting through. In fact i'm reasonably convinced its the best technical answer to spam existing at the moment. My problems are with complicating email by using C-R, and i believe spammers would adapt anyway, hence bringing us back to blacklists anyway.
Re:No spam blocker is perfect... (Score:5, Insightful)
Yeah, if I ever thought about using TMDA, having to deal with other people using it has completely turned me off it.
A number of times somebody has posted to a mailing list asking for help. I've answered them privately, only to get a "please jump through the following hoops" message. Fuck that.
There's no way I'd use it, as email is often how clients first make contact with me. I'm unwilling to risk offending or irritating my correspondents, especially when it could mean many dollars lost.
Re:No spam blocker is perfect... (Score:1)
I have not had a single problem with clients mailing to one of my TMDA protected accounts. I simply put a note on the page that listed the address informing the user to expect a challenge. See here [standblue.net].
Re:No spam blocker is perfect... (Score:2)
If ANY company put me through a TDMA like system, I wouldn't deal with them. You see, it puts forth the impression that their time is more valuable than my time. This is the same attitude I have for aweful phone menu systems. If I can't hit Zero and get a human, I go somewhere else.
Now if you combine something like spamassasin
Re:No spam blocker is perfect... (Score:1)
In other words, I only get the clients who really want me. These are the clients I want anyway.
"TDMA ... TDMA ... TDMA ... TDMA"
Dyslexic?
"Now if you combine something like spamassasin with TDMA and ONLY run messages tagged as spam though TDMA, THEN you may have something"
In fact, I do just this, as I pointed out in earlier post [slashdot.org]. Since I starting using this method not a single legitimate message has bee
Re:No spam blocker is perfect... (Score:2)
Re:No spam blocker is perfect... (Score:1)
Assuming the poster asking for help has a degree of clue, TMDA copes with that. Clearly, in your experience, the poster did not.
You can configure the return address of the posted message to accept unhindered replies from _all_ senders to that particular address for a limitied period of time. Therefore, the window of opportunity for spa
Discussed ad nauseum.... (Score:5, Interesting)
Mailing lists are a simple example. For every mailing list you legitimately want to be on, you will need to manually set up the address on the whitelist because the mailing list software won't repond to the challenge message.
Now lets say that the mailing list programs make some mods to automatically respond to the message, assuming it has a standard format. Now a spammer can use the mailing list's address as their return address and take advantage of its response to a challenge! Of course, the challenge could contain other validation data such as a reciept number and/or a digital signature but now we're talking about major mods to the Internet's mail infrastructure and mail clients.
Re:Discussed ad nauseum.... (Score:2)
TDMA also has features such as time bomb email addresses, which stop
Re:Discussed ad nauseum.... (Score:1)
Now lets say that the mailing list programs make some mods to automatically respond to the message, assuming it has a standard format. Now a spammer can use the mailing list's address as their return address and take advantage of its response to a challenge!
Why wouldn't they, um, just set up their software to automatically respond to the emails?
Re:Discussed ad nauseum.... (Score:1)
(I assume "they" refers to spammers.)
That would require spammers to use valid return addresses. This raises their costs and makes them less anonymous. It won't happen (at least on a large enough scale to matter).
Mailing list software should never respond to a challenge from a subscriber. Any such challenges should be treated as bounces and should unsubscribe the user.
-chris
effectiveness? (Score:5, Insightful)
Re:effectiveness? (Score:1)
Re:effectiveness? (Score:2)
Re:effectiveness? (Score:1)
No, that is not what he is telling you.
The problem is determining if it is unsolicited commercial email. You may have requested mailings from a company two years ago and forgotten about it. This mail is not spam because you opted in, but SpamAssassin or some other "smart" method may not be able to tell it apart from the junk. The frequent mails from Register.com come to mind.
Re:effectiveness? (Score:2)
The problem is updating all the MTAs, or worse all the clients at the same time. If you continue to receive mail from older MTAs or clients which don't know how to sign or 'add postage' to an email, then the spammer will just pretend to be the older MTA/client...
So there's a huge res
How would TDMA stop spam? (Score:3, Insightful)
When confirming the test email address noted int he article, I just hit reply and send the email as is, and I'm sure a script could be written to automatically send a blank message to the Reply-To: address if this became widespread.
The spammers task would become harder, but far from impossble.
Re:How would TDMA stop spam? (Score:2)
This also starts sucking up spammers resources in CPU time and bandwidth since he now has to individually send out replies instead of CC'ing a million address, all you really have to do to stop SPAM is make it more expensive than it's worth.
Re:How would TDMA stop spam? (Score:2)
My point is, if use of this became widespread, then the spammers would simply start using valid email addresses and auto responders. And considering that people who take the effort and expense to post junk mail and 'telemarket' seem to think its worthwhile, writing a few scripts and using a few cpu cycles wont seem like
Re:How would TDMA stop spam? (Score:1)
Like I said, it's not about making it impossible, it's about making it more expensive than it's worth, which I guess I also mean to say they spend more time (time is money) than I do, if I spend ten minutes setting up TMDA (I think it took me about considerably less than that, very good documentation on that project) then I just have to cos
Re:How would TDMA stop spam? (Score:2)
Re:How would TDMA stop spam? (Score:1)
Re:How would TDMA stop spam? (Score:1)
See the FAQ [tmda.net]
Eventually it would be bypassed. (Score:2)
I have my own ideas on how to stop spam, but I'm thinking I'll save them for my thesis
Re:Eventually it would be bypassed. (Score:1)
I am not going to say it can't be done, but I am curious, how can you "mimic/steal" an email address that is in my whitelist?
Even if you do come up with a way to do it, how could you do it for millions of people in a cost effective way as would be necessary if you were a spammer?
Didn't work for me (Score:4, Interesting)
First of all, I've had trouble white-listing my friends. I could just give them the address ac@mydomain.com and white-list them, but sometimes they will change email addresses or send me mail through a third-party source (like sending a news item from a web page or sending a greeting card). The alternative is to give each friend an tagged address that will go through, but it is hard for them to remember ac-friend-a751af@mydomain.com
Second, some of my friends can't handle the concept of replying to a message to let their first message through. (Obviously this happens when they use an address that I haven't white-listed.) I've tried to customize the message to make it easy to understand, but I guess I have dumb or stubborn friends. In particular, if a relative sends a joke to me and a long list of other people, and one of those people replies to everyone ("ha, that was really funny!!"), the sender gets really confused about getting a confirmation request from someone they haven't heard of before.
I've had one on-line store refuse to use my tagged email address because it was too hard to type. (Apparently their brain-dead system had them manually retype the address into another system.) They processed the order, but I didn't get any status from them.
The killer was my ISP changed the rules on me and doesn't allow having a mail server on my local system. Further more, the provider I was using for out-going mail now blocks mail from my Linux box because they detect it going through exim and declare that it is relaying through their system. (It works for a simple mail client, just not for a MTA!)
Another provider I could use has their MTA configured such that it doesn't work with the tagged addresses. Of course, many ISPs now block in and outgoing port 25. The anti-spam efforts of ISPs keep breaking my attempts to avoid spam and TMDA is the latest victim.
Again, I like the concept of TMDA. Jason Mastaler and company did a lot of things right, but it just didn't work out for me. When the general public becomes educated on the concepts and it is easier to find an ISP that will work smoothly with TMDA, I'd be happy to use it again.
Re:Didn't work for me (Score:2)
tmda can then be configured to send the mail directly to your isp's mail server.
no need to go through exim, postfix, qmail or any other local mta.
Re:Didn't work for me (Score:2, Funny)
I've tried to customize the message to make it easy to understand, but I guess I have dumb or stubborn friends. In particular, if a relative sends a joke to me and a long list of other people, and one of those people replies to everyone ("ha, that was really funny!!"), the sender gets really confused about getting a confirmation request from someone they haven't heard of before.
This is a bad thing?
Re:Didn't work for me (Score:1)
You mean that this will deter people from sending those useless mass mailed jokes or flash animations all the time? Why didn't I think about installing TDMA before?!
Learning Spam Filters (Score:4, Interesting)
Personally, I use SpamAssassin which was primed with 1200 spams and 6000 hams. Since that point, it has captured 200 spams with 0 false positives and 2 false negatives.
The hard part is priming the databases. Maybe it would be worth it to have a database that can be downloaded and used as an initial point for new users - combined with "Spam", "Not Spam", "Whitelist" buttons in their client to automatically tweak the db to their usage patterns.
- Tony
Re:Learning Spam Filters (Score:2)
But anyway back on topic, yes it would be nice to have some of easy update feature, but I sure as heck wouldn't give it to the users...
Re:Learning Spam Filters (Score:2)
tmda includes a script to extract all the from addresses from your mailboxes. since tmda works off of addresses - the addresses *you* want to get email from - this essentially primes the list.
Re:Learning Spam Filters (Score:2)
http://www.spamassassin.org/publiccorpus/ [spamassassin.org]
Re:Learning Spam Filters (Score:1)
pipe "/usr/bin/spamc -c" ok
With this setup the only people who have to confirm are unknown senders whose mail appears suspicious according to SpamAssassin. Since I started using this method not a single legitimate message has had to be confirmed.
I shop online. (Score:1)
Why haven't they been adopted? (Score:4, Informative)
But, I think John Levine does a much more eloquent job of explaining why C-R systems are not the answer:
Date: 11 May 2003 21:41:35 -0400
Message-ID: <Pine.BSI.4.40.0305111408240.28246-100000@tom.iecc
From: "John R Levine" <johnl@iecc.com>
To: "Declan McCullagh" <declan@well.com>
Subject: Re: FC: MailFrontier.net, poor anti-spamware, and future of mailing lists
In-Reply-To: <5.2.1.1.0.20030511122149.00b1a710@mail.well.co m >
> My reluctant conclusion is that C-R systems with flawed implementations
> have the potential to end legitimate mailing lists as we know them today.
No, it's worse than that. The collateral damage from widely used C/R
systems, even with implementations that avoid the stupid bugs, will
destroy usable e-mail.
Challenge systems have effects a lot like spam. In both cases, if only a
few people use them they're annoying because they unfairly offload the
perpetrator's costs on other people, but in small quantities it's not a
big hassle to deal with. As the amount of each goes up, the hassle factor
rapidly escalates and it becomes harder and harder for everyone else to
use e-mail at all.
A relatively easy to solve problem with challenge systems is that most of
them are written by dimwits who don't understand the way that e-mail
really works. In 1983 the 4.3BSD Berkeley Unix "vacation" program
correctly dealt with mail from lists and other mechanical sources, yet 20
years later I still see out-of-office replies from Lotus Notes and MS
Exchange to list mail every day. (Is there really nobody at IBM or
Microsoft who used 4.3BSD or knows the rules of thumb to recognize
non-personal but legit mail?) Challenge systems have the same bugs, and
list managers are now routinely kicking people off lists whose broken
challenge systems spam out stupid challenges to everyone who posts to the
list, and ignoring challenges to signup confirmation messages. These
particular problems are soluble; the few challenge systems used by
experienced mail users like Brad and Dan Bernstein avoid them.
But the real damage from challenge systems will come when spammers start
attacking them. Challenge systems all have user whitelists so that each
correspondent only gets one challenge, then mail goes through directly. So
spammers will start trying to send spam with forged sender addresses that
are on the recipients' whitelists. That's not so hard, sign up for a
mailing list, scrape addresses from the list traffic, then send NxN copies
of spam, to each list address from each list address. Similarly with
addresses scraped in groups from web pages, usenet groups, and anywhere
else scrapage happens.
So what will the effect of this be? You won't be able to trust that mail
from your friends is actually from your friends, since an increasing
fraction will be spam leaking through your challenge system. What will
people do? Given the basic principle of challenge systems, which is that
it's someone else's job to solve your spam problem, people will dump their
whitelists and start challenging every message. At this point, it's
possible to automate much of the work, most challenge systems are
scriptable, so that for example I have a few lines in my mail sorting
filters that catch the per-message challenges from submissions to Dan
Bernstein's mailing lists and automatically send confirmations. But of
course, if I can send responses from scripts, spammers can and will too,
so challenge systems will increasingly include "prove you're human"
features like showing you a picture and asking you how many kittens are in
Re:Why haven't they been adopted? (Score:3, Funny)
I am going to implement a challenge-response system that sends S.A.T. questions as a challenge. That way it will be very difficult for spammers to automate responses. As a fringe benefit I won't get email from stupid people anymore.
Wrong on so many levels... (Score:1)
Fuggedaboutit. These types of things belong on web forums or usenet. Both work exceedingly better on so many levels its laughable that anyone is on anything but a receive-only mailing list right now.
If, for some idiotic reason you really need to deal with two-way listservs, you are probably "elite" enough to have a separate email account just for that without the spam protection, or at least with non-whitelisting protection.
Next, if you pl
I'd love to use a TMDA-like system, but.. (Score:3, Interesting)
I'd install it myself, as a proxy MTA, but it's not a Mail Transfer Agent; instead it requires one to use one of a particular set of MTA.
In short, there's not way to use it under Windows or even cygwin (as far as I can tell).
I wrote much of a TMDA, but never completed it, as a plug-in for Microsoft Outlook -- I abandoned that project when I decided it should be wriiten as an extension of an SMTP/POP3 proxy. (And I wrote it first as a Visual Basic "macro" before I understood how to add plugins written in C++ to Outlook; that was the antithesis of fun.)
I was unable to find an open source SMTP/POP3 proxy that runs under both Windows and linux -- I've looked, but what I've found has been either for Windows but not linux or vice versa, or SMTP but not POP3 or vice versa. The one thing I've found is Hamster, which is quality software, but written in Delphi, and it doesn't run under linux.
Basically, I'll use a TMDA as soon as I can run it myself, under Windows -- or the OS of my choice.
The TMDA softweare currently available seems to be aimed at ISPs, and this seems to be a political decision of the TMDA software authors.
It probably makes some sense, in the long term battle against spam, to keep it off the desktop so as to put pressure on ISPs to install it, but it sure doesn't make it easy for me to use.
Re:I'd love to use a TMDA-like system, but.. (Score:2, Insightful)
With TMDA running on the mail server, new messages are processed as they are recieved and confirmation messages (if any) are generated as close to the t
Re:I'd love to use a TMDA-like system, but.. (Score:2)
That's a good reason. But my desktop does run 24/7 (doing folding@home, motion detection, routing my handheld's wifi connection, acting as a jukebox).
Even if it did not, people don't (yet) expect instantaneous answeres to email. As I'd only challenge prev
Fix the email programs! (Score:2)
Sure, the spam ads are pesky and take time to DL and delete, but they really aren't that intrustive or obnoxious. At least not for me using `pine` or `mutt`. Then I had to use a GUI browser to get my mail on vacation. Using a GUI was bad enough, but suddenly I _saw_ the obscene cr@p that was being foisted on unsophisticated lu
Re:Fix the email programs! (Score:1)
Good for you! It's cool not to get shitty spams.
I got a worrying pair of spams the other day:
- It's Mother's Day soon!
- Give Her Something Bigger
Now say what you will about spam, but my name's definitely not Ed...
What a pain (Score:3, Informative)
There are better methods. Message analysis (ala SpamAssassin [spamassassin.org]), spam clearing houses (ala Razor [sourceforge.net]), RBLs [google.com], bayesian filters [paulgraham.com], and sender address verification [exim.org]. I use all five at my site [keyschool.org], and my users are happy.
Plus, can you imagine a potential client of your company e-mailing for information, only be sent a TDMA message? I'd bet money that person would either not no what to do, or just ignore the message and think you never got back to them.
What if (Score:2, Interesting)
Joe e-mails Fred. Fred's TMDA sends a confirmation e-mail to Joe. And Joe's TMDA sends a confirmation e-mail to the confirmation e-mail, then the cycle continues.
I don't like the looks of this.
Re:What if (Score:1)
You haven't done your homework. See the FAQ [tmda.net]
Re:What if (Score:2)
Re:What if (Score:2)
You could configure it to mangle your From address to a dated or tagged address when sending a challenge. Then the other person's TMDA will send its reply to the dated address and it will automatically get through.
In the unlikely event that a spammer did not forge his address, the challenge was sent from a dated address, and the spammer started spamming the dated address, then at least it would expire in a day or two.
Re:What if (Score:2)
Upon closer inspection of the program, the TMDA does infact include the dated address in the "Reply-To:" header. Wheni first looked at it i only noticed the "From:" header of the origial address.
Now if every one used this method its still not going to stop the SPAM. Sure, in this case the SPAM will be now confirmed to an Address where the investigation can start from and posible removal of the account. But i think the SPAM will contiue without too much trouble.
I still think filtering the better method
Re:What if (Score:2)
If spammers have to have valid addresses, then that will straight away eliminate most spam. Spammers operate today assuming (1) it is difficult to get caught or shut down, with open relays and forged addresses, and (2) it is inexpensive, since they don't have to have an ISP or their own servers and lots of ban
Re:What if (Score:2)
Since the "Reply-To:" header is set to the TMDA dated address a spammer can simply get into your white list with a simple auto-responder. If the spammer has access to alot of disposi
I wasn't happy with it (Score:2)
It also blocked a lot of valid automated email that I wanted to get. Airline confirmations, advertising/announcements that I had signed up for. That kind of thing.
Now I use tess.sf.net (baysian(sp)). I don't get false positives ever, and I nail about 90% of my spam (and getting better).
For the curious - I receive about 55
This could be a boon for spammers (Score:2)
2 different filters (Score:1)
The problem with using the filter described is that a good portion of spammers DO send from legitimate e-mail addresses...just usually not their own. Sometimes it's even being sent from the person receiving it (by simply faking the from: tag)
Am I the only one (Score:1)
Re:Am I the only one (Score:1)
Has anyone targetted the programmers of spamware? (Score:1)
My gut feelings is... (Score:4, Insightful)
I still think, and am quite happy with, a Bayesian Filtering [paulgraham.com] application that Mozilla Mail currently offers. Very little spam leaks through and I have only had one false positive in almost 3 months of using it.
Use Mozilla Mail/ThunderBird (Score:1)