
Comcast Cheating On Bandwidth Testing? 287
dynamo52 writes "I'm a freelance network admin serving mainly small business clients. Over the last few months, I have noticed that any time I run any type of bandwidth testing for clients with Comcast accounts, the results have been amazingly fast — with some connections, Speakeasy will report up to 15 Mbps down and 4 Mbps up. Of course, clients get nowhere near this performance in everyday usage. (This can be quite annoying when trying to determine whether a client needs to switch over to a T1 or if their current ISP will suffice.) Upon further investigation, it appears that Comcast is delivering this bandwidth only for a few seconds after any new request and it is immediately throttled down. Doing a download and upload test using a significantly large file (100+ MB) yields results more in line with everyday usage experience, usually about 1.2 Mbps down and about 250 Kbps up (but it varies). Is there any valid reason why Comcast would front-load transfers in this way, or is it merely an effort to prevent end-users from being able to assess their bandwidth accurately? Does anybody know of other ISPs using similar practices?"
This is an advertised feature I believe (Score:5, Informative)
Re:This is an advertised feature I believe (Score:5, Informative)
Re: (Score:2)
Earthlink Cheats with Latency too (Score:3, Interesting)
I think what they are doing is giving me 1000KBs at periodic intervals or with a high latency such that my peak speed is high but my average speed is low. My latenc
Re: (Score:3, Informative)
208.67.222.222
208.67.220.220
Re: (Score:3, Informative)
you have the right idea, though. everyone (on your node) shares that frequency. each cable modem a bandwidth limit. (it stores this limit in a file it downloads from the cable company. people change this file to get around the limit. if you've ever heard of "un
Re:This is an advertised feature I believe (Score:5, Insightful)
Re:This is an advertised feature I believe (Score:5, Interesting)
Re: (Score:2, Informative)
OVH [ovh.net] offers dedicated servers with a dedicated 5 Mbps line, but you can upload some MB (I can't really remember if it was 5 or 10 MB) using full 100 Mbps capacity. After that, you let your upload privilege "refill" (i.e. using less than 5 Mbps "recharges the line"), so you can get another burst.
Nothing new under the sun. If anything, it's kind of a cool feature. If you need to measure real bandwidth, bursty downloads won't do.
Re:This is an advertised feature I believe (Score:5, Interesting)
Re:This is an advertised feature I believe (Score:5, Insightful)
Actually, there is nothing wrong with this approach. This means that interactive services and casual browsing are favoured vs bulk downloads. That is what every ISP wants to do anyway.
PowerBoost uses a 30 second average, not filesize (Score:5, Informative)
PowerBoost only accelerates the connection if the average speed you've been getting over the past 30 seconds* is less than the speed you are rated at/paid for. So if you have a 6 Mbps connection, that's 768 KB/s max. PowerBoost will raise that to up to 2 MB/s for a little less than 15 seconds, making your average for the past 30 seconds equal to 768 KB/s. After that, no matter how many new connections you open, your connection stays at 768 KB/s. But if your connection gets interrupted/throttled for a few seconds, you may get another boost after it resumes, until you are back to 768 KB/s 30 second average again.
*it may be slightly more/less than a 30 second average. Boosts seem to last about 10-15 seconds, which would make sense with that number.
Can't be right (Score:5, Funny)
That can't be right. From your description, it sounds like a genuinely good and beneficial to the user idea. Where's the catch ?
Re:Can't be right (Score:5, Funny)
That nice warm shower feels pretty good until you realize someone is pissing on you.
Re:PowerBoost uses a 30 second average, not filesi (Score:5, Interesting)
And yes, as the other commenter pointed out, this is actually an entirely sensible way to deal with "bursty" internet use and improve user experience without actually buying any more bandwidth. It would be really sweet if Comcast didn't do other stupid shit
Re: (Score:2)
A related note: Mail- and webservers usually don't serve content at more than 1 mbit, so all those speedboost features are not that useful at all. Just monitor your bandwith usage when you are retriving lots of mails...
Re: (Score:2)
Re: (Score:2)
.However, this is not the point I was trying to make. Back in the mid-90's there was a variety of plans available for all sorts of usage patterns. Today even the most casual user has a flatrate. Most users would be better off with a (cheaper) volume or time based contract but of course the ISPs don't want that.
Re: (Score:2)
but it's probably only giving you that boost when you start from idle. so write an azureus plugin that batches your transfer starts appropriately.
Re: (Score:2, Insightful)
1) No peer can upload at those speeds
2) If your speeds were that high, Comcast would just cut your connection due to their 'fair use' policy (trust me I know)
Re:This is an advertised feature I believe (Score:4, Interesting)
In chicago it is 12mbps then down to 6 or 8 depending on your plan. To do a proper speedtest on comcast you need to download a 100-200MB file. Although if you are getting 12mbps easily odds are you are getting your rated line speed.
Re:This is an advertised feature I believe (Score:5, Interesting)
I've made something of a game out of it, actually. With careful tactics, one can easily hit as much as 1.0 MiB/s upstream for short periods. I use Deluge to play. My present record is 2.4 MiB/s, on an Ubuntu 7.10 torrent for which I already had all the file data.
First, configure your torrent client to use a modest number of connections -- limit it to, say, 250 connections globally and 70% of your nominal upstream speed. Then, get on a very large, active torrent and build up a few minutes' worth of downloaded data. Once you're in the swarm, open everything wide up -- no global connection limit, no bandwidth cap, and no per-torrent upload slot limit. If your client has a bandwidth chart, watch it scroll by and enjoy the thrill as your upstream bandwidth surges to heights like you have never seen before. Of course, eventually the Power Boost will wear off and some connections will finish as their pieces are completely transferred, but it's fun while it lasts.
Re:This is an advertised feature I believe (Score:5, Funny)
Nobody should ever enjoy a bandwidth chart to the degree you are enjoying it. I don't know whether to be scared or awed.
Re:This is an advertised feature I believe (Score:5, Funny)
Re:This is an advertised feature I believe (Score:5, Interesting)
Most shapers (including the ones in their broadband routers) allow a variety of parameters.
You can set a sustained rate, peek rate, and burst size. For example a common implementation would have the following values (I haven't worked with Cisco QOS much, so it may be implemented differently but the principals are the same):
sustained rate: 2mbps
burst rate: 10mbps
Max burst size: 10 Megabytes
The burst size counter is depleted as you download over 2mbps, and replenished when you download under 2mbps.
When you download a 100MB file you will deplete the burst size at 8mbps. You can download at 10mbps for 10.5 seconds, at which point your download will drop to 2mbps and will stay there until you slow your transfer rate. If you stop downloading completely it will take 42 seconds to refill your burst counter.
Re: (Score:2)
Re:This is an advertised feature I believe (Score:4, Funny)
Re: (Score:2)
Re:This is an advertised feature I believe (Score:5, Informative)
People are out with pitchforks and torches over the "bad" thing Comcast does, throttling Torrent downloads, which works completely differently. To throttle a torrent, they forge a "I'm dead" packet from remote host, and send it to the customer. This causes the customer's torrent application to shop elsewhere for a feed. The repeated connect-forge disconnect-search-connect process slows the overall transfer. This only works because of the multi-peer technology underlying torrents, and wouldn't work with web browsing or ftp*.
-Ellie
* technically it would reduce the bandwidth usage, because it terminates the connection. This would result in broken connections and half-downloaded files. Then the pitchforks would REALLY come out.
Re:This is an advertised feature I believe (Score:5, Informative)
Actually that is not entirely correct. If they were simply forging the RST packet and only sending it to their customer it would be a simply matter of having the customer's firewall filter out all RST packets on specified port that is used for torrent download/uploads. I in fact have such a filter rule in place. However, detailed testing has shown that Comcast is sending the RST packet to BOTH their customer AND the outside connection, not just their own customers. Unless both sides have the RST filter in place on their firewalls, the connections are still dropped and throttled. This is what is going to get them into trouble as they are not just sending forged packets to their customers whom they have it written down in their service agreements somewhere that they can do this to you, but they are also forging YOUR identity and sending those packets to outside entities to affect their service as well, something that those people have NOT agreed to have happen to them.
Re: (Score:3, Interesting)
Except that I never get more than my apportioned amount. In other words, my SpeedBoost never goes faster than the 6MB I actually pay for. I think that's what the
Re: (Score:2, Informative)
Except that I never get more than my apportioned amount. In other words, my SpeedBoost never goes faster than the 6MB I actually pay for. I think that's what the person who wrote the article is saying too: "Goes at the speed they paid for, which is really fast, for a short time period and then drops to something like 1.2 MB, which is clearly slower than most comcast plans."
That person should call up and complain. We were paying for 8MB, it was not running that fast, they checked and realized our modem needed a configuration reload, after which we were back up to our paid speed with a credit on our account for the time missed. Also, not all older cable modems are compatible with the "SpeedBoost" technology, they may need to trade in for a newer model.
It messes up Netflix Watch Instantly (Score:3, Interesting)
Re: (Score:3, Informative)
Not hard to get fully advertised bandwidth les 01% (Score:3, Interesting)
Since TCP accelerates linearly and falls back exponentially, each fallback is disastrous, and if you fall back once, you are likely to do it several times in a row from the same cause.
So find out what your upstream speed is
Re:This is an advertised feature I believe (Score:5, Informative)
Re: (Score:2, Informative)
Powerboost (Score:5, Informative)
Re:Powerboost (Score:5, Insightful)
I wonder how it deals with P2P or a multi-streams of data. What if I have 10x 30Kbps streams running simultaneously would that aggregate and trigger the throttle down mechanism?
Re:Powerboost (Score:5, Informative)
Re: (Score:2)
Re: (Score:3, Funny)
Re: (Score:2)
Sure, it ain't pretty on the servers, but the brainiacs at ComCast don't care.
Re: (Score:2, Interesting)
Re: (Score:3, Informative)
Re: (Score:3, Insightful)
Comcast might do things differently.
Re: (Score:2)
Personally, I'd rather pay up front for a consistent higher speed. I do. I pay an extra $5 (or something cheap, I don't remember exactly) and I get an additional 8mbit down, and an additional 640Kbps up, for a total bandwidth of 15Mbit down / 1Mbit up.
I'm h
Re: (Score:3, Informative)
A Comcast official said the company is not boosting speeds for particular applications or content, a situation that would likely get Comcast into hot water with Net neutrality proponents, who want network operators to provide the same level of service to all content providers on the Net. Instead it's supercharging speeds for all customers downloading any content--whether it's music, e-mail, pictures or movies--when the network is not being used at maximum capacity.
"The Comcast network is really content-agnostic," said company spokeswoman Jeanne Russo. [/quote]
Re:Powerboost (Score:4, Insightful)
This is technically kind of true.
They are not protocol-agnostic though. But content, sure. They block both "illegal" and legal bittorent files, so they are not examining the content, they are just making assumptions without really looking.
Re: (Score:2)
I have one of those and using BitTorrent crashes the router, though V2 of the same router worked fine (until an official firmware update bricked it).
Re:Romani (Score:2)
HTTP (Score:2)
Easy (Score:2, Interesting)
Gasp! (Score:4, Insightful)
Comcast? Dishonest? Say it ain't so!
All kidding aside, this wouldn't surprise me too much. Comcast (and probably all other providers) are advertising this super-mega-intarweb speed as "up to x mbps." So, theoretically, as long as *one* site can provide data at that rate, their marketing garbage still stands. Even if 99.9% of the other websites top out at 4kbps, if Speakeasy's speed test says it can transfer a file at 15mpbs, technically Comcast is correct. They are giving you "up to 15mbps."
Re: (Score:3, Interesting)
The usual Slashdot "assume dishonesty before checking out the facts" attitude...
Except that they only advertise 8Mbps sustained speed, which is what you get. They also advertise PowerBoost, which gets you ~25Mbps for a few seconds.
Comcast needs to be drawn and quartered over their forged packets, but they haven't done anything dishonest in advertising their speeds, at least not where I live. I do indeed get >20MBps for a few seconds and then 8MBps until the cows come home.
Re: (Score:2)
Comcast advertises their connection like this: a 6 Mbps download, 384 upload, with a temporary "up to 20 second" boost to 12 Mbps download and 2 Mbps upload.
How is this _at all_ disadvantageous to the customer? If you are downloading small files, or browsing the web, you're golden. And by small I mean 5-15 Megs, which is actuall
Wouldn't it help with browsing speeds? (Score:5, Insightful)
I'm not saying that Comcast might not be cheating on purpose for speed tests, I just think that there might be another reason behind it other than just to make their test scores artifically high.
Web browsing optimisation (Score:5, Informative)
Re: (Score:2, Insightful)
Front-Load (Score:2, Redundant)
Your average webpage is not 100+MB. If they give you full bandwidth for, say, 2 seconds - most reasonable webpages will download completely within that time. It's not "cheating" exactly since they don't guarantee those speeds, but "up to" those speeds. They're not the only ones who do it, either.
Still a sleezy thing to do...
=Smidge=
This is most likely "PowerBoost" (Score:3, Informative)
All it does is give you short bursts of high bandwidth and is really more talk than usefulness.
My ISP, Cox, does this too, though once the "PowerBoost" thing is off, I steadily get the bandwidth I'm supposed to get. Dunno about Comcast.
SpeedBoost is the thing (Score:5, Informative)
Some consumers may not notice the speed increase when downloading smaller files, such as text-based e-mails and simple Web sites with few graphics. However, customers who frequently download large files, such as software, games, music, photos, and videos will now download at speeds that are faster than ever before. For example, PowerBoost significantly reduces the time it takes to download a one hour television program. Comcast subscribers at the 6 Mbps tier would reduce their wait time in half - from 4 minutes and 29 seconds to 2 minutes and 15 seconds. And MP3 fans will be able to download music files as fast as 2.2 seconds!
Token Bucket (Score:5, Informative)
http://en.wikipedia.org/wiki/Token_bucket [wikipedia.org]
Seems normal (Score:2)
Speeds (Score:2, Informative)
~Sun
If those clients are running Windows... (Score:3, Informative)
My advertised and provisioned rate via Atlantic Broadband cable is 5/512. I am actually getting closer to 6 or 7 down and 468 up at all times due to some tweaking I did. Even the AtlanticBB tech seemed a bit shocked that I was getting more than 5 down, and said it was unusual, but they wouldn't re-provision the line or anything because of it. I count myself lucky, because Verizon's service here is absolute rubbish - $25.00/month for 1.5/768 DSL that, shall I say in the politest way possible, isn't actually working for more than two weeks per month because they are too cheap to replace lines that were put up in this town sometime in the 1950's at the latest (Not to mention they never actually bother to show up for scheduled appointments to rewire buildings that were constructed pre-1900, such as mine - big old Victorian type home turned into apartments).
Powerboost does mess with speed testing, however those "tests" are very rarely accurate anyhow, as I can rate higher on a test to Seattle or Los Angeles than I do to say Pittsburgh, Toronto or NYC, which are MUCH closer to where I live (by several thousand wire miles). It's more accurate to calculate your average rates by downloading/uploading large files from/to a university/public FTP or something, at least in my experience.
Note to ISPs (Score:2)
Of course it depens on the user, the average traffic from my xbox 360 alone (in gaming, demo downloads, movies etc) in one day, is more than my parents have in a month with their just light surfing and email use. And I don't use my xbox that much.
It is an issue they have to face now. Legal traffic alone these days for high tech households internet use, can pass your ISPs secret acceptable use limits.
QoS limits (Score:2, Informative)
How about an answer? (Score:4, Informative)
I know that this is slashdot but I'll try to answer some of the OP's question anyway. Of course I won't do any original research myself, but rather rely on information from the previous posters or make things up as I go.
Q1. Is there any valid reason why Comcast would front-load transfers in this way?
Yes. Most requests from browsers are for short files. By upping the speed for short requests, pages will render faster. This is a plus for the user, as he spends less time idling. Long downloads on the other time are expected to take a while to complete; the user expects to be able to walk away from the computer for a while. Thus Comcast can argue that they have greatly enhanced the experience of the web browser by stealing a few cycles from the downloader. I would welcome such a plan as long as the ISO downloading speed is reasonable.
Q2. Is it merely an effort to prevent end-users from being able to assess their bandwidth accurately?
It would have that effect on a poorly designed bandwidth test. Bandwidth testers try to make the download size long enough to counteract tcp connection costs and to average over variations in download speed. Comcast has just given them another variable to take in to account. Interestingly, there are some test suites that are designed to detect what Comcast is doing and give them extra credit for it. They bill their tests as real world throughput tests. They want to indicate what the effective bandwidth is while browsing web pages that reference many images or javascript files.
Q3. Is Comcast cheating?
If Comcast is just doing this when accessing known test sites then they are cheating. If this is their policy for all connections then the worst that can be said is that they are optimizing their service to a particular class of users (surfers as opposed to downloaders). If you are in this category, then you should be happy.
I wish (Score:2)
Re: (Score:3, Informative)
Re: (Score:2)
Re: (Score:2)
Re: (Score:3, Insightful)
See link here (Score:3, Informative)
Iperf (Score:3, Informative)
Re: (Score:2)
It's true (Score:5, Informative)
It's really bad on uploads -- I just ran a test and I got 300 KB/s for the first 5 megs, then it degrades 100 KB/second over the next few megs, so that by the time you have uploaded 14 megs you are getting close to 40 KB/S in upload speed, and the connection is so bad that the shared digital phone line does not have enough bandwidth to have a phone conversation. Stop the upload and start it up again, and you get 330 kb/second, with the same degradation curve.
For downloads they do the same thing, but not so severely -- I downloaded a 67 meg file and it ran at about 750 KB initially, but then dropped to around 350-400 KB/S (according to the FTP app) about halfway through.
So for anyone using the connection for smaller file sizes (like the speed tests) you seem to get "blazing" speeds -- I ran the test at a couple of the internet speed test sites and they both think that I have 12000-14000 kb/s download speed and 2700 kb/s upload speed.
So if I didn't have any other way to measure it, I would think that I was getting way more than I paid for, rather than something that in reality is very pitiful.
Network Admin? Baseline the network utilization! (Score:2, Informative)
Unless there is an problem with the link that can be immediately identified at the time you tested, like a physical problem, then you should develop a
Crumcast... (Score:2, Flamebait)
I've had my Fios Fibre-optic connection for over a year now, and unlike everything else I've had before -- including Crumcast -- Fios has been fast and trouble-free. I can sustain the 5Mb down and the 2Mb up without a hitch, and I've tested this with BitTorrent, of all things.
It's so good, in fact, that it's been exposing problems with my Netgear Wireless Router RangeMax -- I don't think they'd figured on someone sustaining that kind of bandwidth. So it's time for
Re: (Score:2)
Depends on the market you're in. By European or Asian standards, even my connection is crap.
Re: (Score:3)
Consumer-grade Shared bandwidth (Score:5, Informative)
If you want a commercial-grade link you expect to saturate, pay for it! Otherwise, you are stealing from other users and the ISP should throttle you to be fair to them.
Re: (Score:3, Informative)
The good news. (Score:2)
How can we trigger this effect all the time?
Works as expected, nothing nefarious going on. (Score:2)
If you want to test sustained speed, then test sustained speed. When you benchmark a HD, do you only test reading small files (which will fit in the HD's cache ram) and then get surprised when the sustained speed is significantly lower? Use the right benchmarking tool, mmkay?
it appears that Comcast is delivering this bandwidth only for a few seconds after any new request and it is immediately
Bursting software (Score:2)
SpeedBoost? "Burst" back. (Score:2)
false; while [ $? != 0 ] ; do wget -c http://ubuntu.com/foo.iso [ubuntu.com] & ; export X=$! ; sleep 20 ; except kill -9 $X ; done
This runs wget in continuation, sets the PID of wget to X, sleeps for 20 seconds, kills wget, and finally quits when wget isn't around any more. Possible problem: if something else gets wget's old PID during the sleep period (after wget finishes normally), kill -9 will kill it, and run through th
Scales to business class too (Score:2)
The only way to really know is, (Score:2)
Shortest Job First (Score:5, Informative)
In operating system theory, it is well known that a scheduling algorithm called "Shortest Job First" yields the least total waiting time. The SJF algorithm is usually implemented by giving a "new" job high priority, and then reducing the priority gradually as the job accumulates resource usage. The algorithm was developed in the 1960's to allow time-sharing operating systems to provide rapid keystroke response, while continuing to process large batch jobs in the background.
For communication systems, the same principle applies. The only difference is that the network is sharing a different resource (circuit bandwidth), instead of cpu time. The "new" connection gets high priority, and then that priority is reduced as the number of bytes/packets transferred over that connection increases. This allows rapid response for interactive applications, like browsing or editing, while also allowing the network to process large data transfers in the background. To apply it to datagram traffic, the switch just keeps a priority for each source/destination address-pair in cache, and any pair that is not in the cache is regarded as "new".
This has been pretty much standard practice in packet communication switching for a very long time. There is no surprise here, at least not to those of us who have not been doing communications network programming for a few decades.
sheesh... (Score:5, Informative)
This is not a new thing (throughput vs. bandwidth) (Score:4, Informative)
Think of the connection as a large pipe (your cable connection) with a small outflow valve (your modem), connected to a larger, higher pressure pipe (your ISP). Until your local pipe is full, you can put water into it as fast as you desire. But once it is full, the volume slows down because you can only put in as much as you are taking out (your cable modem connection/outflow valve). So what speakeasy and various other speed testing sites see is the effect of filling up your local pipe (your connection to your ISP).
What a large file download shows you is the actual throughput.
BTW, this is also a quick, very simplified explanation of bandwidth (how much data you can pack into the pipe) vs. throughput (how fast you can actually pull data through the pipe).
Get rid of kdawson (Score:3)
http://www.dslreports.com/shownews/Slashdot-Keeps-Rediscovering-Comcast-Powerboost-91976 [dslreports.com]
kdawson continually posts garbage like this. s/he clearly has no clue. Get rid of kdawson and maybe I'll come back here.
Re: (Score:2)
Re: (Score:2)
Re: (Score:3, Interesting)
Re: (Score:2)
Re: (Score:2, Insightful)
Re: (Score:2)
I take that to mean that you turned off the torrents and then tested, which means your connection was probably still in "Punitive Mode"; you need to shut down your cable modem for at least 30 second then reboot it with a fresh configuration, which gets you back into "Normal Mode" and a new IP address that is not viciously throttled by the sandvine policy routers at the head-end.