Slashdot is powered by your submissions, so send in your scoop

 



Forgot your password?
typodupeerror
×
The Internet

Are Internet News Sites Ready for Major World News? 304

An anonymous reader asks: "Heading says it all really - are Internet news websites ready for the next big world event? news.bbc.co.uk already switches format under heavy load (not sure if this is automatic or not) and i'm sure some other sites do the same. But should a major world event take place in the coming months/years, the Internet is going to be the primary news source for many millions of people, particularly those without access to a quality television news service. How will / can it cope?"
This discussion has been archived. No new comments can be posted.

Are Internet News Sites Ready for Major World News?

Comments Filter:
  • Uh oh (Score:5, Funny)

    by joyoflinux ( 522023 ) <thejoyoflinux AT yahoo DOT com> on Monday October 07, 2002 @09:12AM (#4402030)
    Hopefully news.bbc.co.uk can cope with having it's link on Slashdot's homepage...
  • won't replace TV (Score:3, Insightful)

    by potcrackpot ( 245556 ) on Monday October 07, 2002 @09:14AM (#4402036) Homepage
    Certainly when the events of September 11th took place, for those of us at work in the UK without a television at hand the only way to keep up with events was via the web.

    News sites failed to cope with the load - millions of people trying to access the same sites meant that no amount of bandwidth could cope with demand.

    For this reason, I don't think that the web is going to replace television as a source of live news coverage anytime soon.
    • Re:won't replace TV (Score:5, Interesting)

      by garcia ( 6573 ) on Monday October 07, 2002 @09:18AM (#4402057)
      personally, I didn't like watching TV on 9/11/02. They were repeating the same garbage all day long. The reporters were rather boring and the news coverage the same.

      I preferred to read /. (as most other news sites were unreachable due to traffic) b/c of not only the news but also discussion w/others. It was interesting to read what other people were feeling, especially those that were not in the US.
    • Re:won't replace TV (Score:3, Interesting)

      by MImeKillEr ( 445828 )
      Agreed. The 2nd plane hit the 2nd tower just as I was pulling into my parking lot at my (then) office. I thought it was a total and tasteless joke (considering the juvenile humor the morning show I listed to at the time was known for). When I unlocked the office, I jumped on CNN's webpage. By the time that the rest of the engineers and the admin staff arrived, CNN was almost unreachable. We did get to watc about 15 minutes more of the coverage before we lost connection.

      I tried several other news sites (MSNBC, ABCNews, etc) only to find the same congestion.

      No, the internet isn't ready to handle the bandwidth associated with millions of people logging on to get the latest information.

      Which leads me to a question: Any *decent* (and FREE) newstickers out there that are totally customizable, and run under Windows? I already checked SourceForge.. I've been using Netropa, but its not set up to allow me to add whatever channels I want. I tried Swen (from Tucows) but it doesn't work at all..
    • Re:won't replace TV (Score:4, Informative)

      by nicklott ( 533496 ) on Monday October 07, 2002 @10:01AM (#4402345)
      The BBC has its bandwidth graphs online here [bbc.co.uk].

      Sept 11 is just on the left of graph at the bottom. Interestingly a normal day's traffic is now greater than the sept 11th spike, maybe they could handle major news events.

      (I can't think what the early april spike is, but the raised traffic in june/july is the world cup)

      • Possibly the April spike is the UK budget announcement. Since that knd of thing has a lot of information involved, most of which only applies to a small portion of the audience, it works a lot better on the web than on TV.

        The general increase since summer may be due to the increasing availability of broadband connections in the UK, or thousands of students who normally look at the site through the academic caches getting summer jobs (though I doubt it).
      • I can't think what the early april spike is
        Just off the top of my head... would that be about when the Queen Mum passed away?
  • by nick255 ( 139962 ) on Monday October 07, 2002 @09:14AM (#4402039)
    How many people have internet access, but no access to TV, radio, or other broadcast recievers? For major news stories boardcast medium will always be the main method of disseminating information to the masses, client-server systems aren't really designed for this purpose.
    • by JohnFluxx ( 413620 ) on Monday October 07, 2002 @09:20AM (#4402073)
      People at work.
  • On sep. 11 last year I watched the first hour of it live from BBC's homepage without to many problems.

    Seemed fine to me (not that I was thinking much about the quality). Was it really that bad?
    • You got lucky. CNN was posting video clips to their website as they got them in. By 9:30 their webpage had slowed to such a crawl even their ads were having trouble loading.
      • You got lucky. CNN was posting video clips to their website as they got them in. By 9:30 their webpage had slowed to such a crawl even their ads were having trouble loading.
        As early as I can recall on that morning, CNN had taken down their website and replaced it with a large text link and a picture with a breif blurb. For most of the day it remained an extremely simplistic website with primarily textual content. Video clips were sparse, there were a few pictures, but no ads until mid-late afternoon. By late afternoon they'd re-designed their main page to include all those excellent titles they gave the day ("Attack On America!", "America Under Attack!", etc.) and lots of pictures, snippets, and almost all of the links/sections were about the attack, and the ads had returned.
  • Why... (Score:5, Funny)

    by aallan ( 68633 ) <alasdair@babilim[ ].uk ['.co' in gap]> on Monday October 07, 2002 @09:16AM (#4402047) Homepage

    ...are Internet news websites ready for the next big world event?

    Why? Are you planning one?

    Al.
  • Sites can do their best to anticpate heavy load, but off-the-map events like 9/11 tend to reveal weaknesses in systems (which potentially can be elsewhere in the network). Also, it's pretty expensive to engineer to contantly be ready for such rare occurances.
  • This [slashdot.org] is how.
    • by wiredog ( 43288 )
      That was my first thought. On that day Slashdot, Kuro5hin, and other places became "rip'n'read" sites and held up quite well under the load.
  • ... you would find me reading about it on slashdot, not some news site, for the following reasons:

    1. Resistance to large amounts of sudden traffic.
    2. Meta-news from other sites.

    Simple really.
    -----

    fat chicks need love too [wallpaperscoverings.com]

  • In a word, no. (Score:5, Informative)

    by FreeLinux ( 555387 ) on Monday October 07, 2002 @09:20AM (#4402068)
    No they can't cope. It's been proven already. Even giants like the BBC and CNN had several moments where they could not handle the load on September 11th.

    I'm sure that they have taken steps to improve things in the future but, there is only so much that you can do, or at least do cost effectively. There is no substitute for hardware and bandwidth but, maintaining enough to support the entire planet at one critical moment in time, that may or may not come, is not cost effective.

    When the time comes, the news sites will buckle under the load, just as the telephone system does. The best source for news, during times of disaster are television and more so, radio. Even in the most remote places, you can still get radio and with new satellite radio, you can get it anywhere.
  • Backend ? (Score:2, Interesting)

    What type of backend is running most of the news sites? Are some of them distrubuted? (I know some are, but to what extent and how? )

    If you mean a major bandwith spike, then where is the weakest link? Will the pipe fill up before the processing power is toped out?

    I know that some ISP's had their bandwidth bursting at the seams during 911, so even if there was nothing wrong with the news/internet/network - the ISP was fragile.

    Not really a post - in that I am not giving much in the way of answers, but just trying to ask the right questions. There is so much to consider in such a situation, rather than looking (drooling?) at their massive server farm(s), don't forget about the pipe that feeds it(them).

  • by Anonymous Coward on Monday October 07, 2002 @09:20AM (#4402071)
    The BBC coped because of two main things. The first is because they switched to a low-graphics version. The other reason is that the BBC's servers are geographically spread out. They have servers on several European backbones, and also have seperate servers in New York Telehouse which serves all the content for the people on the other side of the Atlantic.

    Thats how they coped, my old mucker.
  • Ananova (Score:3, Insightful)

    by mccalli ( 323026 ) on Monday October 07, 2002 @09:20AM (#4402072) Homepage
    Well, on September 11th Ananova [ananova.com] stayed up without trouble. I'm aware that it has also survived a good few Slashdottings too.

    Cheers,
    Ian

  • September 11th (Score:5, Informative)

    by sql*kitten ( 1359 ) on Monday October 07, 2002 @09:20AM (#4402074)
    Keynote have oublished a report [keynote.com]on the performance of major web sites on September 11th, 2001.

    Of course, there's a lot of dark fibre around, so the capacity is there if it's really needed. Once the current recession is over, we can expect to go back to the days of massive overprovision and redundancy as content and bandwidth providers seek to build in capacity to handle peaks. What will really help is multicasting for video streams, and well-designed caches at ISPs.
  • Well... (Score:3, Insightful)

    by Arminius ( 84868 ) on Monday October 07, 2002 @09:21AM (#4402076) Homepage
    the Internet is going to be the primary news source for many millions of people, particularly those without access to a quality television news service. How will / can it cope?"


    They can do it the same way I cope when my power goes off... A cheep battery operated shortwave radio tuned to the BBC or other quality station. IMHO, I'm pretty sure if they can't get access to a TV then what chances do they have at getting the internet?
  • by Anonymous Coward
    A lot of news sites got a taste of what covering big events on the internet is like. Some did okay, most didn't. Even Slashdot learned a few things about handling loads.

    Also, it in part led to Google News. I'm actually kinda comfortable with Google handling news, as I think if such an event happens again, Google can just cache the important news.

    TV and radio, though, will likely always have the advantage that viewer load doesn't affect them. So, even if someday we move beyond traditional TV/Radio broadcasting, emergency radio broadcasting should be kept in some form.
  • by Anonymous Coward on Monday October 07, 2002 @09:25AM (#4402099)
    "...particularly those without access to a quality television news service."

    Gee, that's pretty much everyone.
  • September 11th (Score:5, Interesting)

    by Komrade S. ( 604620 ) on Monday October 07, 2002 @09:25AM (#4402101) Homepage
    On September 11th, major news sites like Yahoo, BBC, CNN were entirely flooded with traffic much like the phone system was, going as far as taking down some fairly large servers altogether. What ended up happening was that a bunch of IRC channels (specifically on SlashNET) cropped up with people giving live webcam shots, rumours and snippets of information, mirrors. Then the CNN closed captioning bots started relaying to IRC for those without the cable service. It was interesting as it showed the Internet both failing at and succeeding in its primary designed function, as a communications and information network that could survive a major catastrophe.
    • Re:September 11th (Score:3, Insightful)

      by micromoog ( 206608 )
      It was interesting as it showed the Internet both failing at and succeeding in its primary designed function, as a communications and information network that could survive a major catastrophe.

      The "major catastrophe" it is designed to survive is something that physically destroys or isolates many nodes of the network. This was a simple traffic spike.

      • Sorry, but you are wrong. The WTC crashes knocked out a lot of major internet links. I live and work in Maryland; on 9/11, one of our redundant internet connections went down as a direct result of the WTC collapse. The backbone it routed through was in the Verizon CO that was destroyed.
      • The "major catastrophe" it is designed to survive is something that physically destroys or isolates many nodes of the network. This was a simple traffic spike.

        I've often heard this story that the Internet was designed to withstand a nuclear war, but I'm sure we've all experienced the Internet failing on a pleasant summer's day :-)
    • Re:September 11th (Score:2, Interesting)

      by grishnav ( 522003 )
      The internet was designed to be a somewhat peer-to-peer infrastructure.

      IRC, while admitedly incorporating a client/server architecture, is still more peer to peer (it is, after all, Internet relay chat) than a news site (which is completely server/client).

      The "failures" were those parts of the 'net that didn't obey p2p, and the "successes" were the systems that did.

      Even Kazaa lit up with ripped/pirated CNN broadcasts. I didn't have access to a TV that day, either. I got my footage from Kazaa at School.

    • Re:September 11th (Score:4, Informative)

      by drdink ( 77 ) <smkelly+slashdot@zombie.org> on Monday October 07, 2002 @10:57AM (#4402775) Homepage
      As a SlashNET administrator, I appreciate the fact that people acknowledge and appreciate the efforts of our users to provide up to the minute news in times of crisis. We hope to continue doing this in the future as time dictates, and we've improved our ability to do so in the future as necessary.

      The problem with the web is that it is graphics intensive. When you go to CNN, you have to download a ton of graphics, you have to initiate a new connection with the server on each request, etc. With IRC, you don't have any of the graphics and you don't have to reconnect to it in order to get updates 5 minutes later.

      The history of IRC is pretty spotty. Most of the times it can be pretty lame and pointless, but it has always become a useful communications tool. I hope this practice continues.

    • On 9/11, most of the guys I worked with got their news from cnnfn.com, Yahoo! India, etc. There were plenty of alternative paths to the online news on that day.
  • With the prevalence of the internet as a means for distribution of all forms of data, new ways of meeting these needs are needed. No longer can one use traditional methods of increasing pipe size or basic colocation and assume that you're back will be covered. We're seeing increasing occurrences of sites being hammered (for whatever reason) and not just the small ones. While the internet may be a massively distributed thing, it still has some major Hopefully this is an area which the methodology of P2P systems and on-the-fly mirroring can help with. If something is in high demand, it should be made _easier_ to get hold off, not harder.
  • Yes and No (Score:5, Interesting)

    by javatips ( 66293 ) on Monday October 07, 2002 @09:28AM (#4402115) Homepage
    My observation for 9/11 waw that major news site crawled under the load. However, less often visited news site were responsive all day and gave the same news with the same level of coverage than the big news sites.

    So I must say, find some smaller news site and bookmark them. When your big-shot news site will crawl under load, just go to the small one and you will get your news.

    BTW if you just want nice video, the Intenet is not the place to go, turn on your TV, you'll get far better image quality and you don't have to wait until the video is buffered.
  • 9/11 proved it can't (Score:3, Interesting)

    by Dynamoo ( 527749 ) on Monday October 07, 2002 @09:28AM (#4402117) Homepage
    9/11 proved that news services collapse under heavy load, something that was repeated only a few weeks later with the Queen's air disaster. This series [dynamoo.com] of diary articles might refresh your memory.

    Being a Brit, the BBC was the first place I turned to for news and basically the whole thing ground to a halt and that was despite the BBC News outfit having upgraded systems substantially to cope with the 2001 UK General Election. Both the UK and US mirror were swamped and basically stopped working. Interestingly the US Mirror site was in New York, not far from the WTC, and despite the fact the power was lost in the entire area, the servers kept going for several days on backup generators until those generators died due to the dust.

    It tended to be the second-tier news service like Ananova [ananova.com] that could cope, simply because in times of crisis people will always turn to familiar names first.. the BBC, NBC, CBS, CNN etc.

    I seem to remember that the low-graphics option came after 9/11, but it's only a partial solution to the problem.. several times since then the BBC have switched to low-graphics but there haven't been any events of the magnitude of 9/11 since then.

    Look at it this way.. lets say the US has 50 million office workers with access to the Internet (a pure guesstimate) and they all try to access the same news sites within a window of 30 minutes. On 9/11 people were trying to download videos of the attacks so they could understand what was going on - don't forget that those now familiar images we all know now were completely unthinkable. This combination of huge numbers of users and very high demand for streaming video is almost impossible to keep up with.

    In short, on 9/11 the web let us down and the only people who knew what was going on were those with access to televisions. The world has not moved on that much in the past 12 months, so basically the same thing will happen all over again if (God forbid) the same thing happens all over again..

    • I seem to remember that the low-graphics option came after 9/11
      No, it's been there from the beginning, AFAIK. The beeb could do a bit better about presenting eg SW frequency information in a form suitable for low-bandwidth connections, but they're pretty good about keeping the low-graphics news pages themselves going and as current as the high-graphics ones.
  • by kipple ( 244681 ) on Monday October 07, 2002 @09:29AM (#4402121) Journal
    or at least this is what I think:

    http://robots.cnn.com

    however, I still think that the best medium for broadcast is not an interactive media like the Internet, but a one-way media like radio or TV;

    Anyway, I would rather prefer a text-only information source like during the Gulf War the BBC did on IRC. But I may be wrong on that.
  • 9/11/01 and CNN (Score:2, Informative)

    by Anonymous Coward
    On 9/11/01, many people may have had trouble accessing CNN. There is a good reason for this. CNN was in the middle of a server upgrade. If memory serves me correctly (and keep in mind this is second-hand), CNN only had eight servers running for cnn.com at the time.

    Needless to say, cnn.com really had to get more servers into production quickly. They worked with Sun to get several hundred servers on site and running.

    I don't know why cnn.com had such an upgrade strategy, but it is what happened....

  • This is where proxies come in handy. If there are 1000 people in a large corporation trying to access the web at once on such a day, then a proxy would reduce the number of duplicate requests being made to the web site involved.

    At the same time maybe the HTTP procotol needs a version that is capable of UDP broadcasts in special cases?
  • News from all over (Score:5, Interesting)

    by SplendidIsolatn ( 468434 ) <splendidisolatn@yah[ ]com ['oo.' in gap]> on Monday October 07, 2002 @09:34AM (#4402147)
    news.google.com should hold up under even the heaviest loads, and while you might not get the actual site it links to, you should at least be able to get the idea of what's going on based on the headlines.

    In a time of crisis, is it really necessary to know the details of a major world event immediately? If a nuke goes off somewhere, I'm not too concerned about who did it--I'm driving to some remote place, THEN I'll start asking the questions.

    On Sept. 11th, what did we know for certain:

    *4 planes were hijacked
    *Two towers fell
    *The Pentagon was hit
    *A plane went down in PA

    everything else was mere specualtion at the time, and everything above could be read by headlines alone.

    Just a thought,
  • Multicast ! (Score:5, Interesting)

    by Anonymous Coward on Monday October 07, 2002 @09:34AM (#4402148)
    The answer to scalability has been there for years, and it's multicast. Multicast is a protocol that implement a one-to-many distribution of the information, allowing very efficient distribution of contents on the internet (the target is that the information should not pass more than once on any given physical line), and dynamic group joining and leaving.

    However, ISP and users are confronted to a chicken-and-egg problem: ISP pretend there is no demand for multicast, so that can't justify the investment in increased NOC knowledge, users don't know what it is, and content providers have no support from ISP or user.

    Multicast is however the scalable answer for live broadcast and scheduled replay, it's been there for years and I do not loose hope that it will be better used one day.

    • Re:Multicast ! (Score:2, Insightful)

      by jeffy124 ( 453342 )
      multicast would be better for streaming media, not loading of webpages. In a case of a Sept 11 scale news event, local caching would be better, as the ISP could cache major news sites (CNN, Yahoo, MSNBC, etc) and serve those up, refreshing the cache something like every 5-10 minutes, forwarding requests to the real site for pages not being cached.
    • Re:Multicast ! (Score:3, Insightful)

      by Sentry21 ( 8183 )
      This makes a very good point. Multicast won't work with a static (request, responce, close) connection like websites (because you won't necesssarily have people downloading the same content at the same time)... but it works great for streaming content. Theoretically, if multicast were implemented properly and universally, it would be easier on bandwidth and server load for everyone to view streaming video than static websites (because the server only needs to send out one multicast stream, except if you hit a limit as to the number of destinations that a packet can have).

      Interesting to think that streaming audio and video could be easier on bandwidth than websites...

      --Dan
  • Seems like the best answer would be automatic load balancing between disparate servers. But how would we get the services to cooperate? E.g. rushlimbaugh.com not be too keen on sharing resources with cnn.com. :) And that begs the question, would the "rescuing" site be entitled for a fee for their failover support?
  • Flash crowds (Score:5, Insightful)

    by ajs ( 35943 ) <{ajs} {at} {ajs.com}> on Monday October 07, 2002 @09:34AM (#4402158) Homepage Journal
    It was Larry Niven who predicted the idea of "flash crowds". Of course, he was envisioning physical crowds via teleportation, but the basic idea still holds. It's only going to get worse as more and more people use the net.

    Look at it this way: in a primative society, a clan or village would usually have a storyteller or sage who gathered the news of the world in story form and re-told as appropriate. We should not be supprised that it takes millions, perhaps even hundreds of millions of people to be the story-tellers to 6 billion (that's a US billion).

    If the Internet had a higher percentage of useful sites for news (not just talking jpeg-heads, but innovative ways of conveying the STORIES that the news represents), then no one of them would be loaded down and the backbones would be the only bottleneck. Notice that so many of us flocked to Slashdot when the towers fell? Wonder why? Because Slashdot, for good or ill, is our community's storyteller, and we instinctively come here to understand how our community is reacting.
  • by RealBeanDip ( 26604 ) on Monday October 07, 2002 @09:35AM (#4402160)
    Folks,

    If you don't have a portable AM/FM radio, or even better a shortwave receiver, then get one TODAY. Get some spare battteries for it as well.

    The simple fact is if you want to hear what's going on during a "major event" radio is the best way to do it. And you have evacuate in a hurry, you sure as hell aren't going to be taking your 60" flat screen TV with you. You want pictures, wait for the evening news, if you want to know what's going on NOW, get a radio.

    Even better, get yourself licensed as a ham radio operator so you can be part of the communication solution if needed (yes, amateur radio is still important, even today).
  • particularly those without access to a quality television news service.

    Isn't that a oxymoron?

  • by X86Daddy ( 446356 ) on Monday October 07, 2002 @09:41AM (#4402199) Journal
    During the horror of the attacks last year, I was surprised and thankful for CNN's approach which allowed them to withstand the barrage of hits:

    They switched to an old-school, how-the-web-used-to-be, no-nonsense design. It was basic HTML, with some embedded pictures that contribued to the information. No frills, no ads, no sidebars about the latest crap-news, just the information we were looking for. Needless to say, it also ate a lot less bandwidth.

    Of course, they were down part of the morning, but when they came back in the altered format, I thought it was a great move. A few other sites were doing the same thing, and I think they'll remember the technique for the next time something big goes down (hopefully something pleasant next time? I can hope...)
  • by SgtChaireBourne ( 457691 ) on Monday October 07, 2002 @09:42AM (#4402203) Homepage
    Sites that can't handle or adapt on the fly to a heavy burst of traffic lose status as a news source. Many sites were unable to cope with the traffic and were slashdotted out of existence. The entire net was under the functional equivalent of a DDOS last autumn. Some probably made improvements in their ability to handle bursty traffic, but many probably save their money.

    To state the obvious, the major news sites would have to have not only leaner pages, but also have the infrastructure to withstand a slashdotting-with-hair-on-it. Leaner, lower bandwidth web pages benefit every one, every day, but for daily needs the infrastructure is going to be expensive overkill.

    In contrast, more of the tech sites were already used to heavy loads and I would guess that his brought in a larger than normal number of new and infrequent visitors. Maybe it was my imagination, but it seemed that after that many mainstream newspapers, magazines, and radio magazines started to carry more cutting edge tech info and topics and providing in a much more timely manner - days instead of weeks or months.

    It would be interesting to map how much the coverage and timeliness of tech issues by the mainstream press changed, when it changed, and how much was related to being able stay on line.

    • To state the obvious, the major news sites would have to have not only leaner pages, but also have the infrastructure to withstand a slashdotting-with-hair-on-it.

      Slashdotting-with-hair-on-it?

      You mean... A horde of rabid Cowboy Neals attacking innocent news web sites???

      *shudder*

      I think I am going to be sick... ;)
  • by Andy Smith ( 55346 ) on Monday October 07, 2002 @09:47AM (#4402244)
    It isn't just the news sites we have to think about. We should also be asking, when the next big event does happen, will people even be able to get online to access the news sites?

    I'm not talking about some sort of damage to the communications network. I'm talking about ISPs that enforce strict rules on how many of their customers can get online simultaneously. They are the real threat to the Net as a primary source of urgent information, and it's all about money. They take on millions of customers but total capacity is measured in tens of thousands.

    For example, on September 11th there were a few hours when tall buildings in London and other British cities were being evacuated, but many people over here couldn't get online to access vital information because our ISPs have notoriously low capacity and only allow a small percentage of their customers online at any one time.

    Obviously this is a greater threat in rural areas because the only available connection method is dial-up.
  • by BluBrick ( 1924 ) <blubrick@ g m a i l.com> on Monday October 07, 2002 @09:48AM (#4402252) Homepage
    I am subscribed to a couple of worldwide mailing lists and I have found that email simply rocks in high 'net traffic situations.

    During the New York tragedy, much of the traffic on those lists was along the lines of "I can't get to the major sites because the web is clagged solid - can anyone tell me the latest?". And thankfully for a couple of days, the rules about straying from the topic of the mailing list were ignored.

    Granted, many of the complaints were actually related to individual corporate firewalls, http gateways and proxy servers, rather than the sites themselves, but the situation stands: for whatever reason, you can't get to the site. Our web proxy fell over under the load, but our SMTP gateway just kept on going. And so did most others around the world. And I imagine that NNTP stuff worked just as well the SMTP stuff.

    Remember folks, the Internet is a lot more than the Web!
  • by mbone ( 558574 ) on Monday October 07, 2002 @09:49AM (#4402262)
    Multicast news services worked well [nanog.org] during 9/11 and there is no reason to think that they won't the next time. Multicast is specifically designed not to "melt down" under extreme changes in audience.

    The trouble is that not everyone is multicast enabled, but this shows real promise in handling news and emergency information over the Internet.
  • interesting fact (Score:3, Informative)

    by hype7 ( 239530 ) <u3295110.anu@edu@au> on Monday October 07, 2002 @09:50AM (#4402264) Journal
    one of the passengers on one of the planes that came down on 9/11 (it was the one that crashed in the field, IIRC) was a founder of Akamai Networks [akamai.com], one of the load sharing/distribution companies that allow bandwidth to scale according to demand. As his plane came down, his company was entering one of the most demanding days in its history, as more people were targeting news sites at once than ever before.

    It's organisations like that which will assist in the next big news item.

    -- james
  • Slashdot seems to be the Gray Hat [slashdot.org] QA engineer in testing concurrent site capacity. Maybe it should get a salary and benefits....
  • by jht ( 5006 ) on Monday October 07, 2002 @09:53AM (#4402287) Homepage Journal
    Ever since 9/11, I've noticed that the heavily-trafficked sites cope with sudden floods of hits by switching over to static pages with minimal graphics. The NY Times, for instance, did this when the AA flight went down in Queens last November. CNN's done it a couple of times as well.

    When we're looking at scale, though, it's useful for us to remember that these sites can handle way more traffic than even the typical slashdotting can deliver. Most breaking major news can be handled by them with only a little bit of slowdown. It's only the 9/11-scale events that can really bring the news sites to their knees - so lets hope that we don't have to see anything that brings on a overload scenario for the big news sites.

    The other thing to consider is that most of the news providers are still investing some money in their infrastructure - just less than before. It's very well possible that a 9/11-scale event might not hammer the servers the way they were hammered last year. A lot of web sysadmins learned valuable lessons that day that I'm sure have been applied since then.
    • I think the news sites should have the ability to run multiple mirrors of their own web site all over the world. That way, instead of everyone trying to log onto one centralized site they just log onto the closest mirror site. After all, Microsoft now uses Akamai as their primary means to distribute patches and updates online, and Akamai is one of the companies specializing in this type of business.
  • Unless... (Score:2, Funny)

    by cookiej ( 136023 )
    ... the headline reads, "Internet knocked out by multi-city EMP attack"
  • It was Princess Di's death. I was on shift the night it happened and it pretty much brought all news websites to their knees. That was the first time I noticed the low bandwidth version of CNN. At first I thought the site was choking because it looked like some graphics were not loading.

    Still, I'll give it to Slashdot and to IRC. I spent most of 9/11 on IRC transcribing what was being reported on CNN, since for a while the site was pretty much useless. A bunch of us where also taking screen captures and posting them online so people could see the horror. I still have captures of the first flyover of the Pentagon, which is less than 10 miles from my office.
  • by shoppa ( 464619 ) on Monday October 07, 2002 @09:55AM (#4402304)
    This was all settled years ago. A long neglected Usenet group, news.announce.important, is reserved for these global earth-shattering events. For Example [google.com]:
    • (b) "The Internet is running out of IP addresses, please conserve your addresses and give any you are not using back to the NIC." Approved.
    • Recent posts to this important announcement newsgroup include:

      17 Sep 2002 Blind Vigilantes
      23 Apr 2002 Art and all that Jazz
      16 Oct 2001 My car was recently struck by a United Parcel

      Maybe not a such a great source of breaking news - there are no Sept 11-related posts at all.
  • Bandwidth insurance.

    When there are big world events, the amount of net traffic does increase overall, but not hugely, as instead of wasting time reading/working, we all go and look at news sites instead.

    One way around this problem is bandwidth insurance. What is this? Large groups of averagely popular websites all get their bandwidth from certain sources. When there's a sudden move in traffic, those really big providers can simply deallocate the bandwidth from gardening.com and reallocate it to the BBC .

    I might be talking out of my ass here, as the BBC already has peering agreements with Telehouse etc it's so big. Alternatively ISPs could implement decent caching systems. Otherwise, FreeNet released 0.5rc1 earlier :)

  • A Few Ideas (Score:3, Informative)

    by limekiller4 ( 451497 ) on Monday October 07, 2002 @10:07AM (#4402383) Homepage
    When 9/11 hit, the first thing I did was wget about two dozen news sites and thousands of blogs immediately. CNN, in particular, got blacked out really, really hard, and was reduced to one image on the front. I wish I had my archives available to post but they're rather deeply gzipped ...somewhere. =)

    Akamai had their work cut out for them that day, I can tell you. I was lucky. I called out sick.

    But none of this really answers the question -- how do you cover your butt and insure that you keep getting a news feed when/if you need it? I noticed that when I go to www.php.com, it's quite slow. So I started using uk.php.net and it zips right along. The moral of this story is that you might want to find 3-5 news sites that you consider good (and a factor in this probably should be how fast news gets to their site), then find some printer-friendly version/low bandwidth links to their front pages. Those are far less likely to be used when things get crazy. Drop some admins an email, perhaps certain versions of their site is located on entirely seperate servers and might go unscathed during a 9/11-ish rerun.
  • by DaoudaW ( 533025 ) on Monday October 07, 2002 @10:40AM (#4402633)

    the Internet is going to be the primary news source for many millions of people, particularly those without access to a quality television news service. How will / can it cope?

    Huh?? I'm not sure what you're talking about but I'm pretty sure I don't recognize it. Quality television service is much more widespread than the Internet. I'm N. American, but I've lived for years in Africa and Asia. I can assure you that in "None of the above" has the web surpassed broadcast media as a source of news for any but an elite few. And the comment is irrelevant for the elite since they have access to "all of the above"-plus.

    Seriously, even in the smallest, poorest villages around the world several people will have radios and access to VOA, BBC, a national broadcast network and one or two regional stations. In addition most villages will have at least one television.

    The internet is a bit player if it's a player at all
    • I disagree. In the U.S. there are more people with Internet access than quality TV. Especially if you look at the signal to noise ratio of the content and not just at reception quality.

      Most programs are filler or infomercial. Take one hour of broadcast from CNN for example. Once you've removed all the ads, the logos, intros, thankyous, redundancies, credits, and teasers, you have about 6 minutes of content. A far cry from the days of Walter Cronkite.

      As the big syndicates spread from the U.S. to Asia and Europe, any stations with relatively high quality are drown out or crushed. Content costs. Good content costs more.

      AM, FM and shortwave are a different matter. If you can't access the web, then radio's where it's at. Most villages may have only one TV, but they'll have plenty of radios.

      • A far cry from the days of Walter Cronkite.

        You mean back when we had exactly 22 minutes of world news for the entire day?

        You mean before the days of 24 hour news channels? And 24 hour Headline News channels?

        You mean before the days of live congressional coverage via C-Span?

        And are you aware that virtually every TV network went commercial-free during 9/11 coverage?

        TV news deserves its criticism, for sure... but be fair. And don't pretend there was this golden age of news when reporters and newscasters worked for free because of an altruistic love of the truth. They've always been under pressure to make the news presentable, entertaining, to package it for consumption. If they don't we stop watching. But there are a HELL of a lot more TV news resources now than there were then.

    • Why is this rated Insightful? Zillions of peple work in offices with

      (a) good web access, and
      (b) no television.

      Most companies don't give you paid vacation to go home and watch television during Major News Events.

      Somebody has never held a real job....

  • by Katz_is_a_moron ( 197780 ) on Monday October 07, 2002 @10:41AM (#4402644)
    Yes.

    I contacted them all and they said they're ready.
  • On Sept 11th (and you all know what happened there, save the ribbons for a different soapbox), I used the internet as my primary source for what was happening. Somebody here had a radio, and the news channels were spouting lie after lie, rumours on air, digging up unchecked sources, because that's what the mainstream media does.

    I, instead, got my news from "switchboard" type sites (/., drudge and a few forum sites), keeping an eye on who was up, mirroring important pages, and basically exchanging as much info as possible. It lagged a bit...I was 10 minutes out of the loop when the tower fell, for example...but I also wasn't supplied rumours like "there are nukes in the air" or "A fifth plane is on its way to chicago."

    By the way, BBC had amazing realtime coverage plus rm video that stayed online pretty well. NYTimes was slow as hell. CNN got swamped, as did MSNBC.
  • by m00nun1t ( 588082 ) on Monday October 07, 2002 @10:44AM (#4402675) Homepage
    ...CNN.com announces a new hosting deal with hotnakedteens.com to handle peak traffic periods.

    A spokesman for CNN.com said "after talking to several vendors including Sun, IBM and Microsoft, hotnakedteens.com won the business by showing they routinely handle traffic 10 times the traffic we received around Sept 11."

  • It's already been kinda mentioned, but doesn't the web just provide the initial notification that something big is happening, then we all switch to "standard" media news to find out more?

    CNN and others provide email alerts for breaking news (which notified me of 911), the web then provides initial reports, then we switch the TV on and get realtime news as the web grinds to a halt.

    Though if the next major event happens on the same day as a game demo or a new Matrix trailer are released, we're truly stuffed...

  • First off, most Web sources of news are basically viewed by their corporate owners as just another channel for content distribution. Your local newspaper posts stories that are slightly-differently-edited versions of ones they'll print (or ones they've printed) in each day's paper, with a few "breaking news" slots where they plug in AP stories during the day usually. They may have a "content management" system in place to send variations on the same thing to your handheld, to pdfs, and so on.

    So we have questions about bandwidth, okay -- but we also have questions about how and whether television and newspaper editorial process might break down in trying to get "instant" stories up on a Web site. A process set up to approve stories for tomorrow's paper doesn't necessarily apply to stories that need to go up now. (My two local dailies have really felt their way with that, too.)

    particularly those without access to a quality television news service.

    Okay, I'll bite... What quality television news service? Gotta get me some of that action. You must not be viewing the local sludge we get here, with the jocular anchors' repartee and all...

    I've seen one U.S. "news" program -- Dateline, maybe? -- ask a scant few questions about the preparedness of New York's emergency Fire and Police responses, mentioning specifically the failure to improve the same communications gear that had failed in the earlier WTC attacks. The show mentioning those problems in passing, almost rhetorically -- "Some people wonder..." was the tone. (Apparently the TV network didn't wonder itself. Only some vague "critics" -- that's the tone I mean.) The New York Times published an article about those same problems, around a full year later if I remember right -- and the article's theme was "Why isn't anyone asking these questions?"

    If we had quality "news" on TV, the shows would be investigating controversial events, not just... what, commemorating momentous ones? Journalism is about intelligent enquiry. If you had to choose between "intelligent enquiry" and "advocacy" in describing the Fox "News" Network, which would you choose? That network is about reinforcing people's political leanings, not reporting the news. No thanks.


    • CNN HEADLINE NEWS, baby.

      From the AP:

      CNN Looks to Get Hip, Think Young

      Wed Oct 2, 5:02 PM ET

      NEW YORK (AP) - Is CNN Headline News down with it?

      The cable network is trying, judging from an effort emanating from its executive suite to think young.

      CNN Headline News general manager Rolando Santos told the San Francisco Chronicle this week that he's looking to mix 'the lingo of our people' -- words like 'whack' and 'ill' -- into newscasts to attract young people.

      And the New York Daily News on Wednesday quoted from an e-mail sent by a network manager to his headline writers, sending them a copy of a slang dictionary so they can be 'as cutting edge' as possible.

      'Please use this guide to help all you homeys and honeys add a new flava to your tickers and dekkos,' the message said, referring to graphics on the Headline News screen.

      The list of phrases included 'fly,' meaning sexually attractive.

      Santos said Thursday that the e-mail was designed to point out resources that might help headline writers.

      'The e-mail was informational, not a policy or directive from me,' Santos said. 'With that said, I should point out that I want the language used in our tickers and dekkos to be real, current and relevant to the people who watch us.'

      CNN underwent a makeover a year ago to add busy graphics to make its screen look like a computer screen. Its ratings have been improving among young viewers.

      --------------------

      Eh, maybe that wasn't such a great example. "Yo, that suicide bombing is wack!"
  • by gobbo ( 567674 ) on Monday October 07, 2002 @11:10AM (#4402869) Journal

    But should a major world event take place in the coming months/years, the Internet is going to be the primary news source for many millions of people, particularly those without access to a quality television news service.

    Please be advised that your set needs adjusting... It's pretty clear from the evidence (and from a phenomenological point of view if you observe your own reactions) that the experience of watching a major event on television as it unfolds barely qualifies as useful information, due in part to the nature of the medium, but largely due to the nature of media filters and techniques. When you see something like 9/11 going on, it's much closer to entertainment, unfortunately, than providing one with reconnaisance leading to rational behaviour. The drama of the moment helps you develop powerful emotions in relation to the event, but what kind of info do you really get?

    When it comes to war, TV obscures. For instance, see this study on media and the gulf war. [umass.edu] [Remember that? Oh wait, it's still happening.] A salient quote:

    What our study revealed, in fact, is that TV news seems to confuse more than it clarifies. Even after controlling for all other variables, we discovered that the correlation between TV watching and knowledge was actually quite often a negative one.

    In other words, you'd actually be better off combing through usenet than sucking on the immediacy of the glass teat.

    Qualifier: I've worked in media-democracy-oriented film/video for years, I'm involved and devoted to the medium!

  • Failure of multicast (Score:3, Interesting)

    by afidel ( 530433 ) on Monday October 07, 2002 @11:13AM (#4402886)
    If multicast were ubiquitous then things could have been much better. If people could received the html only web page and turn to the mbone or some other multicast network for the streaming video then the net could probably shrugged almost any event off. Since porn is one of the few things that makes money on the net I am suprised that multicast for streaming smut hasn't become more prevelant.
  • CNN.com (Score:2, Informative)

    by Whizard ( 25579 )
    William LeFebvre (of CNN.com) has an excellent talk that he's given at least twice at Usenix events (I saw it at Usenix '02, he also gave it at LISA '01), that gives a lot of detail as to the things that had to be coped with to keep CNN.com running on September 11. I can't find the full-text of the speech anywhere online, but there's some information at this site [tcsa.org] that at least gives you an idea. Interesting stuff!
  • A local SAGE chapter had the senior sysadmin for CNN come in to give a presentation on managing a large webserver farm. I remember the admin said their weekly staff meetings frequently discussed the answer to the question "What if the president declares war this week?" and the servers' readiness for the load, projected from the traffic they received during Desert Storm. In general, I seem to recall their main strategy revolved around scalable or easily-expanded network connections to the data center, and a large pool of servers used as a testbed and development set that could be switched over to production use (I believe they were using a round-robin DNS strategy similar to Netscape's ftp server system in Netscape's early days.
    I atttended this presentation, so while the description above is first-hand, my memory of the details may well have dimmed with time.
  • So tell me again what possible motivation the news industry has for upgrading their online capabilities?

    Are any of them even making a penny on their websites? So why pour more money into upgrades? What's the reward? So they can pay more for bandwidth and lose more money?

    I was at work, away from a television on September 11th I heard vague news of a plane crash on the radio. I logged in for details:

    msnbc.com - down

    cnn.com - down

    cbsnews.com - down

    abcnews.com - down

    drudgereport.com - down

    I turned the radio back on. Yep. Still works.

    Why? Because radio can charge enough for ad space to pay for a working transmitter and a studio and a full-time staff. Cable news makes enough money to support their operation as well.

    But online news, for the most part, loses money, and thus can exist only as an offshoot from an offline operation like a TV news broadcast or a newspaper. Therefore it winds up acting only as 1) a supplement and a promotional tool for the broadcast or publication 2) a reader feedback time-waster.

    It's always this way; follow the money and you get your answer. And right now the answer is none of the online operations have the desire or motivation to be "the" online news source when the next 9/11 breaks. Let the site go down. Who cares?
  • by ellbee ( 93668 ) on Monday October 07, 2002 @11:44AM (#4403158)
    I ran a major streaming media distribution net on 9/11. We saw a steady 75k - 100k simultaneous users (mostly audio) for the next several days as people used webcasts to get live news while at work. We had a few glitches as video streams were inserted by customers without warning us of the oncoming load, but they were mostly transient as we adjusted for capacity. At the edge we were seeing between two and four terabits/second being sent out, and could have turned up more if we needed it.


    I've since built some even larger systems; I've no doubt that it's possible to scale Internet streaming media distribution to millions or even tens of millions of simultaneous viewers using today's technology and protocols.


    ellbee

  • If I had to design a site that had to stay up during a world event, I'd try to talk to the people that were able to keep there site up(mostly) during the last world event. At least that would give me some ideas to work with.

    Ha, I did the whole post about world events and didn't mention 9/11 once!. . . D'oh
  • by Infonaut ( 96956 ) <infonaut@gmail.com> on Monday October 07, 2002 @12:30PM (#4403565) Homepage Journal
    ...particularly those without access to a quality television news service.

    Damn, all of us in the US are screwed!

To the systems programmer, users and applications serve only to provide a test load.

Working...