The Biggest MySQL Cluster, Ever? 55
ExcerLee asks: "Our team is going to build a MySQL (load-balancing and fail-over) cluster for the Cluster World Expo in the end of June. This cluster is going to have at least 10 nodes, and will use
dual-opteron systems from Polywell Computers and
SuSE Enterprise Linux for AMD64 from SuSE. While we are working on this hefty cluster, we wonder if this is the biggest MySQL cluster has ever been built. I googled with terms like 'biggest mysql cluster', but didn't find much." If you've run a MySQL cluster before, how large was it and how well did it perform? Krow: I have been told of much larger clusters then this; Slashdot DBs total 6 machines with 18 processors, and LiveJournal has one of the most complicated clusters I have ever seen set up.
Why would they think that? (Score:5, Insightful)
They didn't [Was: Re:Why would they think that?] (Score:2)
The submitter never claimed that their cluster was the biggest, but while they were building a good sized cluster, they were just curious what the biggest one ever built was.
Re:They didn't [Was: Re:Why would they think that? (Score:3, Informative)
While we are working on this hefty cluster, we wonder if this is the biggest MySQL cluster has ever been built.
They're clearly asking if theirs is the biggest ever built.
Re:Why would they think that? (Score:3, Informative)
It would definitely be the world's largest MySQL cluster. Of course, I dobut that anybody would even WANT a cluster that big. Once you get a database that size, you would probably want to custom-tailor your own solution, or not use a traditional database at all. The only databases big enough to warrant this type of power are probably those of the government (ie. the IRS); that being said, the gove
Re:Why would they think that? (Score:2)
Re:Why would they think that? (Score:2)
You're not even close. This [sgi.com] cluster has 48 nodes [sgi.com] with 128 processors apiece, but each node can take up to 512. Each node also has up to a terabyte of RAM.
Re:Why would they think that? (Score:1)
Re:Why would they think that? (Score:2)
Wow! Correct use of the Cliff Comma Subject! (Score:5, Funny)
Assuming, of course, that he was trying to sound like Fat Comic Book Guy from The Simpsons.
--
Re:Wow! Correct use of the Cliff Comma Subject! (Score:2)
Re:Wow! Correct use of the Cliff Comma Subject! (Score:1)
No one is perfect.
Against stupidity the gods themselves contend in vain.
One Question.... (Score:4, Funny)
...what are you going to put in the db?
Re:One Question.... (Score:4, Funny)
Re:One Question.... (Score:4, Funny)
You forgot the evil "Mwahahahahahaha" after it!
Cliff's commas (Score:2)
BEOWULF (Score:2, Funny)
Someone had to say that stupid shit.
Re:BEOWULF (Score:5, Interesting)
BEOWULF support has to be compiled into an application for it to be used. MySQL doesn't have BEOWULF support, and I don't see a patch for it on the web.
OpenMosix performs kernel level clustering. You apply the OpenMosix patch to Linux, compile, reboot, and Linux will now migrate processes automatically to other OpenMosix enabled computers on your network.
Beowulf is more efficient, but it would probably take a month or so to program MySQL to use it. OpenMosix takes about 30 minutes to set up and it then works with every application you run.
I thought this was interesting.
Ciaran O'Riordan
Re:BEOWULF (Score:3, Funny)
All these years...
Re:BEOWULF (Score:3, Interesting)
Well, not *every* application. Some don't migrate, depending on I/O, threading, etc. But a lot do, and it really is easy to setup.
We use it at work on a bioinformatics cluster and the best part is that it'll transparently balance user jobs without them having to do or learn anything new.
Ob topic: we happen to run MySQL on one of our cluster nodes, but it doesn't migrate
-h3
Re:BEOWULF (Score:1)
Re:BEOWULF (Score:1)
Score: (5, Interesting)
These are not the droids you are looking for.
(Pity I posted tihs 8 days late, huh?)
In Soviet Russia (Score:1)
Documentation (Score:4, Insightful)
Why powerful servers? (Score:3, Interesting)
If you show how well it can run on stock hardware (as opposed to buying more) it may impress more people.
That means 800MHz to 1GHz maybe?
Just a thought.
Sam
comic book guy sez: (Score:2)
"There is no emoticon adequate to express what I'm feeling right now."
Re:comic book guy sez: (Score:1)
livejournal? (Score:2)
Who can tell me how it all cums together?
Re:livejournal? (Score:5, Informative)
Re:livejournal? (Score:1)
Re:livejournal? (Score:2)
If a journal site was using 6 databases in 2001, forgive me if I'm not impressed by the "Cluster World Expo" using four more, two years later.
Wow! Amazing! (Score:4, Funny)
The truly amazing part is that the postgresql folks have not arrived yet.
Re:Wow! Amazing! (Score:5, Funny)
Not at all. Postgresql is a database. This story has absolutely no connection to databases.
Re:Wow! Amazing! (Score:2)
mobile.de (Score:3, Interesting)
I'll bet the biggest is Google... (Score:3, Informative)
Re:I'll bet the biggest is Google... (Score:2)
I can't find any contrete info.
Re:I'll bet the biggest is Google... (Score:2)
Well, apparently both [google.ca], according to the same page you linked.
The Oracle dev position is for corporate financials, whereas the MySQL is for Technical Web Applications, whatever that means (maybe data mining).
They also have another position [google.ca] with MySQL experience mentioned on the same page.
Re:I'll bet the biggest is Google... (Score:2)
Re:I'll bet the biggest is Google... (Score:5, Informative)
Re:I'll bet the biggest is Google... (Score:1)
How does the load balancing work? (Score:2)
Tom
Re:How does the load balancing work? (Score:1)
multimaster replication would solve that issue
Re:How does the load balancing work? (Score:1)
> cluster would be useless
Yup, that sounds reasonable.... does anyone know how the replication mentioned here works?
Tom
Wow, all those CPUs! (Score:1)
CPUs are great and all, but if you're sucking data through a soda straw (i.e., anything less than a good hardware RAID) those CPUs aren't going to have much to do...
Re:Wow, all those CPUs! (Score:2)
I think what they are doing is more of an look we got all the pieces here. Maybe what he realy wants to know is, is this the biggest ever set up as a convention demo, not the biggest production system.
Since MySQL doesn't actually support 'clustering' (Score:1, Insightful)
You can take a flatfile text database, put it on a bunch of computers,run round-robin DNS, and label it a 'large database cluster' if you want, but I don;t think that is a very useful definition of 'cluster'
You could periodically run rsync to update the slave node's files from a single master file too, but this is routinely done with things like FTP mirrors of Linux distros. Is rpmfind.net a 'clus
Re:Since MySQL doesn't actually support 'clusterin (Score:1)