Please create an account to participate in the Slashdot moderation system

 



Forgot your password?
typodupeerror
×
AMD Hardware

Best Motherboard for a Large Memory System? 457

kimanaw writes "Due to a particular infrastructure need, and increasing OS support for 64 bitness, I'm looking into building a large memory server box (at least 16 gigs, possibly up to 64 gigs, probably config'ed into a big ramdisk). I only need a single CPU, and just minimal disk; most prebuilt systems w/ large memory seem to focus on more CPus and big RAID, all of which (over)inflate the pricetag. I've searched several websites (including Tom's Hardware), and I've googled, but can't seem to locate any commercially available AMD MBs supporting more than 4 sticks of RAM, or 4 gigs. Have any Slashdotters built a big-RAM server? Any pointers, hints, and tips much appreciated."
This discussion has been archived. No new comments can be posted.

Best Motherboard for a Large Memory System?

Comments Filter:
  • by Rick Zeman ( 15628 ) on Sunday April 17, 2005 @02:42PM (#12263155)
    ...but there are 2 GB chips now.
    • by Anonymous Coward on Sunday April 17, 2005 @03:17PM (#12263427)
      The only way to get anywhere close to 64GB is by going multi processor. I have 2 Thunder K8S Pro (S2882) motherboard with 16GB of RAM each, running Postgres 8 on FreeBSD 5.3 in production. These systems are dual opterons. They have 2GB sticks. I also have a test system with a Tyan Thunder K8QS Pro (S4882), this one is a quad opteron and supports upto 32GB with 2GB sticks. The only way I know to get 64GB with 2GB sticks is with an IWILL H8501, that's an 8-way opteron barebone system.

      I think you can get 4GB stiks now, but they are very expensive still.
      • by jarich ( 733129 ) on Sunday April 17, 2005 @03:52PM (#12263621) Homepage Journal
        Opteron boards can support 8 gigs per CPU. The singles support 8, duals support 16, quads 32.

        This is the only way to get an affordable high ram board.

        Sounds like for the poster's needs, he'd want to buy a dual and fill it with 2 gig memory sticks. After he's tinkered with 16 gigs of memory for a bit, he can decide if he needs more. The 2 gig dimms can be pulled over to his quad (or 8 way board) if he needs it.

        • "Opteron boards can support 8 gigs per CPU. The singles support 8, duals support 16, quads 32."

          Not true. At my office, we routinely configure HP DL585 servers (4way Opteron) with 64GB of memory.

          You need 2GB DIMMs to get 64GB, plus the right motherboard (most only have 4 DIMMs per CPU). But you definately can put 16GB on a single Opteron.
      • by magarity ( 164372 ) on Sunday April 17, 2005 @05:25PM (#12264119)
        The only way to get anywhere close to 64GB is by going multi processor.

        You need to append to the end of the above: "motherboard but only buy one CPU".

        Let's face it, one CPU with memory in the range required is a teeny tiny niche market. Nearly everyone else wanting that much RAM is going to want more processors as well. There are plenty of decent 2-CPU motherboards that can handle 32GB; it's not like you need to buy a Superdome or somesuch, so the original poster's complaint about multiple CPUs adding a lot to the price isn't very legitimate, IMO. For example, here's a URL for some dual CPU boards that take up to 32GB and start at a lousy $243 on pricewatch:
        http://www.supermicro.com/products/motherboard/X eon800/
        • As others here have said already, Opteron is a NUMA design - each CPU has its own bank of memory, and other CPUs have to ask that CPU to retrieve data on their behalf.

          This means that on a dual mobo, half the RAM slots are wired directly to the second CPU socket, and with no second CPU installed, that half of the RAM is simply inaccessable to the first CPU. You need that extra CPU - or a single-CPU mobo with a lot of RAM slots.

      • Far out man, your post is just a blast from the past!

        If you replace every GB with MB, it'd be soooo 1992 again. Well, except for the opteron references.... but you know what I mean, dammit.
  • I have. (Score:2, Funny)

    by Colin Smith ( 2679 )
    Or at least, I took it out the box and plugged it in. With the help of the vendor engineers. Cost quarter of a million quid.

    HTH.

  • Demand? (Score:2, Offtopic)

    by tomstdenis ( 446163 )
    Maybe you don't see many home-user 64G boxes because there is little demand for it.

    As for "expensive addons/etc". You can buy cheaper motherboards and just add on IDE if that suits your fancy. Promise [iirc] controllers give decent performance and aren't that expensive [~$60 CAD]

    Tom
  • by DmitryProletariat ( 876610 ) on Sunday April 17, 2005 @02:45PM (#12263169)
    With AMD I've only seen 8 stick support on 4-way SMP motherboards. And yes, they're expensive as hell. But you do get up to 32GB RAM support, and it's all shared. Which is perfect for absurdly large matrix calculations, but less than helpful for your situation.

    • by DmitryProletariat ( 876610 ) on Sunday April 17, 2005 @02:55PM (#12263258)
      You do not need a great deal of RAM capitalist pig! The entire population of China will easily be enough human labor to meet these needs. And so through this socialist distribution humanity becomes valued more than simple machinery. Because people count more than computers! Does your computer love a wife at night? Does it eat morning gruel? NO! It is a thing. And as long as you value CPU more than people, the cycle of money more than the cycle of life, you will forever be a money grubbing MCM overlord of labor stealing, evil capitalist, ideologues!!! When the revolution comes we will cover you in plaster, make statues of you, and pour hot grits down your calcified pants!!! REVOLT!!!

      *sigh* I think I'm getting tired of this....

      *bang!*

    • by Anonymous Coward
      There is the Tyan Thunder K8WE [tyan.com], a 2-way Opteron motherboard with 8 memory slots for around $500-600 USD. There are probably others like this.
  • by carterhawk001 ( 681941 ) on Sunday April 17, 2005 @02:45PM (#12263171) Journal
    http://ask.slashdot.org/article.pl?sid=05/02/22/09 30238&tid=198&tid=126&tid=4&tid=137
  • overkill, but... (Score:4, Informative)

    by Bad Boy Marty ( 15944 ) on Sunday April 17, 2005 @02:47PM (#12263184) Homepage
    I really like the specs on the Tyan S4882. Quad Opteron, 32GB RAM, and lots of stuff you probably don't want/need. It's a sweet motherboard, nonetheless.
    • I really like the specs on the Tyan S4882. Quad Opteron, 32GB RAM, and lots of stuff you probably don't want/need. It's a sweet motherboard, nonetheless.

      I doubt it's really overkill. To reach the 32 GB, you must use 4 Opteron CPUs because you can't get a board/CPU combination which supports more than 8 GB per CPU.
  • by Anonymous Coward on Sunday April 17, 2005 @02:47PM (#12263190)
    IBM xSeries 445 [ibm.com]. We have around 50 of these IBM servers at work and they support up to 64 GB of RAM. Any reason why you are trying to build a server out of cheap commodity parts? Save yourself the trouble and buy one of these.
    • by Ryan Amos ( 16972 ) on Sunday April 17, 2005 @03:34PM (#12263516)
      Very, very good advice. PC parts (especially very high end stuff like this guy is looking for) are usually at a premium on the consumer market anyway. With an IBM server you get support and a guarantee that everything you buy will work properly under Linux. With bleeding edge high-end stuff, this is not always the case, at least not immediately. Try pricing out an equivalent machine from commodity parts; and remember that for a server you're going to want ECC registered memory. Also remember that, if this is for a business, they are essentially paying you by the hour to build a PC. It's probably cheaper to pay an assembly worker to build a computer than a system admin (and if it's not, you should ask for a raise ;) Like the saying goes, it's only free if your time is worthless.

      This goes for home-built systems as well. Often it's just cheaper to buy a system built in taiwan than to build your own out of the exact same parts. I'm all for geeking it out and building something to your own specs, but for gaming machines or just basic desktop apps a pre-built system saves a lot of headaches.
      • > - but for gaming machines or just basic desktop apps a pre-built system saves a lot of headaches. I've got to WHOLEHEARTEDLY disagree here. If I were to buy a pre-assembled gaming rig, it would cost about 100% more than if I were to build it myself - even if it had the exact same components in it. Don't believe me? Just go look at alienware or something equivilant. Now for a desktop only machine for granny, an emachine is fine and dandy, but you'd never catch me buying a pre-built computer.
      • Another thing to keep in mind is that for high-end motherboards, you can't just pricewatch random power supply and RAM. You need to be very careful to select components that are fully compatibile, and this stuff comes at a premimum.

        If the poster is serious about building this box, I would recommend he ask over at Ars Technica or some other board where people have detailed knowledge of these highend motherboards.

        My datapoint is that a couple years ago I looked into building a dual Xeon, and ended up findin
  • 2GB DIMMs and Tyan (Score:4, Interesting)

    by Jeffrey Baker ( 6191 ) on Sunday April 17, 2005 @02:47PM (#12263193)
    You might want to get 2GB DIMMs. I have never seen any that worked reliably, but I also haven't looked at them in about a year. Get some and burn them in with memtest and see what happens. As for 8-DIMM motherboards, check out something from Tyan. Since you say you don't need that much CPU power, you could load up a Tyan Thunder board with two Opteron 240 CPUs for rather little money (or, a very small amount compared to what the 16GB of memory is going to cost you). If you seriously need 64GB of memory, the only PC system I've seen with that much are the HP ProLiant DL585, DL740, and DL760 machines. These are very expensive, especially once loaded with 64GB of memory.
  • Products (Score:4, Informative)

    by Virtual Karma ( 862416 ) on Sunday April 17, 2005 @02:47PM (#12263196) Homepage
    Here is a link for a list a motherboards (supporting various amounts of RAM). You can read product reviews, compare prices and store ratings

    CLICK HERE [lycos.com]

  • At least will get you up to 8 slots. I'm not sure if 2GB DIMMs are shipping yet, however, so you still may be limited to 8GB.

    Also, what are you going to do with all of that RAM? You'll likely end up with far more data than you have the resources to process.
    • 2gb dimms are shipping, I just purchased some for my G5 Xserve. Yeah, I thought the same thing, the G5 PowerMacs hold 8gb (prob. more now since the 2gb are shipping) with 8 slots. We're using the hell out of those on my graphic designers' boxes.
    • by JackAxe ( 689361 ) on Sunday April 17, 2005 @06:32PM (#12264582)
      The 2G sticks have been out for about a year now. 4G sticks are what's new.

      Apple doesn't list higher then 8G, because that is what they tested. 4G sticks will most likely also work. There is really no reason why they wouldn't.

      "All that RAM." "far More data than you have resources to process." *LOL* It's safe to say that you don't work with video, nor as an artist. Are you working on a 386SX. :D *Kidding* I could be wrong though. :)

      I have over a Terabyte of HD and my system handles it just fine. My 7 to 8 minute video jobs export single video files that average about 12Gigs. If I had 16GB of RAM and AEPro supported it, even with that Much RAM I would still need to "purge it all" every so often. I also generally run most of my pro apps at the same time since I need to jump between them. When they support 64-bit memory, my 5 G of RAM will not be enough. I'm upgrading to Tiger since it allows 64-bit memory support for apps now and CS2 will take advantage of that, at least on the Mac. I'll be allocating 4 gigs of RAM into it, since some of the poster illustrations I work on have exceeded over 3.5G in RAM (And since PS could only see 2G, it had to rely on scratch disk(s) to make up the difference.). That would only leave 1G for everything else, so needless to say I'll also be upgrading my RAM when I buy Tiger to more then 8G.

      What I work with is peanuts compared to what a friend of mine does. He works with satellite imagery and a small plot of land can easily exceed over a Terabyte for one image.

      Anyways, 16G of RAM is nothing with current comps and I bet that in about 4 years you'll probably have at least 6Gs in your system. Go back just a few years and 1G of RAM was considered more then most peeps would ever need or use.
  • Huh? (Score:2, Insightful)

    by zsadecki ( 530782 )
    4 DIMMs = 4GB ?!

    You know there are 4GB DIMMs around nowadays. So, 4 slots = 16GB. And 2G DIMMs are all over the place and relatively cheap, so you could get 8G with 4 slots at a minimum!

    I've seen a 4P Opteron system with 16 DIMMs running with 64GB of memory. So it can be done! But that much memory is EXPENSIVE (4G DIMMs are just now getting under $1/MB)!

  • Look at Xi (Score:5, Informative)

    by PseudononymousCoward ( 592417 ) on Sunday April 17, 2005 @02:49PM (#12263208)
    I know you're looking for an MB, not a system, but if you go to http://www.xicomputer.com/ [xicomputer.com] and check out their NetRaider 64 LT. You can custom configure it to have up to 12GB of ram w/ a single Opteron 244.

    Have fun!
  • tyan (Score:4, Informative)

    by DarkSarin ( 651985 ) on Sunday April 17, 2005 @02:49PM (#12263210) Homepage Journal
    has several boards, but none of them are single proc systems. If you need a stock Mobo, and want that much memory, you may need to go for a tyan board. I don't know if you can purchase the quad cpu board, use one cpu and all sixteen slots or not, but I think it will work. Obviously if you are going to shell out for that much memory, buying that mobo shouldn't be a big deal, even if you don't use all four cpu slots.

    FWIW, that's the only thing I know of.
    • by alienmole ( 15522 ) on Sunday April 17, 2005 @03:23PM (#12263469)
      The ASUS K8N-DL [asus.com] is a dual Opteron motherboard which officially supports up to 24GB RAM in 6 DIMMs. It costs only about $300, too. Not sure of current availability, it's pretty new.
    • Re:tyan (Score:4, Informative)

      by turm ( 125406 ) on Sunday April 17, 2005 @03:33PM (#12263510) Homepage
      I don't know if you can purchase the quad cpu board, use one cpu and all sixteen slots or not, but I think it will work.

      No, it won't. The memory controller is in the processor. If you don't populate a processor socket, you can't use the DIMM banks attached to that socket.
    • For optimum results, this should be two DIMMs per channel, two channels per CPU, four CPUs, 16 DIMMs total.

      In this optimum (generally) case, a CPU must be fitted in the socket to which the DRAM banks are connected - the Opteron has built-in DRAM controllers, no CPU = no controller = dead slots.

      Also, probably only one or two of the CPUs are connected to the chipset so these slot(s) have to be used first to provide an IO bridge for the others - signals do not mysteriously jump across sockets when the CPUs u
  • Sun (Score:5, Informative)

    by cerberusss ( 660701 ) on Sunday April 17, 2005 @02:50PM (#12263223) Journal
    I didn't even Google when I read what you wanted, but went straight to Sun's page. I don't know if this is what you're looking for?

    Sun Fire V40z [sun.com]: up to 32 gb of memory

    • by fm6 ( 162816 )
      He did make it clear that cost was an issue. I don't know how much more expensive the V40z is than equivalent AMD-based boxes -- but the extra cost of SPARC-based systems is the main reason Sun is in trouble.
      • I've seen v40z, with 2 CPU and 2GB RAM, for around $6k, promotional deals. You could get one and add the 3rd and 4th CPUs and a shitload of RAM yourself, without paying Sun's prices on the parts, but beware you'll also need to find a source for the removable (and not installed by default) voltage regulator modules for each CPU, and for each CPU's bank of DIMMs. That's 8 VRMs total, and the machine only comes equipped with 4.
      • Re:Sun (Score:2, Informative)

        by Spy Hunter ( 317220 )
        The V40z is Opteron-based, his link was wrong. The real link is here [sun.com].
  • Large memory systems (Score:5, Informative)

    by mknewman ( 557587 ) * on Sunday April 17, 2005 @02:51PM (#12263233)
    Get a Sun. You can get very large memory systems. You can go up to 192 gigs of memory. Marc
    • Get a Sun. You can get very large memory systems. You can go up to 192 gigs of memory.

      192 GB is no longer very large nowadays, and Sun indeed offers systems with larger per-node memory sizes. The price tag is hefty, of course, but so is anything which goes beyond 32 GB (maybe even 64 GB).
  • by JRW129 ( 823295 ) on Sunday April 17, 2005 @02:51PM (#12263235) Homepage
    Tyan Thunder K8QS Pro Quad Socket 940 Motherboard AMD Solution Motherboard - Operton Motherboard: Outpost #: 4311135 http://shop2.outpost.com/product/4311135/ [outpost.com]

    -Chipset: AMD-8131
    -Processor Support: Quad Socket 940 for AMD Opteron 800 Series Processors
    -Memory Support: Up to 32GB Registered PC3200 DDR
    -Expansion Slot: Two 64-bit 66/33 MHz PCI-X, two 64-bit 133/100/66/33 MHz PCI-X, One 32-bit PCI Slots
    -Other Features: GigaLAN, Integrated Video, SCSI

    if you have the money to fork over, pick one of these up at your local Fry's Electronics or try fry's online at http://www.outpost.com/ [outpost.com]
  • by Xerp ( 768138 ) on Sunday April 17, 2005 @02:53PM (#12263241) Journal
    Any good to you? You can easily get up to 128Gb in a single drive, 3GB/s bandwidth, fits in a drive bay. Who cares what "RAM" the motherboard supports? Just a though, don't know if it would be any good for your environment.
    • by billstewart ( 78916 ) on Sunday April 17, 2005 @03:56PM (#12263650) Journal
      If what he's looking for is a "ramdisk", then that has a good chance of being the right direction, depending on how fast I/O his application needs (e.g. is the problem just that he needs 0-latency retrievals, or does he also need a fast bus speed?) (Cost is obviously an issue also - these devices are sometimes pricy.)

      I'm curious how a device like this would get 3GB/s bandwidth - what kind of bus is it using? It's certainly way past PCI. Perhaps PCI-X, or plugging into AGP or something?

      Another possibility, if cost is more of a problem, and bus speed is less of a problem, is to network a couple of motherboards together, with as much RAM as possible on each of them, and either GigE or Firewire.

  • This one [hp.com] or
    This one [hp.com]
    or This one [sun.com]

    ok, some of them are end of life, but hey you'll never know... ;-)

    ps:I hope you have some spare money lying around...
  • Tyan (Score:5, Insightful)

    by Neon Spiral Injector ( 21234 ) on Sunday April 17, 2005 @02:59PM (#12263287)
    The biggest board I know of is the Thunder K8QS Pro (S4882) [tyan.com]. With 16 DIMM slots it supports 32 GB of RAM. But it is a quad processor board.

    Most of the rest of Tyan's Opteron server boards [tyan.com] do support 16 GB. Again they are dual processor.

    Tyan's boards will run with a single processor installed, but only 4 DIMM slots (1 bank) will be active. All processors can see all the RAM installed, but because the memory controller is integrated into the CPU, the CPU must first be installed. Then it can pass access to the RAM to the other CPUs. Local RAM always being the fastest. (Linux with Opteron NUMA support tries to keep memory associated with the task running on a specific CPU local to that processor.)
  • by anthony_dipierro ( 543308 ) on Sunday April 17, 2005 @02:59PM (#12263290) Journal

    Is it possible for you to write software which can handle this application across several machines? 4 machines with 4 gigs of ram connected to each other via gigabit ethernet would probably cost less than 1 machine with 16 gigs.

    If cheap is what you care about, you've gotta use scalable software. If you want to just buy something out of the box which can handle 16 gigs of ram, you can expect to pay more.

  • by m50d ( 797211 )
    Have you looked at getting an external scsi ramdisk? That might be easier than trying to find a motherboard you can fit it all in
  • PowerMac G5 (Score:2, Redundant)

    by for_usenet ( 550217 )

    Actually, if you are looking for something relatively cheap, the 2.0 and 2.5 GHz PowerMac G5 models actually support 16 GB of RAM, if you can find matched 2G PC 3200 DIMMs to fill the slots. This was the info given in the developers docs for the memory controller. And compared to other boxes that can support this much memory, they aren't that expensive. Linux support is also coming along for them, though not all quite there yet.

    If you think your memory needs are going to rise above 16 GB, you'll need t

  • I think there's a misconception made by the poster that pricing is going to be cheaper for a single CPU system with no SCSI or RAID built into the motherboard, and they're trying to cut the cost down. However, the law of supply and demand asserts that if most people who want big memory systems also want lots of CPU and disc, then the price for a single CPU motherboard may actually be MORE expensive (because there's less demand).

    Personally, I'd say just suck up the extra few hundreds of dollars (from what
  • Tyan anyone! (Score:2, Interesting)

    by mwfolsom ( 234049 )
    What's the deal?

    Tyan currently lists 6 2 processor opteron boards that hold 16 GB and 1 4p board that holds 32 GB - actaully got one of those the other day. Very nice!

    Iwill has one 8p system that holds 64GB.

    See:
    http://www.tyan.com/products/html/opteron. html
  • The Opteron 242 is only $169 on newegg.com. So getting an extra low end Opteron is not much money. And these actually are still very fast CPUs.
  • You can try an IBM Regatta, I think they max out at about 512GB, their are some Power5 chip boxes that IBM makes with about 1/2 a terrabyte of RAM etc.. There are also these PCI cards that are RAM DISKS don't know the size or that they do but stuff like that does exist. Also I don't think ther are any x86-(64) motherboards beyond 192 GB of memory. If you are willing maybe some company can get you a custom solution. Over all of the shelves no.. but there are other 'types of computes' you can buy which might
  • IBM eServer 326 (Score:2, Interesting)

    by Stack_13 ( 619071 )
    If 16 GB is enough, IBM has eServer 326 [ibm.com] is just about expandable to that amount.

    Strangely, 16 GB memory is only available in a dual-CPU configuration. DIMMs 5-8 can only be used if another CPU is installed.

    But since the extra Opteron CPU costs about the same as a 2 GB memory module, that shouldn't be much of a concern. Price is in the vicinity of $15K with 2 x Opteron 248 and 16 GB RAM.

    • Re:IBM eServer 326 (Score:3, Informative)

      by Junta ( 36770 )
      Not so strangely, each set of 4 DIMM banks is hard wired to the memory controller of each processor.

      Accesses from one processor to the further away bank must go through hypertransport, but as long as the OS scheduler is NUMA-aware, jobs should tend to run on the processor which is local to the memory it has been allocated, making for some screaming memory performance relative to single memory controller solutions (most Intel SMP setups).
  • by shawnce ( 146129 ) on Sunday April 17, 2005 @03:12PM (#12263389) Homepage
    You will likely be better served if you just use a solid state disk [storagesearch.com] for this.

  • Solid State storage (Score:5, Informative)

    by soniCron88 ( 870042 ) on Sunday April 17, 2005 @03:16PM (#12263423) Homepage
    What you're interested in is solid-state storage, which you can google. The main problem with your plan is, if the power goes out, you've lost everything. Even trying to flush everything to the hard drive will take dangerously long. (Writing 15GB to harddisk is no small task!) The solid state storage machines out there are basically computers with lots of RAM, but the RAM is backed by battery, so even if it's unplugged, it stores its state, and then backs up to hard disk, automatically. Trying to get a PC to do this for you would be much trouble. Remember: UPSing a whole computer is a lot different than keeping RAM charged! :)
  • My recommendation (Score:4, Insightful)

    by Sivar ( 316343 ) <charlesnburns[@]gmail...com> on Sunday April 17, 2005 @03:17PM (#12263424)
    I've searched several websites (including Tom's Hardware), and I've googled, but can't seem to locate any commercially available AMD MBs supporting more than 4 sticks of RAM, or 4 gigs.

    First, I would recommend going with a server vendor. I honestly do not mean any offense by this, but if you are looking at places like Tom's Hardware for recommendations (a website which is frequently incompetent even at reviewing l33t g4m3r d00ds hardware, let alone server-grade hardware), you are probably not qualified to build a system which would actually need 16GB of RAM (e.g. a corporate server which must be relied upon). I do not know what the system will be used for, but if it is for a many-person organization, my recommendation stands, and if it is just for you and some friends, 16GB of RAM is almost always going to be absurd overkill.

    Now that that's out of the way, Tyan has several dual Opteron boards which support 8 DIMMs. Look at their Thunder line, and put just one Opteron in them, and 2GB DIMM modules.
  • HyperOS [hyperos2002.com] makes a IDE interfaced RAM drive named "HyperDrive III". It basically is a power-backed drive that stores the data onto ordinary DIMMs. Speedy drive, unfortunately it's up to 12 gigs now.
  • "I've searched several websites (including Tom's Hardware), and I've googled, but can't seem to locate any commercially available AMD MBs supporting more than 4 sticks of RAM, or 4 gigs."

    I'm actually building a system right now. Dual Opteron 224. The Tyan Thunder server boards are your best bet. This is the one going in my system:

    http://www.tyan.com/products/html/thunderk8we.h t ml

    It has 8 DIMM slots and supports 16GB of memory.

    You just aren't going to find any i386 archs to support more than that right
  • Consider Intel (Score:5, Informative)

    by Wesley Felter ( 138342 ) <wesley@felter.org> on Sunday April 17, 2005 @03:35PM (#12263521) Homepage
    In order to populate all the RAM slots in an Opteron system, you have to populate all the processor sockets as well. And a 4-socket system requires expensive Opteron 8xx processors.

    Instead, consider an IBM x366 or an HP DL580; either one can be configured with 32GB RAM and 1 processor for under $30K.
  • by Hoser McMoose ( 202552 ) on Sunday April 17, 2005 @03:49PM (#12263609)

    There are a few possible solutions you might want to look at for a big-RAM server. Now, if you really want 64GB and AMD Opteron processors than you really only have one choice, the HP Proliant DL585 [hp.com]. That's the only Opteron solution that I know of which supports 64GB of memory.

    If you can get by with a bit less memory then you have some other solutions. Tyan carries quite a number of boards [tyan.com] with varying capabilities. The trouble here is that the Opteron processors are limited to 8GB of memory per processor, so to get 16GB you're going to be looking at a dual-processor board (quad processor for 32GB). Since the memory controller is right on the CPU with the Opteron you will actually need a second processor in the socket to use this memory.

    For this reason, you might actually want to consider one of Intel's new 64-bit Xeon chips [intel.com]. I know that Supermicro offers some boards that can handle up to 32GB with only a single Xeon processor. Something like the X6DHE-XB [supermicro.com] seems like it might fit you're bill reasonable well. Fairly inexpensive to get you up to 16GB of memory, though going to 32GB is quite expensive. Crucial [crucial.com] has a list of compatible memory for this board, including some 4GB modules.

    Of course, if you're not limited to x86 systems then there are other solutions that would work. You could get something like an IBM Power system or Sun UltraSparc system with pretty much any amount of memory you need (or can afford).

  • by kimanaw ( 795600 ) on Sunday April 17, 2005 @04:26PM (#12263812)
    Thanks to all for the pointers, guess I need to use better google search terms...

    As to the purpose of the box, I can't say too much, except its intended as a sortof main-memory database cache solution (ala TimesTen [timesten.com] ) to serve a potentially very large user base, with a lot of cached images associated with the cached data.

    I also considered a piecemeal commodity approach, e.g., filling racks with cheap 4 gig RAM 1U's running Linux, but then I'd have to come up with s/w that can coordinate those systems (basically, a head-end to hash the requests to the right 1U). memcached looks intriguing, but I'm still concerned about interconnect latencies.

    Based on my cocktail napkin estimates, the h/w cost of a big RAM system (if it can be got) would probably be about 2x the cost of the piecemeal system, but hopefully signifcantly reduce interconnect latency, and use simpler s/w (assuming I can get Linux to config a ramdisk that big).

    Since latency is the prime concern, solidstate disks using the usual HD interconnects just didn't seem an acceptable solution, esp since the cost reduction doesn't seem that significant.

    As for failure recovery, my thoughts were just a couple fast HDs that would ping-pong taking snapshots of the ramdisk; hopefully, the ramdisk recovery would never lose more than an hour's data (the lost data wouldn't be critical, and would be recoverable from other sources...its really the delivery speed thats essential)

    But I may need to go back to my napkin and do some more queueing analysis to see if there are better commodity solutions.

  • 64G ramdisk??! (Score:3, Insightful)

    by Maljin Jolt ( 746064 ) on Sunday April 17, 2005 @07:13PM (#12264809) Journal
    By my opinion the idea of wasting a precious, fast and costly memory for just a ramdisk of that hideous size is a product of pure lunacy and clearly indicates there is something extremely wrong with your software. For the price of the memory itself, you can certainly design and built a more adequate hardware infrastructure for your task if you use some brain first. But wait, you are not a Longhorn core developer, aren't you?
  • by ocbwilg ( 259828 ) on Sunday April 17, 2005 @07:32PM (#12264903)
    There are a couple problems with what you propose. Firstly, most applications requiring 16 GB or more of memory usually require (or at least benefit from) multiple CPUs. Such applications would be databases, sophisticated modelling systems, etc.

    The next problem is the electronic signaling. Getting 4 memory slots to work together at today's speeds can be tricky. That's why in the past couple of years it has become increasingly important to use memory modules that are listed as supported by your motherboard manufacturer. Wiring together more than four slots and getting the signalling/timing down right is much more difficult. This isn't as big of an issue on SMP Opteron systems because each CPU has it's own memory interface and dedicated memory, so 8 slots on a 2-way equals 4 slots per CPU, still with easily achieveable goals.

    That leaves you with having to fit larger memory modules into your four memory slots. The largest that I have seen generally available are the 2GB modules. I wouldn't be suprised if someone were selling 4GB modules, but they will be very hard to come by and very expensive. Right now you can buy 1GB ECC modules for around $280-$300 each. The 2GB ECC modules are about $800 each. I can't imagine what 4GB modules would cost, but I know that I wouldn't want to pay for them.

    Since you were talking about using it as a RAMdisk a better option might be a solid state hard disk.
  • Xserve (Score:5, Informative)

    by Johnny Mnemonic ( 176043 ) <mdinsmore&gmail,com> on Sunday April 17, 2005 @08:07PM (#12265062) Homepage Journal

    You can configure an Apple Xserve this way, with either one or two CPUs. Not an AMD board, but it is 64bit, and you can still put Linux [yellowdoglinux.com] on it if you like.

    $14,599--One CPU, 80GB HD, CD-RW, no video support, but 16GB of RAM and an unlimited user Server OS. You can do better if you purchase through the Education or Government channels, and you can do better if you purchase the 2GB DIMMs elsewhere.

    Although I actually couldn't find 2GB DIMMs at the popular aftermarket places, but they are now available from Apple direct (just be sure to get the Xserve with at least one 2GB DIMM, to be sure it has support for 2GB DIMMs on the MLB).

He has not acquired a fortune; the fortune has acquired him. -- Bion

Working...