Slashdot Log In
Setting Up a Home Dev/Testing Environment?
Posted by
timothy
on Fri Nov 21, 2008 03:31 PM
from the just-live-at-work dept.
from the just-live-at-work dept.
An anonymous reader writes "I'm a Project Manager (hold the remarks) who recently decided that I want/need to get my dev skills more up-to-date, as more projects are looking for their PM's to be hands-on with the development. Looking around my house, I have quite the collection of older (read: real old — it's been a while) PCs — it's pretty much a PC graveyard. Nothing that would really help me set up a nice dev infrastructure for developing web/database apps. So, my question is as follows: Should I buy a number of cheaper PC's, or should I buy one monster machine and leverage (pick your favorite) virtual machine technology?"
Related Stories
Submission: Home Dev/Testing Environment by Anonymous Coward
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading... please wait.
Simple... Get an Intel based Apple... (Score:3, Informative)
Re: (Score:3, Interesting)
I have an Intel Mac with fusion. With 4 GB of ram, which is pretty cheap these days, I can run OSX, Vista, Linux, and Solaris at the same time. Put each box on a different Spaces window and you can flip around them easily.
Now fusion is not a power user friendly setup, but it is certainly usable.
Re: (Score:2, Insightful)
Windows XP, Windows Vista, Mac OS X 10.4, and Mac OS X 10.5. Linux is a little harder to get on there (EFI and all) and I'm not sure about BSD, Solaris, etc. Overall, it works well enough for me.
Triple booting a Mac isn't too bad; you can use Hybrid MBR/GUID. Quad booting and up is more difficult because you have to use MBR and get around
Not what I've done (Score:4, Interesting)
Simple... Get an Intel based Apple...
Yeah, if you want OSX you'll need one.. but which one?
If OSX is going to be your primary OS, and you want to mostly work in OSX and virtualize everything else on top of it... by all means get a powerful mac, ideally a pricey tower so you can get some extra hard drives inside it etc, which makes multi-booting a lot less of a hassle for when you don't want to access linux/windows in VM.
You can setup multiple boot or VM environments for Windows, Linux, and of course Mac OS X.
Except you can't VM OSX desktop edition, and buying an ADDITIONAL copy of OSX Server for each VM is expensive, and doesn't really help you since, as an OSX developer you want to test your software on OSX client, and probably both 10.4, and 10.5, possibly even 10.3 -- DESKTOP editions, since that's what most users use.
So, my approach has been to buy a powerful PC, and do all the linux/solaris/bsd/windows stuff on that, and then to have an Apple laptop. You can get a very serviceable PC tower for the fraction of the price of a Mac tower, and if OSX isn't going to be your 'primary' OS its much more flexible way to go.
The money you save by buying a PC tower instead of a Mac one can then be thrown at at a Mac Mini and a cheap KVM... or in my case, I have an Apple laptop.
Parent
Personally... (Score:5, Insightful)
Re: (Score:2, Informative)
Vmware server is a free download as well. Or you could purchase workstation for a reasonable cost. Stock up on RAM though!
I'm testing ESX by installing it inside workstation then putting virtual machines inside ESX.
Re: (Score:3, Interesting)
ESXi is also free. That's what I'm using for Linux, FreeBSD and OpenSolaris VM's at the moment.
Another thought. (Score:3, Informative)
Re: (Score:3, Interesting)
Even the closed source version (added USB support?) is available for free to anyone who is willing to install it themselves. From the licensing FAQ [virtualbox.org];
Personal use is when you install the product on one or more PCs yourself and you make use of it (or even your friend, sister and grandmother). It doesn't matter whether you just use it for fun or run your multi-million euro business with it. Also, if you install it on your work PC at some large company, this is still personal use.
I like those terms;-)
Virtual Machines (Score:4, Interesting)
Virtual Machines are GREAT for Dev/Testing. You can setup machines with several different configurations, operating systems, etc., for testing and development. Plus, for N-tier web/database apps, you often want to be able to test a variety of different infrastructure choices for scalability and performance testing.
Nothing really beats the way you can change things around on-the-fly with virtual machines. It really gives you the ultimate in flexibility.
Re:Virtual Machines (Score:4, Interesting)
Parent
Re: (Score:3, Interesting)
Noob question: can you simulate high network latency and other network performance problems between VMs?
Re: (Score:3, Informative)
You just need a box with at least 5 bays, an external 5 drive hot-swap canister, a 'gaming' motherboard with a decent south bridge and a bunch of SATA p
Solution (Score:5, Funny)
Virtual Machines (Score:2)
Use two different virtual machines. One for dev, one for test. Which VM to use, is an exercise for the reader. /thread
One machine with virtual machines (Score:4, Insightful)
Depends what you're doing. For example, database servers virtualize poorly, but most other applications will run just fine that way. Everything besides your database machine could probably run as Xen paravirtualized servers on one or two machines.
That has the advantage of not producing as much heat and draws less power, which is an advantage unless you own some sort of stock in your local power utility.
Re: (Score:3, Insightful)
Virtualization is not some magic fix that makes everything
Re: (Score:2)
>>For example, database servers virtualize poorly
This may or may not be true. However, for home development purposes, one isn't necessarily concerned about performance. You just want to build a DB and schema and just connect to it.
I've got the developer version of Oracle 9i (yes I know, EOL) running in VMware and I've no trouble with moderate development sized result sets.
Re: (Score:2)
Forgot to mention that the host machine is a 6 year old pentium 4 with EIDE drives.
Tools aren't your problem (Score:5, Insightful)
Get started with what you have now. Buying a new tool won't make you a better programmer, you already have a computer of some sort so you have all that you need to get started. Just get started. After a while, if you like it, and do well, and think a better computer would help you be more productive, then consider maybe buying hardware. But don't look at it as a prerequisite, you don't need to start off that way. If you want to buy something now, it should be a book.
Language? (Score:2, Insightful)
What do you call old (Score:4, Insightful)
No, really? What is old? If you've got a couple of P-III in de 600MHz++ range, or even a couple P-IVs, you're golden. This is not going to be a heavy load system. It can't be, it's for you alone. I've got a couple of servers, an AMD64 3000+/2Gig which I got from a dumpster (originally 256Meg, but I had some RAM lying around), my old desktop, a P-III 800MHz/768Meg RAM serves as my parents server and I built a Duron 800Mhz/512Meg RAM for my sisters business running Debian/postgresql/SQLLedger.
Depending on what you call old, you have tons of options. However, if you want to talk power efficiency. In that case, buy a good (but not monster, those eat power) machine and virtualize. You'll realise soon enough how much power your virtualised "server" requires. It might be as little as 256Meg RAM running Debian-stable for your "test" servers.
Of course, I don't know what you want to do...
Re: (Score:2)
I would say (Score:3)
that if you're a PM (and not something closer to a team lead) who is being asked to "get more hands-on" with the development you have bigger problems to worry about than setting up a proper dev environment. Your situation sounds very similar to the company I just got laid off from who let more than 60% of their IS consultants go (in an environment where 90% of the devs are consultants). They're now so top-heavy that it will be a wonder if there is any kind of release in the next 6 months.
Also you didn't exactly provide a lot of detail regarding what kind of development you need to do. Personally I have a single LAMP server set up for my own projects with Subversion for version control and a couple of Bash scripts for nightly backups to an offsite location.
Use Puppet to provision the VMs (Score:3, Interesting)
If you do go the VM route, consider using puppet [reductivelabs.com] to define your machine configurations. That'll make it much easier to build out more than one of each machine.
Along the same lines, if you don't want to run a bunch of machines or VMs yourself you could spin up new EC2 instances as needed, point them to your Puppet server, and have them built out - consistently and correctly - in short order. Good times.
Get at least two real machines (Score:3, Insightful)
With two machines if you're doing web/database, one can be the client and the other can be the server.
No point getting "monster" stuff if you mean "high end", since it's diminishing returns once you get above a certain point.
Machines with 2GB or even 4GB of RAM aren't that expensive nowadays.
What I suggest you get are extra drives, and preferably easily removable/swappable drives.
Then you could have huge drives (good GB per $$$) with virtual machines in them, and you could swap them out for cheaper smaller drives with "real machines" in them and test different O/Ses and configurations without having to waste time reinstalling and updating.
A 3rd machine would be nice - so you can do work or post on slashdot etc without affecting your "real machine" benchmark tests
Depends on what you want out of it (Score:2)
Depends largely on what kind of project you're looking at to use as a refresher.
If it's some small project, then probably one of the computers you have laying around is sufficient (as long as it can run whichever dev toolset you're planning on using.
As far as testing environments - if you're just practicing, you probably only need a simple environment - like the same desktop used for dev. Or another machine with a clean environment (whatever your primary testing environment) All the way up to a beefy virt
One machine (Score:4, Insightful)
With quad and octo core machines readily available, it's a no brainer. But go for the 64 bit version of your favorite OS and gobs of ram. A few hard drives in raid 5 or 10 always help. A great keyboard, mouse, and 3 monitors will complete the developers god box.
Really, CPUs are ridiculously fast, and it's all about the IO devices and memory today.
Depends (Score:2)
This is very much an engineering problem. What's better for you depends very much on what kind of development you're doing and what your "measures of goodness" are.
Multiple machines generally work well when you're doing large builds that take tons of CPU for a long time (say, repeated builds of a Linux kernel or similar). The big reason for this is that the machine you're on isn't being eaten up by the background build.
VMs are better when you just need to test in multiple environments (and thing
Variety is the spice of developing? (Score:2, Insightful)
maybe try a VPS online (Score:2)
I recently went the VM route (Score:2)
Answer: use virtual machines (Score:2)
Keep the Legacy Gear (Score:2, Insightful)
Considerations (Score:2)
If you are planning this for your house, consider the environmental impact as well.
I used to do the multiple machine thing. Between the noise, the heat (haven't turned my heater on in 3 years) and the electrical bill I decided I didn't like that approach anymore; and switched to a large machine with xVM.
Personally though, I agree with eison. Changing your hardware isn't going to make you a better programmer. I'd start with whichever machine you currently have that will be quickest for you to get started on
No extra computers needed (Score:3, Informative)
Contrary to what a lot of people are suggesting, you don't need extra computers at all (in fact, recycle all those old ones, they're only taking up space).
You don't need to worry about performance if you're just learning the basics, and so there's no reason for all kinds of over-engineered setups like separate development and testing environments and stuff. Spend too much time setting up all this junk and you won't have any time left to actually write code.
I do all my development on my laptop. I'm running Apache, MySQL, PHP, and Rails, most of which come stock with OS X, and that's all I need. Add VMware for testing sites in IE and you're done. If you're using Windows, check out WAMP [wampserver.com]; if you have a Mac, either try MAMP [mamp.info] or use the stuff that came with the system (you'll have to install MySQL separately in this case, which is what I did); if you're running another *nix variant it's all just an apt-get or yum away.
I was working with 2GB RAM which was fine for everything but VMware and just yesterday upgraded to 4GB. Two is usable though, so don't even consider this a requirement. As far as that goes, don't worry about testing in IE at all if you're really just doing stuff to learn. Worry about that if/when you decide to make something public. Skip VMware and you can do it all in 1GB easy.
Use Amazon's EC2 (Score:3, Informative)
Since you don't need boxes all the time and running using Amazon's EC2 seems to be the way to go:
http://aws.amazon.com/ec2/ [amazon.com]
Also gives you the ability to experiment at scale, while paying $0.10 / hour.
Not Enough Information? (Score:2)
Perhaps it's my lack of experience specifically in the web services arena, but you didn't really give much information about the details of the sorts of things you'll be developing and testing. Are you developing proprietary server software or something like that with a lower level language? Are you using off the shelf components in a PHP/MySQL environment or something like that? Are you developing on Windows? Linux? Unix of some sort?
Honestly, I don't think the question can be answered usefully withou
use the old PCs, but don't leave them on always (Score:2)
Don't spend money until you figure out that you can't achieve your goals without spending. You don't give many details about what sort of environment or development you want to do, but but as long as you can get the OS installed, it is probably good enough for home development.
However, don't leave those PCs on all the time. It will kick your electric bill up . . . unless you heat your house with electricity, then it will make no difference in the winter but hurt you twice as bad in the summer. Set up you
Virtualization is nice, but... (Score:2)
I use virtualization for tons of stuff, but it really pays to have at least two machines handy in case something goes sour. Get a desktop and a laptop. Call it a day.
I have buckets of current computers around, but I mainly stick to a desktop, a laptop, and a server for all of my development. I could live with only two if I weren't doing pro audio/video.
what to buy (Score:2)
I'll take you at your word that nothing you have would help you. Depending on what you're trying to accomplish, you may never even need to have multiple machines (physical or virtual) to give yourself the refresher you want. Even if you do, there's probably no good reason to invest in a "monster" machine, unless you have special needs you didn't mention. Absent those special needs, you can probably do just fine with a mid-level dual core machine and a close eye on your RAM needs. Also absent special nee
Do buy a bulky box for a virtualized server (Score:2)
Doesn't matter whether you use Xen, Vmware ESXi, VMware Server, or whatever. Virtualization is how your customers will deploy your product, a way you can reduce costs, speed product cycles, and as a PM you should learn as much about it as you can.
So buy a well-specced out box, with 2-4 CPU cores, 4G - 16G of memory, several sata drives, and install a 64-bit linux with the virtualization solution of your choice.
From that point, create VMs as you need. You can even turn your existing machines into VMs with
One physical machine... (Score:3)
I have a pretty weak machine that I use for development hosting - a crappy Intel Xeon 3050 (2MB l2 cache, 1.86GHz)and 8GB of DDR2-667 RAM. I put in 4 250GB drives, and run Xen Express 5 on top of it. I have two gigabit ethernet ports on it at the moment. I have 7 virtual machines running on it right now - 5 debian etch servers and 2 windows 2008 x86 servers. One of the 2008 servers is running Sharepoint Services, and the other is a domain controller. I messed around with Xen 4, but really decided to stick with Citrix' product with the 5.0 upgrade. I tried running VMWare Server 2.0 on the same computer (Ubuntu 8.04.1 LTS), and I have much better performance with Xen 5. Additionally, the XenCenter management tool is a lot nicer to work with - it makes connecting to iSCSI storage arrays (put a couple of large-capacity PATA drives in those old computers of yours, a $20 D-Link GigE card, and throw OpenFiler on them for a really easy, cheap SAN) stupidly easy. As I mentioned, the performance is nice - the SharePoint VM and DC both respond a lot better under Xen than it did under VMWare.
Regardless of what platform you choose, I'd suggest just get one decent computer (it doesn't even have to be particularly fancy - any dual- or quad-core around 2GHz with 8GB of RAM will do great) and put your VMs on there. Building and tearing down machines and networks is so much easier under a virtualized environment.
Really? (Score:2)
I'm a Project Manager who recently decided that I want/need to get my dev skills more up-to-date, as more projects are looking for their PM's to be hands-on with the development.
Is this actually true? Maybe it's because I tend to know about larger shops, but this doesn't seem to be the case as far as I can see. Having been both a development manager and a project manager, I'd say that having the PM also responsible for development tasks is a quick way to not have a very good outcome for either. However,
One machine, virtual environments (Score:3, Insightful)
As a guy who makes his living testing software, I can tell you that the biggest boon to testing has been virtualization. The ability to have multiple environments running is great. The ability to painlessly restore them to a known good configuration saves hours daily. Snapshots are your friend.
Get a recent machine with plenty of disk. It doesn't need to be a monster - a mid range dual core or quad core is plenty. Several disks are better than a one, as it helps I/O bandwidth. Get enough space to hold your host os, and several VMs. More memory is better, and with 4GB kits running less than $50 get as much as you can. Use VMware/Xen/KVM to build the test environments you need, then snapshot/backup/copy them before installing any software you'll be testing.
Alternatively, if you're testing Linux apps, it might make more sense to get a vps - Linode.com has good ones. Less horsepower, but easy enough to reinstall. And no capital investment.
Re: (Score:2)
More memory is better, and with 4GB kits running less than $50 get as much as you can.
I've been pricing this recently, and systems that take the $50-per-4G type (only DDR2 non-ECC unregistered) will take a maximum of 8Gb. Are there any motherboards that will take more than that of the cheap RAM?
Neither: use a mid-machine, and virtualization. (Score:2)
The problem is a bit generic, as we do not know what "development" is. For most Linux based development (Web-display, or Database, or coding), as well as most Windows based development (Same set) - with a few exceptions, you don't need a very powerful machine, and can virutalize.
I will state, that you can purchase a DEV box to emulate Five "Serviceable servers" for less than $1,000.00:
For this purpose, "A Servicable Server" is: 2x 2GHZ Xeon processor, 75GB of storage space, and 2GB of memory.
CPU: $120+ (AM2
Web/Database? Don't worry about it. (Score:2)
Buy yourself a decent workstation. No need to go overboard, anything relatively recent will work.
No need for any fancy VMs, just pick an OS you're comfortable with -- preferably something Unix-y (OS X or Ubuntu) -- Windows will work, too, but it'll be more frustrating unless you're developing .NET.
In my case, I develop mostly with Ruby -- not all Rails, but pretty much all frameworks follow the same pattern of embedding a webserver in the app. So there's no need for a separate server -- just fire up the app
Virtualization sucks (Score:3, Insightful)
Years ago (20+?) IBM did studies that statistically proved that sub second response time was critical to productivity. As more and more stuff moves to the web we seem to have forgotten that fact, but it is in my experience very very true. Now I don't care how much money you spend, a virtualized development environment will never be as responsive as a native environment on the same hardware. Fast response time = productivity. You can keep a fast pace on your train of thought. Hit enter and wait 5 seconds for a response and your mind wanders. You lose your concentration.
Virtualization makes sense for replacing legacy hardware servers and for a portion of the development process, Quality Assurance/Testing. But keep the design and code writing native. Take your fastest machine and put your DEV IDE on it. Take your next fastest machine and put your database/web server on it. Or for a better model put them on separate machines, but keep your fastest machine for the IDE. And true, some can do great dev work without an IDE (like with vi/emacs & command line) but that is something for the very experienced, you know the type that has every API call memorized. The rest of us need robustness and the fast context sensitive help of a modern IDE.
Don't need virtualization (Score:3, Insightful)
If you're developing web/database apps, you don't need virtualization. Just work with different user accounts, "dev" and "test" for instance, then have virtual hosts and point these to directories owned by those accounts.
Use SVN to check in code/database dump from the dev account, then log in as test and do a check-out and database-upload. Commence testing.
As an aside, you're a project manager so you probably have some feeling for the commercial side as well. Why not up the stakes a bit and get a small paid project as a freelancer? Get some designer to get you a PSD, get it sliced/based by a HTML guy and then proceed to code in the dynamic parts. Don't overdo it, a project in the $1000 to $2000 range is excellent for exercise.