Clustering On A Budget

This is a discussion on Clustering On A Budget within the Tech Board forums, part of the Community Boards category; Hello, I'd like to start a little computation project I've been milling over for a while. Initially I had tried ...

  1. #1
    Registered /usr
    Join Date
    Aug 2001
    Location
    Newport, South Wales, UK
    Posts
    1,262

    Clustering On A Budget

    Hello,

    I'd like to start a little computation project I've been milling over for a while. Initially I had tried running it on my computer (after increasing the Windows swap file size to 4GB), but this proved a bit silly as it was constantly swapping pages to go through the massive table I had generated. After nearly two full weeks of listening to constant grinding I called it off.

    So, I decided that what I would do is modify the design of the program to work on a parallel processing basis, in that my computer would dole out chunks of work to a cluster of machines that would do as asked, return the results and check out another chunk.

    The thing is, how can I put together a cluster on a budget? I want about eight machines and they don't need hard drives or sound cards or anything like that, just 128MB or so and a network adapter. Can I get a rack or something like this?

    I've thought about just getting several old PCs off eBay or wherever but those would all be big things that could possibly go bang at an innappropriate time. Laptops were also an idea but even the older ones are relatively expensive.

  2. #2
    (?<!re)tired Mario F.'s Avatar
    Join Date
    May 2006
    Location
    Portugal
    Posts
    7,436
    Is distributed computing out of the equation? You could probably use CORBA (or DCE... although CORBA is probably a better choice) as a middleware. It integrates well into whatever C++ project you may have.
    The programmer’s wife tells him: “Run to the store and pick up a loaf of bread. If they have eggs, get a dozen.”
    The programmer comes home with 12 loaves of bread.


    Originally Posted by brewbuck:
    Reimplementing a large system in another language to get a 25% performance boost is nonsense. It would be cheaper to just get a computer which is 25% faster.

  3. #3
    Registered User Frobozz's Avatar
    Join Date
    Dec 2002
    Posts
    546
    About a year or two ago I was digging around on the internet for cheap systems myself. The goal was a system around $50 for a guy who needed a basic internet system. I came across a site called Directron. In particular, their PC clearance department.

    Shipping isn't too bad. I've typically paid around $20 to $25. Note that their system stats aren't quite exact. Last system I bought was supposed to have 256MB of memory but only had 128MB. Plus it was supposed to have Windows 98 but instead came with Windows 2000. Other than that it was alright.
    Last edited by Frobozz; 09-01-2006 at 06:14 AM.

  4. #4
    Registered /usr
    Join Date
    Aug 2001
    Location
    Newport, South Wales, UK
    Posts
    1,262
    Good prices, Frobozz, but the shipping rises to about $100+ to the UK, kinda puts a downer on it all.

    I also want to avoid a forest of big beige boxes if I can. Like I said, I don't need any sort of expandability, just a little box (with a little power supply, external even) that has a CPU, memory and a NIC in it. Perhaps there are systems that don't have proper video cards or monitor output, which is also fine, I can control those remotely.

    A rack of servers sounds like the best option, but I was wondering if anyone had any experience in that area regarding buying.

  5. #5
    Registered User
    Join Date
    Aug 2006
    Posts
    163
    http://www.devbuilder.org/article/24
    Very good write-up on the subject

Popular pages Recent additions subscribe to a feed

Similar Threads

  1. any smarter ways to design this tree structure
    By George2 in forum C++ Programming
    Replies: 5
    Last Post: 04-19-2008, 07:34 AM
  2. this project - functions and arrays - getting few errors
    By arps789 in forum C++ Programming
    Replies: 10
    Last Post: 12-10-2007, 07:29 PM
  3. TCP\IP Programming for clustering
    By nasir_qau in forum Linux Programming
    Replies: 0
    Last Post: 10-25-2001, 02:54 AM

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21