Home » Blogs » loner's blog

GridGain + Multi-Core processors

16 Nov 2008
Posted by loner

GridGain is an open source product written in Java providing a grid computing platform. It is known to be one of the more widely used grid product, certainly, as far as I see, one of the easiest to "gridify" or grid-enable an existing product.

One of the applications of the product is to couple with Amazon EC2 to make a "cloud" computing platform. See Gridgain + Amazon EC2

The widespread use of "multi-core" PCs also means that the product can be used to "parallelise" to take advantage of this increased power.

My setup involves one "broker" node and three "worker" nodes. The grid job is sent from one of the worker nodes.

I use ActiveMQ for communication between nodes, GridSharedFsCheckpointSpi for saving down intermediate data (to be picked up during the "Reduce" phase) and JobStealing SPI for automatic load-balancing and failover.

AttachmentSize
gridgain-broker.xml3.91 KB
gridgain-worker.xml3.43 KB
Tags:

What did I say then?

Energy companies turning to hedge funds | FT (10 years 9 weeks ago): Hedge funds are replacing banks as leading lenders to troubled US energy companies, providing billions of dollars in credits in return for the promise of rich returns. ......In total, more than USD10bn in refinancings has been arranged this year for companies including Allegheny Energy, Centerpoint Energy, Reliant Resources, Dynegy and Aquila.