The road so far….

June 4, 2010

Testing Hadoop MapReduce Using Fitnesse

Filed under: java — Tags: , — Rahul Sharma @ 9:38 pm

Testing is an important aspect of TDD and we do it by deriving tests for every possible element. Testing components along with the framework, where they are deployed possess its own set of challenges and most of them are from the framework side like the environment in which the framework operates , how much control does it offer etc.

Unit testing Map-Reduce classes was easy part as they can be tested using Mock-Objects but testing using Fitnesse, where we would like to run the whole system on a bunch of Inputs and then retrieving outputs, was a whole different ball game. We had the following challenges in mind while trying to integrate Hadoop and Map-Reudce: (more…)