The road so far….

August 29, 2014

Horizontal Scaling using Parallel file systems

Filed under: Linux — Rahul Sharma @ 8:45 am

If you are doing good business then you need to be prepared for scaling your services. Stateless services are easy to scale, but if there are state-full ones then you need to think sometime before you start trying to scale. Now we had one service that was building state on its local disc, like a invoice generation service where your customers can generate invoices for their customers in all kind of formats eg PDF, Excel etc. While it was easy to vertically scale the service, just shutdown the EC2 instance, change the type and start-up, but there is a ceiling to it. How can we scale such a service  horizontally without rewriting our component ?   (more…)

August 22, 2014

Limiting Fork Bomb in Docker

Filed under: Linux — Tags: , — Rahul Sharma @ 12:55 pm

Docker is a great tool for experimenting and learning. If you haven’t tried it till now then do give it try !  You can play with-in it without messing your own system. We can also built limitations for the container so that the host does not have any major impact in case the container goes berserk. While it was easy to put limitations for memory and CPU utilization, last few days I spend major amount of time in figuring out ‘how to handle a fork bomb ?’ (more…)

August 4, 2014

Introducing Hadoop Development Tools

Filed under: java — Tags: , — Rahul Sharma @ 12:54 pm

Few days back Apache Hadoop Development Tools a.k.a. HDT was released.  The projects aims at bringing plugins in eclipse to simplify development on Hadoop platform. This blog aims to provide an overview of few great features of HDT.

Single Endpoint :

The project can act as a single endpoint for your HDFS, Zookeeper and MR Cluster. You can connect to your HDFS/Zookeeper instance and browse or add more data. You can submit jobs to MR cluster and see status of all the running jobs.  (more…)

July 25, 2014

Developing Eclipse plugins

Filed under: eclipse, java, maven — Rahul Sharma @ 8:49 pm

Recently I started working with team on a Eclipse plugin. The team had developed an awesome plugin that does the intended purpose. Thus I checkout the source and tried building it. The project source contained all the required libraries and it could only be build in Eclipse. In today’s world of continuous delivery, this is a major impediment as such a project can not be built on Jenkins. (more…)

March 28, 2014

Using Postgres JSON

Filed under: java — Rahul Sharma @ 3:03 pm

The applications of today are trying to persist data that has no fixed definition to it like user actions, application responses etc. Since the data is varied in nature the developers pick the Nosql paradigm to keep track of it.Often applications are spring based and spring has awesome support for Mongodb so developers start using Mongo db. Thus now there are multiple databases in the same application and there are overheads of working with the them. The admins have to keep track to two sets, the devs have to keep track to different pojos to make references etc. But do we really need to go down this road ?  I am ardent follower of  Postgres, so if we are using Postgres as the application store I will advise against going this road. (more…)

Older Posts »

The Shocking Blue Green Theme. Create a free website or blog at WordPress.com.

Follow

Get every new post delivered to your Inbox.