Cloudera Manager is a web based management application for your Apache Hadoop cluster. It makes the installation and configuration for your Hadoop cluster a whole lot easier and is free for a cluster up to 50 nodes. In particular I like the suggested configuration settings based on your cluster hardware.

All the configuration settings of Cloudera Manager are persisted in the configuration database, which can be manually exported through the admin interface. One of our clients wanted to export these settings programmatically for auditing and backup purposes.

Currently there isn’t an automated way to do that, besides backing up the entire database. Here is a little shell script that allows you to download the configuration automatically in text format.

 Read more

I used to be a big fan of tools. I still am…..but not as big a fan as I used to be. This changed after I realized the meaning of ‘Individuals and interactions over processes and tools’. Especially the “interactions over tools” part. This week’s blog Eat your failure cake! Learn from your mistakes. motivated me to share one of my failure cakes with you.
 Read more

I used to be a big fan of tools. I still am…..but not as big a fan as I used to be. This changed after I realized the meaning of ‘Individuals and interactions over processes and tools’. Especially the “interactions over tools” part. This week’s blog Eat your failure cake! Learn from your mistakes. motivated me to share one of my failure cakes with you.
 Read more

Last time I blogged about the importance of benchmarking the architecture and new technology in a Proof of Concept for Performance. This time I’ll deal with the importance of representative performance testing.

Slowness of applications in development environments is often neglected with the rationale that faster hardware in the production environment will solve this problem. However, whether this is really true can only be predicted with a test on a representative environment and in a representative way. In such an environment, there needs to be more representative than just the hardware.
 Read more