Uncategorized

What’s the Point of Data Governance ?

If you are in information technology, you have no doubt heard the term “data governance” bantered about more and more.  The very sound of “data governance” conjures up images of layers of bureaucracy and regulatory minutiae.  If you are in the ranks of development or change control – all that can be imagined from this term is just one more layer of regulations to navigate through for a simple data related change request to be approved and released.

Maybe your industry mandates the existence of said “data governance” to satisfy some compliance requirements, or maybe the mere fact that other companies are creating their “data governance” programs has caused the powers that be at your organization to determine that yours has got to have one too.  Whatever the reason for its inception at your organization, what is the point of “data governance”? What does it really mean?

At its best, data governance provides […]

HBase Data Extraction

Our Client is a NE based data solution provider in the healthcare industry. The client manages a single node CDH5 cluster Ver 5.3.2 in Ubuntu (Trusted Tahr) . The client had two main concerns. One of them being extracting data from HBase. Each table in HBase has its own metadata file. The metadata files provide information about the tables in HBase, including which columns to include and exclude from the output. The other concern was to convert the output data to JSON format.

In order to extract data from HBase, Pig is used. Originally, different approaches were made to interact with HBase. However, after exploring different options, Pig was an apt solution for this project due to its built-in functions and UDF flexibility. Only one UDF is used in this project, which is written in Python.

If you would like to read more about the article, click the link here ——-HbaseExtractionFinal

DevOps

IT Industry has underlying assumptions that the projects will not meet the deadlines or will run over budget. Often times, the projects that are completed will not perform the way we expect.

Many a times these problems exists due to lack of communication between the various project teams.

DevOps was first introduced in 2008 Agile Conference by Andrew Clay Shafer and Patrick Debois . DevOps is a cultural change which encourages communication and collaboration between the Software Developers and the Information Technology Professionals. DevOps helps in optimizing  SDLC. Software building , testing, release are done frequently and rapidly which has been the biggest advantage.

To read more about the article, please click the link—DevOps

Vizable: Tableau’s New Mobile App

Vizable is a free mobile app which extend tableau from pc end onto mobile end. It towards to normal end users and executives which simplifies the process for digging data, helps end user to explore data by seeing, touching, then eventually understanding.
Here is the layout of Vizable interface, clean in look and user friendly. By looking at the view of Vizable we can easily find out it has two basic graphic forms, bar chart and line chart.

Apparently Vizable is designed for light weighted data, and different purposes from tableau. Tableau dashboards developing is more about business strategy using and visual variation. One the other hand, Vizable tends to give end user a general analytic idea with their own data to answer those simple analytic questions. For example, how is my work out performance? How is my truck drivers’ driving? How is my asset affected by my purchasing behavior? By inputting those […]