Data Swamp

Share this topic

Data Swamp

From the book I Am Datapedia!, published here free by the author.

Part of I Am Datapedia!

Data Swamp is a term famous as nightmare for CDO.

Table

Description automatically generatedWe all are aware of Data Lake or many other datastores where structure, semi and unstructured data is stored in an organized manner with proper Master Data, Metadata and Data Lineage. On the other hand, if datastores is missing Master Data, Metadata and Data Lineage, it becomes Data Swamp.

Data Swamp is a datastore that is not organized and from which it's very hard to extract information, which has a lot of duplications, and which has a lot of data quality issues.

In other words, retrieving and transforming data is no longer possible when it becomes a Data Swamp.

Data Swamps can happen quickly and can create a serious problem for companies relying on this storage, extraction, and transformation system for analytics.

Any organization which is in the process of becoming a Data-Driven Organization must first focus on Data Governance, Metadata Management, Master Data Management, Data Lineage. Having a data-driven organization with no clues like what and where data is residing is a nightmare and a waste of time and effort.

It doesn’t finish here; Data Swamp poses very serious threats to organizations in financial, telco and other sectors. There are Regulatory bodies that keep an eye on organizations' data and that’s where we hear about Compliance reports. Not producing or producing Compliance reports with wrong stats can pose millions of dollars of fines on the organizations. Top management personnel can be sakes and many more.

Express your reaction

Your Take on This Insight?

Share how this content resonates with you.

Comment
Useful0
Insightful0
Actionable0
Thought-provoking0
Inspiring0

0 reactionsSign in to react or comment

Comments (0)

No comments yet.

    Free account

    You can read every topic without one. A free account lets you react to this topic, comment under it and search the Knowledge Hub. Reacting and commenting need a confirmed e-mail address.