Data Silos

Share this topic

Data Silos

From the book I Am Datapedia!, published here free by the author.

Part of I Am Datapedia!

Data Silos is always confused with Data Island.

Data Islands are those datastores which are not accessible from external world may be due technology barriers, but Data Silos are those which are only accessible for their relevant stakeholders.

There can be a lot of reasons why data is in silo.

  • A particular datastore might be hosting confidential data e.g., finance data, audit data etc.
  • A particular data which is not readable e.g., semi or unstructured data sets.
  • There is Security or Privacy concerns, so data is not shared among another departments.
  • The quality of data is so low that it can’t be shared with management as it may cause wrong decisions and may damage the company’s image.
  • Sometime, in development environment different database instances are created for different development teams so if one changes data or table’s structures, other development teams are not impacted.

Why should Data Silos not exist?

Diagram

Description automatically generatedIn the current era, data driven organization concept is flourishing where not only data is brought at centralized location rather data democratization and liberalization has also been made a norm.

If data is not residing at one location, then it’s not possible to correlate the same kind of data across multiple systems. Data Scientists or top management always want cross-departmental dashboards and reports.

Data Warehouse came into being to cater for this problem where data in source systems were sitting in silos e.g., almost all medium to large organizations have a CRM system, ERP system, Procurement system, HR system etc. Now, if management want to have information from all the above-mentioned systems, then first it's very time-consuming to extract data and secondly the quality of data is also very difficult to validate. In Date Warehousing, data is brought from all kinds of source systems in one place in unified data model for have single source of truth for Decision Support Systems.

Express your reaction

Your Take on This Insight?

Share how this content resonates with you.

Comment
Useful0
Insightful0
Actionable0
Thought-provoking0
Inspiring0

0 reactionsSign in to react or comment

Comments (0)

No comments yet.

    Free account

    You can read every topic without one. A free account lets you react to this topic, comment under it and search the Knowledge Hub. Reacting and commenting need a confirmed e-mail address.