Data Catalog

Share this topic

Data Catalog

From the book I Am Datapedia!, published here free by the author.

Part of I Am Datapedia!

We discussed the Data Dictionary and the Data or Business Glossary. What is Data Catalog?

‘Data Catalog comes under Metadata Management.’

Although all three Data Dictionaries, Data or Business Glossary and Data Catalog look similar, it's very important to understand the difference.

Data Dictionary stores metadata details about the solution and Data or Business Glossary is the collection of all business terms about the solution whereas Data Catalog jointly refers to Dictionary and Glossary like which business term is referring to which table or dashboard etc. In other words, Catalog gives a complete picture of both Dictionary and Glossary.

Let's take an example of a Bank Account Number (BAN).

  • Data Glossary: BAN is the unique identifier for a customer across all banking applications whether it’s HR, Finance, Marketing etc.
  • Data Dictionary: BAN is a unique identifier with field type as string, field length as 10, with two times # in it etc., metadata detail.
  • A diagram of data processing

Description automatically generatedData Catalog: It tells the whole story i.e., BAN is the unique identifier for a customer across all banking applications and it is stored in tables i.e., x, y, and z, it is in which schema and database. And which department owns which databases, tables, dashboards, and reports etc.

What the data is about, how it is stored and WHERE it is stored, gives an added advantage to analysts, designers, and developers. Having a Data Catalog means a Data Dictionary and Data Glossary is already in place which is a perfect recipe to eliminate chances of Data Swamp. As mentioned in previous topics, with the introduction of Semi and Unstructured datasets, the requirement for a Data Catalog has moved from the Good-to-Have to Must-have zone.

‘Both technical and business folks interact with Data Catalog.’

Express your reaction

Your Take on This Insight?

Share how this content resonates with you.

Comment
Useful0
Insightful0
Actionable0
Thought-provoking0
Inspiring0

0 reactionsSign in to react or comment

Comments (0)

No comments yet.

    Free account

    You can read every topic without one. A free account lets you react to this topic, comment under it and search the Knowledge Hub. Reacting and commenting need a confirmed e-mail address.