Knowledge Hub

Before we explore what constitutes a Data Product (DP), it is important to establish the foundational context within which these products exist. Most enterprise data environments comprise two distinct but interconnected types of systems:

• OLTP (Online Transaction Processing) systems, which are responsible for generating operational data through transactional processes.
• OLAP (Online Analytical Processing) systems, which are designed to serve data for analytical and decision-support purposes.

We will not dive into the technical specifics of OLTP and OLAP here, as those are covered in dedicated sections elsewhere in this book. However, it is essential to understand this distinction because Data Products are primarily built and operated within the OLAP ecosystem.

In essence, OLTP generates data. OLAP serves it.

Data products are almost always born, shaped, and consumed in the OLAP layer, where raw data is transformed into meaningful, trustworthy outputs for business consumption.

In the modern data landscape, few topics spark more debate than the question: “What is a Data Product?”

Across conferences, boardrooms, and industry discussions, the term has taken on a life of its own. Many practitioners argue over definitions, frameworks, and taxonomies, yet the underlying truth is simpler: most of us already know what a data product is.

The real challenge isn’t defining it. It’s understanding its quality.

At its core, a data product is any output, a curated dataset, analytical model, dashboard, that delivers tangible business value, offsets the cost of inaction (COI), and can be reused by multiple stakeholders. By that definition, its importance is undeniable.

But the real question is: Is the data product Good, Bad, or Ugly?

The Juice Analogy

To make this concept tangible, think about juice as an analogy.

When someone makes juice for you at home, is it a product? No. Even if it has the same ingredients, taste, and nutrition as a bottled juice, it’s not a product because:

The transformation of data into a strategic asset has led to the evolution of modern data products into what is now recognized as Data-As-a-Product (DAaP). Unlike traditional data products that serve narrow, predefined use cases, DAaP represents curated, production-grade datasets or models designed for consumption by multiple downstream users, systems, or applications. The goal is not just to serve information but to enable further processing, analytics, and transformation, with guaranteed semantic clarity, contract enforcement, and lifecycle stability.

The DAaP Shift: Two Pathways to Maturity

A data product evolves into DAaP under two primary scenarios:

1. Organic Maturity
   • Occurs when the utility of a data product extends beyond its original intent, powering other systems, dashboards, or models.
   • Example: A sales insights dashboard originally built for a regional team becomes DAaP when its curated datasets feed into forecasting models, executive dashboards, or marketing analytics.
2. Purposeful Design
   • DAaP is built intentionally from day one to serve as a scalable, reusable, and governed data source across domains.
   • Example: A centralized operational dataset constructed with clear semantic models and data contracts to serve finance, supply chain, and HR platforms in parallel.

A Data Product Owner (DPO) is the person responsible for overseeing the development, maintenance, and evolution of a data product. This role is essential in ensuring the data product serves user needs, aligns with the business’s strategic goals, and leverages data effectively to provide value. But who should take on this role? Let’s explore what makes an effective Data Product Owner and which roles within an organization are best suited to it.

Who Can Be a Data Product Owner?

Selecting the right DPO is key to the success of a data product. While the role can technically be filled by individuals from various backgrounds, the most effective DPOs tend to have a unique blend of business, technical, and strategic skills.

Here’s a look at potential candidates:

• Business Leaders (CDO, CAO, or other Senior Business Leaders): Business leaders, such as the Chief Data Officer (CDO) or Chief Analytics Officer (CAO), are well-suited for the DPO role because they typically have a deep understanding of the organization’s strategic goals and data-driven needs. With a focus on aligning data products to support overall business objectives, these leaders ensure that the data product delivers high business value and actionable insights.
• Technical Leaders (CTO, CIO): A Chief Technology Officer (CTO) or Chief Information Officer (CIO) may also make a good DPO, especially in organizations where data products are highly technical or integrated with broader IT systems. Their expertise in the technical infrastructure allows them to understand the complexities of data architecture, security, and scalability, ensuring the DP is robust and reliable.
• Data Visionaries (Founders, CEOs, or Business Visionaries): For some companies, particularly startups or data-driven organizations, a visionary founder or CEO may step into the DPO role. These leaders often bring a strong vision for how data can shape the future of the business and can inspire teams to build innovative data products. However, for this to work effectively, the visionary leader should have a solid understanding of data and a clear vision of how it will add value.
• Cross-Functional Managers (Product Managers, Data Analysts): Product Managers with data knowledge, or senior Data Analysts who understand both the business and technical requirements, may also serve as excellent DPOs. They can connect the dots between data insights, business goals, and user needs, while ensuring a data product remains practical and user-friendly.
• Dedicated Data Product Owners: As organizations become more data-focused, some create roles specifically for Data Product Owners. This person focuses exclusively on managing data products, with a balance of business and technical skills, and may report to data, IT, or product leadership.

Data Product Ownership refers to the responsibility of managing and overseeing a data product from creation through to ongoing improvements. A data product owner (DPO) ensures the product aligns with user needs and business goals, making sure it’s useful, valuable, and reliable.

Key Responsibilities of Data Product Ownership

• Define Vision and Goals: The DPO sets a clear vision for the data product, focusing on how it will serve users and provide business value. For instance, if the product is a sales dashboard, the DPO would define what metrics and insights will help users make informed sales decisions.
• Prioritize Features and Improvements: Not all features or updates are equally important, so the DPO decides which functionalities to develop first based on their value to users and the organization. They balance short-term needs with long-term goals to create a roadmap that guides the development process.
• Understand User Needs: The DPO connects with end users to understand what they need and expect from the product. This means gathering feedback, studying user behaviour, and ensuring that the data product addresses actual problems or enhances the user experience.
• Ensure Data Quality and Compliance: Data accuracy, reliability, and security are crucial. The DPO collaborates with data engineers and analysts to ensure the data product meets high standards and complies with privacy regulations.
• Collaborate with Cross-Functional Teams: The DPO works closely with data scientists, engineers, designers, and business leaders to bring the product to life. This collaborative effort ensures that the product’s technical foundation is solid and that it serves business purposes.
• Monitor Product Performance: After launch, the DPO monitors key performance indicators (KPIs) to assess how well the product meets its goals and addresses user needs. This helps in deciding when to update features, fix issues, or adjust the product’s direction.

In today’s data-driven world, the creation, management, and delivery of data have evolved beyond pipelines and reports. At the heart of this transformation lies the concept of the data product, a curated, consumable asset designed to deliver value to internal and external consumers. But as enterprise data demands grow, so too does the need for a more governed, scalable model: Data-As-a-Product (DAaP).

To appreciate the full lifecycle, we must examine the zones, roles, and processes that underpin the ecosystem.

1. The Data Preparation Zone: Building the Foundation

The journey of every data product starts in the Data Preparation Zone, where raw, fragmented inputs are collected, validated, and modeled for reuse. This phase lays the architectural backbone needed for reliable analytics, machine learning, and productization.

Common modelling approaches in this zone include:

• 3NF Data Warehouse Modelling – Ideal for highly structured OLTP-aligned models with integrity constraints.
• Lakehouse Modelling (3NF in Data Lake) – Hybrid model allowing structured and unstructured data in open table formats with transactional consistency.
• Data Vault Modelling – Designed for agility, historization, and traceability in complex data landscapes.
• Ensemble Techniques (Focal Point, Anchor, etc.) – Used to unify fragmented entities across domains.
• Feature Store Design – Curated, versioned features for ML model consumption, supporting reuse across pipelines.

A Unified Approach to Data Ecosystem Management

The concept of Data Platform Gravity revolves around a holistic framework where every aspect of data handling, from ingestion to transformation, analytics, and deployment, is achieved within a single, unified platform. Inspired by the Data Fabric paradigm, it advocates for seamless operations across the entire data lifecycle, reducing complexities, minimizing data silos, and empowering organizations to derive value efficiently and effectively.

Understanding Data Platform Gravity

In a traditional data management ecosystem, disparate tools and technologies often create bottlenecks. A single project might involve different platforms for:

• Extracting and loading data from sources,
• Transforming and enriching data,
• Performing analytics and data science experiments,
• Visualizing results in dashboards or reports, and
• Sharing data insights with external systems or stakeholders.

The worlds of structured data and textual data are as far apart as the ocean is from the desert. These worlds are extremely different. But there is great value in being able to bring them together.

To that end there is textual ETL. Textual ETL reads text and disambiguates the text. As data is placed into a structured format from a textual format, the word that has been found and the context of the word that has been found are captured. That is the mechanics of how textual ETL operates.

How does textual ETL know what words to pluck out from text? Textual ETL knows by fiat of one or more taxonomies. The taxonomies alert textual ETL as to what words are important and need to be placed into a database for the purpose of analysis. In addition, the taxonomies provide the context for the word that has been selected.

Another feature of textual is inline contextualization. While many words can be contextualized by the usage of taxonomies, not all words can be treated this way. In addition to taxonomies, inline contextualization allows the word and its context to be selected by means of the positioning of the word in raw text and the proximity of the word or phrase to other words and phrases.

A Graph is a way to show connections between things. It is made up of dots, called vertices (or nodes), and lines, called edges (or links), that connect the dots. Graphs help us understand relationships between objects and are used in many areas like computers, biology, and social studies.

Important Terms in Graphs

• Vertices and Edges
  • Vertices (Nodes): These are the basic points in a graph. ‘One node is called Vertex whereas Multiple nodes are called Vertices.’
  • Edges (Links): These are the lines connecting the points.
• Types of Graphs
  • Undirected Graph: The edges don’t have a direction, meaning the connection works both ways.
  • Directed Graph (Digraph): The edges have a direction, shown by arrows.
  • Weighted Graph: The edges have values or weights, like distance or cost.
  • Simple Graph: There are no loops (lines starting and ending at the same point) or duplicate edges.
  • Complete Graph: Every point is connected to every other point.
  • Bipartite Graph: The points are split into two groups, and lines only connect points from different groups.

Graph theory is a mathematical framework that is widely applied to solve real-world problems involving interconnected data. It’s used in various fields such as:

• Computer Science: For tasks like network analysis, designing routing algorithms, indexing databases, and building AI models.
• Social Networks: To analyse relationships and influence across social media platforms.
• Biology: For mapping genetic networks and studying protein interactions.
• Transportation: To improve route planning and manage traffic flow efficiently.
• Project Management: To visualize tasks, dependencies, and project schedules.
• Graph theory offers powerful tools for representing, analysing, and solving problems that involve properties, structures and relationships between data elements. It focuses on studying graphs, which consist of vertices (or nodes) connected by edges (or links).
• Vertices (Nodes): These are the basic points in a graph. ‘One node is called Vertex whereas Multiple nodes are called Vertices.’
• Edges (Links): These are the lines connecting the points.