Data Pipelines
From the book I Am Datapedia!, published here free by the author.
Part of I Am Datapedia!
Questions 1–10 of 10
1. In simple terms, what is a Data Pipeline?
2. In the Pull data processing mechanism, which system initiates the movement of data?
3. By what other name is Bulk Loading known?
4. What does CDC Loading process?
5. Which of the following is an example of Batch processing in a Data Pipeline?
6. Which example illustrates Real-Time (event-based) processing in a Data Pipeline?
7. What effect does better hardware have on Batch processing?
8. Which of the following is NOT one of the named Data Processing Mechanisms?
9. What is the likely future for an organisation that builds Data Pipelines without Data Lineage, a Data Catalog and Data Governance standards?
10. Why does CDC play a vital role in supporting Real-Time processing from OLTP systems?