DataOps(Data Operations)

DataOps follows the same principles just like DevOps/ DevSecOps but here it has few more elements related to Data domain.

DataOps focuses on data related aspects of operations. It makes sure data is properly integrated with source and target, its flowing-in using automated and best practices data pipelines, its highly secured, it’s of high quality etc.

DevOps doesn’t care whether its data project or mobile application project or any other technology project, but DataOps focuses on Data like where it is coming and where it will go, why it is coming and how it will be used, how much it costed and how much it will monetize etc.

As mentioned above, DataOps includes all the steps or processes involved in DevOps/ DevSecOps but at the same time it also introduces a few additional steps.

DataOps Process Flow

• Regular Integration
• Regular Development
• Regular Build
• Regular Testing
• Regular Deployment
• Regular Delivery/ Run
• Regular Monitoring and Feedback

Key Elements of DataOps

• ETL or ELT
• Agile and CI/CD
• Component Design
• Environment Management
• Governance, Security and Change Control
• Automated Testing
• Collaboration and Self-Service

‘The practice is to implement DataOps under the umbrella of DevOps including CI/ CD.’