Course : Data Mesh, Data Products, Data Contracts: Implementation and Deployment Best Practicesunify the data architecture, empower business units, and ensure security
Seminar - 2d
- 14h00 - Ref. DMD
|
Download in PDF format
Share this course by email
 | Master the concepts of Domain-Driven Design, Data Mesh, Data Product, and Data Contract |
| Discover the first insights from companies adopting a Data Mesh architecture |
| Develop a roadmap, list and prioritize the tasks to be completed, and identify the teams to involve |
| Implementing industry standards: data contracts and data products |
| Identify and select the IT tools used in a Data Mesh approach |
Intended audience
Data architects, data engineers, Chief Data Officers, and anyone interested in understanding this architecture (which has been in use since 2020) and how to implement it in their organization
Prerequisites
No specific knowledge required.
Course schedule
1 Data Mesh vs. Traditional Data Architectures
- The Limitations of the Data Warehouse, Data Lake, and Data Lakehouse Combination.
- Comparison of Architectures: Data Lake, Lakehouse, Fabric, Hub…
- The Role of Business Domains in an Organization: Domain-Driven Design (DDD), a New Approach to Application Development.
- Develop a framework for assessing an organization's maturity with regard to Data Mesh.
- Set priorities to ensure the success of the initiative.
2 The Value Proposition of the Data Mesh
- The 4 Key Principles of Data Mesh.
- Business Unit Empowerment, Data Product, self-service data platform, federated governance.
- Data mesh applied to operational data and analytical data.
- Design a "Data as a Product" approach.
- Apply the product and service development process to data.
- Product Model Canvas Information – Applying Product Management Best Practices to Data Products.
- Align the process with the data catalog
- Standardizing Data Products: Data Contracts and Their Tools.
- The Data Contract: Key to Improving Data Quality.
- Data Contracts vs. Data Usage Agreements: Understanding the Differences.
- Measuring and Monitoring Data Quality in a Data Mesh Environment
- Set up a data platform
- The Data Steward and the Data Mesh
- Formalize and codify the various elements of governance: standards, rules, tests, and indicators (case study).
Demonstration
Create and formalize Data Product schemas: Create a metamodel in YAML or JSON. Format standardization initiatives (Bitol, with ODCS and ODPS): a case study on creating a data product in ODPS format. Using Data Contracts Studio: Formalize a Data Contract model.
3 What Architecture Should a Data Mesh Have?
- It's Possible to Launch a Data Mesh Project in One Month
- Data Mesh is an organizational model, not a turnkey architecture
- Defining the Architecture of a Data Product: Collecting, Transforming/Preparing, and Using Datasets
- Align consumer needs with the constraints faced by data producers.
- Organize workshops for the co-creation of data products and the formalization of data contracts
- Publish and share data products to maximize interoperability
- Ensure the backward compatibility of Data Products (based on standards)
- Observability and Lifecycle Management of Data Products
- Data Mesh and Regulatory Compliance (GDPR and Others)
- Data Mesh Project Strategy and Execution
- : action plan, people to involve, roles, workload, initial budget, operating budget
4 What Tools Are Available for Data Mesh: A Comparison
- Data Mesh: On-Premises or in the Cloud
- Building an Event-Driven Data Mesh: Change Data Capture (CDC) and Data Mesh.
- tools for creating data pipelines
- Specialized data product platforms: Nextdata, IBM, Starburst, Snowflake, Databricks, Denodo, Orkestra Data, AbeaData.
- Data Mesh in Major Platforms (SAP, SAS, Amazon, Google, Microsoft, etc.)
- Share and publish data products through a portal
- Building blocks: Estuary Flow, K2view…
- Open-source solutions: Dremio, Apache
- Complementary architectures: Edge, micro-databases, etc.
- Implement security procedures on the data mesh platform
5 Adapting the data mesh to Your Own Environment
- The first companies to implement a Data Mesh approach, the obstacles they encountered, and how to overcome them.
- Allocate costs and measure the ROI of the data mesh.
- Deploy your first Data Mesh MVP across the enterprise.
- Data Literacy: A Prerequisite for Deploying a Data Mesh in the Enterprise.
- The Future of the Data Mesh: Data Spaces, Data Marketplaces, and Data Monetization?
PARTICIPANTS
Data architects, data engineers, Chief Data Officers, and anyone interested in understanding this architecture (which has been in use since 2020) and how to implement it in their organization
PREREQUISITES
No specific knowledge required.
TRAINER QUALIFICATIONS
The experts leading the training are specialists in the covered subjects. They have been approved by our instructional teams for both their professional knowledge and their teaching ability, for each course they teach. They have at least five to ten years of experience in their field and hold (or have held) decision-making positions in companies.
ASSESSMENT TERMS
The trainer evaluates each participant’s academic progress throughout the training using multiple choice, scenarios, hands-on work and more.
Participants also complete a placement test before and after the course to measure the skills they’ve developed.
TERMS AND DEADLINES
Registration must be completed 24 hours before the start of the training.
ACCESSIBILITY FOR PEOPLE WITH DISABILITIES
Do you need special accessibility accommodations? Contact Mrs. Fosse, Disability Manager, at psh-accueil@orsys.fr to review your request and its feasibility.
Data architects, data engineers, Chief Data Officers, and anyone interested in understanding this architecture (which has been in use since 2020) and how to implement it in their organization
PREREQUISITES
No specific knowledge required.
TRAINER QUALIFICATIONS
The experts leading the training are specialists in the covered subjects. They have been approved by our instructional teams for both their professional knowledge and their teaching ability, for each course they teach. They have at least five to ten years of experience in their field and hold (or have held) decision-making positions in companies.
ASSESSMENT TERMS
The trainer evaluates each participant’s academic progress throughout the training using multiple choice, scenarios, hands-on work and more.
Participants also complete a placement test before and after the course to measure the skills they’ve developed.
TEACHING AIDS AND TECHNICAL RESOURCES
• The main teaching aids and instructional methods used in the training are audiovisual aids, documentation and course material, hands-on application exercises and corrected exercises for practical training courses, case studies and coverage of real cases for training seminars.
• At the end of each course or seminar, ORSYS provides participants with a course evaluation questionnaire that is analysed by our instructional teams.
• A check-in sheet for each half-day of attendance is provided at the end of the training, along with a course completion certificate if the trainee attended the entire session.
• The main teaching aids and instructional methods used in the training are audiovisual aids, documentation and course material, hands-on application exercises and corrected exercises for practical training courses, case studies and coverage of real cases for training seminars.
• At the end of each course or seminar, ORSYS provides participants with a course evaluation questionnaire that is analysed by our instructional teams.
• A check-in sheet for each half-day of attendance is provided at the end of the training, along with a course completion certificate if the trainee attended the entire session.
TERMS AND DEADLINES
Registration must be completed 24 hours before the start of the training.
ACCESSIBILITY FOR PEOPLE WITH DISABILITIES
Do you need special accessibility accommodations? Contact Mrs. Fosse, Disability Manager, at psh-accueil@orsys.fr to review your request and its feasibility.
This programme is an original creation, developed by the teaching teams at ORSYS Formation. Any reproduction, representation, adaptation or use, in whole or in part, without the prior written authorisation of ORSYS, is strictly prohibited. ORSYS reserves the right to take any action necessary to protect its intellectual property rights.
Dates and locations
Select your location or opt for the remote class then choose your date.
Remote class
Dernières places
Date garantie en présentiel ou à distance
Session garantie
This programme is an original creation, developed by the teaching teams at ORSYS Formation. Any reproduction, representation, adaptation or use, in whole or in part, without the prior written authorisation of ORSYS, is strictly prohibited. ORSYS reserves the right to take any action necessary to protect its intellectual property rights.