Course : Hadoop, development
Practical course - 3d
- 21h00 - Ref. HDD
|
Download in PDF format
Share this course by email
 | Understanding the Cloudera/Hortonworks Hadoop ecosystem |
| Introducing the principles of the Hadoop framework |
| Mettre en œuvre des tâches Hadoop pour extraire des éléments pertinents d'ensembles de données volumineux |
| Developing efficient parallel algorithms with MapReduce |
| Charger des données non structurées des systèmes HDFS et HBase |
Intended audience
Developers, project managers, data scientists, architects
Prerequisites
Knowledge of an object programming language such as Java, and of scripting.
Practical details
Application development for Big Data.
Teaching methods
Lectures 30%, practical work 70%.
Course schedule
1 Big data
- Defining the scope of big data.
- The role of the Hadoop project.
- Basic concepts of big data projects.
- Introduction to cloud computing.
- The difference between private and public cloud computing.
- Big data architectures based on Hadoop projects.
- The Cloudera/Hortonworks Hadoop ecosystem.
Demonstration
Using Hadoop.
2 Collecting data and applying Map Reduce
- Analysis of company data flows.
- Structured and unstructured data.
- The principles of semantic analysis of enterprise data.
- MapReduce-based task graph.
- Data consistency granularity.
- Transfer data from a persistence system to Hadoop.
- Transferring data from a cloud to Hadoop.
Hands-on work
Managing the collection of customer information using MapReduce. Configuring the YARN implementation. Developing a MapReduce-based task.
3 Data storage with HBase
- Several types of XML database.
- Usage patterns and their application to the cloud.
- Application of Hadoop database within a workflow.
- Using Hive/Pig projects.
- Using the HCatalog project.
- HBase Java API.
Hands-on work
Manage modifications to a data catalog.
4 Data storage on HDFS
- Usage patterns and their application to the cloud.
- Architecture and installation of an HDFS system, journal, NameNode, DataNode.
- Operations, orders and order management.
- Java HDFS API.
- Data analysis with Apache Pig.
- The Pig Latin language. Using Apache Pig with Java.
- Querying with Apache Hive.
- Data replication. Data sharing on HDFS architecture.
Hands-on work
Administering a shared client repository on Hadoop. Using the visualization console.
PARTICIPANTS
Developers, project managers, data scientists, architects
PREREQUISITES
Knowledge of an object programming language such as Java, and of scripting.
TRAINER QUALIFICATIONS
The experts leading the training are specialists in the covered subjects. They have been approved by our instructional teams for both their professional knowledge and their teaching ability, for each course they teach. They have at least five to ten years of experience in their field and hold (or have held) decision-making positions in companies.
ASSESSMENT TERMS
The trainer evaluates each participant’s academic progress throughout the training using multiple choice, scenarios, hands-on work and more.
Participants also complete a placement test before and after the course to measure the skills they’ve developed.
TERMS AND DEADLINES
Registration must be completed 24 hours before the start of the training.
ACCESSIBILITY FOR PEOPLE WITH DISABILITIES
Do you need special accessibility accommodations? Contact Mrs. Fosse, Disability Manager, at psh-accueil@orsys.fr to review your request and its feasibility.
Developers, project managers, data scientists, architects
PREREQUISITES
Knowledge of an object programming language such as Java, and of scripting.
TRAINER QUALIFICATIONS
The experts leading the training are specialists in the covered subjects. They have been approved by our instructional teams for both their professional knowledge and their teaching ability, for each course they teach. They have at least five to ten years of experience in their field and hold (or have held) decision-making positions in companies.
ASSESSMENT TERMS
The trainer evaluates each participant’s academic progress throughout the training using multiple choice, scenarios, hands-on work and more.
Participants also complete a placement test before and after the course to measure the skills they’ve developed.
TEACHING AIDS AND TECHNICAL RESOURCES
• The main teaching aids and instructional methods used in the training are audiovisual aids, documentation and course material, hands-on application exercises and corrected exercises for practical training courses, case studies and coverage of real cases for training seminars.
• At the end of each course or seminar, ORSYS provides participants with a course evaluation questionnaire that is analysed by our instructional teams.
• A check-in sheet for each half-day of attendance is provided at the end of the training, along with a course completion certificate if the trainee attended the entire session.
• The main teaching aids and instructional methods used in the training are audiovisual aids, documentation and course material, hands-on application exercises and corrected exercises for practical training courses, case studies and coverage of real cases for training seminars.
• At the end of each course or seminar, ORSYS provides participants with a course evaluation questionnaire that is analysed by our instructional teams.
• A check-in sheet for each half-day of attendance is provided at the end of the training, along with a course completion certificate if the trainee attended the entire session.
TERMS AND DEADLINES
Registration must be completed 24 hours before the start of the training.
ACCESSIBILITY FOR PEOPLE WITH DISABILITIES
Do you need special accessibility accommodations? Contact Mrs. Fosse, Disability Manager, at psh-accueil@orsys.fr to review your request and its feasibility.
This programme is an original creation, developed by the teaching teams at ORSYS Formation. Any reproduction, representation, adaptation or use, in whole or in part, without the prior written authorisation of ORSYS, is strictly prohibited. ORSYS reserves the right to take any action necessary to protect its intellectual property rights.
Dates and locations
Select your location or opt for the remote class then choose your date.
Remote class
Dernières places
Date garantie en présentiel ou à distance
Session garantie
This programme is an original creation, developed by the teaching teams at ORSYS Formation. Any reproduction, representation, adaptation or use, in whole or in part, without the prior written authorisation of ORSYS, is strictly prohibited. ORSYS reserves the right to take any action necessary to protect its intellectual property rights.