DP-3014 – Build machine learning solutions using Azure Databricks

About the Course

Azure Databricks is a fully managed, cloud-based data analytics platform, which empowers developers to accelerate AI and innovation by simplifying the process of building enterprise-grade data applications. Built as a joint effort by Microsoft and the team that started Apache Spark, Azure Databricks provides data science, engineering, and analytical teams with a single platform for big data processing and machine learning. In this course, you’ll learn how to use Azure Databricks to train and deploy machine learning models.

There are currently no scheduled sessions available for this course. However, feel free to contact us for more information or to inquire about upcoming sessions.

Questions about this? let our team answer them!

Course Outline

1. Explore Azure Databricks
• Get started with Azure Databricks
• Identify Azure Databricks workloads
• Understand key concepts
• Data governance using Unity Catalog and Microsoft Purview

2. Use Apache Spark in Azure Databricks
• Get to know Spark
• Create a Spark cluster
• Use Spark in notebooks
• Use Spark to work with data files
• Visualize data

3. Train a machine learning model in Azure Databricks
• Understand principles of machine learning
• Machine learning in Azure Databricks
• Prepare data for machine learning
• Train a machine learning model
• Evaluate a machine learning model

4. Use MLflow in Azure Databricks
• Capabilities of MLflow
• Run experiments with MLflow
• Register and serve models with MLflow

5. Tune hyperparameters in Azure Databricks
• Optimize hyperparameters with Optuna
• Review trials
• Scale hyperparameter optimization

6. Use AutoML in Azure Databricks
• What is AutoML?
• Use AutoML in the Azure Databricks user interface
• Use code to run an AutoML experiment

7. Train deep learning models in Azure Databricks
• Understand deep learning concepts
• Train models with PyTorch
• Distribute PyTorch training with TorchDistributor

8. Manage machine learning in production with Azure Databricks
• Automate your data transformations
• Explore model development
• Explore model deployment strategies
• Explore model versioning and lifecycle management

Course Details

Pre-requisites

• Experience of using Python to explore data and train machine learning models with common open source frameworks, like Scikit-Learn, PyTorch, and TensorFlow.
• Consider completing the Create machine learning models learning path before starting this one.

Target Audience

This course is designed for aspiring data scientists and AI engineers who need to train and manage machine learning models by using Azure Databricks.

Class Format

For online (live) format

There are currently no scheduled sessions available for this course. However, feel free to contact us for more information or to inquire about upcoming sessions.