Don't like banners? Log in and we will make sure you see no banners. For free.
[ CourseWikia.com ] Linkedin - Data Engineering Pipeline Management with Apache Airflow

[ CourseWikia.com ] Linkedin - Data Engineering Pipeline Management with Apache Airflow

Size
287 MB
Seeders
1
Leechers
1
Files
98
Category
Added
at 11:13am GMT+1
Infohash
b75403d8496a34361f46115ed2894b651b304ab3
Don't like banners? Log in and we will make sure you see no banners. For free.

Description
[ CourseWikia.com ] Data Engineering Pipeline Management with Apache Airflow



If You Need More Stuff, kindly Visit and Support Us -->> https://CourseWikia.com







Released: 08/2023

Duration: 2h 8m | .MP4 1280x720, 30 fps(r) | AAC, 48000 Hz, 2ch | 286 MB

Level: Intermediate | Genre: eLearning | Language: English



Take a deeper dive into data engineering pipeline management using Apache Airflow. In this course, certified Google cloud architect and data engineer Janani Ravi guides you through using Apache Airflow to complete your data engineering pipeline management workflows. Learn how to work with role-based access control, including creating users with different roles, executing a branching DAG and a SQL DAG, recalling actions that users with different roles can perform, and more. Go over how to manage SLAs and schedule DAGs with datasets. Find out how to work with AirFlow plugins and explore the CSV reader plugin. Plus, discover how to scale Apache Airflow, set up a data transformation pipeline, execute tasks, and more.

This course was created by Janani Ravi. We are pleased to host this training in our library.



Homepage



https://www.linkedin.com/learning/data-engineering-pipeline-management-with-apache-airflow



If You Need More Stuff, kindly Visit and Support Us -->> https://FreeCourseWeb.com



Get More Tutorials and Support Us -->> https://DevCourseWeb.com



We upload these learning materials for the people from all over the world, who have the talent and motivation to sharpen their skills/ knowledge but do not have the financial support to afford the materials. If you like this content and if you are truly in a position that you can actually buy the materials, then Please, we repeat, Please, Support Authors. They Deserve it! Because always remember, without "Them", you and we won't be here having this conversation. Think about it! Peace...



Image error



Image error

File list
  • [ CourseWikia.com ] Linkedin - Data Engineering Pipeline Management with Apache Airflow
  • ~Get Your Files Here !/01 - Introduction/01 - Features for data engineering pipeline management.mp4 10.1 MB
  • ~Get Your Files Here !/01 - Introduction/01 - Features for data engineering pipeline management.srt 10.4 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/01 - Prerequisites.mp4 987.5 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/01 - Prerequisites.srt 1.2 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/02 - Quick install overview.mp4 8 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/02 - Quick install overview.srt 6.2 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/03 - Creating an admin user and exploring roles.mp4 11.4 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/03 - Creating an admin user and exploring roles.srt 9.2 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/04 - Creating users with different roles.mp4 4.9 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/04 - Creating users with different roles.srt 5.5 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/05 - Executing a simple branching DAG.mp4 5.4 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/05 - Executing a simple branching DAG.srt 4.8 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/06 - Executing a simple SQL DAG.mp4 8.3 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/06 - Executing a simple SQL DAG.srt 6.6 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/07 - The public and viewer roles.mp4 8.5 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/07 - The public and viewer roles.srt 6.2 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/08 - The user role.mp4 5.6 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/08 - The user role.srt 4.5 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/09 - The op role.mp4 3 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/09 - The op role.srt 2.8 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/10 - Actions, resources, and permissions.mp4 4.4 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/10 - Actions, resources, and permissions.srt 4.2 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/11 - Adding permissions to the public role.mp4 9.4 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/11 - Adding permissions to the public role.srt 6.5 KB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/12 - Creating and configuring a custom role.mp4 6.8 MB
  • ~Get Your Files Here !/02 - 1. Working with Role-Based Access Control/12 - Creating and configuring a custom role.srt 5.6 KB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/01 - Configuring emails for SLA management.mp4 8.7 MB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/01 - Configuring emails for SLA management.srt 6.2 KB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/02 - Configuring task-level SLAs.mp4 7.2 MB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/02 - Configuring task-level SLAs.srt 4.9 KB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/03 - Triggering and viewing SLA misses.mp4 9.2 MB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/03 - Triggering and viewing SLA misses.srt 5.1 KB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/04 - Configuring DAG-level SLAs.mp4 8.9 MB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/04 - Configuring DAG-level SLAs.srt 6.4 KB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/05 - Configuring DAG failed action.mp4 14.4 MB
  • ~Get Your Files Here !/03 - 2. Managing SLAs/05 - Configuring DAG failed action.srt 9.8 KB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/01 - Dataset producer pipeline.mp4 9.2 MB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/01 - Dataset producer pipeline.srt 6.9 KB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/02 - Dataset consumer pipeline.mp4 4.8 MB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/02 - Dataset consumer pipeline.srt 3.4 KB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/03 - Data-aware scheduling.mp4 7.1 MB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/03 - Data-aware scheduling.srt 5.5 KB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/04 - Purchases producer pipeline and join pipeline.mp4 12.7 MB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/04 - Purchases producer pipeline and join pipeline.srt 9.2 KB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/05 - Data-aware scheduling with multiple datasets.mp4 14.2 MB
  • ~Get Your Files Here !/04 - 3. Scheduling DAGs with Datasets/05 - Data-aware scheduling with multiple datasets.srt 10.4 KB
  • ~Get Your Files Here !/05 - 4. Working with Airflow Plugins/01 - Introducing plugins.mp4 7.1 MB
  • ~Get Your Files Here !/05 - 4. Working with Airflow Plugins/01 - Introducing plugins.srt 6.4 KB
  • ~Get Your Files Here !/05 - 4. Working with Airflow Plugins/02 - Adding menu items using plugins.mp4 6.6 MB
  • ~Get Your Files Here !/05 - 4. Working with Airflow Plugins/02 - Adding menu items using plugins.srt 4.5 KB
  • ~Get Your Files Here !/05 - 4. Working with Airflow Plugins/03 - Exploring the CSV reader plugin.mp4 5 MB
  • ~Get Your Files Here !/05 - 4. Working with Airflow Plugins/03 - Exploring the CSV reader plugin.srt 3.8 KB
  • ~Get Your Files Here !/05 - 4. Working with Airflow Plugins/04 - Implementing the CSV reader plugin.mp4 16 MB
  • ~Get Your Files Here !/05 - 4. Working with Airflow Plugins/04 - Implementing the CSV reader plugin.srt 10.7 KB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/01 - Scaling Apache Airflow.mp4 6.8 MB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/01 - Scaling Apache Airflow.srt 8 KB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/02 - Basic setup for the transformation pipeline.mp4 5.4 MB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/02 - Basic setup for the transformation pipeline.srt 6.1 KB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/03 - DAG for the transformation pipeline.mp4 15.1 MB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/03 - DAG for the transformation pipeline.srt 10.3 KB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/04 - Install RabbitMQ on macOS and Linux.mp4 8.3 MB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/04 - Install RabbitMQ on macOS and Linux.srt 6.6 KB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/05 - Set up an admin user for RabbitMQ.mp4 3.6 MB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/05 - Set up an admin user for RabbitMQ.srt 3.3 KB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/06 - Configuring the CeleryExecutor for Airflow.mp4 6.2 MB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/06 - Configuring the CeleryExecutor for Airflow.srt 2.9 KB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/07 - Executing tasks on a single Celery worker.mp4 7.6 MB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/07 - Executing tasks on a single Celery worker.srt 6.3 KB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/08 - Executing tasks on multiple Celery workers.mp4 3 MB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/08 - Executing tasks on multiple Celery workers.srt 2.4 KB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/09 - Assigning tasks to queues.mp4 10.2 MB
  • ~Get Your Files Here !/06 - 5. Scaling Airflow/09 - Assigning tasks to queues.srt 5 KB
  • ~Get Your Files Here !/07 - Conclusion/01 - Summary and next steps.mp4 2.7 MB
  • ~Get Your Files Here !/07 - Conclusion/01 - Summary and next steps.srt 2.9 KB
  • ~Get Your Files Here !/Bonus Resources.txt 386 B
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/00_Quick_Install_Overview/demo00_quick_install_overview.sh 2.2 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/01_Role Based Access Control/01-role_based_access_control.sh 15 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/01_Role Based Access Control/dags/simple_branching_with_variable.py 1.6 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/01_Role Based Access Control/dags/simple_sql_pipeline.py 2.2 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/02_SLA Managment/02-sla_managment.sh 12.5 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/02_SLA Managment/dags/simple_branching_with_dag_sla.py 2.2 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/02_SLA Managment/dags/simple_branching_with_sla_email.py 3.4 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/02_SLA Managment/dags/simple_branching_with_task_sla.py 2.3 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/03-datasets.sh 22.5 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/dags/consumer_pipeline_customers.py 2.1 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/dags/consumer_pipeline_join.py 3 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/dags/producer_pipeline_customers.py 1.7 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/dags/producer_pipeline_purchases.py 1.7 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/datasets/customers.csv 1.6 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/datasets/purchases.csv 1.2 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/output/clean_customers.csv 1.5 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/output/clean_purchases.csv 1.4 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/output/groupby_country.csv 177 B
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/03_Datasets/output/joined_data.csv 1.9 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/04_Plugins/04-plugins.sh 4.3 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/04_Plugins/datasets/customers.csv 1.6 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/04_Plugins/datasets/purchases.csv 1.2 KB
  • ~Get Your Files Here !/Ex_Files_Data_Eng_Pipeline_Mgmt_Apache_Airflow/Exercise Files/04_Plugins/plugins/__pycache__/CSVReaderPlugin.cpython-37.pyc 3.4 KB

Rating
Not rated yet
Log in to rate

Comments

No comments yet.