No cover art

[ WebToolTip.com ] Udemy - Master Airflow - Orchestrate Snowflake and Databricks

Size
1.6 GB
Seeders
7
Leechers
1
Files
98
Category
Added
08/14/26 at 4:47pm GMT+1
Infohash
e876e6f2e8b0a8b031374a5eba23a73d8d507f32

Description

Master Airflow: Orchestrate Snowflake & Databricks


https://WebToolTip.com


Published 7/2026

MP4 | Video: h264, 1920x1080 | Audio: AAC, 44.1 KHz, 2 Ch

Language: English | Duration: 5h 41m | Size: 1.58 GB


Stop firefighting cron chains — build production Airflow 3 DAGs that orchestrate Snowflake, Databricks, and dbt.


What you'll learn

Explain why chained cron jobs silently corrupt downstream data, and what a DAG's explicit completion check fixes

Author production-grade DAGs using both classic operators and the TaskFlow API's `@task`/`@dag` decorators

Design idempotent, backfillable pipelines using Airflow's data-interval scheduling model

Use sensors and deferrable operators to wait on external systems efficiently, without wasting a worker slot

Pass data between tasks correctly with XComs, understanding what should and shouldn't cross that boundary

Scale a single task over an unknown number of inputs with dynamic task mapping (`.expand()`)

Build branching logic, trigger rules, and human-in-the-loop approval steps into a DAG

Manage credentials safely with Connections, Variables, Hooks, and a Secrets backend — never hardcoded

Orchestrate real cross-platform pipelines: Snowflake loads, Databricks jobs, and dbt runs (via Cosmos), from a single DAG

Debug failed DAG runs using logs, the Grid and Gantt views, retries, SLAs, and alerting callbacks

Deploy Airflow to production (Kubernetes, Astronomer, MWAA, or Cloud Composer) with CI/CD gating every DAG change

Migrate a legacy Airflow 2 deployment to Airflow 3, and recognize the performance anti-patterns that break DAGs at scale


Requirements

Basic Python — functions, imports, and reading a script is enough; no advanced Python required

Comfort with the command line for running Docker and Airflow CLI commands

Docker installed on your machine (used to stand up a local Airflow environment)

No prior Airflow experience required — we build the mental model from zero starting in Module 1

Helpful but not required: prior exposure to Snowflake, Databricks, or dbt, since Module 13 orchestrates all three

File list
  • [ WebToolTip.com ] Udemy - Master Airflow - Orchestrate Snowflake and Databricks
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/1 - The 3am Page — When Cron Jobs Collide.mp4 26.1 MB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/2 - What a DAG Actually Is.mp4 25.9 MB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/3 - Where Airflow Fits (and Where It Doesn't).mp4 30.7 MB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/capstone/dags/capstone_pipeline.py 8.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/capstone/include/dq_checks.py 1.9 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/capstone/README.md 5.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/capstone/tests/test_capstone_pipeline.py 757 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_01_dag_concepts_and_idempotency.py 6.3 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_02_scheduler_and_task_execution_api.py 3.5 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_03_standing_up_airflow_project_layout.py 5.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_04_first_real_dag.py 4.2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_05_operators_taskgroups_and_templating.py 4.7 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_06_taskflow_api.py 6.2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_07_scheduling.py 4.8 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_08_sensors_deferrable.py 5.9 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_09_xcoms.py 5.4 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_10_dynamic_task_mapping.py 5.9 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_11_branching_and_gates.py 5.4 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_12_connections_and_secrets.py 4.7 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_13_provider_ecosystem.py 6.2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_14_testing_and_data_quality.py 4.4 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_15_failure_retries_alerting.py 4.8 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_16_monitoring_observability.md 5.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_17_deployment_options.md 4.6 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_18_airflow2_to_3_migration.py 5.3 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_19_cicd_for_dags.py 4.3 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/exercises/module_20_performance_antipatterns_assets.py 5.3 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/README.md 2.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/setup/environment_setup.md 9.9 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/5005_all_py.py 48.3 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/5005_all_slide_notes.txt 10.7 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_01_py.py 1.3 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_01_slide_notes.txt 707 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_02_py.py 2.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_02_slide_notes.txt 1.6 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_03_slide_notes.txt 2.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_04_py.py 1.4 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_04_slide_notes.txt 2.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_05_py.py 2.7 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_06_py.py 3.5 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_07_py.py 2.4 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_08_py.py 4.7 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_08_slide_notes.txt 821 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_09_py.py 1015 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_09_slide_notes.txt 700 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_10_py.py 3.9 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_11_py.py 9.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_12_py.py 3.5 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_12_slide_notes.txt 788 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_13_py.py 3.7 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_14_py.py 3.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_14_slide_notes.txt 679 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_15_py.py 3.8 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_16_slide_notes.txt 2.4 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_17_py.py 1.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_17_slide_notes.txt 1.9 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_18_py.py 2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_18_slide_notes.txt 879 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_19_py.py 2.2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_19_slide_notes.txt 1.2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_20_py.py 6 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_21_py.py 3.7 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_code/module_21_slide_notes.txt 601 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/5005_all_queries.sql 27 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_01_queries.sql 1.8 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_03_queries.sql 742 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_04_queries.sql 1.6 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_05_queries.sql 3.2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_06_queries.sql 2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_07_queries.sql 2.7 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_09_queries.sql 1.8 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_11_queries.sql 1.2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_12_queries.sql 2.7 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_13_queries.sql 5.1 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_14_queries.sql 558 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_16_queries.sql 745 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_17_queries.sql 4.2 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_18_queries.sql 721 B
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_19_queries.sql 1.3 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_20_queries.sql 1.6 KB
  • ~Get Your Files Here !/1 - Why the Best Data Teams Stopped Using Cron/Course_Resources/slide_queries/module_21_queries.sql 2.5 KB
  • ~Get Your Files Here !/10 - Dynamic Task Mapping — DAGs That Scale With Your Data/36 - Expand and Partial.mp4 20.7 MB
  • ~Get Your Files Here !/10 - Dynamic Task Mapping — DAGs That Scale With Your Data/37 - Anti-Pattern First — Copy-Pasted Task-Per-Table DAGs.mp4 15.9 MB
  • ~Get Your Files Here !/10 - Dynamic Task Mapping — DAGs That Scale With Your Data/38 - Mapping Over XCom Output.mp4 14.9 MB
  • ~Get Your Files Here !/10 - Dynamic Task Mapping — DAGs That Scale With Your Data/39 - Debug Slide — My Mapped Task Created 10,000 Instances.mp4 17.9 MB
  • ~Get Your Files Here !/11 - Branching, Trigger Rules, and Human-in-the-Loop/40 - BranchPythonOperator and ShortCircuitOperator.mp4 30.8 MB
  • ~Get Your Files Here !/11 - Branching, Trigger Rules, and Human-in-the-Loop/41 - Trigger Rules.mp4 30.2 MB
  • ~Get Your Files Here !/11 - Branching, Trigger Rules, and Human-in-the-Loop/42 - Reference Card — Trigger Rule Cheat Sheet.mp4 23.7 MB
  • ~Get Your Files Here !/11 - Branching, Trigger Rules, and Human-in-the-Loop/43 - Human-in-the-Loop — Pausing a DAG for Approval.mp4 30.4 MB
  • ~Get Your Files Here !/11 - Branching, Trigger Rules, and Human-in-the-Loop/44 - Case Study — A Data-Quality Sign-Off Gate.mp4 29.1 MB
  • ~Get Your Files Here !/12 - Connections, Variables, Hooks, and Secrets/45 - Connections and the Connections UI.mp4 14.5 MB
  • ~Get Your Files Here !/12 - Connections, Variables, Hooks, and Secrets/46 - Variables.mp4 23.2 MB
  • ~Get Your Files Here !/12 - Connections, Variables, Hooks, and Secrets/47 - Hooks — The Bridge to External Systems.mp4 10.1 MB
  • ~Get Your Files Here !/12 - Connections, Variables, Hooks, and Secrets/48 - Anti-Pattern First — Secrets in Plain-Text Variables.mp4 15.6 MB
  • ~Get Your Files Here !/13 - The Provider Ecosystem — Orchestrating Snowflake, Databricks, and dbt/49 - The Snowflake Provider.mp4 21.4 MB
  • ~Get Your Files Here !/13 - The Provider Ecosystem — Orchestrating Snowflake, Databricks, and dbt/50 - The Databricks Provider.mp4 19.3 MB
  • ~Get Your Files Here !/13 - The Provider Ecosystem — Orchestrating Snowflake, Databricks, and dbt/51 - Orchestrating dbt with Cosmos and dbt Fusion.mp4 10.9 MB
  • ~Get Your Files Here !/13 - The Provider Ecosystem — Orchestrating Snowflake, Databricks, and dbt/52 - Case Study — One DAG, Three Platforms.mp4 15.6 MB

Rating
Not rated yet
Log in to rate

Comments

No comments yet.


Similar torrents
NameSizeDate
78 MB11/10/2539452626
18 MB07/19/2633592238
15 MB07/19/2633342224
71 MB07/07/2333242212
2.8 GB08/19/2632891547
6 MB07/18/2631122069
18 MB08/11/2631062067
3 MB08/14/2631022063
3.5 GB08/12/2630932633
50 MB07/14/2630872053
13 MB08/09/2630702043
43 MB05/14/2330552023
156 MB05/14/2330432024
42 MB07/15/2630392019
18 MB07/15/2630112008