You are viewing as a ‘Guest’. Your progress will not be recorded.
Scheduling and Orchestrating SAS® Programs and Flows with Apache Airflow
14m + Hands-On Practice
START FREE TRIAL
Available in:
Education Category Image


  
Scheduling and Orchestrating SAS® Programs and Flows with Apache Airflow
DE330W : DE330C
Learn how to schedule and orchestrate SAS programs, flows, and jobs using Apache Airflow.
Learn How To
  • Schedule and orchestrate SAS programs, flows, and jobs using Apache Airflow.
  • Use Airflow sensors, time, SQL, and dataset dependencies to trigger workloads.
  • Use the SAS Airflow operator, macro variables, etc.
  • Use the Airflow SAS Studio custom steps to create a DAG from SAS Studio.
Who Should Attend
The workshop would be suitable for anyone with a basic understanding of SAS Viya and an interest in learning how to use Apache Airflow to create more efficient and reliable data workflows. It may also be beneficial for those looking to modernize their data processing operations by integrating SAS Viya with contemporary workflow management tools. The list may include: SAS Programmers, Data Engineers, Data Scientists/Analysts, Business Intelligence Professionals, DevOps Engineers, IT Professionals, System Administrators, Technical Managers/Project Managers.
Prerequisites
Before attending this course, you should be familiar with:
  • Basic knowledge of SAS Viya: Understanding of SAS programming language and environment, as well as familiarity with SAS Viya's capabilities.
  • Programming Skills: Proficiency in at least one programming language that is commonly used in data environments, such as Python, which is often used in conjunction with Apache Airflow.
  • Workflow Automation: An understanding of the importance of automating repetitive tasks and how it applies to data workflows.
  • Familiarity with DevOps Principles: For those who will be integrating SAS Viya with Apache Airflow into a DevOps workflow, a basic understanding of DevOps practices could be helpful.
SAS Products Covered
SAS Studio
Course Outline
Airflow Basics
  • Create a basic DAG, which stands for Directed Acyclic Graph.
SAS Studio Operator
  • Create an Airflow DAG (Directed Acyclic Graph) using the SASStudioOperator, which involves importing the operator, creating a task, and setting various parameters such as path type, exec type, and connection name.
  • Create DAGs to run SAS Studio flows.
  • Create DAGs to run SAS Studio programs.
  • Create DAGs to run SAS Studio jobs.
  • The steps to explore and manage the updated DAG in Airflow, including triggering the DAG, checking task logs, and ensuring successful task execution.
Time Dependencies
  • Trigger a DAG containing SAS workloads using time dependencies or cron schedules.
File Dependencies
  • Trigger a DAG containing SAS workloads using file dependencies, for example when a file arrives in a folder.
SQL Dependencies
  • Trigger a DAG containing SAS workloads using SQL dependencies: when a certain criteria is met in a table's data.
Macro Variables
  • Passing macro variables to SAS programs and downstream tasks from one SAS task to another in a DAG.
  • Using the XCOM mechanism to push or pull variables or reusing the SAS Studio Compute session.
Airflow SAS Studio Custom Steps - No Code Option
  • Use the Airflow SAS Studio custom steps to create a DAG from SAS Studio that loads several tables using SAS Studio flows.
Live Class Schedule
Duration: 10.5 hours
Step into our live classes and experience a dynamic learning environment where you can ask questions, share ideas, and connect with your instructor and classmates. With on-demand lab hours, you can explore the material at your own pace. Our globally acclaimed instructors will motivate you to think bigger, so you can take what you've learned and achieve your biggest goals.
This course isn't publicly scheduled, but private training and mentoring may be available. Contact us to explore options.
Private Training
Get training tailored specifically for your team, led by expert SAS instructors. Choose from virtual sessions, or training at your location (or ours). Perfect for teams seeking a customized curriculum and plenty of interaction with a SAS specialist. We'll schedule it at a time that works for you.
Request private training
Mentoring Services
Take your training to the next level with personalized mentoring. While private training offers structured coursework, mentoring provides hands-on, real-time support from a subject matter expert. As you work with your own data, you'll receive expert guidance to help you uncover insights, unlock the full potential of your data, and make faster progress. Perfect for those looking to apply what they’ve learned and see quicker results.
Request mentoring