Introduction to SAS® and Hadoop
DIACCHAD : DIAHSM
This course teaches you how to use SAS programming methods to read, write, and manipulate Hadoop data. Base SAS methods that are covered include reading and writing raw data with the DATA step and managing the Hadoop file system and executing Pig code from SAS via the HADOOP procedure. In addition, the SAS/ACCESS Interface to Hadoop methods that allow LIBNAME access and SQL pass-through techniques to read and write Hadoop Hive table structures are discussed. Although not covered in detail, a brief overview of additional SAS and Hadoop technologies, including executing DS2 in Hadoop with the SAS Code Accelerator for Hadoop and using Hadoop data sources for the distributed in-memory analytics platform of SAS Viya, is included. This course is included in the Expert Exchange on Hadoop: Using SAS/ACCESS service offering to configure SAS/ACCESS Interface to Hadoop or SAS/ACCESS Interface to Impala to work with your Hadoop environment.
Learn How To
- Read and write Hadoop files with the FILENAME statement.
- Execute and use Hadoop commands with the HADOOP procedure.
- Invoke the execution of Pig programs in Hadoop within a SAS program.
- Access Hadoop distributions using the LIBNAME statement and the SQL pass-through facility.
- Create and use SQL procedure pass-through queries.
- Use options and efficiency techniques for optimizing data access performance.
- Join data using the SQL procedure and the DATA step.
- Use Base SAS procedures with Hadoop.
- Modify DS2 programs to execute in-database in Hadoop.
- Use data in Hadoop as disk storage for SAS Viya in-memory tables.
Who Should Attend
SAS programmers that need to access data in Hadoop from within SAS
Prerequisites
Before attending this course, you should be comfortable programming in SAS and Structured Query Language (SQL). You can gain the required SAS programming knowledge from the SAS Programming 1: Essentials course. You can gain the required knowledge of SQL from the SAS SQL 1: Essentials course. A working knowledge of Hadoop is helpful.
SAS Products Covered
SAS Data Connect Accelerator for Hadoop;Base SAS;SAS Data Connector to Hadoop
Course Outline
Introduction
- What is Hadoop?
- How SAS interfaces with Hadoop.
- Overview of methods available in Base SAS for interacting with Hadoop.
- Reading and writing Hadoop files using Base SAS.
- Methods.
- Executing MapReduce code.
- Executing Pig code using PROC HADOOP.
- Understand the SQL procedure pass-through facility.
- Connecting to a Hadoop Hive database.
- Learning methods to query Hive tables.
- Investigating Hadoop Hive metadata.
- Creating SQL procedure pass-through queries.
- Creating and loading Hive tables with SQL pass-through EXECUTE statements.
- Handling Hive STRING data types.
- Using the LIBNAME statement for Hadoop.
- Using data set options.
- Creating views.
- Combining tables.
- Benefits of the LIBNAME method.
- Using the HDMD procedure to access delimited data, XML data, and other non-Hive formats.
- Performance considerations for the SAS/ACCESS LIBNAME statement.
- Copying data from a SAS library to a Hive library.
- Identifying partitioning, clustering, and indexing methods in Hive.
- Understanding how partitioning and clustering can increase query performance.
- Creating and loading partitioned and clustered Hive tables.
- Loading and saving CAS tables to HDFS.
- Executing DS2 threads in Hadoop to summarize data.
- Using the HDMD procedure to access HDFS files.
Live Class Schedule
Duration: 14 hours
Step into our live classes and experience a dynamic learning environment where you can ask questions, share ideas, and connect with your instructor and classmates. With on-demand lab hours, you can explore the material at your own pace. Our globally acclaimed instructors will motivate you to think bigger, so you can take what you've learned and achieve your biggest goals.
This course isn't publicly scheduled, but private training and mentoring may be available. Contact us to explore options.
Private Training
Get training tailored specifically for your team, led by expert SAS instructors. Choose from virtual sessions, or training at your location (or ours). Perfect for teams seeking a customized curriculum and plenty of interaction with a SAS specialist. We'll schedule it at a time that works for you.
Mentoring Services
Take your training to the next level with personalized mentoring. While private training offers structured coursework, mentoring provides hands-on, real-time support from a subject matter expert. As you work with your own data, you'll receive expert guidance to help you uncover insights, unlock the full potential of your data, and make faster progress. Perfect for those looking to apply what they’ve learned and see quicker results.