DATA 450 - Data Pipeline

5 CR

This course delves into aspects of data pipeline design, management, and implementation with a focus on integrating external data through APIs – an essential skill for aspiring data engineers. Aimed at providing an in-depth understanding of complex data pipelines, the course encompasses scalable pipeline architecture, real-time data processing, and sophisticated ETL (Extract, Transform, Load) processes.

Prerequisite(s): DATA 332, DEV 120 or CS 211, Admission to BAS Data Management and Analysis program

Course Outcomes

Identify the fundamental concepts of data pipelines, including ETL (Extract, Transform, Load) processes and workflow orchestration
Apply industry-standard tools for designing, building, and managing data pipelines
Acquire hands-on experience in designing scalable and efficient data pipelines for various data sources
Demonstrate the ability to integrate external data through APIs (Application Programming Interfaces) and real-time processing
Develop practical skills in troubleshooting and optimizing data pipelines for performance.

Find out when this course is offered