10156127
Modern Data Topics
Course Information
Description
This course examines current developments in data management, analytics, and governance. Emphasis is placed on contemporary tools, practices, and emerging issues in the modern data landscape.
Total Credits
0
Course Competencies (Course Outcomes)
-
Explain modern data architecture strategiesAssessment StrategiesSkill demonstration in lab, written assessment, and semester-long projectCriteriaDescribe the differences between and applications of OLTP and OLAP systems effectivelyDescribe strengths and weaknesses of data warehouses, data lakes, and data lakehousesDistinguish ETL from ELT and choose an appropriate approach for a given use caseExplain how and why data models differ for BI reporting, machine learning, and AI-oriented use
-
Create data products for analytical useAssessment StrategiesSkill demonstration in lab, written assessment, and semester-long projectCriteriaDesign star schemas with clearly defined fact and dimension tables with effective grain and keysShape data models that are effective for BI tools and easy for analysts to understandWrite documentation that effectively describes the use and purpose of curated datasets
-
Identify effective data storage formatsAssessment StrategiesSkill demonstration in lab, written assessment, and semester-long projectCriteriaChoose effective file forms (CSV, JSON, Parquet, etc.) for different stages of a data pipelineJustify the choice of format based on performance, schema evolution, and interoperability criteriaIncorporate open table formats, employing table-centric thinkingManage data ingestion and transformation on a professional-grade data platform, such as Databricks
-
Apply governance and security principlesAssessment StrategiesSkill demonstration in lab, written assessment, and semester-long projectCriteriaOrganize governed data using catalog, schema, and table abstractions in a tool such as Unity CatalogApply basic permissioning models to control access to data, with particular attention to PIIUtilize data lineage information to explain where data comes from and who depends on it
-
Create end-to-end data pipelinesAssessment StrategiesSkill demonstration in lab, written assessment, and semester-long projectCriteriaDesign end-to-end pipelines that move data from raw sources through curated outputsDescribe and define DAGs of tasks that include job triggers, dependencies, and schedulesStructure data flows using a medallion (bronze-silver-gold) architectureExplain the purpose of each layer in terms of cleanliness, usability, and trust
-
Utilize multiple data processing approachesAssessment StrategiesSkill demonstration in lab, written assessment, and semester-long projectCriteriaDifferentiate between batch and streaming processing, selecting the best pattern for different scenariosMinimize full data reloads through incremental processing that leverages watermarks and CDC
-
Create reliable, high-quality data productsAssessment StrategiesSkill demonstration in lab, written assessment, and semester-long projectCriteriaApply ACID-related concepts to data pipelines and storageDesign pipelines and transformations that are idempotent, resilient to reruns and partial failuresAssess the quality of data by implementing data quality checksDescribe multiple types of data quality checks and how they contribute to data quality
-
Utilize engineering principles (“Data as Code”)Assessment StrategiesSkill demonstration in lab, written assessment, and semester-long projectCriteriaMaintain a sharable, version-controlled repository of artifacts using Git and GitHubEnsure that all artifacts – transformations, quality checks, etc. are versioned, reviewable, and reproducibleDemonstrate good engineering practices of clear naming, modular code, simple tests, and documentation
-
Describe DataOps conceptsAssessment StrategiesSkill demonstration in lab and written assessmentCriteriaDescribe continuous integration and continuous delivery (CI/CD) in the context of data pipelinesExplain how automated checks and repeatable deployment contribute to analytical system reliability and safety
-
Utilize curated data for insight and AI readinessAssessment StrategiesSkill demonstration in lab, written assessment, and semester-long projectCriteriaAnswer business questions using known tools and techniques that attach to gold-layer, curated dataDescribe how a data product supports downstream workflows under different types of analytic scenariosCommunicate technical designs and decisions in clear language to nontechnical stakeholders