Engineer 2, Enterprise BI & AI / ML Engineering-8060

DUTIES: Contribute to a team responsible for creating tables using SQL within Teradata database; perform object-oriented software development using Python; process big data with Apache Spark; schedule data load jobs using Airflow; perform big data Extract, Transform, and Load (ETL) using Databricks and Kubernetes; store data within cloud platforms, including AWS S3, and on-premise platforms, including MinIO; execute data integration and consolidation projects; contribute to low-level design and test planning; develop and perform unit testing on integration modules; develop large, scalable, and repeatable ETL pipelines to ingest data from various source systems; analyze, profile, and understand the source data and proactively generate suggestions to improve the design or handling of data and technical challenges during project execution; and identify and recommend framework changes to increase performance and scalability.

• Contribute to a team responsible for creating tables using SQL within Teradata database
• Perform object-oriented software development using Python
• Process big data with Apache Spark
• Schedule data load jobs using Airflow
• Perform big data Extract, Transform, and Load (ETL) using Databricks and Kubernetes
• Store data within cloud platforms, including AWS S3, and on-premise platforms, including MinIO
• Execute data integration and consolidation projects
• Contribute to low-level design and test planning
• Develop and perform unit testing on integration modules
• Develop large, scalable, and repeatable ETL pipelines to ingest data from various source systems
• Analyze, profile, and understand the source data and proactively generate suggestions to improve the design or handling of data and technical challenges during project execution
• Identify and recommend framework changes to increase performance and scalability

• Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field
• One (1) year of experience creating tables using SQL or a relational database
• Performing object-oriented software development using Python
• Processing big data with Apache Spark
• Scheduling data load jobs using Airflow
• Performing big data Extract, Transform, and Load (ETL) using Databricks and Kubernetes
• Storing data within cloud platforms, including AWS S3, and on-premise platforms, including MinIO

• Paid Time off
• Physical Wellbeing
• Financial Wellbeing
• Emotional Wellbeing
• Life Events + Family Support

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences.