Principal Engineer - Data Platform

No detailed description available.

• Architect and lead development of a reusable, scalable data platform framework
• Design robust ETL/ELT pipelines for structured and semi-structured healthcare data
• Build APIs and internal tools using Django, focused on performance and maintainability
• Use Prefect for orchestration, and Ray or Spark for distributed compute
• Leverage Databricks for testing and validation of data pipelines (not for primary compute)
• Enforce data quality, observability, and reliability using Metaplane or similar tools
• Integrate and manage data across Postgres, Snowflake, and Snowflake Shares
• Optimize for scalability and performance in a cloud-native Azure environment
• Mentor engineers and collaborate with product, data, and platform teams

• 15+ years of experience in data engineering, platform architecture, or backend systems
• Proven experience designing and building modular data infrastructure
• Hands-on expertise with ETL frameworks, orchestration tools (Prefect), and distributed compute (Ray/Spark)
• Strong experience in Django-based API development
• Deep understanding of data modeling, warehousing, and pipeline reliability
• Experience with Azure cloud services and managing large datasets across Snowflake and Postgres
• Familiarity with data observability and monitoring tools (e.g., Metaplane)

• Medical, Dental, and Vision
• Health Spending Accounts
• Flexible Spending Accounts
• 401(k) (U.S.)
• Pension (Canada)
• Employee Stock Purchase Plan
• Mental Health Programs
• Flexible Schedules
• Paid Time Off
• Wellness Program
• Education Reimbursement
• Volunteer Opportunities
• Flexible Work Environment

At Compile (a McKesson company), we’re transforming fragmented healthcare data into powerful intelligence that drives real-world impact — from mapping patient journeys to optimizing go-to-market strategies for life sciences.