Principal Data Platform Architect
Microsoft
About the role
As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad β to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. Itβs also inclusive: we aim to make AI accessible to all β consumers, businesses, developers β so that everyone can realize its benefits.
Responsibilities
- Thought leader and owner of the architecture blueprint of data platform
- Superior coding skills in SPARK using Scala, Python and Java
- Work collaboratively with other Platform, infrastructure, application engineers as well as AI Researchers to build next generation data platform services and capabilities
- Ship high-quality, well-tested, secure, and maintainable code
- Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively
- Enjoy working in a fast-paced, design-driven, product development cycle
- Embody our Culture and Values
Requirements
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years' experience in software development, data modeling or data engineering work
- Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years' experience in software development, or data engineering work
- 5+ years of hands-on experience in building from ground up large-scale data processing platforms with more than 100 data pipelines
- 5+ years of experience building data pipelines using Scala, Python (PySpark), and SQL, with deep understanding of big data technologies including Apache Hadoop ecosystem, Spark, Kafka Stream/Flink, columnar and vector databases, semantic search, RDBMS, and key-value stores
- 5+ years of experience designing and deploying scalable services on public cloud platforms such as Azure, AWS, and GCP
- 2+ years of hands-on experience architecting distributed systems at scale, with comprehensive systems knowledge spanning bare-metal infrastructure, containerization, and networking
Benefits
- Health insurance
- 401k matching
- Flight privileges
- Discounts on products and services
- Educational resources
- Generous time away
- Giving programs
- Opportunities to network and connect
About the Company
Microsoft is committed to empowering every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day, we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Job Details
Salary Range
$163,000 - $296,400/yearly
Location
New York, United States, United States of America
Employment Type
Full-Time
Original Posting
View on company website