Dataproc Lead, Spark, OSS Technologies, Google Cloud

Build high-impact customer-facing features which make Cloud Dataproc the best place to run Spark, Ray, Trino, Flink and newer technologies in the cloud.

• Build high-impact customer-facing features which make Cloud Dataproc the best place to run Spark, Ray, Trino, Flink and newer technologies in the cloud.
• Define the roadmap for Open Source technologies like Spark, Ray, Trino, Flink, etc.
• Define and implement the next generation Data Lakes and Lake Houses focusing on technologies like Iceberg, Hudi and Delta.
• Optimize the open source technologies for performance and efficiency.
• Design and build software stack to take advantage of Google technologies for faster cluster setup, efficient cluster operations, comprehensive monitoring and observability.

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.
• Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with distributed computing systems, including Apache Spark, Apache Hadoop, and Apache Hive.
• Experience in Open Source technologies, Big Data, Data Analytics, Artificial Intelligence, Machine Learning, and Database Internals.

• Performance-based bonuses
• Stock options
• Professional development opportunities
• Flexible work arrangements

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another.