Dataproc Lead, Spark, OSS Technologies, Google Cloud

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another.

• Build high-impact customer-facing features which make Cloud Dataproc the best place to run Spark, Ray, Trino, Flink and newer technologies in the cloud.
• Define the roadmap for Open Source technologies like Spark, Ray, Trino, Flink, etc.
• Define and implement the next generation Data Lakes and Lake Houses focusing on technologies like Iceberg, Hudi and Delta.
• Optimize the open source technologies for performance and efficiency.
• Design and build software stack to take advantage of Google technologies for faster cluster setup, efficient cluster operations, comprehensive monitoring and observability.

• Bachelor’s degree or equivalent practical experience.
• Experience with software development in one or more programming languages, and with data structures/algorithms.
• Experience in software development and engineering, incorporating design methodologies, leveraging open source technologies, and working with distributed computing systems, including Apache Spark, Apache Hadoop, and Apache Hive.
• Experience in Open Source technologies, Big Data, Data Analytics, Artificial Intelligence, Machine Learning, and Database Internals.

Benefits information not provided in this listing.

Google Cloud accelerates every organization’s ability to digitally transform its business and industry.