We’re building Ocean for Apache Spark, a cloud-native platform that lets data engineers easily build, deploy, and maintain large-scale Apache Spark data pipelines on top of Kubernetes on all major cloud providers.
Ocean for Apache Spark builds upon the strengths and is integrated with NetApp/Spot Ocean to manage Kubernetes clusters. You will join a mid-sized team of experienced engineers combining Spark and Kubernetes expertise.
Job Requirements
Build and maintain a Spark platform deployed on Kubernetes. Features include auto scaling optimizations, automated tuning of Spark configurations, real-time monitoring, and log analysis.
Education
– At least 8 years’ experience contributing to a software engineering team.
– At least 3 years experience with Kubernetes and containers.
– Experience with modern development processes, practices and tools.
– Programming experience in at least two of: Python, Java, Go, NodeJS.
– If you are a strong coder in another language then we are open to that also.
– Built cloud computing applications running on AWS, GCP, or Azure
– Experience with Apache Spark or other big data technologies is a strong bonus
BS/MS/PhD in CS, scientific field or equivalent experience.
IC – Typically requires a minimum of 8 years of related experience.Mgr & Exec – Typically requires a minimum of 6 years of related experience.
Source ⇲
