16 Aug
Senior Spark Engineer
Colorado, Ohiocity , 81237 Ohiocity USA

Vacancy expired!

Senior Spark EngineerClient is in Ohio but position can be remote.Contract 12 monthsSenior Spark Engineer to create the first POC around their planned use for Spark. Strong experience doing setup and configuration. Strong ability to setup the Spark cluster, establish best practices and work through lead level functions to get it set up correctly for function, integration and performance. So on the technical side, ideally:

  • Spark cluster configuration and performance
  • Presto configuration and performance
  • pySpark and Spark based ML and Python notebooks
  • Kubernetes
  • Kafka/Pulsar familiarity helpful
  • Devops automation Python, ansible, terraform etc.
  • Oracle database performance + S3/Spark/Presto integration
  • Some knowledge of Hadoop infrastructure
  • Able to write shell script / python glue as needed
  • Expertise with log aggregation, management and processing at scale

Vacancy expired!


Report job