01 Dec
California,
Sanfrancisco
, 94086
Sanfrancisco
USA
Vacancy expired!
We are looking for a strong Sr Data Engineer with our direct clients in San Francisco Bay Area, CA. The position is long term and remote until the offices are open.The primary skills we’re looking for are:
Solid python and SQL development experience – including code craftsmanship, robust unit and integration testing, Git driven CI/CD to productionProven experience developing streaming data processing tasks using pySpark and SparkSQL:Solid understanding of Spark, preferably Databricks Spark and Apache DeltaRead streaming data from Kafka, Apache Delta or similar, merge /enrich /qualify data inline, capture operations metrics, persist to target, debug and optimizeAt meaningful scale and in productionExperience leveraging public cloud data and analytics services. Azure preferred, but AWS/Google Cloud Platform also works.Client is not particularly looking for traditional data warehouse, database or Hadoop experience. The context is a plus, but tertiary.
Vacancy expired!
