02 Nov
Senior Data Engineer- 100% Remote
California, Sanfrancisco , 94103 Sanfrancisco USA

SENIOR DATA ENGINEER - SILICON VALLEY - FULL-TIME THE COMPANYA fast-growing automotive company is looking for a Senior Data Engineer who is looking for a challenge to make an impact not only in the company but all throughout the automotive industry. THE ROLERESPONSIBILITIES WILL INCLUDE:
  • You will be hands on designing and developing streaming and IoT data pipelines
  • Utilize Kubernetes and Prometheus by monitoring pipelines
  • Deploying and maintaining jobs in CI/CD tools
  • Scripting in Python
  • Designing and implementing Apache Airflow
  • Data modeling and warehousing
  • Scripting with data frame and Apache Spark
YOUTO BE A GOOD FIT FOR THIS ROLE YOU SHOULD HAVE THE FOLLOWING EXPERIENCE:
  • Bachelors or Masters in Software Engineering or Computer Science
  • 6+ years of experience in BI and Data Engineering
  • Development knowledge
  • Data process/ streaming knowledge
  • System design and architecture experience
  • Experience with
    • Scala, spark, Kafka, golang
    • Steaming via Spark
    • Karfka for streaming pipelines
    • Presto, Airflow, influx
    • Pyspark

U.S. CITIZEN IS A MUST, NO SPONSORSHIP AVAILABLE


Related jobs

Report job