02 Nov
Senior Data Engineer- 100% Remote
SENIOR DATA ENGINEER - SILICON VALLEY - FULL-TIME THE COMPANYA fast-growing automotive company is looking for a Senior Data Engineer who is looking for a challenge to make an impact not only in the company but all throughout the automotive industry. THE ROLERESPONSIBILITIES WILL INCLUDE:- You will be hands on designing and developing streaming and IoT data pipelines
- Utilize Kubernetes and Prometheus by monitoring pipelines
- Deploying and maintaining jobs in CI/CD tools
- Scripting in Python
- Designing and implementing Apache Airflow
- Data modeling and warehousing
- Scripting with data frame and Apache Spark
- Bachelors or Masters in Software Engineering or Computer Science
- 6+ years of experience in BI and Data Engineering
- Development knowledge
- Data process/ streaming knowledge
- System design and architecture experience
- Experience with
- Scala, spark, Kafka, golang
- Steaming via Spark
- Karfka for streaming pipelines
- Presto, Airflow, influx
- Pyspark