18 Nov
Senior Data Engineer- 100% Remote
Vacancy expired!
- You will be hands on designing and developing streaming and IoT data pipelines
- Utilize Kubernetes and Prometheus by monitoring pipelines
- Deploying and maintaining jobs in CI/CD tools
- Scripting in Python
- Designing and implementing Apache Airflow
- Data modeling and warehousing
- Scripting with data frame and Apache Spark
- Bachelors or Masters in Software Engineering or Computer Science
- 6+ years of experience in BI and Data Engineering
- Development knowledge
- Data process/ streaming knowledge
- System design and architecture experience
- Experience with
- Scala, spark, Kafka, golang
- Steaming via Spark
- Karfka for streaming pipelines
- Presto, Airflow, influx
- Pyspark
Vacancy expired!