07 Mar
Data Engineer
Vacancy expired!
Data EngineerCharlotte, NC (post pandemic – remote till then)1 year contract Must Haves: Databricks, Spark and ETL Requirements:
- 70% Data Platform Engineer and 30% Data Optimizatiion
- Senior level experience with Databricks
- Hands on experience with Azure data platform stack
- Experience with Spark designing and building end-to-end data pipelines
- Experience working with Azure Delta Tables and Parquets
- Understand ETL datawarehouse concepts and partitions
- Experience with Data Ingestion
- Ability to build pipelines to process structured and semi-structured data.
- Understand principles of data optimization
- Understand the basic data engineering aspects and relational modeling
- Apache Airflow
- Azure Data Factory (ADF)
Vacancy expired!