Data Engineer I

Remote is ok Must have Expertise in Spark, Hive/Spark SQL, and Python- is a MUST Nice to have Experience building data pipelines with Airflow or similar tool Experience with database designJob Description Data Engineer We are looking for a data engineer to support our efforts to rapidly develop data pipelines to transform large datasets into aggregated tables of metrics according to business logic. These metrics will then be stored in a database, structured to support rapid querying by a front-end web app that uses this data to display dashboards for internal stakeholders. They'll be working on: • Orchestrating data pipelines • Optimizing PySpark/Spark SQL jobs • Architecting database infrastructure Requirements: • Expertise in Spark, Hive/Spark SQL, and Python • Experience building data pipelines with Airflow or similar tool • Experience with database design