Data Engineer I

s and those authorized to work in the U.S. can be considered as W2 candidates. Title: Data Engineer IStart: 08/16/2021End: 12/31/2021Location: Cupertino, CAJob DescriptionData EngineerWe are looking for a data engineer to support our efforts to rapidly develop data pipelines to transform large datasets into aggregated tables of metrics according to business logic. These metrics will then be stored in a database, structured to support rapid querying by a front-end web app that uses this data to display dashboards for internal stakeholders.They'll be working on:• Orchestrating data pipelines• Optimizing PySpark/Spark SQL jobs• Architecting database infrastructureRequirements:• Expertise in Spark, Hive/Spark SQL, and Python• Experience building data pipelines with Airflow or similar tool• Experience with database designMust haveExpertise in Spark, Hive/Spark SQL, and Python- is a MUSTNice to haveExperience building data pipelines with Airflow or similar toolExperience with database design