Direct Client Senior Data Engineer

Data EngineerPleasanton CALong term contract10+ yrs of Data Engineer to work on an agile team developing and maintaining an analytics platform using Python. Work closely with other data and software engineers to build and maintain data pipelines using pure Python and/or Glue/Airflow. Must have considerable experience writing production-ready code in Python. Self-starter able to make progress without much direction. Key Responsibilities

• Develop and maintain scalable data pipelines
• Develop and maintain RESTful JSON apis (FastAPI)
• Consume RESTful apis
• Understand and maintain data schemas and architectures
• Understand and architect ETL processes
• Deploy data science models as microservices
• Synthesize requirements from non-technical stakeholders
• Work closely with data governance and technology practice areas
• Work on agile teams (Scrum/Kanban)

• Python (FastAPI, Pandas preferred)
• Git/Github (branches, code reviews, pull requests)
• RDBMS/NoSQL (MySQL preferred)
• Docker
• PySpark
• Scala
• Airflow
• Plotly/Dash experience preferred
• AWS experience preferred (lambda/glue/s3)