Data Engineer or Python Developer

Job Title:

• Design, development, and testing of data ingestion pipelines, perform end to end automation of ETL process and migration of various datasets that are being ingested
• Participate in discussion for technical architecture, Migration activities, collaborate with Product Managers and Architects to establish the Physical application framework
• Develop transformation logic, interfaces and reports as need to meet project requirements.

• 10+ years of experience building and managing complex products / solutions
• 5+ years of experience supporting data heavy applications and databases leveraging Python and Pyspark
• Strong data handling and text log analysis skills
• Expert level experience in Python, Pyspark and SQL
• Good to have Scala, distributed computing, Kafka and REST based API skills