14 Jun
AWS Data Engineer Lead
Vacancy expired!
Hi,
Job Title : AWS Data Lead Job Location - Santa Clara, CAJob Type – Fulltime Job Description:We are looking for an experienced Data Engineering Lead to help manage existing data resources, implement, and enhance new technologies and tooling to further enable data science and analytics.In this role you will split your time between hands on data operation support, development, and project/team lead activities. You will own data environments, integrate with new technologies, and oversee the development of new processes. You will be responsible for following tasks as part of your day to day operations.- Lead the team of data engineers through design, development, operation, and deployment of new functionality,
- Partner closely with onsite leads, customers, and stakeholders to deliver and define the priorities.
- Provide regular updates to the clients and highlight roadblocks proactively.
- Set appropriate project backlogs and manage ongoing changes.
- Work independently on the decided tasks and take the direct responsibility of data operations and support in rotation.
- Participate in regular Agile practices like scrum and retrospection etc.
- Create value by meeting the needs of stakeholders and delivering high-quality results!
- Open and flexible to accommodate and implement new ideas, understand business complexities, nurture innovation and challenge the status quo persistently.
- Demonstrate strong communication skills (both written and verbal) and a positive, solution-oriented attitude.
- In depth knowledge on AWS,
- especially data storage & processing technology stack like Athena, Glue, S3, EMR, Lambda, Cloud front, Cloud Formation, Kinesis, Data Pipeline Services, AWS Batch Services, Dynamo DB, etc.
- In depth understanding of data ingestion, processing, and delivery.
- Expert in writing SQL and Python and understanding of shell scripting.
- Experience on building an enterprise data lake and maintaining data quality through error free and tested ETL/ELTs.
- Experience building data lakes/data warehouses, Knowledge of tools like Apache Airflow.
- Understanding of CI/CD tools, data governance and Agile project management skills
- Clear, professional written and verbal communication skills, ability to easily communicate complex ideas
- Experience working in an onsite-offshore model.
- Knowledge on Big data
- Experience in Spark and real-time processing.
- Any AWS certification related to Data.
- Having AWS Big data specialty or AWS data analytics certification would be a big advantage.
- Experience in the real estate domain.
- Bachelor or master’s in software engineering and Computer Science
- 12+ years of experience in design, development and support of large-scale data platforms
- 4+ years of project and Team lead experience
- Experience working in an onsite-offshore model.
Vacancy expired!