30 Sep
Lead Data Engineer
Vacancy expired!
- Data Flow Processes
- SQL Development
- ETL, Informatica
- Python, Pyspark
- Azure, Data Bricks, ADF
- Design and develop ETL processes based on functional and non-functional requirements in python / pyspark within Azure platform
- Understand the full end to end development activities from design to go live for ETL development and Azure platform
- Recommend and execute improvements
- Document component design for developers and for broader communication.
- Understand and adopt an Agile (SCRUM like) software development mindset
- Follow established processes/standards, business technology architecture for development, release management and deployment process
- Execute and provide support during testing cycles and post-production deployment, engage in peer code reviews.
- Elicit, analyze, interpret business and data requirements to develop complete business solutions, includes data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life cycle management, governance, lineage, metadata and reporting elements.
- Apply automation and innovation on new and on-going data platforms for those development projects aligned to business or organizational strategies.
- Design, develop and implement reporting platforms (e.g. modeling, ETL, BI framework) and complex ETL frameworks that meet business requirements.
- Deliver business or enterprise data deliverables (that adhere to enterprise frameworks) for various platforms/servers/applications/systems.
- Implement processes aligned to data management standards, ensure data quality and requirements are embedded in/adhered to within system development deliverables.
- Develop, maintain knowledge of data available from upstream sources and data within various platforms.
Vacancy expired!