01 Dec
Data Engineer
Vacancy expired!
- The Data Engineer will be responsible for writing SQL, Python and PySpark scripts to be used in API calls to pull data from multiple disparate systems and databases.
- The source data may include Analytic System data (Google Analytics, Adobe Analytics), 3rd party systems, CSV files, CSS Feeds, etc.
- This individual would also assist with cleaning up the data so it's in readily accessible format for the BI systems.
- The Senior Data Engineer will contribute expertise, embrace emerging trends and provide overall guidance on best practices across all of Customer business and technology groups.
- The position will require the ability to multitask and work independently, as well as work collaboratively with teams, some of which may be geographically distributed.
- Required Experience Building ETL data pipelines using SQL, Python for API calls to get data.
- Expertise in Google Biq Query, PySpark, SQL and relational databases (PostgreSQL, MySQL). Scripting experience with Shell Python.
- Experience working with Atlassian products such as Jira and Confluence Experience in managing code within the SDLC methodology
- A firm understanding of code source control concepts in particular using GIT repository Proven ability to write both customer facing and technical documentation
- Experience in AWS
Vacancy expired!