25 Mar
Lead data Engineer
Vacancy expired!
- Lead a team of engineers through architecture, design, demand delivery, code reviews, release management, implementation, presentations, and meetings.
- Mentor fellow data engineers and contribute to ongoing process improvements for the team.
- Evaluate business needs and objectives and align architecture/designs with business requirements
- Build the data pipelines required for the optimal extraction, transformation, integration, and loading of raw data from a wide variety of data sources
- Assemble large, complex data sets and model our data in a way that meets functional / non-functional business requirements
- Create data tools for analytics team members that assist them in generating innovative industry insights that provide our business a competitive advantage
- Implement data tagging mechanisms and metadata management so data is accurately classified and visible to the organization
- Build processes to help identify and improve data quality, consistency, and effectiveness
- Ensure our data is managed in a way that conforms to all information privacy and protection policies
- Use agile software development processes to iteratively make improvements to our data management systems
- Identify opportunities for automation
- Be an advocate for best practices and continued learning.
- Bachelor's/Tech School degree in Computer Science, MIS, or Engineering or relevant technical field and/or commensurate years of real-world experience in software engineering.
- 7+ years of relevant experience in data management
- 5+ years in data engineering with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT
- 3+ years of experience with Cloud based DW such as Redshift, Snowflake, etc.
- Technical expertise with data models, data mining, and segmentation techniques
- Experience in data acquisition, transformation, and storage design using design principles, patterns, and best practices
- Experience with performance analysis and optimization
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
- Experience with data pipeline and workflow management tools
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift, Modern data platforms, Snowflake, dbt, Fivetran, and Airflow.Experience with stream-processing systems: Kafka, Storm, Spark-Streaming, etc. Data engineering certification is a plus.
Vacancy expired!