03 Nov
Cloud Data Engineer
Vacancy expired!
- Provide technical and/or business application consultation to business partners and team members in the areas of functionality, architecture, operating systems and databases for complex application systems.
- Develop data platform components in a cloud and on-premises environments to ingest data and events from cloud and on-premises environments as well as third parties.
- Build automated pipelines and data services to validate, catalog, aggregate and transform ingested data.
- Build automated data delivery pipelines and services to integrate data from the data lake to internal and external consuming applications and services.
- Build and deliver deployment and monitoring capabilities consistent with DevOps models.
- Works with architects in transforming high level architecture designs and assists in technical delivery of large scale enterprise projects to implement optimized end-to-end solutions.
- Bachelor's degree in Computer Science or equivalent education and experience
- 3+ years experience in programming/systems analysis.
- 2+ years of hands-on experience with big data and data-at-scale platform services
- 2+ years experience utilizing Python for big data processing
- 1+ years experience developing cloud-native applications and deploying to a cloud environment (i.e. AWS, Google Cloud Platform, Azure, etc.)
- API Development (proper microservice separation, HTTP verb usage
- Experience in infrastructure automation on AWS with Terraform or similar approaches
- Experience working with bash scripting and the AWS CLI in Linux-based systems
- Experience working with data in various compression formats (including Parquet, ORC) and serialization (AVRO)
- Solid knowledge of the following technologies: HTTP, SSL/TLS, REST, SQL, and JSON
- Hands-on expertise with multiple database technologies (Postgres, Mongo, Elastic Search, etc.) as well as SQL and related query languages
- Knowledge of Continuous Integration environment such as Jenkins, CruiseControl, Continuum, Travis, etc.
- Knowledge of Test Driven Development processes and tooling such as JUnit, Mocha, Jasmine, or Protractor
- Experience with or understanding of container services including Docker and Kubernetes
Vacancy expired!