02 Nov
Cloud Data Engineer
Vacancy expired!
Signature Consultants - Cloud Data Engineer
Cloud Data Engineer Summary:Signature Consultants is seeking a Cloud Data Engineer for an opportunity with a client in Chesterfield, MO. The Cloud Data Engineer works as a key member of our Enterprise Data Fabric team that leverages data as a service for acquiring, securing, cataloging, processing, and analyzing of internal and external data sets. This role will have the opportunity to shape the product strategy, vision and portfolio of our Data Fabric platform. Responsibilities:
- Provide technical and/or business application consultation to business partners and team members in the areas of functionality, architecture, operating systems and databases for complex application systems.
- Develop data platform components in a cloud and on-premises environments to ingest data and events from cloud and on-premises environments as well as third parties.
- Build automated pipelines and data services to validate, catalog, aggregate and transform ingested data.
- Build automated data delivery pipelines and services to integrate data from the data lake to internal and external consuming applications and services.
- Build and deliver deployment and monitoring capabilities consistent with DevOps models.
- Works with architects in transforming high level architecture designs and assists in technical delivery of large scale enterprise projects to implement optimized end-to-end solutions.
- Bachelor's degree in Computer Science or equivalent education and experience
- 3+ years experience in programming/systems analysis.
- 2+ years of hands-on experience with big data and data-at-scale platform services
- 2+ years experience utilizing Python for big data processing
- 1+ years experience developing cloud-native applications and deploying to a cloud environment (i.e. AWS, Google Cloud Platform, Azure, etc.)
- API Development (proper microservice separation, HTTP verb usage
- Experience in infrastructure automation on AWS with Terraform or similar approaches
- Experience working with bash scripting and the AWS CLI in Linux-based systems
- Experience working with data in various compression formats (including Parquet, ORC) and serialization (AVRO)
- Solid knowledge of the following technologies: HTTP, SSL/TLS, REST, SQL, and JSON
- Hands-on expertise with multiple database technologies (Postgres, Mongo, Elastic Search, etc.) as well as SQL and related query languages
- Knowledge of Continuous Integration environment such as Jenkins, CruiseControl, Continuum, Travis, etc.
- Knowledge of Test Driven Development processes and tooling such as JUnit, Mocha, Jasmine, or Protractor
- Experience with or understanding of container services including Docker and Kubernetes
Vacancy expired!