Senior Data Engineer
Vacancy expired!
Applicants must be currently authorized to work in the United States on a full-time basis now and in the future. Are you seeking a new opportunity? My client is protecting today's critical infrastructure, while giving form to tomorrow's: refineries, power plants, heavy manufacturing facilities, vessels, water storage, and many more. They do this through robotics platforms in tandem with their enterprise software solutions, creating a virtuous cycle of data acquisition, processing, analysis, and decision-making. They are looking to hire an engineer to help design and build out their high-scale, cloud-based data platform and pipelines. These mission-critical pipelines are used to perform analysis, aggregation, and transformation of inspection data collected by robots. As an senior data engineer on the team, you will be working with the mission-critical pipelines and will need to have familiarity with container-based technology (e.g., Docker, K8s), pipeline frameworks (e.g., Airflow, Luigi), and experience working with distributed systems. Future work for the team includes ML Engineering to build out a platform and tooling to support the ML model training and deployment. The tech stack for this role is Python and APIs. The ideal candidate for the role is open to new ideas and technologies as well as has solid communication and collaboration skills!
Required Skills and Experience:- Bachelor's degree in Computer Science/Engineering or closely related field (or equivalent experience)
- Familiarity with Python and APIs
- You have excellent communication skills
- You are self-motivated and love of self-directed learning
- You have the ability to work both independently and with cross-functional teams
- You have the desire to have a high impact at a fast-moving startup as a key contributor on a small team
- Proficiency with Python
- Prior experience with container-based development and Docker
- Previous experience building/orchestrating data pipelines with Airflow
- Previous experience with one or more cloud platforms (Google Cloud Platform, AWS, Azure, etc.)
- Previous experience with building fault-tolerant distributed systems
Vacancy expired!