26 Sep
Data Engineer
Vacancy expired!
Data Engineer - Spark Duties:Senior Advisor with Spark/Cluster computing focusDescription:
- Data and Analytics Engineering at our client is looking for a strong Backend Software Engineer with expertise in cluster computing, SQL, and AWS who can solve complex problems, engineer robust, modular and scalable solutions that enable delivering business capabilities that support our client's strategic goals. It is a great opportunity for someone who wants to be challenged, drive change, and deliver value that is tangible. You will work on a scrum team on initiatives that support our client's strategic goals and will deliver user-oriented products in a fast-paced and agile environment. You will get to build state-of-the-art technology that is scalable and robust, utilizing cloud infrastructure, and full automation.
- Develop spark based solutions that are scalable, robust, low latency and thoughtfully designed.
- Design systems for high-performance and high-availability.
- Take accountability and full ownership of the work and hands-on with all layers of the backend stack, that includes Database, API, AWS deployment and testing.
- Desire to simplify, take risks and champion new ideas.
- Collaborate with other software engineers, domain experts, and end-users, to build the right solutions that address business needs.
- Know how to make engineering trade-offs and how to communicate them to others.
- Prioritize many competing tasks on an aggressive timeline.
- Passion to learn about healthcare and technology.
- 6+ years' experience
- Advanced cluster computing frameworks like Spark, EMR etc.
- Advanced experience developing RESTful Web Services
- Strong SQL Skills including PostgreSQL, MySQL, NoSQL etc.,
- Cloud infrastructure experience (AWS Lambda, AWS API Gateway etc.,)
- Experience in architecting large-scale systems and dealing with very large volumes of data
- Comfortable working in an Agile Development process
- Familiarity with Git, Linux, Shell Scripting
- Write clean, modular, and self-documenting code
- Excellent troubleshooting skills
- Bachelor's or Master's Degree in Engineering or Computer Science
Vacancy expired!