17 Apr
Data Engineer
Vacancy expired!
- Design and develop the data platform to efficiently and cost effectively address various data needs across the business.
- Build software across a cutting-edge data platform, including event driven data processing, storage, and serving through scalable and highly available APIs
- Perform exploratory and quantitative analytics, data mining, and discovery.
- Think of ways to help make the data platform more scalable, resilient and reliable and then work across our team to put your ideas into action.
- Ensure a high-performance platform by implementing and refining robust data processing, REST services, RPC (in an out of HTTP), and caching technologies.
- Work closely with data analysts and business stakeholders to make data easily accessible and understandable to them.
- Ensure data quality by implementing re-usable data quality frameworks.
- Work closely with various other data engineering teams to roll out new capabilities.
- Develop and enforce data engineering, security, data quality standards through automation.
- Bachelor's degree in computer science or similar discipline.
- 5+ years of experience in software engineering, 2+ years of experience in data engineering.
- Expertise in at least few programming languages - Java, Scala, Python or similar.
- Expertise in building and managing large volume data processing (both streaming and batch) platform.
- Expertise in building micro services and managing containerized deployments, preferably using Kubernetes
- Expertise in SQL, Spark SQL, Hive.
- Expertise in OLAP databases such as Snowflake or Redshift.
- No-SQL (Apache Cassandra, DynamoDB or similar) is a plus
- Experience in operationalizing and scaling machine models is a plus.
- Experience with variety of data Tools & frameworks (example: Apache Airflow, Druid) will be a plus.
- Experience with Analytics Tools such as Looker, Tableau is preferred.
- Cloud (AWS) experience is preferred
- Ability to work in a fast paced, agile environment.
- Ability and willingness to learn any new technologies and apply them at work in order to stay ahead of the curve.
- Strong interpersonal, communication and presentation skills.
Vacancy expired!