12 Jun
Senior Java/Hadoop Developer (10+ yrs and financial a must)
Vacancy expired!
- 500 & 5000 Honoree Company for 2012, 2013, 2014, 2015, 2016 and 2017
- Atyeti Ranks No. 270 on the 2012 Inc. 500 List
- 2012, 2016 and 2017 NJ 50 Fastest Growing Companies
- You’ll work on a high impact and high visibility project that enables data availability, encompasses data analytics, machine learning, and petabyte scale datasets, and provides reliable and timely access to thousands of data sources.
- Design, architect and support new and existing data and ETL pipelines and recommend improvements and modifications.
- Create optimal data pipeline architecture and systems using Apache Airflow
- Assemble large, complex data sets that meet functional and non-functional business requirements.
- Be responsible for ingesting data into our data lake and providing frameworks and services for operating on that data including the use of Spark & Databricks.
- Analyze, debug and correct issues with data pipelines
- Operate on or build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Spark and Azure technologies.
- You have 8+ years of experience building high performance scalable enterprise analytics or data centric solutions
- You have at least 5 years of experience implementing complex ETL pipelines preferably in connection with Hadoop or Spark
- Experience working with Spark data pipeline and or streaming experience
- You have exceptional coding and design skills in Java/Scala.
- You understand the nature of distributed systems design.
- You have knowledge on Azure.
- You have a BS in Computer Science / Software Engineering or equivalent experience.
- You have a strong understanding & usage of algorithms and data structures.
- You work well in a team environment, and are a self-starter.
- You have the ability to lead, or have led teams before.
- Expertise building and managing python libraries
- Azure Data Lake experience
- Machine Learning expertise
- Experience with Apache Airflow
- Experience with C# .NET Core
- Experience with traditional data marts/warehouses
Vacancy expired!