Data Engineering

RESPONSIBILITIES:Kforce is working with fast growing adtech firm located in New York, NY and we are seeking a Data Engineer. We create best of breed consumer search technology using cutting-edge architectures with millisecond response time and crunch through terabytes of data every day. The ideal candidate is motivated to design for massive scale, developing for low latency and pushing the boundaries of using real-time data in automated decisions. Our team uses a modern tech stack including Kafka, Spark, Scala, Akka, Java8+, NoSQL, Kubernetes, Docker, AWS, Azkaban, and Airflow.Responsibilities: Hands-on development and maintenance of ad-tech related data systems and system components using Java and other software technologies Data streaming, processing, and aggregation solutions Data-driven applications 24/7 low latency large-scale distributed systems Cloud migration and containerization projects Clients integration automation components (Google, Amazon, LiveRamp) Data Engineer will work with team for technical implementation of Data Engineering projects, including data streaming and aggregation pipelines Work closely with QA, DevOps, and other engineering teams to integrate, test, and release different system components (all stages of SDLC) As a Data Engineer, you will solve complex technical challenges related to low latency large scale distributed systems Work closely with business stakeholders and other engineers on understanding and translating business requirements into technical solutionsREQUIREMENTS: BS in Engineering, Computer Science, or related discipline Must have 3+ years strong hands-on development experience using Java (Java 8+ preferred) Experience with big data and streaming technologies like Apache Kafka, Apache Spark, Confluent Platform, Apache Storm, Hadoop, and Zookeeper Experience developing, delivering, and maintaining scalable data streaming and aggregation pipelines Experience with relational SQL and NoSQL databases Ability to collaborate with multiple teams and understanding testing, hardware, and deployment methodologies Good understanding of object-oriented design patterns and effective use of data structures Familiarity and hands-on experience with profiling, code efficiency, and testing/release concepts Experience working in a Linux environment Experience building software in continuous integration and delivery fashion in an automated way Excellent documentation, communication, and troubleshooting skillsIs a plus: Experience with data pipeline and workflow management tools like Airflow, Luigi, Azkaban Experience with AWS, RabbitMQ, MySQL, Vertica, and Aerospike Experience with Spring or another dependency injection framework Familiarity with Docker, CI/CD and Microservices Scala and/or Python development experience Experience working in an agile software development team using Jira Digital advertising industry experienceKforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.