17 Apr
Big Data Engineer
California, Costamesa , 92626 Costamesa USA

Vacancy expired!

Title: Big Data Engineer

Location

:

Costa Mesa, CA

Duration: 6 months

Description:·Big Data: Hadoop / Spark (preferably with Scala; PySpark okay). Looking for Engineers with hands on experience. ·Knowledge and experience with Kafka Streaming, Containerized Micro Services ·Knowledge and experience with RDBMS (Aurora MySQL) and No-SQL (Cassandra) ·Experience in building Data-pipeline & Data-lakes · Experience in API development ·Experience or Knowledge with Data-formats like Parquet, CSV, etc. ·Knowledge of Hadoop/Spark and various data formats like Parquet, CSV, etc. ·Data-storage architectures like HDFS, HBase, S3 and/or Hive. · AWS-certified Architect and/or Developer Role ·AWS Cloud experience – S3, EFS, MSK, ECS, EMR, etc. ·Data-transformations concepts including Partitioning, Shuffling, ·Data-processing constructs like Joins, Map Reduce ·Exposure to working with cloud infra like AWS, Azure ·Experienced Java Programmer. ·Great attention to detail ·Organizational skills ·An analytical mind

Must Have’s · Hands-on Programing/coding skills in one language preferably in C/C, JAVA, SCALA, or PYTHON · Strong Hands-on experience in BigData – Hadoop/Spark · Design, develop and implement the Kafka ecosystem by creating a framework for leveraging technologies such as Kafka Connect, KStreams/KSQL, Attunity, Schema Registry, and other streaming-oriented technology · Assist in building out the DevOps strategy for hosting and managing our SDP microservice and connector infrastructure in AWS cloud · Knowledge of Hadoop/Spark and various data formats like Parquet, CSV, etc. · Strong track record of design/implementing big data technologies around Apache Hadoop, Kafka streaming, No SQL, Java/J2EE and distributed computing platforms in large enterprises where scale and complexity have been tackled.

Vacancy expired!


Report job