03 Jul
ETL/PySpark
New York, New york city , 10075 New york city USA

Job Description: Key responsibilities

  • Preparing HLD and LLD document with ETL methodology transformation rules for data pipelines.
  • Extensive experience on Spark, PySpark and Hive SQL Scripts.
  • Knowledge on Sqoop and Impala
  • Involves in build and unit test of data pipeline ETL's.
  • Provide support and bug fixes during trial validation runs and UAT.
  • Performs ETL code packaging, sequencing and validations of same
  • SIT and UAT support.
  • Conduct code reviews and provide improvement guidelines
  • Extensive experience on Spark, PySpark and Hive SQL Scripts.
  • Coding and development, unit test the ETL code changed/developed.
  • Provide support and bug fixes during trial validation runs and UAT.
  • Performs ETL code packaging, sequencing and validations of same.
  • Involves peer review of ETL code artifacts.
  • Support for Production Deployment
  • Participate in Unit and System Testing and approve deliverable


Related jobs

Report job