Big Data Engineer (10+ Years)

Big Data Engineer with Python, PysparkRaleigh, NC/NYC, NYContract RoleRemote Till CovidClient: Wipro Min: 10+ Years’ experienceJob DescriptionNeed strong profile with Python and PysparkOver all 10 to 12 years of IT experience.Extensive experience in Big Data, Analytics, ETL technologiesApplication Development background along with knowledge of Analytics libraries, statistical and big data computing librariesMinimum 4+ years of experience in Spark, Python/Scala/java programming.Hands on experience in coding, designing and development of complex data pipelines using big data technologiesExperience in developing applications on Big Data.Design and build highly scalable data pipelinesExpertise in Python, SQL Database, Spark, non-relational databasesKnowledge of Palantir would be added advantageResponsible to ingest data from files, streams and databases. Process the data using Spark, PythonDevelop programs in PySpark and Python as part of data cleaning and processingResponsible to design and develop distributed, high volume, high velocity multi-threaded event processing systemsDevelop efficient software code for multiple use cases leveraging Python and Big Data technologies for various use cases built on the platformProvide high operational excellence guaranteeing high availability and platform stabilityImplement scalable solutions to meet the ever-increasing data volumes, using big data/Palantir technologies Pyspark, any Cloud computing etc.Individual who can work under their own direction towards agreed targets/goals and with creative approach to workIntuitive individual with an ability to manage change and proven time managementProven interpersonal skills while contributing to team effort by accomplishing related results as needed