Looking for Data Engineer

Bigdata Developer Michigan Understand the business requirements that drive the analysis and design of quality technical solutions. These solutions must be aligned with business and IT strategies and follow the organization’s architectural standards· Build enterprise solutions and designing and implementing complete end to end Hadoop infrastructure using MapReduce, Pig, Hive, Sqoop, Oozie, Flume, Spark, HBase and Zookeeper.· Installing, Configuration and Testing Hadoop Ecosystem components.· Implementation of Hadoop Architecture and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, MapReduce concepts with latest yarn concepts.· Experience in working with MapReduce programs using Hadoop for working with BigData.· Experience in importing and exporting data using Sqoop and PySpark from Relational Database system to HDFS and vice-versa.· Collecting and Aggregating large amount of Log Data using Apache Flume and storing data in HDFS for further analysis.· Build different types of database objects like Tables, Views, Materialized views, Procedures, Functions and Packages in RDBMS like Oracle, SQL Server etc.· Create tables with different formats like Parquet, Avro, or any column family schemas using HBase on the data to speed up analytics.· Develop and implement application test strategies, prepare Test Plans and Test Cases, and analyze Test Results.· Job/workflow scheduling and monitoring tools like Oozie and Zookeeper.· Experience on Hadoop clusters using major Hadoop Distributions – Cloudera (CDH), Hortonworks (HDP) and MapR.· Experienced in using Integrated Development environments like Eclipse and IntelliJ IDEA.· Excellent knowledge in Java and SQL in application development and deployment.· Hands on experience in creating various database objects like tables, stored procedures, functions, and triggers using SQL, PL/SQL, DB2 reach me at 2489971225