Data Engineer

RESPONSIBILITIES:Kforce has a client that is seeking a Data Engineer to join their team for a contract assignment in New York, NY.Summary:As part of this team, you will work on the collecting, storing, processing, and analyzing huge sets of data. The primary focus will be to develop the construction and maintenance of our data pipeline, ETL processes and data warehouse. The Data Engineer will also be responsible for data quality and understanding the data needs our various source data in order to anticipate and scale our systems.The Candidate must be willing to learn, work well independently, be open to feedback, and enthusiastic, with demonstrated technical aptitude, skills and abilities. Support Learning analytics Project that uses student data to know about the Curriculum quality & effectiveness.Responsibilities: Integrate data from a variety of data sources (Data warehouse, Data marts) utilizing on-premises or cloud-based data structures using Snowflake Develop and implement streaming, data lake, and analytics big data solutions Create integration of data from multiple data sources, knowledge of various ETL techniques and frameworks using Snowflake or Databricks Create Applications using Change Data Capture Tools Technical Support (includes trouble shooting, monitoring) Technical Analyst and Project Management Support Application Performance and System Testing Analyst Utilize ETL processes to build data repositories using Snowflake, Python, etc.; integrate data into Data Lake using Spark, Pyspark, Hive, Kafka Streaming, etc. Application development, including Cloud development experience, preferably using AWS (AWS Services, especially S3, API Gateway, Redshift, Lambda, etc.)REQUIREMENTS: Experience with web services such as AWS, Redshift, S3, RDS, Athena, Dynamo DB and Aurora The ability to connect data using web API, REST API Knowledge of Business Intelligence Tools, Enterprise Reporting, Report Development, data modeling, data warehouse architecture, data warehousing concepts Comfortable with AWS cloud (S3, EC2, EMR, Redshift, etc.)Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.