20 Jul
Catalyst Data Engineer
North Carolina, Raleigh / durham / CH , 27612 Raleigh / durham / CH USA

Vacancy expired!

Hourly Rate: $72 W2; $83 CTC/1099 Job Description: The Technical Specialist is a senior level resource with specialized knowledge and experience in a specific technology. The Technical Specialist has an overall knowledge and understanding of application development and architecture that serves as a strong base for technical expertise in a specific product or program. Demonstrates expertise in conveying technical and functional concepts for a specific technical specialty. Identifies improvements to project standards to achieve high quality services/ products. Able to identify best practices and standards for the use of the product. Delivers support and design for industry specific applications that require integration with statewide systems or applications. Interacts with executive level business users or technical experts. May function as a niche technical SME. Advanced experience in the required technical subject matter. Proven experience with a technical specialty across large and complex implementations and systems. The DHHS Information Technology (IT) Division provides enterprise information technology leadership and solutions to the department and their partners so that they can leverage technology resulting in the delivery of consistent, cost effective, reliable, accessible, and secure services. The DHHS IT Division works with business units to help ensure the availability and integrity, and promotion of confidentiality of automated information systems to meet their business goals. DHHS IT Division's primary information technology services are Application Management, Project Management, Privacy and Security, Financial Management, Health Information Technology, Infrastructure and Service Management. The Technology Center actively leads initiatives which contribute to the digital transformation and proliferation of new and emerging technologies across the Department. The Technology Center provides an organizational structure which encompasses Enterprise Architecture, Cloud Center of Excellence, Catalyst, and Health IT teams. This new organizational structure will provide an integrated framework which spans across DHHS and focuses on the key components enabling DHHS' success as part of our ongoing Cloud Computing Strategy and Digital Transformation. Primary Purpose of the Position: The Redshift and Aurora Database Administrator (DBA) is responsible for the data workload management, query prioritization, capacity management, data warehouse tuning, designing and creating data warehouse schemas, tables, adding users, groups, other administrative tasks around the Department's Business Intelligence Data Platform (BIDP) and Master Patient Index Hub. The Redshift DBA is responsible for: Working with Data Architects, Analysts, and Scientist to aid in BIDP data modeling efforts General administration of Redshift and Aurora within the BIDP environment Conduct regular reporting on the health and performance of Redshift and Aurora environments and jobs Maintain ownership of activities around Redshift Provide consistent database maintenance, optimization and best practices inputs to existing Redshift Assist in discovering, evaluating, and qualifying new technologies around BIDP data lake functions Partner with BIDP stakeholders to establish and maintain policies, procedures, operational standards around the Redshift and Aurora functions Develop, and assist in the development of polices, process, standards, and operational documents related to Redshift, Aurora, or the BIDP environment (25%) Perform Redshift and Aurora process management and lifecycle support by outlining the processes and setting the boundaries for data processing and operations within the BIDP environment. Provide architecture management and support for Redshift and Aurora. Monitor and respond to audit logs, events and notifications. Ensure Redshift compliance with all regulatory standards. Prepare and report on Redshift and Aurora activities, utilization, and health. (65%) Develop and maintain clusters and nodes within the BIDP environment. Manage database workloads i.e., Data integration, Workflow orchestration and Analysis. Assist with schema design, code review, query and general database tuning. Minimize database downtime and manage parameters to provide fast query responses. Provide proactive and reactive data management support and training to users. Work with stakeholders to determine, enforce and document database policies, procedures and standards. (10%) Conduct testing of the Redshift based workloads and the ingestion of data pipelines into the Redshift and Aurora environment. Perform root cause analysis on all processes and resolve all production issues and validate all data and perform routine tests on Redshift and Aurora. Document all test procedures for Redshift coordinate with stakeholders and exchange partners to resolve issues and maintain quality. Required Skills:

  • Experience with AWS Services, especially, Data Pipeline, Glue, Kinesis, Redshift Spectrum. (5 years)
  • In depth experience with Amazon Redshift, and AWS Aurora, working knowledge of S3 data lake environment, AWS Certified Database (preferred). (5 years)
  • Experience in schema design and data modeling. (5 years)
  • Knowledge of compliance frameworks PCI, SOX, SOC 2, ISO 27001 and the ability to apply their requirements and concepts to a complex environment. (5 years)
  • Knowledge and hands-on expertise with Structured Query Language (SQL). (5 years)
  • Strong interpersonal communication and ability to solve complex problems. (5 years)
  • Experience in debugging. (5 years)
  • Strong technical experience, knowledge, and understanding of micro-services architecture. (5 years)
  • Experience with enterprise level cloud-based development, deployment, and auditing, including: PAAS, IAAS, and SAAS. (preferred). (5 years)
  • Excellent knowledge of data backup, recovery, integrity for database solutions. (5 years)
  • Bachelor's degree in Computer Science, Computer Information Systems, Computer Engineering, or other technical degree from accredited institution. (5 years)
  • 4 years of progressive expertise with Redshift, Aurora, or another analytic column store, or external columnar data format, like Parquet or ORC. (4 years)
Catalyst Data Engineer AWS Services, Data Pipeline, Amazon Redshift, Aurora Higher Competitive Rates will be considered for consultants with advanced skill set Corp to Corp Resumes are welcome Consultants may need a criminal background check

Vacancy expired!


Related jobs

Report job