03 Sep
Senior Azure Data Engineer
Texas, Dallas / fort worth , 75342 Dallas / fort worth USA

Job Title: Azure Data Engineer/Solution Architect Job Location: Dallas, Texas Duration: Fulltime Job Responsibilities Design and implement Data Ingestion from multiple sources to Azure Data Storage services. Implement Azure data services and tools to ingest, egress, and transform data from multiple sources. Responsible for application messaging [Service Bus, JMS, RabbitMQ or equivalent] and understanding of message ingestion, pub / sub model Responsible for creating an ETL pipeline with Azure Ecosystem like Azure Data Factory. Build simple to complex pipelines, activities, Datasets & data flows. Utilize Azure compute services [Data Factory, Databricks, Data Lake Store, Apache Spark, Synapse] to implement transformation logic and stage transformed data. Design data ingestion into data modelling services to create cross domain data models for end user consumption. Should be able to create design for NoSQL data structures (MongoDB / Cosmos DB or equivalent) Manage the SQL Azure Database. Implement ETL, related jobs to curate, transform and aggregate data to create source models for end user analytics use cases. Scheduling automation and monitoring instrumentation for data movement jobs. Working experience with Azure Application Insight, Azure monitor and Azure log Analytics. Implement/Support Azure DBaaS infrastructure and services. Experience working in Agile/Scrum/Kanban team environments. Candidate Profile / Qualification A Minimum of a Bachelor's degree in Computer Science or related software engineering discipline, or equivalent Experience managing Cloud Ops, Data factory, SQL Queries, Data Lake, Data Bricks etc. Strong ETL pipeline development experience with Azure Ecosystem like Azure Data Factory. Build simple to complex pipelines, activities, Datasets & data flows. Experience with message ingestion systems like Kafka / Azure Event Hub. Experience with NoSQL databases and design for NoSQL (Cosmos DB, Mongo DB) data structures. Experience in data modelling and Proficient in SQL developer skills in writing stored procedures, functions, transformations etc. Knowledge/Experience in Python will be an added advantage. Knowledge in Service provisioning, scripted provisioning, blueprint development for data service deployment etc. Excellent oral and written communication skills. Candidate should possess a strong work ethic, good interpersonal and communication skills and a high energy level


Related jobs

Report job