Cloud Data Engineer

job summary:

• Senior Cloud Data Engineer with more than 5 years Microsoft Azure cloud Data engineering experience. Experience on Azure Synapse / CosmosDB / Azure SQL Database and/or prior experience on supporting very large database migration to Azure cloud is highly preferred.
• Support multiple instances of Azure cloud databases including Synapse Analytics, CosmosDB, Azure SQL database, development/uat databases, Storage management, Archive, Restore, disaster recovery, security and the enterprise warehouse systems and business applications.
• Building and Installing new cloud database solution including setting access control security layer, DR setup, Manage/Monitor cloud database system performance, including workload management, query performance and tuning.
• Provide consulting on physical database implementations, Partitioning, Indexing, join methods, and data access paths.
• Works closely with Microsoft vendor support, Engineering, Operation, Production support to design and implement secure, available and performant data services on Azure cloud platform supporting a variety of applications on Data Warehouse platform.
• Implement and administer access policies in conjunction with corporate standards.
• Manage, design, develop, support and consult cloud shell/power shell process/scripts/tools/ARM templates for system management.

• Microsoft Azure

• Hadoop

• Teradata

• Must have these skills to be minimally qualified.
• Advanced working knowledge of MPP Database Architecture and Azure cloud architecture.
• Database physical implementation expertise.
• Advanced experience on Azure security/RBAC/Database Roles.
• Experience on Azure ADF/Synapse/CosmosDB/Storage accounts PaaS services.
• Experience on creating resources on Azure using Power Shell / Cloud Shell with proper security and access control attributes.
• Advanced working knowledge of database administration on any RDBMS (SQL Server / Teradata preferred) including Security administration, High Availability, DR, Performance tuning and Workload management.
• Expert in advanced SQL (preferably T-SQL).
• Advanced design and development of Stored procedures (T-SQL preferred).
• Advanced knowledge of Data Warehouse design including 3NF/ Star Schema / Snow Flake design etc.
• Database performance tuning using Indexing, Partitioning etc.
• Experience on Agile development, SDM tools including JIRA, Bitbucket Repository, CI/CD Pipelines, Ansible, Change Management process using tools like Remedy etc.
• Python / Scala scripting experience with working knowledge on Notebooks.

• Familiar with Cloud Storage like Native Object Storage, Machine Learning etc.
• Familiar on Teradata database / Hadoop platform.
• Familiar with Cloud/Blob/object storage and file formats including Parquet.
• SSO onboarding using AD integration for authentication and authorization.
• Familiar with Apache Spark.
• Experience in implementing data solutions in Azure including Azure SQL, Synapse Analytics, CosmosDB, Apache Spark etc.
• Familiar on Data Lake Architecture
• Familiar on Azure RBAC roles.
• Familiar on Elastic computing especially on cloud platform

• Building and Installing new cloud database solution including setting access control security layer, DR setup, Manage/Monitor cloud database system performance, including workload management, query performance and tuning.
• Provide consulting on physical database implementations, Partitioning, Indexing, join methods, and data access paths.
• Works closely with Microsoft vendor support, Engineering, Operation, Production support to design and implement secure, available and performant data services on Azure cloud platform supporting a variety of applications on Data Warehouse platform.

• Experience level: Experienced
• Minimum 3 years of experience
• Education: Bachelors