Cloud Data Architect

Senior Cloud Data Engineer We are seeking a Senior Cloud Data Engineer with expertise in designing and implementing scalable data architectures on Azure.Distributed system architecture Azure Data Engineering services including Event Hub, Data Factory, ADLS Gen2, Cosmos DB, Synapse, Databricks Responsibilities include: Implementing and managing infrastructure using Infrastructure as Code (Ia C) tools like ARM templates and Terraform Managing containerized applications with Docker and orchestrating with Azure Kubernetes Service (AKS)Setting up and managing monitoring, logging, and alerting systems using Azure Monitor, Log Analytics, and Application Insights Implementing disaster recovery strategies, backups, and failover mechanisms for critical workloads Automating infrastructure provisioning, scaling, and management for high availability and efficiency Managing and maintaining clusters across various environments on Azure Defining scheduling and monitoring job flows with proactive alert setup Troubleshooting failed jobs in Azure tools like Databricks and Data Factory, performing root cause analysis, and applying corrective measures Hands-on experience with distributed streaming tools like Event Hub Designing and managing backup and disaster recovery solutions using Ia C with Terraform Automating processes using Python, shell scripting, Jenkins, and Azure Dev Ops Designing and maintaining Azure CI/CD pipelines for seamless code integration, testing, and deployment Monitoring and troubleshooting VM resources and applications, advising developers on performance improvements Reviewing and resolving log file issues for system and application components Adapting to evolving technologies with a strong sense of responsibility and accomplishment Applying agile methodologies for software delivery We require a cloud data engineer with a strong understanding of Azure administration and Azure Dev Ops, with expertise in Storage Account, Data Lake (ADLS), Databricks Unity Catalog, Azure Data Factory (ADF), Event Hub and Event Grid, Key Vault, Cosmos DB, and Synapse.Key Responsibilities: Distributed System Architecture: Design and implement scalable data architectures on Azure.Azure Data Engineering Services: Utilize Event Hub, Data Factory, ADLS Gen2, Cosmos DB, Synapse, and Databricks to build robust data engineering solutions.Infrastructure Management: Implement and manage infrastructure using Ia C tools like ARM templates and Terraform.Containerized Applications: Manage containerized applications with Docker and orchestrate with AKS.Monitoring and Logging: Set up and manage monitoring, logging, and alerting systems using Azure Monitor, Log Analytics, and Application Insights.Required Skills: Azure Administration and Dev Ops Storage Account, Data Lake (ADLS), Databricks Unity Catalog Azure Data Factory (ADF), Event Hub and Event Grid Key Vault, Cosmos DB, Synapse Work Environment: Abu Dhabi, United Arab Emirates),