Senior Data Engineer(Databricks) _ Pref applicants from Indore or Hyderabad (REMOTE)

Vertisystem, now a MOURI Tech company, is among the leading providers of cloud and data migration consulting and services, offering specialized services for data and data warehousing solutions and application modernization. We empower enterprises in leveraging technology like never before, offering AI/ML-driven transformations, advanced analytics capabilities, as well as Snowflake implementation to large datasets for quicker and seamless processing. We are currently looking for Data Engineer _Azure Databricks who has proven track record in IT Industry. This is an exciting opportunity to expand your skill set. Role: Data Engineer _Azure Databricks Location: Indore and Hyderabad Contract: 6 months with possible extension Work Mode: REMOTE Shift: 3 PM - 12 AM IST (should be flexible for rotational shift) Notice Period: Immediate to 30 days max Experience Level: 6 Years to 9 Years Key Responsibilities:

• Develop and optimize T-SQL queries, stored procedures, and functions to support data extraction, transformation, and loading (ETL) processes.
• Design, implement, and maintain data pipelines using Databricks, ensuring efficient processing and analysis of large volumes of data.
• Automate data-related tasks and processes using Python or Java programming languages, enhancing efficiency and scalability.
• Build and maintain RESTful APIs for data access and integration, ensuring security, scalability, and performance.
• Monitor data pipelines and integrations, proactively identifying and resolving issues to minimize downtime and ensure data integrity.
• Implement data governance and quality control measures to ensure the accuracy, completeness, and consistency of data.
• Document data models, processes, and procedures, ensuring knowledge transfer and compliance with best practices.
• Stay up-to-date with emerging technologies and industry trends, evaluating new tools and methodologies to improve data engineering practices.

• Bachelor’s degree in computer science, engineering, or related technical field.
• Four or more years of experience in data engineering, data system development, or related roles.
• Proficiency in TSQL query writing in SQL Server.
• Develop robust and scalable data pipelines and workflows on azure with technologies like Data bricks, Spark, and Python.
• Knowledge of data modeling and database design principles.
• Proven experience working with SQL Server Integration Services (SSIS) and SQL Server Management Studio (SSMS).
• Experience in third party API integration.
• Experience with Databricks.
• Experience in optimizing and tuning ETL processes and SQL queries for performance.
• Develop and maintain Python scripts for data processing, transformation, and automation.
• Strong understanding of data warehousing concepts, ETL best practices, and database administration.
• Understanding of data governance, quality, and security practices.

• Experience with GCP data services such as Apache Airflow, BigQuery, Dataflow, and Data prep.
• Understanding of database security and compliance tools.
• Experience in DataStage
• Azure or GCP cloud data engineering certification