Job details
Technical Lead- Data Shift: 2:00 PM-11:00 PM IST Insight at a Glance
- 14,000+ engaged teammates globally with operations in 25 countries across the globe.
- Received 35+ industry and partner awards in the past year
- $9.2 billion in revenue
- #20 on Fortune’s World's Best Workplaces™ list
- #14 on Forbes World's Best Employers in IT – 2023
- #23 on Forbes Best Employers for Women in IT- 2023
- $1.4M+ total charitable contributions in 2023 by Insight globally
- Design, develop and maintain large-scale data solutions on Azure cloud platform
- Implement ETL pipelines using Azure Databricks and event-driven streaming data engineering
- Develop and deploy data models and data warehousing solutions using Azure Synapse Analytics, Azure SQL Database.
- Optimize performing, robust, and resilient data storage solutions using Azure Blob Storage, Azure Data Lake, Snowflake and other related services
- Develop and implement data security policies to ensure compliance with industry standards
- Provide support for data-related issues, and mentor junior data engineers in the team
- Define and manage data governance policies to ensure data quality and compliance with industry standards
- Collaborate with data architects, data scientists, developers, and business stakeholders to design data solutions that meet business requirements
- 8+ years of experience in data engineering with 3+ years hands on Databricks (DB) experience.(Must)
- Strong expertise in Microsoft Azure cloud platform and services, particularly Azure Databricks, Azure Data Factory, Azure Fabric, Azure SQL Database, and Power BI
- 3+ years of hands-on experience with event-driven streaming data engineering, preferably with Apache Flink and/or Confluent. (Pref- Both skills)
- Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture.
- Extensive experience in data modeling and database design (Good to have)
- Strong programming skills in SQL, Python and Pyspark
- Extensive experience of Medallion architecture (3 layer/ specific to Databricks) and delta lake (or lakehouse) (Databricks)
- Agile development environment experience applying DEVOPS along with data quality and governance principles.
- Good leadership skills to guide and mentor the work of less experienced personnel
- Ability to contribute to continual improvement by suggesting improvements to Architecture or new technologies and mentoring junior employees and being ready to shoulder ad-hoc.
- Freedom to work from another location—even an international destination—for up to 30 consecutive calendar days per year.
- Medical Insurance
- Health Benefits
- Professional Development: Learning Platform and Certificate Reimbursement
- Shift Allowance
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.