Senior Data Engineer
Full time
at COFORGE
in
India
Posted on January 25, 2025
Job details
Role: Senior Data Engineer Skills: ADF, Databricks, and Spark Streaming Developer Experience: 5-8+ Years Location: Noida, Gurugram, Responsibilities:
- Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks.
- Implement real-time data processing solutions using Spark Streaming.
- Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and deliver solutions.
- Optimize and troubleshoot data workflows for performance and reliability.
- Ensure data quality and integrity throughout the data lifecycle.
- Develop and maintain documentation for data processes and solutions.
- Proven experience with Databricks and Spark, including Spark Streaming.
- Strong knowledge of Azure Data Factory (ADF) for data integration and orchestration.
- Proficiency in programming languages such as Python, SQL, and Scala.
- Experience with Delta Lake and Spark SQL.
- Familiarity with big data technologies and ecosystems, such as Hadoop.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Experience with cloud platforms, particularly Azure.
- Knowledge of data warehousing concepts and tools.
- Certification in Azure or related technologies.
- Competitive salary and benefits package.
- Opportunity to work with cutting-edge technologies.
- Collaborative and innovative work environment.
- Professional development and growth opportunities.
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
