Big Data Engineer - 5 + years of Exp - Immediate Joiner - kolkata
Detalhes do emprego
Interested candidates Can Share their resume, along with following details .Email - nitin.patil@ust.comtotal experienceNotice Period ( If Serving - Mention Last working Day)current CTC,expected CTC,current location,preferred locationKey Responsibilities:Design, develop, and optimize big data solutions using Spark and pySpark.Build and maintain data pipelines using Apache Airflow.Develop and maintain complex SQL queries and ensure their performance.Integrate various data sources, including structured and unstructured data, into big data platforms.Ensure data quality, integrity, and consistency across different systems.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.Monitor and troubleshoot data pipelines and workflows to ensure seamless data operations.Implement best practices for data governance and security.Mandatory Skills:Spark: Advanced proficiency in using Apache Spark for big data processing.pySpark: Strong experience with pySpark for building scalable data processing applications.Airflow: Hands-on experience in creating and managing data workflows using Apache Airflow.SQL: Very good SQL skills, including writing and optimizing complex queries.NoSQL: Familiarity with any NoSQL database (e.g., MongoDB, Cassandra, HBase, etc.).Preferred Qualifications:Bachelor's or Master's degree in Computer Science, Engineering, or a related field.Experience with cloud platforms such as AWS, Azure, or Google Cloud.Knowledge of data warehousing concepts and tools.Experience with data visualization tools and techniques.Strong problem-solving skills and attention to detail.Excellent communication and teamwork abilities.What We Offer:Competitive salary and benefits package.Opportunity to work with cutting-edge technologies and innovative projects.Collaborative and inclusive work environment.Professional growth and development opportunities. PRB
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
