Senior Kafka Engineer
Full time
at EPAM Systems, Inc.
in
India
Posted on January 1, 2025
Job details
Senior Kafka Engineer Description
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We are looking for a Senior Kafka Engineer to join our team and be responsible for installing, monitoring, troubleshooting, and maintaining Kafka platform, ensuring optimal performance, security, and developing new features/automation/integration. #LI-DNIResponsibilities
- Install and provision new Kafka clusters and supporting components
- Regularly monitor the health and performance of the Kafka platform and data pipelines
- Identify and fix issues related to the platform, including data pipelines, network problems, cloud or containerization resources failures, or software bugs
- Perform regular performance tuning of Kafka platform components
- Monitor and optimize the cost and performance of Kafka clusters
- Upgrade the Kafka platform to newer versions, including planning, testing, and implementation
- Manage the security of the Kafka platform, including access control lists, encryption, and regular security reviews
- Perform regular backups and disaster recovery procedures
- Manage the capacity of the Kafka platform, including projecting future growth and scaling needs
- Document procedures, configurations, and issue resolutions, and share knowledge with the team
Requirements
- Proven experience in the implementation and maintenance of Confluent Platform
- Minimum 5 Years of experience in Kafka Administration
- Experience in Helm / Kubernetes
- Proficiency with deploying Kafka in Kubernetes
- Experience in Python Or Shell Scripting
- Excellent knowledge of Cloud : AWS /GCP (compute, networking, storage, IAM)
- B2+ English level
We offer
- Opportunity to work on technical challenges that may impact across geographies
- Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
- Opportunity to share your ideas on international platforms
- Sponsored Tech Talks & Hackathons
- Unlimited access to LinkedIn learning solutions
- Possibility to relocate to any EPAM office for short and long-term projects
- Focused individual development
- Benefit package:
- Health benefits
- Retirement benefits
- Paid time off
- Flexible benefits
- Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
