Home Kuwait Software Engineer - Data Infrastructure - Kafka

Home Kuwait Software Engineer - Data Infrastructure - Kafka

Software Engineer - Data Infrastructure - Kafka

Full time at Canonical in Kuwait
Posted on May 8, 2024

Job details

Canonical Data Platform Team

Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops managed solutions for a full range of data stores and technologies, spanning from big data through NoSQL, cache-layer capabilities, and analytics, all the way to structured SQL engines (similar to Amazon RDS approach). We are facing the interesting problem of fault-tolerant mission-critical distributed systems and intend to deliver the world's best automation solution for managed data platforms. We are looking for candidates from junior to senior level with interests, experience, and willingness to learn about Big Data technologies such as distributed event-stores (Kafka) and parallel computing frameworks (Spark). Engineers who thrive at Canonical are mindful of open-source community dynamics and equally aware of the needs of large, innovative organizations.

Responsibilities

  1. Automation of data platform operations
  2. Managing and integrating Big Data platforms at scale
  3. Ensuring fault-tolerant replication, TLS, installation, backups, and more
  4. Providing domain-specific expertise on data systems to other teams within Canonical
This role focuses on creating and automating infrastructure features of data platforms, not analyzing or processing the data in them. You will:
  • Collaborate proactively with a distributed team
  • Write high-quality, idiomatic Python code to create new features
  • Debug issues and interact with upstream communities publicly
  • Work with helpful and talented engineers from various fields
  • Discuss ideas and collaborate on finding good solutions
  • Work from home with global travel for 2 to 4 weeks per year for internal and external events

Requirements

  • Proven hands-on experience in software development using Python
  • Proven hands-on experience in distributed systems such as Kafka and Spark
  • Bachelor's or equivalent in Computer Science, STEM, or a related degree
  • Willingness to travel up to 4 times a year for internal events

Additional Skills

You might also bring a subset of experience from the following areas:
  • Operating and managing other data platform technologies, SQL (MySQL, PostgreSQL, Oracle, etc) and/or NoSQL (MongoDB, Redis, ElasticSearch, etc)
  • Experience with Linux systems administration, package management, and infrastructure operations
  • Experience with public or private cloud solutions like OpenStack
  • Operating Kubernetes clusters and belief in its use for persistent data services

Benefits

Your base pay will depend on various factors including your geographical location, level of experience, knowledge, and skills. In addition to the benefits above, certain roles are also eligible for additional benefits and rewards including annual bonuses and sales incentives based on revenue or utilization. Our compensation philosophy ensures equity across our global workforce. Additional benefits include:
  • Fully remote working environment since 2004
  • Personal learning and development budget of 2,000USD per annum
  • Annual compensation review
  • Recognition rewards
  • Annual holiday leave
  • Parental Leave
  • Employee Assistance Programme
  • Opportunity to travel to new locations to meet colleagues twice a year
  • Priority Pass for travel and upgrades for long-haul company events

About Canonical

Canonical is a pioneering tech firm at the forefront of the global open-source movement. As the company behind Ubuntu, one of the most important open-source projects and the platform for AI, IoT, and the cloud, we are changing the world daily. We recruit globally and set a high standard for people joining the company. Excellence is expected because to succeed, we need to be the best. Canonical has been a remote-first company since 2004, challenging you to think differently, work smarter, learn new skills, and raise your game. Canonical is an equal-opportunity employer fostering a workplace free from discrimination. Diversity creates a better work environment and better products. We give fair consideration to all applications regardless of identity. #J-18808-Ljbffr

Apply safely

To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.

Share this job
Improve your chance to get this job. Do an online course on Software Development starting now. Claim $10 promo towards online courses. See all courses
See All Software Jobs
Feedback Feedback