Software Engineer in Test

Be part of something revolutionaryAt o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises' siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn't stop there. Businesses that plan better and faster also reduce waste, which drives better outcomes for the planet, too.We're on the lookout for the brightest, most committed individuals to join us on our mission. Along the journey, we'll provide you with a nurturing environment where you can be part of something truly extraordinary and make a real difference for companies and the planet.Job title - SDET - Performance TestingExperience: 5-10years full-time in Big Data Performance TestingPosition Overview:As a Spark Deltalake Performance QA Engineer, you will be responsible for ensuring the optimal performance and reliability of Spark applications using Delta Lake, a storage layer for big data workloads. Your primary focus will be on assessing and enhancing the performance of Spark jobs running on Delta Lake, identifying bottlenecks, and implementing optimizations to achieve optimal data processing speeds and efficient resource utilization. You will work closely with the development and data engineering teams to troubleshoot performance issues, provide recommendations, and validate the effectiveness of implemented solutions. What you'll do for us…Performance Testing: Conduct performance testing of Spark applications utilizing Delta Lake to evaluate their efficiency, scalability, and resource consumption.Performance Analysis: Analyze Spark job performance metrics, identify performance bottlenecks, and provide actionable recommendations to optimize query execution times, data ingestion, and data processing tasks.Optimization Strategies: Collaborate with the development and data engineering teams to define and implement performance optimization strategies, including tuning Spark configurations, partitioning schemes, and data compression techniques.Monitoring and Benchmarking: Set up monitoring frameworks and benchmarks to track and compare performance metrics, ensuring the continuous improvement of Spark applications running on Delta Lake.Automation: Develop automated performance testing scripts and tools to streamline the performance testing process and facilitate performance regression testing.Documentation: Create and maintain performance test plans, test cases, and performance-related documentation, including performance tuning guidelines and best practices for Spark applications using Delta Lake.Collaboration: Work closely with cross-functional teams, including data engineers, data scientists, and software developers, to understand their performance requirements and provide guidance on optimizing Spark job performance.What you'll have…Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.Work Experience :Skills: Spark, Deltalake, Performance Testing, JMeter, SQL , Python , Familiarity with Big Data Processing Frameworks such as Hadoop and Kafka, ELK Stack, Jenkins and CI,Understanding of Cloud Architecture specifically on AWS, Azure and/or Google Cloud, capacity planning of the InfraStrong experience in performance testing and optimization of Spark applications, specifically using Delta Lake.Proficiency in Spark, SQL, and programming languages like Scala or Python.Familiarity with big data processing frameworks, such as Hadoop and Apache Kafka.Solid understanding of distributed computing concepts and performance tuning strategies.Experience with performance testing tools, such as Apache JMeter, Gatling, or similar tools.Excellent analytical and problem-solving skills, with the ability to troubleshoot and diagnose performance issues.Strong communication skills and the ability to collaborate effectively with cross-functional teams.Attention to detail and a results-oriented mindset, with the ability to prioritize and manage multiple tasks in a dynamic environment.What we'll do for you:Flat organization: With a very strong entrepreneurial culture (and no corporate politics).Great people and unlimited fun at work.Possibility to really make a difference in a scale-up environment.Support network: Work with a team you can learn from every day.Diversity: We pride ourselves on our international working environment.Work-Life Balance: https://youtu.be/IHSZeUPATBA?feature=sharedFeel part of A team: https://youtu.be/QbjtgaCyhes?feature=sharedHow the process works...• Apply by clicking the button below.• You'll be contacted by our recruiter, who'll fill you in on all things at o9, give you some background about the role and get to know you. They'll contact you either via video call or phone call - whatever you prefer.• During the interview phase, you will meet with technical panels for 60 minutes. The recruiter will contact you after the interview to let you know if we'd like to progress your application.• We will have 3 rounds of Technical discussion followed by an HR discussion• Our recruiter will let you know if you're the successful candidate. Good luck!More about us…With the latest increase in our valuation from $2.7B to $3.7B despite challenging global macroeconomic conditions, o9 Solutions is one of the fastest-growing technology companies in the world today. Our mission is to digitally transform planning and decision-making for the enterprise and the planet. Our culture is high-energy and drives us to aim 10x in everything we do.Our platform, the o9 Digital Brain, is the premier AI-powered, cloud-native platform driving the digital transformations of major global enterprises including Google, Walmart, ABInBev, Starbucks and many others.Our headquarters are located in Dallas, with offices in Amsterdam, Paris, London, Barcelona, Madrid, Sao Paolo, Bengaluru, Tokyo, Seoul, Milan, Stockholm, Sydney, Shanghai, Singapore and Munich.o9 is an equal opportunity employer and seeks applicants of diverse backgrounds and hires without regard to race, colour, gender, religion, national origin, citizenship, age, sexual orientation or any other characteristic protected by law PRB