Senior Software Engineer - Data Validation
تفاصيل الوظيفة
Welcome to Warner Bros. Discovery… the stuff dreams are made of. Who We Are… When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life, the creators bringing them to your living rooms and the dreamers creating what’s next… From brilliant creatives, to technology trailblazers, across the globe, WBD offers career defining opportunities, thoughtfully curated benefits, and the tools to explore and grow into your best selves. Here you are supported, here you are celebrated, here you can thrive. Senior Software Engineer, Data Validation About Warner Bros. Discovery: Warner Bros. Discovery, a premier global media and entertainment company, offers audiences the world's most differentiated and complete portfolio of content, brands and franchises across television, film, streaming and gaming. The new company combines Warner Media’s premium entertainment, sports and news assets with Discovery's leading non-fiction and international entertainment and sports businesses. For more information, please visit Meet Our Team: The Data Platform Data Trust team helps to span development, execution and reporting on various data validation efforts as it relates to the Global Discovery+ & Max product includes functional and non-functional testing. The Engineer will drive the framework for technology, tools, automation initiatives for data validation across the data ecosystem. Ensuring code and pipelines are created to discover, implement, execute, and manage those tests. The Engineer will collaborate with Frontend Client and Backend service teams spread across US / EMEA / APAC teams. Roles & Responsibilities:
- Data Validation and Testing: Expertise in validating data quality, integrity, and consistency across different datasets.
- SQL and Database Knowledge: Proficiency in SQL for querying and validating data in various types of databases (relational and non-relational).
- Programming Languages: Knowledge of programming languages like Python or R, particularly for data manipulation, automation, and building custom validation scripts.
- Engineering: Build systems and datasets to meet Data Quality objectives, using software engineering, data management, and operational best practices.
- Analysis and Design: Analyze systems and data to identify data quality gaps, detect anomalies and provide solutions. Design and document data models and transformation specifications.
- Data Warehousing: Understanding of data warehousing concepts, ETL processes, and tools (e.g., Apache Airflow, Talend).
- Data Quality Tools: Familiarity with tools like Apache Spark, Pandas, Great Expectations, Informatica Data Quality, Talend Data Quality, etc.
- Big Data Technologies: Experience with big data frameworks like Hadoop, Apache Spark, and distributed computing environments.
- API Testing: Skills in testing and validating data flows through APIs and web services.
- Data Governance and Compliance: Knowledge of data governance frameworks and data privacy.
- Tooling Aptitude: Successful track record of instrumenting tools, automation, and processes at scale for frontend and backend Quality engineering activities.
- Software Quality: Understanding of automation workflows, CICD release pipelines, and test environments across multiple products.
- Effectively communicate: Through technical documentation, and experience using various tools and technologies such as JIRA, Confluence, GitHub.
- Partner across Teams: Collaborate with analysts, engineers, subject matter experts, and product managers to apply WBD’s analytical and quality methods to satisfy stakeholder needs.
- Improvement Driven: Experience working with DevOps teams to drive improvements in Release Tools pipeline for automated tracking and reporting.
- 5+ years of hands-on software and quality engineering experience focused on Data Platform & Analytics.
- 5+ years of hands-on experience in Data Validation, building custom validation scripts and automation Data Validation pipelines.
- Proficiency in SQL, Data Warehousing, Data Analysis, Data Profiling and Governance concepts.
- Hands-on experience testing large-scale, production systems using Python, SQL, Apache Spark and Open Source Data Platform Validation Tools.
- Experience working with public cloud infrastructure (AWS, GCP, Azure).
- AWS: 2+ years of experience with AWS Cloud Data Technologies including familiarity with EMR, Kinesis, Athena.
- In-depth knowledge and understanding of standard quality best practices, techniques and methodologies to drive continuous quality improvements.
- Ability to take a project from scoping the requirements and building the test cases.
- Experience with continuous integration / continuous deployment systems like Jenkins.
- Familiarity with Gen AI based test automation, models, processes and tools.
- A Great Place to work.
- Equal opportunity employer.
- Fast track growth opportunities.
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.