Senior Data Engineer

At Optus, we are fuelled by optimism, unwavering customer focus, and a team of amazing people. And that’s where we come in.... “the amazing people” part! We don’t sit back and wait for the future to happen, we are out there crafting our own path through new technology, innovation, and investment. We are truly a challenger brand, with challenger spirit. As our new Senior Data Engineer, you’ll be at the forefront of designing, building, and maintaining both batch and real-time data pipelines across on-premises and cloud platforms. You’ll integrate data from diverse source systems, transforming it into valuable assets that are ready for consumption by end-users and downstream applications. Your expertise will ensure data is efficiently stored and seamlessly integrated into our data models, all while adhering to strict Data Governance and Architecture principles. This ensures high-quality, consistent, and accessible data, driving key business outcomes and innovation. Join us in shaping the future of data at Optus! Your day in the life as a Senior Data Engineer

• Deliver accurate and timely datasets aligned with business needs, while working across various data platforms and APIs to create pipelines.
• Design, build, and optimise data architecture and ETL pipelines to enable data access for Analysts, Data Scientists, and business users, facilitating informed decision-making.
• Collaborate with Optus IT and Data Analysts to productionise and scale value-driven capabilities, including data integrations, transformations, model features, and machine learning models.
• Develop data transformation jobs using Python and SQL on cloud platforms.
• Ensure data completeness and that management processes and structures evolve to meet the changing needs of Customer Success.
• Maintain strong relationships with technical teams, staying informed of opportunities to enhance data models and gain deeper insights into customer experiences.
• Actively participate in identifying, defining, and sharing process improvements.
• Translate high-level product and service requirements into technical specifications.
• Consult with DevOps to develop pipelines from new data sources, supporting the integration of additional business information into the Unified Data Model.
• Implement changes to existing data sources effectively, minimising impact on the Customer Success data map and operations.
• Collaborate closely with Data Science and Analytics teams to share insights, provide recommendations, and identify opportunities for advanced data model development to enhance business outcomes.

It starts with you!

• 6 + years of experience in designing and building data pipelines, with expertise in both batch and real-time processing.
• Strong proficiency in Databricks, Azure cloud data platforms or equivalent (e.g., AWS, Google Cloud).
• Desirable hands-on experience with Databricks and big data technologies such as Hadoop, Spark, or Kafka for large-scale data processing.
• Advanced skills in programming languages such as Python, SQL, or Scala for data manipulation and automation.
• Experience with ETL tools and frameworks (e.g., Apache Airflow, DBT) for data transformation and integration.
• Deep understanding of data modelling techniques and best practices for both structured and unstructured data.
• Familiarity with Data Governance, ensuring high standards for data quality, consistency, and security.
• Hands-on experience with big data technologies like Hadoop, Spark, or Kafka to handle large-scale datasets.
• Strong problem-solving skills with the ability to troubleshoot data pipeline issues and optimise performance.
• Excellent communication skills with the ability to collaborate effectively with cross-functional teams and translate technical concepts for non-technical stakeholders.
• Bachelor’s degree in computer science, engineering, or a related field, or equivalent industry experience.

The good stuff ...

• 3 days in the office, 2 days remote – with flexible hours to suit!
• Inclusive paid parental leave, up to 14 weeks for the primary caregiver.
• All Optus employees have access to resources, webinars and support via the ‘Parents at Work portal’.
• Own your own growth by accessing an extensive online and facilitator-led learning catalogue – even earn an MBA micro-credential via OptusU (University).
• Connect at work through one of our employee-led volunteer groups: Culture Connect, Elevate Women, Disability Network, Express Yourself (LGBTQIA+), United Veterans and Yarn Network.
• Vibrant campus life, variety of facilities including restaurants, cafes, gymnasium, GP, and post office.
• Two easy travel options to Sydney Campus: Optus bus from Sydney CBD (20min travel time) and Macquarie University Metro Station (every 6-8 minutes); morning and afternoon!

At Optus, we have an ambitious goal to be Australia’s most loved everyday brand. Curious about our culture? Go behind the scenes with our people by searching #OptusLife on LinkedIn. Intrigued but don't tick every box? We are building our AI capabilities and value diverse perspectives. If you're driven to join us on this journey, apply now - your passion matters more than a perfect match. At Optus, we are strengthened by others and that means valuing diversity and saying ‘yes’ to embracing individual differences. We are committed to ensuring that our application process provides an equal employment opportunity to all job seekers, including individuals from diverse gender, cultural and linguistic backgrounds, individuals with a disability, individuals identifying as being part of the LGBTQIA+ community, individuals who may have served in the armed forces or who identify as Aboriginal and/or Torres Strait Islander. If you require any adjustments or accessibility support to participate fairly and equitably in the recruitment process, please email along with your preferred method of contact and we will be in touch. For more information on Diversity, Inclusion & Belonging at Optus, please visit this link . #J-18808-Ljbffr