Home India Principal Software Engineer (Big Data Architect)

Home India Principal Software Engineer (Big Data Architect)

Principal Software Engineer (Big Data Architect)

Full time at Mastercard in India
Posted on September 20, 2024

Job details

In this role you will primarily focus on the data architecture of Commercial Solutions group. You will lead the design, implementation, and management of Commercial data platform. Work closely with the leadership to form an opinion on choice of tools, technologies, architecture and execute the overall data strategy. You will be responsible for data modelling, database design, data warehousing, and big data technologies, establishing the path to cloud for the entire data platform. Guide and mentor teams on right engineering principals. Responsibilities:

  • Develop and implement a comprehensive data strategy that aligns with the organization's goals.
  • Define data architecture standards, principles, and guidelines.
  • Responsible for defining and designing the data warehouse, data lakes and establish the data integration strategy.
  • Establish data governance policies and procedures and implement data quality assurance processes.
  • You will be hands on and work closely to guide a team of Data Engineers in the associated data maintenance, integrations, enhancements, loads and transformation processes for the organization.
  • Own and drive the evaluation of data management technologies and lead the implementation with a high bar of performance, scalability, and availability standards.
  • Design and optimize the systems for speed, efficiency, and reliability.
  • Ensure data security and privacy compliance with relevant regulations and standards.
  • Implement security measures to protect sensitive data from breaches and unauthorized access.
  • Provide technical guidance and mentorship to junior data engineers and developers.
  • Strong data engineering experience in an agile production environment.
Requirements:
  • Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or implementing machine learning systems at scale.
  • Experience leading the design and implementation of complex features.
  • Experience leading a large project and working with other data and software engineers.
  • Experience working in enterprise databases and ensure follow industry best practices around data privacy.
  • Expertise in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Impala, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms.
  • Experience in Java/.net, Scala, or Python technologies and deliver analytics involving all phases like data ingestion, feature engineering, modelling, tuning, evaluating, monitoring, and presenting.
  • Experience in anonymizing data, data product development, analytical models, and AI governance.
  • Experience with SQL, Multi-threading, Message Queuing & Distributed Systems.
  • Effective communication and collaboration skills to work with both technical and non-technical stakeholders.
  • Flexible to work with global offices across several time zones.
  • Outstanding problem-solving skills and the ability to navigate complex data challenges

Apply safely

To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.

Share this job
See All Principal Jobs
Feedback Feedback