Azure Data Engineer

We have an opportunity for Data Engineer resource required for Puresoftware (Product and IT Services Company) – Job Type: Permanent Job Location—Remote/Bangalore Please find below JD:- Responsibilities for Data Engineer Exp—7+ Location:---PAN India · Designing and implementing highly performance data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks · Delivering and presenting proofs of concept of key technology components to project stakeholders. · Developing scalable and re-usable frameworks for ingesting and enriching datasets · Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times · Working with event based / streaming technologies to ingest and process data · Working with other members of the project team to support delivery of additional project components (API interfaces, Search)· Evaluating the performance and applicability of multiple tools against customer requirements · Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints. Qualifications · Strong knowledge of Data Management principles · 5 to 10 years of total years of experience · Experience in building ETL / data warehouse transformation processes · Direct experience in building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks). · Should have experience with MS SQL RDBMS and SQL Query Language · Experience using Apache Spark and associated design and development patterns · Microsoft Azure Big Data Architecture certification is an advantage. · Hands-on experience designing and delivering solutions using Azure Storage, Azure SQL Data Warehouse, Azure Data Lake · Experience working in a Dev/Ops environment with tools such as Microsoft Visual Studio Team Services, Terraform etc. Qualifications for Data Engineer Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases About US: PureSoftware partners with global organizations across different focused verticals, including Financial Services, Life Sciences & Healthcare, Telecom & Semiconductors, Retail & Logistics, and Entertainment. We deliver services and solutions by leveraging our deep domain capabilities, and experience in Digital Technologies, Product Engineering, and Infrastructure Services. PureSoftware is one of the fastest-growing software products and services companies that delivers a differentiated customer experience, accelerates cycle times, and helps customers achieve business outcomes through the adoption of new-age digital technologies and integrating them with their existing systems. Our flagship product ‘Arttha’ is one of the fastest-growing financial platforms. It helps businesses embrace digital solutions in the areas of financial services, mobile banking, agency/ branchless banking, microfinance, insurance, payments, and payments aggregation. ‘Arttha’ has been adopted by more than 50 banks & financial institutions in the last three years. As a strategy, we continuously invest in creating innovative products and platforms to stay ahead of the curve and create value for our customers.