Senior Azure Data Engineer
Full time
at Digile
in
Online
Posted on February 3, 2025
Job details
Job Title-Senior Azure Data Engineer Work location: Remote--Hyd/CHN/Blore Job Requirements Experience
- 5+ years of experience in data engineering, focusing on big data technologies and Azure cloud platforms.
- 3+ years of experience developing data integrations using in Azure Databricks, PySpark, Spark Pools, and large-scale data processing.
- Proficient in Python (specifically PySpark) and data analysis libraries like Pandas, NumPy, and SciPy.
- Experience with Spark SQL, DataFrames, and RDDs for data processing and transformation.
- Hands-on experience with Azure Data Lake, Azure Blob Storage, and Azure Synapse Analytics.
- Familiarity with Databricks Notebooks, Delta Lake, and MLflow for model tracking and management.
- Expertise in creating, optimizing, and managing Spark Pools for distributed computing.
- Knowledge of machine learning algorithms, model training, evaluation, and deployment.
- Experience with tools like MLlib, TensorFlow, Keras, or scikit-learn for model development.
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
