Middle Azure Data Engineer

Position Summary:

We are looking for a Middle Azure Data Engineer to join our team. In this role, you will be responsible for developing and optimizing data integration pipelines, migrating existing solutions, and ensuring data reliability. You will work closely with data architects and engineers to implement efficient and scalable solutions

Experience/Skills:

• 3+ years of experience in data engineering or related fields
• Strong SQL and Python skills for data processing and transformation
• Experience with Azure Data Factory, Databricks, Data Lake, Azure Functions
• Familiarity with Unity Catalog features in Databricks
• Understanding of relational and non-relational data stores
• Experience with Azure DevOps or similar tools for version control and release management
• Analytical thinking and problem-solving skills
• Strong communication and teamwork abilities

Primary Responsibilities:

• Develop and maintain data integration pipelines using Databricks (Python, SQL)
• Migrate existing data pipelines from Azure Data Factory (ADF) and Legacy Databricks to Unity Catalog Databricks
• Optimize existing data workflows for better performance and efficiency
• Support data pipelines by troubleshooting failures, identifying root causes, and implementing fixes
• Ensure compliance with data security and company standards.

Job Requirements

Education: A bachelor’s degree in computer science, data science, information science or related field, or equivalent work experience.