Job Summary

We are seeking a Data Engineering Senior for development of scalable data pipelines, ETL workflows, and analytics solutions.
Migration of on-premises Microsoft SQL Server databases to Azure.
Responsible for ensuring efficient data ingestion, transformation, and storage.
Leverage Apache Kafka for real-time data streaming and event-driven architectures.
The ideal candidate has strong expertise in Azure cloud data services, Microsoft SQL Server, and data engineering best practices.
Experience in leading high-performing teams and managing cloud migration projects.

Key Responsibilities

Data Engineering & Pipeline Development

Design, build, and maintain scalable ETL and data pipelines using Azure Data Factory and Databricks.
Develop real-time and batch data processing workflows for analytics and reporting.
Ensure data integrity, security, and governance across all pipelines.
Implement event-driven architectures with Apache Kafka and Azure Event Hubs.

On-Premises to Azure Migration

Migration of Microsoft SQL Server databases to Azure SQL Database and Synapse Analytics.
Define and implement Azure-based data architecture for performance, scalability, and cost efficiency.
Optimize data storage, indexing, and partitioning strategies in Azure.
Work closely with DBA, DevOps, and security teams to ensure a seamless migration with minimal downtime.

Data Architecture & Infrastructure

Oversee the development of a modern Azure data platform (data lake, data warehouse, and real-time processing).
Manage and optimize Kafka-based streaming architectures using Azure Event Hubs.
Implement data governance, security policies, and compliance frameworks (BNM RMiT, GDPR).
Monitor and enhance data performance, availability, and reliability.

Data Analytics & Business Intelligence Enablement

Work with data analysts and scientists to develop self-service analytics and reporting.
Design efficient data models to support business intelligence (BI) using Azure Synapse Analytics and Power BI.
Enable seamless integration between operational and analytical data sources.

Team Leadership & Collaboration

Lead and mentor a team of data engineers, fostering best practices in Azure data engineering.
Promote Agile methodologies, DevOps, and CI/CD pipelines for data workflows.
Collaborate with engineering, product, and business teams to define data objectives.

Performance Monitoring & Continuous Improvement

Monitor and troubleshoot Azure data pipelines, ETL processes, and Kafka streams.
Identify opportunities to automate and improve efficiency.
Stay up to date with Azure cloud, big data, and streaming technologies.

1 Lead Data Engineer Jobs - November 2026 - High Salaries

Lead Data Engineer