Confidential Jobs Hiring! Full Time Senior Data Engineer (Cloud Data Platform | AWS | Lakehouse) in - Ricebowl

About the Opportunity

Our client is a well-established organisation undergoing a large-scale digital and data transformation. They are building modern cloud-native data platforms that support enterprise analytics, AI initiatives, and data-driven decision making across the organisation.

They are seeking an experienced senior data engineer who enjoys designing scalable data platforms, building high-performance data pipelines, and driving cloud-based data engineering best practices.

This is an excellent opportunity to work on enterprise-scale data platforms while contributing to the adoption of DataOps, Lakehouse architecture, and AI-enabled solutions.

Responsibilities

• Translating business requirements into scalable technical solutions, you will be pivotal in the design of scalable, secure and highly available cloud-native data architectures and development of modern data lakehouse solutions.

• You will also build, maintain and optimise production-grade ETL/ELT pipelines as well as developing reliable batch and streaming data pipelines and implementing automated data quality monitoring and validation.

• Other key responsibilities will see you building cloud-native data platforms using AWS services, implementing Infrastructure as Code using Terraform, and supporting cloud migration and platform modernisation initiatives.

• You will also need to integrate data & AI capabilities into enterprise platforms and support modern DataOps and MLOps practices.

• As a senior, you will mentor junior engineers and provide thought leadership to junior team members.

Requirements

• Armed with a relevant degree in Computer Science, Computer Engineering, Information Technology or equivalent, you will also have a minimum 5 years of hands-on data engineering experience in production environments.
• You ideally comes with strong experiences in designing cloud-based data platforms, SQL and Python programming, building ETL/ELT pipelines.skills and Apache Spark
• Experience with Apache Kafka, Apache Airflow or similar
• Good understanding of distributed systems and cloud architecture as well as orchestration technologies such as Apache Kafka will be essential too
• Relevant AWS certifications such as AWS Solutions Architect Professional or AWS Data Engineer Associate are highly regarded.

If you enjoy building modern cloud data platforms at enterprise scale while working on AI-enabled initiatives, we would love to hear from you.