- Jalan Sultan Mizan Zainal Abidin, Kompleks Kerajaan Kuala Lumpur Federal Territory Malaysia
Working Location
Job Description
Responsibilities
We're Hiring: Senior Data Engineer | AWS | Insurance
Location- KL
Preferred- Mandarin
We are looking for an experienced Senior Data Engineer to join our Data & Analytics team within the Insurance domain.
This role is ideal for a hands-on data engineer with strong AWS, Data Lake/Data Warehouse, ETL/ELT, PySpark, Python, SQL, Terraform, and Apache Iceberg experience, with an interest in modern AI-enabled software development.
Key Responsibilities
• Design and develop scalable, secure, and high-performing data pipelines
• Build and optimize ETL/ELT processes across Data Lake and Data Warehouse environments
• Develop batch and near real-time data processing solutions
• Design and maintain Apache Iceberg datasets
• Build and support cloud-native data platforms on AWS
• Implement Infrastructure as Code (IaC) using Terraform
• Monitor, troubleshoot, and optimize data pipelines and platform performance
• Support Disaster Recovery (DR), failover/failback, RTO/RPO, and business continuity activities
• Implement data quality, reconciliation, governance, and metadata management controls
• Support AWS DataZone initiatives and enterprise data governance
• Collaborate with Architects, Business Analysts, Data Analysts, BI Developers, Product Owners, and business stakeholders
• Prepare technical documentation, runbooks, solution designs, and data flow diagrams
• Conduct knowledge transfer sessions and mentor junior engineers
Required Skills & Experience
3+ years of experience in Data Engineering, Data Warehousing, or Data Platform Engineering
Strong hands-on experience with SQL, Python, PySpark, and Terraform
Strong AWS experience, particularly:
AWS Glue | Amazon Redshift | Amazon S3 | Amazon RDS | Amazon SNS | AWS Step Functions | Amazon CloudWatch | AWS IAM | Amazon EventBridge | AWS DataZone
Experience designing and supporting Enterprise Data Lake & Data Warehouse solutions
Hands-on experience with Apache Iceberg
Strong understanding of ETL/ELT, data modeling, and data integration
Experience with Terraform / Infrastructure as Code
Understanding of cloud security, IAM, permissions, and access control
Experience supporting Disaster Recovery and Business Continuity activities
Knowledge of Generative AI, Agentic AI, and AI-assisted software development
Experience using AI-powered coding assistants to improve engineering productivity and code quality
Strong analytical, troubleshooting, communication, and problem-solving skills
Good to Have
• AWS Certifications such as AWS Certified Data Engineer / Solutions Architect / Developer / Cloud Practitioner
• Power BI experience
• SAP BusinessObjects (SAP BO) knowledge
• AWS DataZone and enterprise data governance experience
• Data Lakehouse architecture experience
• DevOps, CI/CD, and cloud automation experience
• Experience in Insurance or Financial Services
Core Technologies:
AWS | Glue | Redshift | S3 | RDS | Step Functions | CloudWatch | IAM | EventBridge | DataZone | SQL | Python | PySpark | Terraform | Apache Iceberg | Data Lake | Data Warehouse | Power BI | Generative AI
Important Information
Never provide your bank or credit card details when applying for jobs. Do not transfer any money or complete unrelated online surveys. If you see something suspicious, Report this Job ad.