- Jalan Sultan Mizan Zainal Abidin, Kompleks Kerajaan Kuala Lumpur Federal Territory Malaysia
工作地点
职位描述
岗位职责
We're Hiring: Senior Data Engineer | AWS | Insurance
Location- KL
Preferred- Mandarin
We are looking for an experienced Senior Data Engineer to join our Data & Analytics team within the Insurance domain.
This role is ideal for a hands-on data engineer with strong AWS, Data Lake/Data Warehouse, ETL/ELT, PySpark, Python, SQL, Terraform, and Apache Iceberg experience, with an interest in modern AI-enabled software development.
Key Responsibilities
• Design and develop scalable, secure, and high-performing data pipelines
• Build and optimize ETL/ELT processes across Data Lake and Data Warehouse environments
• Develop batch and near real-time data processing solutions
• Design and maintain Apache Iceberg datasets
• Build and support cloud-native data platforms on AWS
• Implement Infrastructure as Code (IaC) using Terraform
• Monitor, troubleshoot, and optimize data pipelines and platform performance
• Support Disaster Recovery (DR), failover/failback, RTO/RPO, and business continuity activities
• Implement data quality, reconciliation, governance, and metadata management controls
• Support AWS DataZone initiatives and enterprise data governance
• Collaborate with Architects, Business Analysts, Data Analysts, BI Developers, Product Owners, and business stakeholders
• Prepare technical documentation, runbooks, solution designs, and data flow diagrams
• Conduct knowledge transfer sessions and mentor junior engineers
Required Skills & Experience
3+ years of experience in Data Engineering, Data Warehousing, or Data Platform Engineering
Strong hands-on experience with SQL, Python, PySpark, and Terraform
Strong AWS experience, particularly:
AWS Glue | Amazon Redshift | Amazon S3 | Amazon RDS | Amazon SNS | AWS Step Functions | Amazon CloudWatch | AWS IAM | Amazon EventBridge | AWS DataZone
Experience designing and supporting Enterprise Data Lake & Data Warehouse solutions
Hands-on experience with Apache Iceberg
Strong understanding of ETL/ELT, data modeling, and data integration
Experience with Terraform / Infrastructure as Code
Understanding of cloud security, IAM, permissions, and access control
Experience supporting Disaster Recovery and Business Continuity activities
Knowledge of Generative AI, Agentic AI, and AI-assisted software development
Experience using AI-powered coding assistants to improve engineering productivity and code quality
Strong analytical, troubleshooting, communication, and problem-solving skills
Good to Have
• AWS Certifications such as AWS Certified Data Engineer / Solutions Architect / Developer / Cloud Practitioner
• Power BI experience
• SAP BusinessObjects (SAP BO) knowledge
• AWS DataZone and enterprise data governance experience
• Data Lakehouse architecture experience
• DevOps, CI/CD, and cloud automation experience
• Experience in Insurance or Financial Services
Core Technologies:
AWS | Glue | Redshift | S3 | RDS | Step Functions | CloudWatch | IAM | EventBridge | DataZone | SQL | Python | PySpark | Terraform | Apache Iceberg | Data Lake | Data Warehouse | Power BI | Generative AI
重要安全守则
申请工作时,切勿提供您的银行或信用卡详细资料。不要转账或完成无关的在线调查问卷。如果您发现可疑内容,请举报此招聘广告。