- Jalan Stesen Sentral Bandar Kuala Lumpur WP Kuala Lumpur Malaysia 50470

Working Location
Job Description
Requirements
Big Data Development Engineer
Bachelor's degree or above in Computer Science or a related field.
2+ years of big data development experience; led 50TB+ data platform construction or core module refactoring projects.
Must-have: Proficient in Hadoop/Spark/Flink ecosystem; familiar with Kafka/Pulsar streaming architecture; proficient in SQL/Hive/Python/Java/Scala; experienced in Doris/StarRocks tuning.
Nice-to-have: Distributed system tuning (Spark Shuffle, Flink backpressure); data lake technologies (Iceberg/Delta Lake/Paimon); cloud-native big data (EMR/CDH operations, K8s scheduling).
Familiar with full-chain data scenarios in at least one vertical domain (logistics, e-commerce, telecommunications).
Able to translate business requirements into actionable data solutions.
Big Data Operations Engineer
Bachelor's degree or above in Computer Science or a related field.
2+ years of relevant experience; proficient in Linux principles, systems, and applications.
Deep understanding of mainstream big data open-source systems (Hadoop, Kafka, StarRocks, Flink, ClickHouse) — architecture, configuration, optimisation, deployment, and troubleshooting.
Proficient in at least one programming language: Python / Rust / Golang / Java, with Linux/Unix development experience.
Familiar with Alibaba Cloud big data products, especially StarRocks and Flink monitoring, scheduling, and troubleshooting.
Experience with Hadoop/Hive/Spark/Flink/HBase/Presto/ClickHouse operations is preferred.
Data governance experience is a plus; strong sense of responsibility and excellent communication skills.
Responsibilities
Big Data Development Engineer
Participate in the design and implementation of highly available, scalable big data architectures (Lambda/Kappa).
Optimise large-scale data processing performance (e.g., Spark tuning, Flink state backend optimisation).
Independently develop big data platform modules and resolve technical challenges in data pipelines.
Collaborate with data analysts and algorithm teams to provide efficient data interfaces and tooling.
Lead or participate in technical solution design, produce development documentation, and drive implementation.
Big Data Operations Engineer
Manage and develop automation tools for operations and deployment.
Handle requirements analysis, product design, coding, deployment, and maintenance for the data operations platform and its components.
Ensure data quality across collection and processing pipelines.
Manage daily operations, deploy and optimise production servers, and maintain technical documentation.
Benefits
LRT - MASJID JAMEK
0.5 km
LRT - PLAZA RAKYAT
0.7 km
LRT - DANG WANGI
0.8 km
MRL - BUKIT NANAS
0.8 km
MRT - MERDEKA
0.9 km
LRT - BANDARAYA
0.9 km
KTM - BANK NEGARA
1.0 km
MRL - MEDAN TUANKU
1.0 km
MRT - PASAR SENI
1.1 km
LRT - PASAR SENI
1.1 km
MRL - RAJA CHULAN
1.1 km
MRT - BUKIT BINTANG
1.2 km
MRL - BUKIT BINTANG
1.2 km
MRL - HANG TUAH
1.2 km
MRL - IMBI
1.3 km
Important Information
Never provide your bank or credit card details when applying for jobs. Do not transfer any money or complete unrelated online surveys. If you see something suspicious, Report this Job ad.