- Jalan Stesen Sentral Bandar Kuala Lumpur WP Kuala Lumpur Malaysia 50470

工作地点
职位描述
任职资格
Big Data Development Engineer
Bachelor's degree or above in Computer Science or a related field.
2+ years of big data development experience; led 50TB+ data platform construction or core module refactoring projects.
Must-have: Proficient in Hadoop/Spark/Flink ecosystem; familiar with Kafka/Pulsar streaming architecture; proficient in SQL/Hive/Python/Java/Scala; experienced in Doris/StarRocks tuning.
Nice-to-have: Distributed system tuning (Spark Shuffle, Flink backpressure); data lake technologies (Iceberg/Delta Lake/Paimon); cloud-native big data (EMR/CDH operations, K8s scheduling).
Familiar with full-chain data scenarios in at least one vertical domain (logistics, e-commerce, telecommunications).
Able to translate business requirements into actionable data solutions.
Big Data Operations Engineer
Bachelor's degree or above in Computer Science or a related field.
2+ years of relevant experience; proficient in Linux principles, systems, and applications.
Deep understanding of mainstream big data open-source systems (Hadoop, Kafka, StarRocks, Flink, ClickHouse) — architecture, configuration, optimisation, deployment, and troubleshooting.
Proficient in at least one programming language: Python / Rust / Golang / Java, with Linux/Unix development experience.
Familiar with Alibaba Cloud big data products, especially StarRocks and Flink monitoring, scheduling, and troubleshooting.
Experience with Hadoop/Hive/Spark/Flink/HBase/Presto/ClickHouse operations is preferred.
Data governance experience is a plus; strong sense of responsibility and excellent communication skills.
岗位职责
Big Data Development Engineer
Participate in the design and implementation of highly available, scalable big data architectures (Lambda/Kappa).
Optimise large-scale data processing performance (e.g., Spark tuning, Flink state backend optimisation).
Independently develop big data platform modules and resolve technical challenges in data pipelines.
Collaborate with data analysts and algorithm teams to provide efficient data interfaces and tooling.
Lead or participate in technical solution design, produce development documentation, and drive implementation.
Big Data Operations Engineer
Manage and develop automation tools for operations and deployment.
Handle requirements analysis, product design, coding, deployment, and maintenance for the data operations platform and its components.
Ensure data quality across collection and processing pipelines.
Manage daily operations, deploy and optimise production servers, and maintain technical documentation.
好处
LRT - MASJID JAMEK
0.5 km
LRT - PLAZA RAKYAT
0.7 km
LRT - DANG WANGI
0.8 km
MRL - BUKIT NANAS
0.8 km
MRT - MERDEKA
0.9 km
LRT - BANDARAYA
0.9 km
KTM - BANK NEGARA
1.0 km
MRL - MEDAN TUANKU
1.0 km
MRT - PASAR SENI
1.1 km
LRT - PASAR SENI
1.1 km
MRL - RAJA CHULAN
1.1 km
MRT - BUKIT BINTANG
1.2 km
MRL - BUKIT BINTANG
1.2 km
MRL - HANG TUAH
1.2 km
MRL - IMBI
1.3 km
重要安全守则
申请工作时,切勿提供您的银行或信用卡详细资料。不要转账或完成无关的在线调查问卷。如果您发现可疑内容,请举报此招聘广告。