全职 Data Engineer (Big Data) 工作, 薪水, AI Rudder Federal Territory 公司招聘中 - Ricebowl

About the job

AI Rudder is a software company that harnesses the power of AI voice automation to supercharge customer experiences. With AI voice assistants, your call center can make quality human-like calls at lightning speeds, collecting and analysing data automatically to reach and activate more customers. AI Rudder helps call centers reduce costs by automating repetitive tasks and lowering agent workload. This free up agents to focus on things only humans can do. Over the long term, AI Rudder aims to rethink the future of business communication.

About this role

Key Responsibilities

• Design, develop, and optimize high-performance, scalable data pipelines and processing workflows using frameworks such as Kafka, HBase, Spark, and Flink.
• Handle massive volumes of structured and unstructured data, supporting both real-time streaming and offline batch processing scenarios.
• Monitor, performance-tune, troubleshoot, and perform daily operations of big data clusters to ensure system stability and reliability.
• Work closely with data scientists, analysts, product managers, and other engineers to understand requirements and translate them into robust technical solutions.
• Produce clear technical documentation and adhere to team best practices for code development and data governance.

Qualifications

Must-have:

• In-depth understanding and hands-on development experience with big data components such as Kafka, HBase, and Spark.
• Proficient in Java or Scala, with at least 1+ years of development experience in one of them (Java/Scala); experience with Golang is a strong plus.
• Fluent in English (written and spoken) for technical discussions and daily collaboration.
• Familiar with distributed system principles and concepts like data consistency, fault tolerance, and load balancing.

Nice-to-have:

• Familiarity with big data services on cloud platforms (e.g., AWS EMR/MSK, GCP Dataproc/Dataflow, Azure HDInsight/Event Hubs).
• Experience with tools like Flink, Airflow, Kubernetes.
• Experience in big data development.
• Understanding of data lake/warehouse concepts and related technologies (e.g., Hive, Iceberg, Delta Lake).
• Fluent in Mandarin (written and spoken).