全职 Data Engineer- Python Developer - Data Lake 工作, 薪水, PayNet (Payments Network Malaysia) Federal Territory 公司招聘中 - Ricebowl

Summary Of Responsibilities

We are seeking a talented Python Developer who is passionate about data to join our team as a Data Engineer. In this role, you will play a crucial part in developing and maintaining data pipelines, ensuring the reliability, efficiency, and scalability of our data systems. You will collaborate closely with cross-functional teams including Data Scientists, Analysts, and Software Engineers to drive data initiatives and support our business objectives.

Key Areas Of Responsibilities

• Design, develop, and maintain robust data pipelines and ETL processes using Python and related technologies.
• Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
• Optimize and tune data workflows for performance, scalability, and reliability.
• Implement data quality checks and ensure data integrity throughout the data lifecycle.
• Work with cloud-based technologies such as AWS, GCP, or Azure to deploy and manage data pipelines.
• Develop and maintain documentation for data processes, systems, and best practices.
• Stay up to date with emerging technologies and industry trends related to data engineering
  
  

Minimum Qualifications

QUALIFICATIONS & EXPERIENCE

• Bachelor’s degree in computer science, Engineering, or a related field.
• Proven experience as a Python Developer with a strong understanding of software development principles.
• Hands-on experience with building and optimizing data pipelines using Python and related libraries/frameworks (e.g., Pandas, NumPy, Airflow).
• Experience in python dependency management e.g. libraries, packages
• Familiarity with SQL and database technologies (e.g., PostgreSQL, MySQL, or similar).
• Experience working with cloud platforms such as AWS, GCP, or Azure.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration abilities.
• Experience with Big Data technologies (e.g., Hadoop, Spark) is a plus