全职 Senior Data Engineer (Open source) 工作, 薪水, Lavu Tech Solutions Federal Territory 公司招聘中 - Ricebowl

No visa sponsorship.

Need someone available locally.

Key Responsibilities:

• Design, develop and maintain data pipelines, ETL/ELT workflows and data integration solutions.
• Work with open-source data engineering technologies for data ingestion, processing, transformation and storage.
• Perform data analytics, data modelling and data quality activities to support business requirements.
• Develop data visualizations and dashboards to provide actionable business insights.
• Use Python for data processing, automation, analytics and pipeline development.
• Collaborate with data analysts, data scientists and business stakeholders to translate requirements into scalable data solutions.
• Troubleshoot and optimize data pipelines for performance, reliability and scalability.

Required Skills:

• 5+ years of experience in Data Engineering / Data Analytics.
• Strong Python programming skills.
• Hands-on experience with open-source data engineering technologies such as Apache Spark, Apache Airflow, Kafka, Hadoop or similar.
• Experience in data analytics, data visualization and dashboard development.
• Good understanding of ETL/ELT, data pipelines, data modelling and databases/SQL.
• Experience working with large datasets and data integration environments.
• Strong problem-solving and communication skills.