- Singapore Singapore
工作地点
职位描述
岗位职责
Roles & Responsibilities
Job Description:
• Software design, Bigdata,Scala & Spark development, automated testing of new and existing components in an Agile, DevOps and dynamic environment
• Promoting development standards, code reviews, mentoring, and knowledge sharing
• Production support & troubleshooting.
• Implement the tools and processes, handling performance, scale, availability, accuracy, and monitoring
• Liaison with BAs to ensure that requirements are correctly interpreted and implemented.
• Participation in regular planning and status meetings. Input to the development process – through the involvement in Sprint reviews and retrospectives. Input into system architecture and design.
• Peer code reviews
Requirements:
• 10 years of experience in Big Data development with a Bachelor's degree.
• Big Data, Scala development and design using Scala 2.10+
• Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services)
• Sound knowledge on working Unix/Linux Platform
• Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL.
• Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
• Understanding of big data modelling techniques using relational and non-relational techniques
• Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects;
• Experience with time-series/analytics dB's such as Elastic search.
• Experience with scheduling tools such as Airflow, Control-M.
• Understanding or experience of Cloud design patterns
• Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.
• Experience with developing Hive QL, UDF's for analysing semi structured/structured datasets
Disclaimer: The company is committed to ensuring the privacy and security of your information. By submitting this form, you consent to the collection, processing, and retention of the information you provide. The data collected (which may include your contact details, educational background, work experience and skills) will be used solely for the purpose of evaluating your qualifications for the position you're applying for. Your data will be stored securely and retained for the duration necessary to fulfill our hiring process. If you are not selected for the position, your data will be kept on file for a limited period in case future opportunities arise. You have the right to access, correct, or delete your data at any time by contacting us at Quess Singapore | A Leading Staffing Services Provider in Singapore (quesscorp.sg)
重要安全守则
申请工作时,切勿提供您的银行或信用卡详细资料。不要转账或完成无关的在线调查问卷。如果您发现可疑内容,请举报此招聘广告。