Technical QA Engineer (AI Platform & Automation)
About Our Client
Our client is building one of the world's leading AI-powered Web3 and decentralized identity platforms, serving hundreds of thousands of users globally. Their engineering organization develops scalable backend infrastructure, intelligent automation, and next-generation AI products that power mission-critical services across distributed systems.
Location: Remote (Malaysia Only)
Employment Type: Full-Time Independent Contractor
Department: Engineering
About the Role
We're looking for a highly technical Quality Engineer who enjoys breaking complex systems before users do.
This is not a traditional QA position.
You'll own quality across backend services, APIs, AI-powered features, and automation pipelines. Beyond finding bugs, you'll help define how AI products should be evaluated, measured, and continuously improved.
You'll work closely with backend engineers, platform teams, and AI developers to ensure every release meets high standards of reliability, accuracy, and scalability.
What You'll Do
- Design testing strategies for modern backend and AI-driven applications.
- Build scalable automated testing frameworks using Playwright or similar technologies.
- Validate REST APIs, microservices, event-driven systems, and distributed architectures.
- Develop automated regression, integration, API, and end-to-end testing suites.
- Create repeatable evaluation frameworks for AI-generated outputs.
- Measure AI quality, including factual correctness, consistency, hallucination rate, latency, and reliability.
- Perform prompt validation, AI regression testing, and output benchmarking.
- Collaborate with engineering teams throughout the software development lifecycle.
- Integrate automated testing into CI/CD pipelines.
- Investigate production issues and improve release confidence.
- Continuously improve engineering quality standards through automation and process improvements.
What We're Looking For
- 5+ years of Software QA or Quality Engineering experience.
- Strong experience testing backend applications and REST APIs.
- Hands-on experience with Playwright, Cypress, Selenium, or equivalent automation frameworks.
- Experience testing distributed systems or microservice architectures.
- Strong understanding of API testing using Postman, Swagger/OpenAPI, or similar tools.
- Experience integrating automated testing into CI/CD pipelines.
- Strong SQL knowledge (PostgreSQL preferred).
- Experience writing test strategies, automation architecture, and quality standards.
- Excellent English communication skills.
Bonus Points
- Experience testing AI products or LLM-based applications.
- Experience evaluating AI responses using structured quality metrics.
- Prompt testing or AI regression testing experience.
- TypeScript or Node.js development experience.
- Experience with GitHub Actions, GitLab CI, or Jenkins.
- Performance, load, or security testing experience.
- Experience with Web3, blockchain, or decentralized identity products.
- Familiarity with OpenAI, Anthropic, Gemini, or other LLM APIs.
- Experience with Docker, Kubernetes, Kafka, Redis, or GraphQL.
Why Join?
- Work on cutting-edge AI and Web3 technologies.
- Build quality systems for products used by hundreds of thousands of users.
- Collaborate with experienced engineers across multiple countries.
- High ownership and technical autonomy.
- Fully remote with long-term career growth.
- Opportunity to shape quality standards for AI-powered products from the ground up.