- Jalan Sultan Mizan Zainal Abidin, Kompleks Kerajaan Kuala Lumpur Federal Territory Malaysia
Working Location
Job Description
Responsibilities
We are seeking an experienced AI & AIOps Observability Engineer to design, build, and scale intelligent observability platforms leveraging AI/GenAI, Elastic Stack, Grafana, and AWS cloud services. The role involves implementing AIOps-driven monitoring, predictive analytics, anomaly detection, and automated incident management for enterprise cloud and hybrid environments.
Key Responsibilities
· Design and implement modern observability frameworks covering:
o Metrics, logs, traces (OpenTelemetry preferred)
o Synthetic and real-user monitoring
· Architect solutions using:
o Elastic Stack (Elasticsearch, Logstash, Beats, Kibana)
o Grafana (Dashboards, Loki, Tempo, Prometheus)
· Develop AIOps solutions to:
o Detect anomalies using ML models
o Correlate events across systems
o Reduce Mean Time to Detect (MTTD) and Mean Time to Resolve (MTTR)
· Implement automated root cause analysis (RCA) and alert deduplication.
· Build and integrate GenAI-powered capabilities, such as:
o Intelligent log analysis and summarization
o Natural language query interfaces over observability data
o AI copilots for troubleshooting and incident management
· Leverage frameworks such as:
o LangChain / LlamaIndex
o Large Language Models (LLMs) (OpenAI, Azure OpenAI, or open-source models)
· Develop RAG (Retrieval-Augmented Generation) pipelines using observability data.
· Design and deploy scalable observability solutions on AWS using:
o CloudWatch, X-Ray, OpenSearch
o EKS / ECS / Lambda infrastructure
o S3, Kinesis, MSK for streaming data pipelines
· Ensure cloud-native, cost-optimized, and secure observability architectures.
· Build high-throughput data ingestion pipelines:
o Log parsing, transformation, enrichment
o Stream processing using Kafka/Kinesis
· Optimize indexing, retention policies, and storage strategies in Elastic/OpenSearch.
· Create advanced dashboards using:
o Kibana (Lens, Canvas, APM Views)
o Grafana
· Provide business-level insights alongside technical observability metrics.
· Implement Infrastructure as Code (IaC):
o Terraform / CloudFormation
· Build CI/CD pipelines for observability platform deployment.
· Automate alerting workflows using tools like PagerDuty, ServiceNow integrations.
· Ensure secure handling of observability data:
o RBAC, encryption, audit logging
· Implement SIEM integrations using Elastic Security.
Important Information
Never provide your bank or credit card details when applying for jobs. Do not transfer any money or complete unrelated online surveys. If you see something suspicious, Report this Job ad.