QA AUTOMATION ENGINEER / SDET – AI TESTING
Location:
XenonStack office, STPI, Sector 75, Mohali (Chandigarh Tricity), work from office |
Experience:
2–4 years | Full time ABOUT XENONSTACK XenonStack is a Data and AI Foundry for Agentic Systems, enabling enterprises to design, deploy, operate and scale intelligent agents. Our platforms: Akira AI (agent orchestration), ElixirData (agentic analytics), NexaStack (agentic infrastructure) and MetaSecure (trust and compliance).
THE ROLE
Testing AI agents is a new kind of quality engineering. You will build test automation with Playwright/Selenium and Python, and learn to evaluate LLM and agent behaviour: accuracy, hallucinations, safety and regressions, so our agentic products are reliable in production.
KEY RESPONSIBILITIES
- Design and maintain UI and API test automation (Playwright or Selenium, Python, Pytest).
- Build regression suites and run them in CI/CD pipelines.
- Test AI agents and LLM features: build evaluation datasets, check answer accuracy, hallucinations, safety and prompt regressions.
- Log, track and verify defects; report clear test results to developers and product teams.
- Keep test cases, runbooks and quality metrics current.
- MUST-HAVE SKILLS 2–4 years in test automation.
- Hands-on Playwright or Selenium with Python (Pytest).
- API testing (Postman, REST).
- CI/CD and Git basics.
- Clear written communication and ownership.
- GOOD-TO-HAVE Exposure to LLM evaluation tools (DeepEval, Ragas, LangSmith) – we will help you learn.
- Performance testing (JMeter, k6).
- Docker/Kubernetes and a cloud platform (AWS, Azure or GCP).
- HOW WE WORK WITH AI AI is part of the daily workflow at XenonStack.
- You may use approved AI tools for test design, scripting and documentation, and you verify every AI-assisted output before relying on it.
- HIRING PROCESS Pre-screening assessment → Technical interview (video) → Technical assessment (in person at Mohali for Tricity candidates) → HR and Leadership round → Background verification → Offer.
- OUR VALUES Agency · Taste · Ownership · Mastery · Impatience · Customer Obsession WHY JOIN US Test cutting-edge agentic AI products used by enterprises.
- AI-first environment with real ownership.
- Great Place to Work-Certified, 14+ years, headquartered in Mohali.