AI Agentic Studio QA

Role Overview Coditude is looking for an AI Agentic Studio QA professional with around 4 years of experience in quality assurance and test automation. The successful candidate will develop robust test strategies, maintain automated coverage for web applications and APIs, and help validate AI-enabled workflows involving large language models (LLMs), multi-agent systems, retrieval-augmented generation (RAG), tool calling, MCP, embeddings, and vector databases. Key Responsibilities ● Design test strategies and detailed test cases for complex features and workflows. ● Perform manual and automated testing to identify, document, track, and verify bugs and defects. ● Create, maintain, and improve automated test suites for functional, integration, web, and API testing. ● Participate in code reviews and provide constructive feedback on test automation code. ● Collaborate with developers and product managers to investigate issues, debug failures, and clarify requirements. ● Participate in Agile/Scrum ceremonies, communicate testing progress, and discuss defects, risks, and open issues. ● Validate AI-driven functionality, including prompt behavior, agent workflows, RAG, tool calling, and output quality. Required Skills & Qualifications ● Proficiency in Java programming and Git version control. ● Hands-on experience with web test automation using Selenium WebDriver and Java. ● Experience in API testing and automation, with working knowledge of Postman and REST Assured. ● Experience with the TestNG testing framework. ● Working knowledge of Maven and IntelliJ IDEA. ● Experience with or knowledge of Jenkins and CI/CD workflows. ● Understanding of Docker and containerization concepts. ● Understanding of LLM testing concepts, including multi-agent systems, RAG, tool calling, and MCP. ● Knowledge of testing embeddings and vector databases. ● Experience with prompt engineering and prompt/output validation. ● Understanding of Agile/Scrum methodologies and familiarity with Jira and Wiki applications.