Back to job offers
Apply now

AI Test Engineer (AI-Augmented Testing Focus)

  • Seniority:

    Senior

  • Work model:

    Remote

  • Language:

    English (B2)

  • Billennium is a global technology company with over 20 years of experience, committed to innovation and empowering businesses. As an employer, we offer a supportive, growth-focused environment where collaboration and creativity thrive. Join us to shape the future of technology together!

    We are looking for an experienced AI Quality Assurance Engineer/AI Test Engineer (AI-Augmented Testing Focus) to join our team and work in an international, innovative, and dynamic environment centered on cutting-edge AI solutions and pioneering testing practices.

  • Development Opportunities:

    • Be part of a highly motivated, dynamic, and fun-loving team that is never afraid to take on new challenges in the evolving field of Artificial Intelligence and its application to testing.
    • Learn how to drive fast, complex, and transformative change across international AI-driven projects, including the adoption of AI in quality assurance.
    • Build and extend your network by connecting with colleagues from various parts of the organization including data science, machine learning engineering, and business intelligence, as you champion AI-driven QA.
    • Challenge yourself to grow, excel, and develop relevant capabilities in AI quality assurance, and the practical application of AI tools to enhance the testing lifecycle, within the remit of role and program.

  • What you will do:

    • Analyze business & technical requirements, with AI models while minding ethical guidelines.
    • Design and prepare test cases for systems, actively leveraging AI-powered tools for intelligent test data generation and test case design/optimization.
    • Utilize AI-assisted development environments (e.g., AI IDEs, co-pilots) for the efficient creation, scripting, and automation of test scenarios for AI and traditional software components.
    • Execute diverse test cycles (e.g., System, Integration, Performance) as per the test plan, meticulously documenting results boosting performance with AI support.
    • Utilize AI-driven tools and techniques to review, validate, and enhance the coverage, relevance, and effectiveness of test suites.
    • Co-create and maintain comprehensive AI test documentation, including test plans, AI-generated/validated datasets, evaluation metrics, and model performance reports.

  • What we are looking for:

    • At least 5+ years of working experience in software quality assurance (including 6+ months in AI/ML testing).
    • Understanding of structured test methods, processes, AI-specific testing methodologies, and practical experience or strong interest in applying AI techniques to software testing (e.g., AI-driven test data generation, AI-assisted test case analysis).
    • Experience in test automation with AI systems, including leveraging AI for generating and maintaining automation scripts.
    • Familiarity with data validation tools, techniques, and an understanding of how AI can assist in identifying data anomalies.
    • Good to have ISTQB Foundation Certification or specialized certifications in AI, Data Science, or AI Testing.
    • Familiarity with AI Agents usage, Java/JavaScript is a plus.

    Preferred Skills:

    • Deep understanding of the complexities of AI software, model behavior, data dependencies, and potential ethical implications, with strong attention to detail.
    • Familiarity with key AI-related concepts such as bias, data drift, model degradation, hallucinations, and adversarial vulnerabilities.
    • Proactive mindset towards collaborating with AI systems and tools-viewing AI as a partner to augment and accelerate testing efforts and improve quality.
    • Passionate about advancing responsible AI, ensuring fairness, transparency, and robustness in AI solutions, and championing innovative uses of AI to achieve quality goals.
    • Ability to lead by influence, drive decisions, deliver results, and demonstrate effectiveness in a rapidly evolving technical landscape.
    • Understands the strategic context of large organizations and is eager to make an impact through high-quality AI implementations.
    • Excellent verbal and written communication skills in English.
Apply now