Service
AI vendor due diligence testing
Buying an AI product means inheriting its failures. UK regulators have said that using a supplier's AI does not move responsibility away from you. We test the vendor's assistant on your use case before you sign.
What we test
- The vendor's claims, checked against your own test cases
- Injection, leakage and accuracy on your data
- Behaviour changes between model versions
- What the vendor logs and what you can audit
What you get
A short independent evaluation to attach to the procurement file, with questions to put to the vendor.
Where the fix is in the setup (a prompt, a permission, a retrieval or guardrail setting) we make it and run the failed cases again. The test suite is yours to keep.
Who asks for this
Procurement, IT and risk teams choosing between AI suppliers.
Contact
Tell us what your assistant does. We'll tell you how we'd test it.
Other work
- Prompt injection testing for AI agents
- Third-party LLM red teaming
- Independent AI assistant assessment report
- Chatbot hallucination and accuracy audit
- EU AI Act transparency testing for chatbots
- Custom evaluation datasets and grading rubrics
- AI agent tool and permissions review
- System prompt and data leakage testing
- Crisis and vulnerable-user response testing
- Regression testing for model upgrades