Kilotest

Ensemble testing

Testing by realistic human users is valuable, but slow and expensive. You can optimize the investment in talented testers by discovering as many issues as possible with automated tests, and correcting those issues, before asking humans to start testing. Then testers can concentrate on the subtle issues that automated tests did not detect.

OK, but there are numerous automated testing tools. Which should you use? Kilotest is based on research showing that each tool discovers only a fraction of the issues that multiple tools discover. Tools vary in what and how they test.

The answer: ensemble testing. Test with several tools that have different strengths. Then assemble their results into a standardized report. That is what Kilotest does.

The tools

Kilotest runs the tests of 11 tools developed by teams around the world, including the USA, Canada, Denmark, Australia, and Portugal. Some of the tools are under active development, and when they get updated Kilotest users get the benefits.

The tools perform more than a thousand tests in total. Specialized open-source software developed initially at CVS Health drives the tools and distills their results into about 300 issues.

Status

Kilotest is an early-stage proof of concept, launched in November 2025. The currently used tools focus on HTML and CSS standards, usability, and accessibility. Your suggestions, bug reports, and collaboration proposals are welcome!