On the relationship between benchmarking, standards and certification in robotics and AI

Winfield, Alan F. T.; Studley, Matthew

Abstract

Benchmarking, standards and certification are closely related processes. Standards can provide normative requirements that robotics and AI systems may or may not conform to. Certification generally relies upon conformance with one or more standards as the key determinant of granting a certificate to operate. And benchmarks are sets of standardised tests against which robots and AI systems can be measured. Benchmarks therefore can be thought of as informal standards. In this paper we will develop these themes with examples from benchmarking, standards and certification, and argue that these three linked processes are not only useful but vital to the broader practice of Responsible Innovation.

Citation

Winfield, A. . F. T., & Studley, M. (2024). On the relationship between benchmarking, standards and certification in robotics and AI. In M. I. A. Ferreira (Ed.), Producing Artificial Intelligent Systems (1-9). Springer. https://doi.org/10.1007/978-3-031-55817-7_1

• Online Publication Date: Jun 5, 2024
• Publication Date: Jun 5, 2024
• Deposit Date: Jun 18, 2024
• Publicly Available Date: Jun 6, 2025
• Publisher: Springer
• Pages: 1-9
• Series Title: Studies in Computational Intelligence
• Book Title: Producing Artificial Intelligent Systems
• ISBN: 9783031558160
• DOI: https://doi.org/10.1007/978-3-031-55817-7_1
• Public URL: https://uwe-repository.worktribe.com/output/12066776
• Related Public URLs: https://arxiv.org/abs/2309.12139
• Additional Information: First Online: 5 June 2024