Singapore has proposed a new international standard, ISO/IEC 42119-8, to establish common methods for testing generative artificial intelligence systems such as chatbots and image generators.
It has proposed a new international standard called ISO/IEC 42119-8, which focuses on how generative AI systems—like chatbots and image generators—should be tested.
The newly proposed standard will be one of the key issues up for discussion at the upcoming 17th ISO/IEC JTC 1/SC 42 plenary meeting in Singapore, which will see participation of over 250 AI experts and representatives from 35 countries including U.S., U.K. China, Japan and Germany.
According to a statement by the Singapore government, the need for a generalized testing standard for AI models, on the lines of ISO 9001 and ISO 2859, has risen due to rapid development and pervasiveness of AI across ecosystems.
“Specifically, Singapore has put forth a new ISO/IEC 42119-8 standard with a focus on benchmarking and red teaming methodologies for Generative AI systems with standardized testing approaches. Overall, it establishes an important framework for AI testing that enhances the reproducibility and comparability of results. This, in turn, will drive assurance and overall trust in AI systems and enable safer, more reliable adoption by AI deployers and users,” read a release from the official media agency of Singapore government.
Currently, various organizations might employ different methodologies to test AI, thus making comparisons difficult. With ISO/IEC 42119-8, there will be clearer methods, including something called “red teaming,” where experts try to find weaknesses in AI systems. This helps make AI safer before it is widely used.
Singapore didn’t start from scratch. The country has already built tools like AI Verify to check how AI systems perform. The new initiative expands on this research and applies it on an international level.
In addition to the primary event, there are also discussions and workshops taking place in Singapore to enlighten nations, particularly those in ASEAN, regarding AI policy and standards. These meetings involve key players from both government and industry, as well as other experts, who exchange knowledge and insights.
Also Read: Singapore’s Big AI Push: Turn 100000 workers AI Bilingual by 2029



