“Red-teaming, governance, and evaluation tools are becoming the new table stakes,” said Neil Shah, VP for research at Counterpoint Research. “Security must be multi-layered, integrated first at the development stage to simulate vulnerabilities, and second during real-time monitoring and prompt execution.”
Many organizations are now adopting testing practices for AI that mirror traditional application security processes, according to Keith Prabhu, founder and CEO of Confidis.
“This ‘shift-left’ approach is used extensively today for application security testing,” Prabhu said. “This tried and tested approach has helped improve the security of the final output. It is logical that AI models and tools will also follow a similar ‘shift-left’ approach to testing.”
