National standards are needed to govern the use of artificial intelligence (AI) in local authority children's services, a data science expert has said.
Shaun Manzi, senior data specialist at Dartington Service Design Lab, warns in the latest edition of the CYP Now podcast that the lack of standards and regulations around the use of AI in children's services means local authorities are vulnerable to abuse. Did. Provider of unscrupulous systems.
“It's a little bit like the Wild West at this point,” Manzi said. “Any company can say, “My AI model helps us make better decisions,'' but if it's not transparent or explainable, no one can see inside it. Where is the responsibility?
“Poor quality AI applications can be harmful because they produce poor quality information, resulting in bad or incorrect decisions.
“When we operate in areas such as children's services, we need to ensure that we adhere to the highest possible standards. At the very least, we need agreed national standards.”
Manzi urged local governments to become “informed consumers” about what good AI systems have to offer. If done incorrectly, millions of pounds could be wasted on systems that do more harm than good.
“Many organizations have their own value statements that define how AI will be used, how quality will be ensured, and standards will be maintained by ensuring transparent and accountable processes, i.e. They are beginning to formulate ethical principles to adhere to. [system’s providers] We have a responsibility,” Manzi explained.
“Organizations can start here. Become an informed consumer by understanding what it takes to develop great AI use cases, even before you use AI.” .
“that [AI] We have huge potential to improve the way we deliver care, but we need to know how best to make it happen. ”
Manzi will be joined on the May podcast by Kevin Yong, Head of Consulting at Coram, and Andy Coulter, Teams Technical Specialist at Microsoft, to discuss whether AI poses a threat to children's services. This discussion is also featured in our May issue's Digital Solutions Special Report. CYP Now Magazine. [insert link here]
To listen to the podcast, please visit https://www.cypnow.co.uk/Podcast Or subscribe via your podcast platform.
