AI that thinks like people with autism will benefit software and learning tools

A computer on the third floor of Vanderbilt’s Featheringill Hall scans geometric patterns, deciding which missing shapes would most likely fit in. It fills in those blanks about as well as a human 17-year-old would, and it’s getting smarter, thanks to a study of the way certain people on the autism spectrum see the world.

Inspired by the writings of Temple Grandin, perhaps the most well-known person on the spectrum, Assistant Professor of Computer Science Maithilee Kunda figured out how to write code that emulates the kinds of image-based thinking Grandin used to design complicated farm equipment. The result is a form of artificial intelligence that allows researchers to study a different model of human cognition, determine how it problem-solves and then tweak it to perform better.

“Most of us think in a combination of lots of different things. We think in words, we think in pictures, we think in smells and feelings,” Kunda said. “What we see in some people with autism is that they’re very much on the visual side. Temple Grandin talks about how she thinks really strongly with images, and certain kinds of language-based thinking are a little more difficult for her.”

Maithilee Kunda

Kunda works with a neuropsychologist who studies visual cognition in autism. At Vanderbilt, computer science students in Kunda’s lab are working to turn that system of thinking into code. The lab’s computers are programmed to solve many different types of human cognitive tests, such as the Raven’s Progressive Matrices, an intelligence test developed in 1936 that asks subjects to look at a series of patterns and determine what the missing one would be.

The benefits of this research run both ways, Kunda points out. AI is improved by looking at intelligence that isn’t neuro-typical. Drawing on a rich variety in human intelligence, it makes it more creative and effective. At the same time, artificial intelligence is used to develop educational tools specifically for people with autism.

“One of the big mysteries we have right now is there is so much variability among people on the spectrum and how they think,” Kunda said. “By trying to pin down these visual reasoning processes more carefully, we’re hoping we can start to divide up that spectrum into people who reason in particular ways and support them more effectively.”

Media Inquiries:
Heidi Hall, (615) 322-NEWS
heidi.hall@vanderbilt.edu