Fix AI Mode or take Google out of classrooms, advocates say

Content

Millennials, the first generation of computers, remember many classroom lectures about the unreliability of Wikipedia. We were told to watch out for unconfirmed pitches. We were advised to search the World Wide Web for primary sources, and the place to start was Google.

Now, as Gen Alpha enters the AI-powered classrooms, will Google Search be no longer trusted?

A new report by child safety watchdog Common Sense Media has concluded that Google’s improved, AI-powered search. poses an “unacceptable risk” to the new people at Google. In fact, the report’s authors say, the AI-generated search engine is so dangerous that students should stop using it altogether until Google’s instructors can disable the AI.

Google search for AI as a classroom threat

Child safety advocates have been urging schools to ditch technology in the classroom for years. As generative AI embeds itself in educational products, that cry has grown louder. But while it’s easy to see the potential danger in introducing something like ChatGPT to young readers, it may not be obvious that a simple Google search exposes young readers to AI.

Google launched AI Search Mode last year. Unlike the release of AI Overviews, AI Mode was available to everyone, immediately, including academic accounts. Both Common Sense Media and other experts Mashable spoke to said this is alarming, especially because Google’s AI Mode is powered by Gemini models — age-matched models in other Google products, including Google’s educational technology suite.

Google Search is the tentpole product of the tech giant and an important tool for both teachers and students, Robbie Torney, senior director of AI programs at Common Sense Media, explained. “Google is a dominant player in both areas of search again place of education.”

The company helped fuel the 1:1 device movement that saw the introduction of personal devices, such as Chromebooks, to schools across the country. Google Workspace for Education now enables management suites and classroom resources. The company later became a major evangelist of AI startups, launching, and eventually decommissioning, Gemini Education. Google now boasts millions of Workspace for Education, Chromebook, and other Google education product users from Kindergartners to post-grads.

By making artificial intelligence a staple of Google’s products — to the point where most users don’t even realize they’re using it — Google has destroyed years of trust, sources told Mashable.

Googling is not that easy anymore

First, researchers found that Google’s AI Overviews tend to repeat false information, the first sticking point of the brand with which has not been resolved by the tech giant. As with the problems with chatbots, sources told Mashable, the product’s design suggests an air of authority that could easily confuse adults, let alone children.

In addition, Common Sense Media found that Google AI tools easily complete household tasks for young users. Experts suggest that this combination of misleading design, varied responses, and the permissive nature of chatbots (including AI Mode) may lead readers to unknowingly cheat. They say, searching on Google can make learning difficult.

“They’re putting AI in the wrong way with Sesho,” explains Amanda Bickerstaff, deputy director of AI for Education. The organization works with educational institutions to create AI learning programs and reduce the potential negative impact of AI tools on children’s learning.

There is no reason why a 10 year old, 13 year old, or even 15 year old should see AI Overview or have AI Mode.

Bickerstaff called AI Mode a backdoor for students to access unsafe AI productivity experiences. It also complicates teachers’ ability to strengthen literacy skills in the next generation, Bickerstaff explained, replicating some of the worst aspects of chatbot design right into a previously trusted information environment.

“There’s no reason why a 10-year-old, 13-year-old, or 15-year-old should see AI Overview or have AI Mode,” Bickerstaff said. “When teaching AI to read and write, the first step is to be intentional. These approaches are opposite. You don’t go to a search engine to get a chatbot answer, you go to search for real things.”

According to a report by Common Sense Media, AI Overviews and the new Google Search chatbot AI Mode may pose mental health and safety risks to children.

Google doesn’t offer an option to disable AI-only features while keeping Search accessible. That means kids can still be exposed to productive AI while at school even when guardrails are in place, just by doing their homework. Parents can completely turn off Search or block Google.com from child accounts they manage, Google explains. School administrators can do the same for Workspace for Education accounts, bricking the Google Search domain for all users. Bickerstaff sees this as putting teachers between a rock and a hard place. “What are you going to say? That kids can’t search the web?”

In a statement to Mashable after the report was released, Google said Common Sense Media’s stress test was narrow and vague, and not “an effective way to measure a product’s safety and usefulness.” Common Sense Media has not reviewed Workspace for Education accounts, only consumer accounts. However, Google has expressed that the AI-powered Search experience is the same for all users, Torney said.

Could AI Search be a legal nightmare for schools?

Because of this, sources Mashable spoke to said it may be time to cut ties with Google.

“Google’s overview of AI and AI Mode is undermining children’s education, giving them dangerous misinformation, and putting their lives at risk,” said David Monahan, campaign director for the non-profit child safety organization Fairplay for Kids. “If Google isn’t even willing to disable AI features for students, schools should stop using Google products altogether.”

The Common Sense Media report could be a wake-up call for school districts, said Anya Meksin, deputy director of Schools Beyond Screens, a national coalition that enforces school policies that limit the use of technology in classrooms. Schools Beyond Screens just took the lead new policies for using technology in Los Angeles Unified School District (LAUSD) schools.including banning screen time in kindergarten and first grade classrooms.

Both Fairplay and Schools Beyond Screens are excellent calls to stop for many years on the use of Gen AI in schools. Meksin explained that lawyers are already raising the alarm about AI Search and other integrated Google products, not just chatbots.

“It shocks us how Big Tech has managed to educate the public about its products,” said Meksin. “We have to take this as a matter of urgency. Education is the foundation of our democracy, and they are deliberately crippling our children to be able to fight these companies in the future.”

School districts, including LAUSD, have struggled to deal with the problems created by relying on classroom technology, often to the detriment of their own. emerging AI policieshe explained.

“School districts are quickly breaking any set goals because of the speed of technology and the way AI is embedded,” Meksin said. For example, LAUSD’s new policy prohibits students under the age of 13 from using artificial intelligence in school. But with products like Chromebooks and Google search on school computers, students can still use AI Mode.

We should treat this as an emergency.

In the past 20 years, K-12 schools have he spent billions equipping their classrooms with educational technology. Meksin said he was told by several states that it would be impossible to fully disable services like these, including Google products like Chromebooks.

“We find this position absolutely ridiculous,” Meksin said. “School districts have a responsibility to expose children to products known to cause permanent damage.” He believes educational institutions could get into the same legal hot water as social media and AI companies.

Google and parent company Alphabet recently faced it first offense of wrongful death after the user died by suicide following conversations with Gemini. YouTube, also owned by Alphabet, has been acquired is guilty of negligent field design and subsequent mental health harm to young users. Torney compared the rollout of Google’s AI features and the launch of YouTube to classrooms, which have also drawn criticism from child safety advocates.

Instead of incriminating themselves, Meksin believes that school districts should seek change from Big Tech — starting with stronger controls for the productive embedded AI features now found in school devices. “As the biggest consumers of these products, the states have the power. If Google refuses to comply with the law, the states should stop using these products and cancel these contracts.”