Google blames Chinese networks that use Gemini to commit fraud

Google loves to tell us all the ways people are using its AI tools to create new things, grow businesses, and save the world. He says. Of course, humans are also using AI for crime. Google has announced a new salvo against a Chinese group called Outsider Enterprise, which appears to be involved in an AI-powered phishing campaign. Google says it is working with authorities and mobile carriers to address the issue.

According to Google’s official filing, Outsider Enterprise operates via Telegram. This group provides scam services to people who may not be very tech savvy to set up scam websites and individual campaigns. In its Telegraph thread, Outsider Enterprise reportedly provided instructions on how to use Google’s Gemini AI to create websites that mimic Google, YouTube, and government agencies like New York’s E-ZPass. The team provided about 300 fake templates.

Google says so that a scam launched by Outsider Enterprise resulted in more than 2.5 million text messages being sent to Android users. About 55,000 of these messages were made within two weeks last month. In total, Google tracked 9,000 fake websites and 1 million URLs linked to the fraudulent network.

The messages often referred to account problems or problems with package delivery. When users clicked on the links, they ended up on one of the fraudulent websites, designed by Gemini to look legitimate. Cybercriminals used these sites to steal personal information and bank details. Google’s listing does not estimate how much money has been stolen through the Outsider Enterprise scam, but the blog post indicates that hundreds of people have lost some money.

Google worked with AT&T, Verizon, and T-Mobile to block many of these malicious text messages, and Google says that its device-based phishing detection in Google Messages may have also helped reduce the number of successful phishing attempts. This AI-powered system seems to stop 10 billion fraudulent posts every month, so it’s safe to say that it can handle some of the Outsider Enterprise’s tasks.