Исследования

Google DeepMind and Singapore Government collaborate to build fine-tuned AI model for scam detection

Learn how Google DeepMind and GovTech Singapore uses lightweight on-device Gemma models to intercept conversational scams in private chats with zero cloud data egress.

14 October 2026 · Source: Google DeepMind Blog

October 14, 2026 Responsibility & Safety JJ Geewax and Miguel de Andrés Collaborating with the Government Technology Agency of Singapore (GovTech Singapore) to protect users without compromising privacy. Scams, such as investment fraud, fake job offers, and impersonation of public officials make up over half of Singapore’s reported crimes, and account for more than S$4 billion in losses since 2019. At the same time, scam tactics have shifted from simple phishing to complex social engineering, whereby attackers manipulate victims with convincing conversations before requesting money. Such scams now account for up to 80% of all losses. To address this, Google DeepMind and the Government Technology Agency of Singapore (GovTech Singapore) have been working together as part of our National AI Partnership with the Singapore Government. Together, we've fine-tuned a privacy-preserving, on-device scam detection model. Generic models often struggle with local deception techniques, making scam detection harder. To address this, Google’s lightweight Gemma model was fine-tuned on local scam conversations. These ranged from impersonations of public institutions, banks, and local figures, to trending regional schemes. This ensures the fine-tuned model will be able to distinguish benign social chatter from genuine manipulation when deployed in applications installed by citizens. Unlike traditional threat detection, which relies on server-side scanning of messages in the cloud, this model can process conversation data directly on-device. When integrated into applications, this will allow faster analysis of conversation patterns to detect manipulative intent and help citizens act before financial or credential exposure can occur. The roll out of the model within applications will be carefully phased and developed in partnership with the Singapore Government. When deployed, the model will only be able to access on-device conversations with the user's consent, in accordance with the terms of use of that application. As the model runs entirely on-device, neither the Singapore Government nor Google, will be able to access users’ conversations through its deployment. When the model detects manipulative conversational patterns, it triggers a real-time warning directly on the user's device advising them to pause and exercise caution before sharing sensitive information or funds. Running a complex scam classifier model on modern smartphones is no easy task, with battery efficiency being a critical area of concern. To do this, we're relying on a two-stage pipeline: Stage 1: A lightweight, efficient classifier screens inbound messages, using minimal power, focused on catching potential threats. Stage 2: In-context analysis with our fine-tuned Gemma model, where we analyze a larger snapshot of the conversation to confirm a threat or discard a false alarm. Presented at Singapore International Cyber Week (SICW 2026), this collaboration provides a model for messaging platforms balancing user protection with end-to-end encryption. Strict governance was maintained throughout development: Sovereign Sandbox: Fine-tuning took place within GovTech Singapore's managed and maintained GCP environment, keeping training data isolated. No Citizen Data: Training strictly excluded private or personally identifiable information, utilising anonymised datasets derived from scam reports and intelligence feeds. Stress-Testing: The model was tested against synthetic dialogues and local corpora to cover diverse scam categories and evolving impersonation tactics. The project demonstrates how AI can help counter criminality without compromising safety or privacy. It also shows how governments and model providers can work together to build tech for public good. With this lightweight, on-device model, we've proven the ability for local, real-time scam detection while ensuring chat interactions remain secure. We look forward to sharing more soon on our collaboration with the Singapore government, as well as exploring the potential for similar technology to be deployed in other countries. As the next step in this collaboration, GovTech Singapore launched the open beta of the Anti-Scam Pango app for Android users in Singapore at STACK 2026. The app applies our joint research insights to flag suspicious messages while keeping private conversations strictly on the user's device. Throughout the beta phase, Google DeepMind and GovTech Singapore will continue working together to test and integrate our fine-tuned, lightweight models. Watch the video below to see how our teams are tackling scams together.

Read at the source →

More in this topic

ИсследованияSame Facts, Different Remedy: Linguistic Profiling and Arbitrariness in LLM and System One DecisionsarXiv:2611.08995v1 Announce Type: new Abstract: Large language models are increasingly used to resolve consumer complaints, and the way complainants write varies with age, education and socioeconomic status (SES). We audit three remedy-decision systems using sociolinguistic rewrites of US consumer financial complaints that are instructed to preserve every fact: two generative LLMs that return a single label (GPT-4o-mini and GPT-5-mini) and a probabilistic "System One" model that returns a distriarXiv cs.CY (Computers and Society)
ИсследованияAI Exposure and the Changing Responsibilities in Job PostingsarXiv:2611.09870v1 Announce Type: new Abstract: The growing adoption of artificial intelligence (AI) in the workplace has raised questions about how employer demand for different work activities is changing. We examine how the prevalence and content of work activities in online job postings change in association with activity-level measures of AI exposure, derived from Copilot and Claude usage. To enable systematic comparisons, we develop a pipeline that extracts the responsibilities from job adarXiv cs.CY (Computers and Society)
ИсследованияSeeing Is Not Knowing: The Epistemic Limits of LLM-Based Mental Health Inference from Youth Social Media ConversationsarXiv:2611.08565v1 Announce Type: cross Abstract: Adolescents increasingly use social media for private conversations, sharing experiences and seeking support. These interactions generate digital traces, prompting efforts to infer mental health and psychosocial states. As large language models become more capable of reasoning about conversations and interpersonal dynamics, a fundamental question remains nonetheless: what can models actually "know" about an individual's psychological experience farXiv cs.CY (Computers and Society)
ИсследованияEntering a New Domain in the Era of Generative AI: An Autoethnography of Solo Game Development as a Bioinformatics EducatorarXiv:2611.09623v1 Announce Type: cross Abstract: The rapid improvement of generative AI (GenAI) not only increased the efficiency of practice but also empowered individuals with capabilities to explore new domains. However, identity formation in the wake of such empowerment remains understudied. We use an autoethnography to understand identity formation in the context of solo game development as a bioinformatics educator. With the goal of developing a create-your-own-adventure (CYOA) game, we carXiv cs.CY (Computers and Society)