June 13, 2024 at 02:41PM
Conversational AI has been used to engage with scammers, providing insight into cybercriminal operations and extracting information about their fraud methods and infrastructure. Netcraft’s ChatGPT-based chatbot was successful in collecting bank account details from fraudsters, demonstrating the potential of AI in countering cybercrime and creating a more proactive cyber defense.
The meeting notes provide insights into the use of conversational AI in engagement with scammers and cybercriminals. The experiment conducted by UK-based fraud-defense firm Netcraft demonstrated that large language models (LLMs) can effectively interact with cybercriminals, extracting valuable threat intelligence by engaging in conversations with them. The AI chatbot, based on OpenAI’s ChatGPT, was used to respond to scams and gather sensitive information, such as bank account numbers from multiple financial institutions across various countries.
This approach allows threat analysts to gain deeper insights into cybercriminal activities, adapt to different types of criminal behavior, and potentially disrupt fraud rings operating internationally, particularly in regions like Southeast Asia. The use of AI chatbots with local language capabilities has shown potential in curbing cybercrime by making it more challenging for cybercriminals to carry out their fraudulent activities.
The AI chatbot was successful in engaging cybercriminals in conversations, resulting in the collection of significant threat data. As a result, Netcraft introduced its Conversational Scam Intelligence service at the RSA Conference, leveraging AI technology to combat cybercrime. The system’s ability to engage cybercriminals at scale and gather important threat intelligence holds promise in potentially shifting the advantage from attackers back to defenders, as attackers are also starting to adopt AI in new ways. The ongoing development of the AI chatbot’s capabilities, such as adding more languages, further underscores its potential impact in combating cybercrime.