KELA’s 2025 AI Threat Report finds a 200% rise in malicious AI tool mentions and a 52% jump in jailbreaking discussions on cybercrime forums
TEL AVIV, Israel, March 25, 2025 /PRNewswire/ — KELA, a global leader in cyber threat and exposure intelligence solutions, today released its 2025 AI Threat Report: How Cybercriminals are Weaponizing AI Technology (LINK), revealing a 200% increase in mentions of malicious AI tools on cybercrime forums in 2024. The findings underscore the growing trend of cybercriminals rapidly advancing their AI tactics.
In the past 12 months, threat actors increasingly leveraged LLMs including ChatGPT, Gemini, DeepSeek, Claude and other public GenAI applications to use dark AI tools to improve business operations and to use jailbreak techniques to bypass public AI systems to conduct malicious activities. The shift in tactics requires a new mindset where organizations must act just as quickly to stay ahead.
Key Findings from KELA’s 2025 AI Threat Report:
- Jailbreaking methods are evolving rapidly:
Threat actors are continuously refining AI jailbreaking techniques to bypass security restrictions in public AI systems. KELA observed a 52% increase in discussions related to jailbreaking methods on cybercrime forums in 2024 compared to the previous year. - Threat actors are increasingly leveraging AI in cybercrime forums:
KELA’s platform recorded a 200% increase in mentions of malicious AI tools and tactics in 2024, highlighting a growing underground market for AI-assisted cybercrime. - Dark AI tools are proliferating:
Cybercriminals are distributing and selling jailbroken AI models and customized malicious AI tools, such as WormGPT and FraudGPT, to automate phishing, malware creation, and fraud operations. - AI-driven phishing campaigns are becoming more sophisticated:
AI-generated phishing and social engineering tactics have increased in effectiveness, with deepfake technologies being used to impersonate executives and trick employees into executing fraudulent transactions. - Malware development is becoming more efficient with AI assistance:
Threat actors are using AI tools to generate at scale sophisticated, evasive malware, including ransomware and infostealers, making detection and mitigation more challenging for security teams.
“We are witnessing a seismic shift in the cyber threat landscape,” said Yael Kishon, AI Product & Research Lead at KELA. “Cybercriminals are not just using AI – they are building entire sections in the underground ecosystem dedicated to AI-powered cybercrime. Organizations must adopt AI-driven defenses to combat this growing threat.”
To combat the rising AI-powered cyber threats, KELA urges organizations to invest in employee training, monitor evolving AI threats and tactics, and implement AI-driven security measures including automated intelligence-based red teaming and adversary emulations for Generative AI models.
The 2025 AI Threat Report: How Cybercriminals are Weaponizing AI Technology is available here.
About KELA Cyber
KELA is an Intelligence-Driven Threat Exposure Management company. We are redefining how organizations discover, monitor, and reduce risk from external threats—both known and unknown, managed or unmanaged. Our unique technology enables automatic, real-time access to the exact places where threat actors communicate, collaborate, and monetize stolen information, allowing organizations to take proactive action. By combining our proprietary CTI Platform with External Attack Surface Management and Third-Party Risk Management, along with direct access to the hidden corners of the cybercrime underground in the Deep and Dark Web, our solutions empower organizations to continuously and proactively reduce their exposure to external threats—at any scale, from a single enterprise to the national level. Learn more at www.kelacyber.com.
Press Contact:
