Generative AI

Started in August 2023

AI voice cloning is already being used for spear phishing. In the near future, companies may be targeted by criminals. Therefore, it is of crucial importance that PCSI partners are adequately prepared for AI voice calls.

https://pcsi.nl/uploads/projects/generative_ai_1.png

Project Proposal

The aim of the project is to develop a solution that provides the call recipient (e.g. helpdesk, customer service, engineers, procurement officers) with an indication that the caller may be using AI to generate or disguise a voice.

Expected benefits of the Generative AI project?

To ensure that we are adequately prepared enough for AI voice calls.

Why do we want to work on this idea within the PCSI?

Build a shared knowledge base on deepfake audio detection. Develop a solution with input from multiple partners. The project is open to liaison partners.

Our use-case: combating vishing (voice-phishing)

Three main techniques: bulk-vishing, spear-vishing, identity theft/impersonation.

Activities in Explore phase

What is the potential threat to business partners?
What commercial and open source tools are already available to create AI voices?
What are our options for obtaining training data?
How would you potentially integrate a solution?

This project is part of the trend

50 Opportunity and threat February 2025

Increase of the use of generative AI

Generative AI (GenAI) is a type of Artificial Intelligence that can create a wide variety of data, such as images, videos, audio, text, and 3D models. It does this by learning patterns from existing data, then using this knowledge to generate new and unique outputs. GenAI is capable of producing highly realistic and complex content that mimics human creativity, making it a valuable tool for many industries such as gaming, entertainment, and product design. Recent breakthroughs in the field, such as GPT (Generative Pre-trained Transformer) and Midjourney, have significantly advanced the capabilities of GenAI. These advancements have opened up new possibilities for using GenAI to solve complex problems, create art, and even assist in scientific research.