How Voice Cloning Works
Voice cloning uses AI to analyze a sample of a person's voice and generate new speech in that voice. Early voice synthesis systems required hours of recorded audio to produce convincing results. Modern AI voice cloning tools can generate a usable voice clone from a few seconds of audio — enough to be sourced from a social media video, a voicemail greeting, or a public recording.
Once a voice clone is created, it can be used to generate any text as speech in the cloned voice, or in some systems, to conduct real-time voice conversion during a phone call — making the caller's voice sound like the cloned person in real time.
The Grandparent Scam and Voice Cloning
The grandparent scam is one of the most common voice cloning fraud schemes. A criminal calls an elderly person, plays a brief clip of a cloned voice that sounds like their grandchild, and then claims the grandchild is in trouble — arrested, in a car accident, or in the hospital — and needs money immediately. The caller often instructs the victim not to tell other family members.
The FTC has documented cases where victims lost thousands of dollars to this scam. The emotional urgency of hearing what sounds like a grandchild's voice in distress can override normal skepticism, particularly when the caller insists on secrecy and speed.
Seniors are disproportionately targeted by this scam, but it has also been used against parents and other family members. Anyone with publicly available audio of their voice — which includes most people who use social media — is potentially vulnerable to voice cloning.
Voice Cloning in Business and Financial Fraud
Voice cloning is also used in business fraud. Criminals impersonate executives, IT personnel, or financial officers to instruct employees to transfer funds, share credentials, or bypass security procedures. In some documented cases, employees received calls that sounded exactly like their CEO authorizing an urgent wire transfer.
This type of attack is sometimes combined with email compromise — the victim receives a convincing email followed by a phone call in the executive's cloned voice, reinforcing the legitimacy of the request.
How to Protect Yourself and Your Family
Establish a family code word. Agree on a word or phrase that only family members know. If you receive a call from someone claiming to be a family member in distress, ask for the code word before taking any action. A genuine family member will know it; a scammer will not.
Hang up and call back. If you receive an unexpected call from someone claiming to be a family member, bank, or government agency, hang up and call them back using a number you already have — not a number provided by the caller. This simple step defeats most voice cloning scams.
Be skeptical of urgency and secrecy. Scammers use urgency ('you must act now') and secrecy ('don't tell anyone') to prevent victims from verifying the request. Legitimate emergencies can almost always wait a few minutes for a callback.
Talk to elderly family members about this threat. Many older adults are not aware that AI can clone voices. A brief conversation explaining that a voice on the phone is no longer proof of identity — and establishing a code word — can prevent significant financial and emotional harm.
Sources & References
CyberIdentityTheft.com is an independent consumer education resource and is not affiliated with any of the organizations listed above.