How to Use ElevenLabs AI to Clone Your Voice & Generate Natural Speech from Text

Jun. 21, 2023

How to Use ElevenLabs AI to Generate Natural Speech from Text

ElevenLabs is free to use for individual users. Under the free tier, you can generatespeech from text of up to 10,000 charactersin a month. You can also generate speech in multiple languages and accents. That said, here’s how this AI tool works:

1. Head to theElevenLabs website(visit) and click “Sign up” to create a free account.

2. After signing up, you will land on the Speech Synthesis page. Here, in Settings, you canpreview different voicesand choose your preferred voice.

3. You can also choose the audio model right below. If your text is in English, chooseEleven Monolingual v1. In case your text is in other languages, including English, German, Hindi, Spanish, Italian, French, Portuguese, or Polish, choose “Eleven Multilingual v1” here.

4. Finally, enter the text below and click on “Generate” to have ElevenLabs AI convert your text to speech.

5. Here, I have generated the speech from a sample text in Sam’s voice. You can click on the “Download” button to get the generated speech in MP3 format.

6. You can also enter thetext in a different languageand it can generate speech perfectly. Make sure to select the “Multilingual” model from the drop-down menu.

7. You can also clone your voice using ElevenLabs AI, which we have demonstrated below. However, there is a library of voice samples in different accents that you can add fromVoice Library.

8. Click on “Add to VoiceLab” next to your preferred speech. For example, here I am adding a young male voice in a British accent.

9. Now, simplyselect the voicefrom the drop-down menu and generate the speech. You are done.

You might have already seen people on Instagram and TikTok using voice cloning to get prominent figures like Obama, Drake, and many others to say random things. ElevenLabs used to offer Voice Cloning for free, but you nowneed to pay $5 to create up to 10 custom voices. In case you don’t want to pay, you can use PlayHT (visit) to clone your voice for free. In this article, I am going to use ElevenLabs AI to clone my voice.

1. To clone your voice with ElevenLabs AI, click on “Voice Lab” at the top. After that, click onAdd Generative or Cloned Voice.

2. Next, click onInstant Voice Cloning.

3. After a few seconds, your voice will be cloned and ready to use. Click on “Use” to convert text to speech using it right away.

4. Here, make sure your voice is selected in the drop-down menu. Now, add your text, and click onGenerate. It will take a few seconds to synthesize your speech and generate audio. You can now download the audio as well.

In my opinion, ElevenLabs AI didn’t do a good job at cloning my voice despite uploading a 5-minute audio file. Perhaps, I need to add more audio samples and train the model again. Or, it could be because the AI model is delivering the output in English (US) instead of localizing the accent for India. Also, in my audio sample, there was some background noise which may have reduced the quality. Nevertheless, it’s an exciting AI project, and we will keep track of all the new advancements in speech synthesis.

Passionate about Windows, ChromeOS, Android, security and privacy issues. Have a penchant to solve everyday computing problems.