1. Select the Modify button in the top right corner of the screen
2. On the dialog that opens, select Settings.
3. Select Voice Settings.
4. Select Download & Manage Voices. The Manage Voices menu will open.
5. Select the red trash can icon next to the voice you wish to delete.
Also see How do I Add Voices to my Device.