Funny/spooky hallucinations with the Whisper AI model (running TTS locally)
August 31, 2024
Watch on YouTube (opens in new tab)

Last year I decided to stop wasting money paying for AWS' Transcribe service and switched to OpenAI's open-source "Whisper." It was surprisingly easy, however I encountered a bunch of funny issues with hallucinations. Whisper doesn't handle silence (or random noise) well.