Did you also configure Emily's voice with Swittalker?
Just about every TTS voice will have some inconsistancies
with a word or combination of words now and then.
For now, treat it as a minor annoyance because the TTS
technology is improving all the time.