The PokeMiku / Pocket Miku device takes MIDI commands to sing notes and could be adapted to speak. The Vocaloid Keyboard VKB-100 seems to use similar commands.
Initial version can probably be robotic speech similar to Robokoe but it might also be possible to use MaryTTS to generate pitch data which could then be fed to MIDI, for something a bit more realistic.