A historical figure you can talk to
Visitors ask Carlo Schmid a question out loud. He answers in his own cloned voice, from the archive's documents, with a face animated by the audio. Every model runs locally, on one machine.
- ~1.2 s
- average response
- 256 / 64
- token chunks / overlap
- 0
- cloud calls
- 01Visitor speaksmicrophone
- 02Whisperspeech to text
- 03Hybrid retrievalFAISS 70% + BM25 30% over OCR'd archive documents
- 04Mistrallocal LLM, in character
- 05XTTS v2cloned voice, streamed sentence by sentence
- 06Audio2Facelip-sync and expression from the audio
- 07MetaHumanrendered live in Unreal Engine 5






