MedComms: VI ⇄ EN speech translation pipeline

MedComms: VI ⇄ EN speech translation pipeline An architecture diagram generated by Archify. Speaker page · mic → AudioWorklet → Opus · Architecture component Speaker page mic → AudioWorklet → Opus Front door · aiohttp · relay + recording · Small VM · medcomms front Front door aiohttp · relay + recording users.json · scrypt hashes · Small VM · medcomms front users.json scrypt hashes sessions/ · audio.opus · results.jsonl · Small VM · medcomms front sessions/ audio.opus · results.jsonl Engine HTTP · WS /ws/<direction> · Modal GPU · app medcomms-engine · 1 session per direction Engine HTTP WS /ws/<direction> 1 session per direction Segmenter · Silero VAD · Modal GPU · app medcomms-engine › One pipeline per direction (vi-en, en-vi in parallel) Segmenter Silero VAD Transcriber (ASR) · faster-whisper / transformers · Modal GPU · app medcomms-engine › One pipeline per direction (vi-en, en-vi in parallel) Transcriber (ASR) faster-whisper / transformers Translator (MT) · seq2seq / merged PEFT · Modal GPU · app medcomms-engine › One pipeline per direction (vi-en, en-vi in parallel) Translator (MT) seq2seq / merged PEFT WS · Opus + {end} WS · proxy auth PCM int16 speech segments text partial / final info · partial · final finals with id sign-in record Small VM · medcomms front Modal GPU · app medcomms-engine One pipeline per direction (vi-en, en-vi in parallel) Legend Frontend Backend Database