WebMoti
Hybrid learning platform for neurodivergent students.
Overview
Custom video conferencing interface for a research project studying hybrid learning for neurodivergent students. Twilio Video streamed two camera feeds (classroom overview + whiteboard) to remote participants, who could interact with a physical robotic hand.
Forked from the twilio-video-app-react open-source template and heavily customized:
- Toolchain migration: Create React App → Vite, React 16 → 19, MUI v4 → v7, Enzyme → React Testing Library
- Raise hand queue: students join an ordered speaker queue; the professor sees who’s next in real time
- Notify button: sends a customizable audio cue to the professor (tones or TTS voice clips), designed around neurodivergent communication needs
- Robot hand control: buttons trigger physical gestures (raise, wave, etc.) via the Python backend
- Classroom audio controls: remote mute, mic mixing, and volume controls across participant modes
- Camera controls: zoom, pan, rotation, and quality switching for the remote feeds, all keyboard-shortcut accessible
- Live captions: WebSocket overlay fed from a speech recognition stream
- Python/FastAPI backend: raise hand queue (SSE), captions WebSocket, TTS, session scheduling