fmartingr/tellme
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Implement Phase 1: Global hotkey, HUD, and audio capture

Browse source 
Add complete listening UX without STT:
- Global hotkey manager with ⌘⇧V, push-to-talk and toggle modes
- Floating HUD with real-time RMS audio visualization
- AVAudioEngine capture with 16kHz mono PCM conversion
- 10-minute dictation timeout with ESC cancellation
- Optional start/stop sounds and microphone permissions
- Permission management for accessibility and input monitoring

All Phase 1 acceptance criteria met.
This commit is contained in:
Felipe M 2025-09-18 20:06:46 +02:00
parent 1db16227b2
commit 6e768a7753
Signed by: fmartingr
GPG key ID: CCFBC5637D4000A8
10 changed files with 1005 additions and 51 deletions
Download patch file Download diff file Expand all files Collapse all files

38
TODO.md
View file

@ -54,27 +54,27 @@ Conventions:
**Goal:** Listening UX without real STT.
### Tasks
- [ ] Implement **global hotkey** manager:
- [ ] Default **⌘⇧V** (configurable later).
- [ ] Support **push-to-talk** (start on key down, stop on key up).
- [ ] Support **toggle** (press to start, press to stop).
- [ ] Create **HUD** as non-activating centered `NSPanel`:
- [ ] State **Listening** with **RMS/peak bars** animation (SwiftUI view).
- [ ] State **Processing** with spinner/label.
- [ ] Dismiss/cancel with **Esc**.
- [ ] Implement **AVAudioEngine** capture:
- [ ] Tap on input bus; compute RMS/peak for visualization.
- [ ] Resample path ready for 16 kHz mono PCM (no STT yet).
- [ ] Add dictation **time limit** (default **10 min**, configurable later).
- [ ] Optional **sounds** for start/stop (toggle in settings later).
- [ ] Permissions onboarding:
- [ ] Request **Microphone** permission with Info.plist string.
- [ ] Show guide for **Accessibility** and **Input Monitoring** (no hard gating yet).
- [x] Implement **global hotkey** manager:
- [x] Default **⌘⇧V** (configurable later).
- [x] Support **push-to-talk** (start on key down, stop on key up).
- [x] Support **toggle** (press to start, press to stop).
- [x] Create **HUD** as non-activating centered `NSPanel`:
- [x] State **Listening** with **RMS/peak bars** animation (SwiftUI view).
- [x] State **Processing** with spinner/label.
- [x] Dismiss/cancel with **Esc**.
- [x] Implement **AVAudioEngine** capture:
- [x] Tap on input bus; compute RMS/peak for visualization.
- [x] Resample path ready for 16 kHz mono PCM (no STT yet).
- [x] Add dictation **time limit** (default **10 min**, configurable later).
- [x] Optional **sounds** for start/stop (toggle in settings later).
- [x] Permissions onboarding:
- [x] Request **Microphone** permission with Info.plist string.
- [x] Show guide for **Accessibility** and **Input Monitoring** (no hard gating yet).
### AC
- [ ] Hotkey works in both modes (push/toggle) across desktop & full-screen apps.
- [ ] HUD appears centered; **Listening** shows live bars; **Processing** shows spinner.
- [ ] Cancel (Esc) reliably stops listening and hides HUD.
- [x] Hotkey works in both modes (push/toggle) across desktop & full-screen apps.
- [x] HUD appears centered; **Listening** shows live bars; **Processing** shows spinner.
- [x] Cancel (Esc) reliably stops listening and hides HUD.
---