things

2026-04-28 18:52:06 -05:00
parent 57c717aff4
commit dad9999695
3 changed files with 104 additions and 0 deletions
@@ -0,0 +1,32 @@
+# 🎙️ Project Summary: Self-Hosted High-Performance AI Assistant
+
+### 🎯 The Ultimate Goal
+To build a fully local, privacy-focused smart speaker/home automation engine that uses high-end hardware to achieve near-instantaneous response times (low latency) without relying on cloud-based processing.
+
+### 🏗️ The Software Pipeline (The "Stack")
+1.  **Wake Word Detection:** Porcupine/Picovoice (Running on CPU, acting as the gatekeeper).
+2.  **ASR (Speech-to-Text):** `faster-whisper` (Running on **RTX 3080 Ti via CUDA** for high-speed transcription).
+3.  **NLU (The Brain):** Local LLM via **O/llama** (e.g., Llama 3 or Mistral) to parse intent from text into JSON commands.
+4.  **Execution Layer:** **Home Assistant** (Receiving JSON webhooks to trigger physical smart home devices).
+
+### 🖥️ The Hardware & Infrastructure
+*   **Host Hypervisor:** Proxmox VE.
+*   **Physical Resources:** 32GB System RAM, NVIDIA RTX 3080 Ti (12GB VRAM), Intel CPU with VT-d enabled.
+*   **The "Brain" VM Configuration:**
+    *   **OS:** Ubuntu 24.04 LTS (Regular version).
+    *   **CPU:** 1 Socket, 4 Cores, **Type: Host** (Crucial for AI instructions).
+    *   **Memory:** 16GB RAM, **KSM and Ballooning disabled** (To ensure stability and prevent latency jitter).
+    *   **Storage:** VirtIO SCSI Single controller using `io_uring` for high-performance asynchronous I/O.
+    *   **GPU Passthrough:** Completed. The GPU is isolated from Proxmox using `vfio-pci` (bypassing the `nouveau` driver) and passed directly to the Ubuntu VM.
+    *   **Networking:** VirtIO (paravirtualized) for low-latency communication.
+
+### 🚩 Current Progress & Status
+*   [x] Proxmox IOMMU/VT-d configuration finalized.
+*   [x] GPU Isolation and VFIO configuration completed.
+*   [x] Ubuntu VM creation and storage architecture (LVM) finalized.
+*   [x] Ubuntu installation completed.
+*   [ ] **CURRENT TASK:** Post-install "Day Zero" tasks: SSH access, system updates, and installing NVIDIA Drivers + Docker + NVIDIA Container Toolkit.
+
+***
+**Instructions for New Chat:** 
+Paste this block into a new chat and say: *"I am working on the project described in this summary. I have finished the installation and am ready to begin the 'Day Zero' tasks."*