Text Gen WebUI Install

Installing Text Generation WebUI on Apple Silicon

Text Generation WebUI (oobabooga) on Mac uses Metal GPU acceleration for fast inference.

Installation

1. Clone repository:
   git clone https://github.com/oobabooga/text-generation-webui
2. Run installer:
   bash start_macos.sh
3. Download models:
   Place model files in ~/text-generation-webui/models/
4. Launch:
   ./start_macos.sh --listen

Features

• Multiple model formats
• Chat mode with instruction templates
• Custom chat templates for roleplay
• API server mode