This gist collects changes to the official docker build of tabbyAPI and some additional files used to create a derived build suitable for RunPod.
- The Royal Lab's tabbyAPI GitHub
- Docker Hub repo with custom RunPod images
- tabbyAPI RunPod template for CUDA 12.1, derived from nvidia/cuda:12.1.0-runtime-ubuntu22.04
- tabbyAPI RunPod template for CUDA 12.2, derived from nvidia/cuda:12.2.2-runtime-ubuntu22.04