Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.
Required Ruby Version
>= 3.1.0
Required Rubygems Version
>= 3.3
Authors
Christopher Petersen, kojix2
Versions
- 1.8.1 June 20, 2026 x86_64-linux (41.3 MB)
- 1.8.1 June 20, 2026 aarch64-linux (39.7 MB)
- 1.8.1 June 20, 2026 arm64-darwin (38.2 MB)
- 1.8.1 June 20, 2026 (129 KB)
- 1.8.0 June 18, 2026 x86_64-linux (41.3 MB)
Requirements
Rust >= 1.85
