Dépendances inversées pour tokenizers Latest version of the following gems require tokenizers
informers 1.2.1
Fast transformer inference for Ruby
2 371 004 Téléchargements
discourse_ai-tokenizers 0.4
A Ruby gem providing a consistent interface for various AI/ML tokenizers including Open...
115 774 Téléchargements
llm_memory 0.1.15
LLM Memory is a Ruby gem designed to provide large language models (LLMs) like ChatGPT ...
21 289 Téléchargements
clip-rb 2.0.0
OpenAI CLIP embeddings, uses ONNX models. Allows to create embeddings for images and text
5 850 Téléchargements
transformers-rb 0.1.7
State-of-the-art transformers for Ruby
3 991 Téléchargements
vectorsearch 0.1.2
Vector Search backed by your vector search DB of choice.
1 879 Téléchargements
gliner 0.3.1
Basic Ruby inference wrapper for the GLiNER2 ONNX model.
1 406 Téléchargements
token_estimator 0.1.2
TokenEstimator is a Rails gem that allows you to count tokens in Excel, CSV, PDF, TXT, ...
1 354 Téléchargements
fastembed 1.1.0
A Ruby port of FastEmbed - fast text embeddings using ONNX Runtime
1 123 Téléchargements
fine 0.2.0
A Ruby-native interface for fine-tuning machine learning models, starting with image cl...
421 Téléchargements
siglip2 1.0.0
Ruby implementation of Google's SigLIP2 model for creating text and image embeddings. U...
421 Téléchargements
prompt_guard 1.0.2
Security pipelines for LLM applications using ONNX models from Hugging Face Hub. Detect...
373 Téléchargements
nanochat 0.1.0.pre
A minimal, hackable LLM implementation with inference capabilities. Port of Karpathy's ...
192 Téléchargements
kiribi-ruri_v3-30m 0.0.3
Easy to use some onnx models.
164 Téléchargements