🎯

huggingface-tokenizers

🎯Skill

from orchestra-research/ai-research-skills

What it does

Hugging Face Tokenizers skill from the AI Research Engineering skills library, providing guidance for text tokenization workflows used in NLP and language model development.

📦

Same repository

orchestra-research/ai-research-skills(158 items)

huggingface-tokenizers

Installation

Vibe Index InstallInstalls to .claude/skills/

npx vibeindex add orchestra-research/ai-research-skills --skill huggingface-tokenizers

skills.sh Install⚠ Installs to .agents/skills/

npx skills add orchestra-research/ai-research-skills --skill huggingface-tokenizers

Manual InstallCopy SKILL.md content and save to the path below

~/.claude/skills/huggingface-tokenizers/SKILL.md

SKILL.md

421Installs

AddedFeb 7, 2026

View on GitHub Back to Skills

More from this repository10

🔌

distributed-training🔌Plugin

Plugin

Plugin

A tokenization skill from the AI Research Engineering Skills Library, which offers 83 skills across 20 categories covering model architecture, fine-tuning, inference, and other AI research areas.

🔌

inference-serving🔌Plugin

Plugin

Plugin

Plugin

Plugin