unicode AI Agent Skills

sentencepiece

21.8k

davila7

Language-independent tokenizer treating text as raw Unicode. Supports BPE and Unigram algorithms. Fast (50k sentences/sec), lightweight (6MB memory), deterministic vocabulary. Used by T5, ALBERT, XLNet, mBART. Train on raw text without pre-tokenization. Use when you need multilingual support, CJK languages, or reproducible tokenization.

qe-localization-testing

215

proffesor-for-testing

Internationalization (i18n) and localization (l10n) testing for global products including translations, locale formats, RTL languages, and cultural appropriateness. Use when launching in new markets or building multi-language products.

localization-testing

215

proffesor-for-testing

Internationalization (i18n) and localization (l10n) testing for global products including translations, locale formats, RTL languages, and cultural appropriateness. Use when launching in new markets or building multi-language products.

special-chars-skill

4

Sfmskywalker Agentskillsdotnet Special Chars Skill

A skill testing special characters: quotes "test", apostrophes 'test', and symbols !@#$%