lib/python3.9/site-packages/tokenizers/decoders/__init__.py · kktt / ccc-model-manager v1.10.2 - python package | Gemfury

Gemfury

Why Gemfury? Push, build, and install RubyGems npm packages Python packages Maven artifacts PHP packages Go Modules Debian packages RPM packages NuGet packages

kktt / ccc-model-manager python

Repository URL to install this package:

Details

ccc-model-manager / lib / python3.9 / site-packages / tokenizers / decoders / __init__.py

from .. import decoders


Decoder = decoders.Decoder
ByteLevel = decoders.ByteLevel
Replace = decoders.Replace
WordPiece = decoders.WordPiece
ByteFallback = decoders.ByteFallback
Fuse = decoders.Fuse
Strip = decoders.Strip
Metaspace = decoders.Metaspace
BPEDecoder = decoders.BPEDecoder
CTC = decoders.CTC
Sequence = decoders.Sequence