FastBertTokenizer

https://github.com/georg-jung/fastberttokenizer

FastBertTokenizer is a fast and memory-efficient library for WordPiece tokenization as used by BERT,...

Tokens:5,227
Snippets:39
Trust Score:9.1
License:MIT
Update:4 weeks ago
Tokens:
Raw