class Kachet::Tokenizer
- Kachet::Tokenizer
- Reference
- Object
Defined in:
kachet.crConstructors
Instance Method Summary
- #build_path(text, edge_builders)
- #path_to_ranges(path)
- #ranges_to_tokens(ranges, text)
- #tokenize(text : String)