nlptools.model.tokenizer
->SimpleTokModel
(->SimpleTokModel logger)
Positional factory function for class nlptools.model.tokenizer.SimpleTokModel.
->TokModel
(->TokModel id binfile trainfile language model logger)
Positional factory function for class nlptools.model.tokenizer.TokModel.
->WhitespaceTokModel
(->WhitespaceTokModel logger)
Positional factory function for class nlptools.model.tokenizer.WhitespaceTokModel.
map->SimpleTokModel
(map->SimpleTokModel m__7585__auto__)
Factory function for class nlptools.model.tokenizer.SimpleTokModel, taking a map of keywords to field values.
map->TokModel
(map->TokModel m__7585__auto__)
Factory function for class nlptools.model.tokenizer.TokModel, taking a map of keywords to field values.
map->WhitespaceTokModel
(map->WhitespaceTokModel m__7585__auto__)
Factory function for class nlptools.model.tokenizer.WhitespaceTokModel, taking a map of keywords to field values.