Vocabularies

finalfusion.vocab

finalfusion.vocab.load_vocab(file)	Load any vocabulary from a finalfusion file.
finalfusion.vocab.subword.load_finalfusion_bucket_vocab(file)	Load a FinalfusionBucketVocab from the given finalfusion file.
finalfusion.vocab.subword.load_fasttext_vocab(file)	Load a FastTextVocab from the given finalfusion file.
finalfusion.vocab.subword.load_explicit_vocab(file)	Load a ExplicitVocab from the given finalfusion file.
finalfusion.vocab.simple_vocab.load_simple_vocab(file)	Load a SimpleVocab from the given finalfusion file.
finalfusion.vocab.vocab.Vocab(*args, **kwds)	Finalfusion vocabulary interface.
finalfusion.vocab.simple_vocab.SimpleVocab(…)	Simple vocabulary.
finalfusion.vocab.subword.SubwordVocab(…)	Interface for vocabularies with subword lookups.
finalfusion.vocab.subword.FinalfusionBucketVocab(…)	Finalfusion Bucket Vocabulary.
finalfusion.vocab.subword.FastTextVocab(…)	FastText vocabulary
finalfusion.vocab.subword.ExplicitVocab(…)	A vocabulary with explicitly stored n-grams.

Content

• SimpleVocab
• FinalfusionBucketVocab
• ExplicitVocab
• FastTextVocab
• Interfaces

finalfusion.vocab.load_vocab(file: Union[str, bytes, int, os.PathLike]) → finalfusion.vocab.vocab.Vocab

Load any vocabulary from a finalfusion file.

Loads the first known vocabulary from a finalfusion file.

One of:

• SimpleVocab,

• FinalfusionBucketVocab

• FastTextVocab

• ExplicitVocab

Parameters

file (str, bytes, int, PathLike) – Path to file containing a finalfusion vocab chunk.

Returns

vocab – First vocabulary in the file.

Return type

Vocab

Raises

ValueError – If the file did not contain a vocabulary.