ner.data_processing package

Submodules

• ner.data_processing.constants module
  • NER_DECODING_MAP
  • NER_ENCODING_MAP
  • PAD_NER_TAG
  • PAD_TOKEN
  • UNK_TOKEN
• ner.data_processing.data_collator module
  • DataCollator
    • DataCollator.__call__()
    • DataCollator._get_max_length()
    • DataCollator._process_labels()
• ner.data_processing.tokenizer module
  • Tokenizer
    • Tokenizer.__str__()
    • Tokenizer.decode()
    • Tokenizer.extend()
    • Tokenizer.from_dict()
    • Tokenizer.from_file()
    • Tokenizer.id2token
    • Tokenizer.reset()
    • Tokenizer.save()
    • Tokenizer.tokenize()
    • Tokenizer.train()
    • Tokenizer.vocab
    • Tokenizer.vocab_size