Open topic with navigation

# NGramMultiByteOnly

Whether to tokenize all strings into N-grams, or only multi-byte strings. Use this parameter in combination with the NGram parameter, which determines the size of character N-grams.

For example, if you set `NGramMultiByteOnly` to `True`, if a document that contains both English and Asian text, IDOL Category Component tokenizes the Asian text into N-grams according to the NGram setting. It does not tokenize the English text.

Type: | Boolean
Default: | False
Required: | No
Configuration Section: | LanguageTypes or `MyLanguage`
Example: |
    Ngram=2
    NgramMultiByteOnly=True
See Also: | NGram

© 2016 Hewlett Packard Enterprise Development LP | Send documentation feedback to HPE Close We welcome your comments! To open the configured email client on this computer, open an email window. Otherwise, copy the information below to a web mail client, and send this email to AutonomyTPFeedback@hpe.com. Product: Topic Title: Help Topic: Feedback:

_HP_HTML5_bannerTitle.htm