Skip to content

Function: tokenizeWithOptions()

tokenizeWithOptions(options, …values): Generator<string>

Yield normalized tokens using explicit casing, URI, email, and deduplication rules.

TokenizeOptions

…unknown[]

Generator<string>