BloombergLP::bdlb::Tokenizer_Data::Tokenizer_Data

Same as the preceding overload, also marking characters in the specified hardDelimiters as hard delimiter characters.

Synopsis

Declared in <bdlb_tokenizer.h>

Tokenizer_Data(
    std::string_view const& softDelimiters,
    std::string_view const& hardDelimiters);