BloombergLP::bdlb::Tokenizer::Tokenizer

Create a Tokenizer bound to input using the specified soft delimiters.

Synopsis

Declared in <bdlb_tokenizer.h>

Tokenizer(
    std::string_view const& input,
    std::string_view const& soft);

Description

Same as the preceding overload for a string_view input.

Parameters

NameDescription
inputcharacter sequence to tokenize
softset of unique soft delimiter characters