BloombergLP::bdlb::Tokenizer::Tokenizer

Create a Tokenizer bound to input using soft and hard delimiters.

Synopsis

Declared in <bdlb_tokenizer.h>

Tokenizer(
    char const* input,
    std::string_view const& soft,
    std::string_view const& hard);

Description

Same as the preceding overload, also using the specified hard delimiter characters.

Parameters

NameDescription
inputnull-terminated character sequence to tokenize
softset of unique soft delimiter characters
hardset of unique hard delimiter characters