BloombergLP::bdlb::Tokenizer::Tokenizer

Synopses

Declared in <bdlb_tokenizer.h>

Create a Tokenizer bound to input using the specified soft delimiters.

Tokenizer(
    std::string_view const& input,
    std::string_view const& soft);

Create a Tokenizer bound to input using the specified soft delimiters.

Tokenizer(
    char const* input,
    std::string_view const& soft);

Create a Tokenizer bound to input using soft and hard delimiters.

Tokenizer(
    std::string_view const& input,
    std::string_view const& soft,
    std::string_view const& hard);

Create a Tokenizer bound to input using soft and hard delimiters.

Tokenizer(
    char const* input,
    std::string_view const& soft,
    std::string_view const& hard);

Name	Description
input	character sequence to tokenize
soft	set of unique soft delimiter characters
hard	set of unique hard delimiter characters