[#BloombergLP-bdlb-Tokenizer-2constructor-09]
= xref:BloombergLP.adoc[BloombergLP]::xref:BloombergLP/bdlb.adoc[bdlb]::xref:BloombergLP/bdlb/Tokenizer.adoc[Tokenizer]::Tokenizer
:relfileprefix: ../../../
:mrdocs:

Same as the preceding overload, also using the specified `hard` delimiter characters.

== Synopsis

Declared in `<bdlb_tokenizer.h>`

[source,cpp,subs="verbatim,replacements,macros,-callouts"]
----
Tokenizer(
    char const* input,
    std::string_view const& soft,
    std::string_view const& hard);
----


[.small]#Created with https://www.mrdocs.com[MrDocs]#