[#BloombergLP-bdlb-Tokenizer_Data-2constructor-00]
= xref:BloombergLP.adoc[BloombergLP]::xref:BloombergLP/bdlb.adoc[bdlb]::xref:BloombergLP/bdlb/Tokenizer_Data.adoc[Tokenizer&lowbar;Data]::Tokenizer&lowbar;Data
:relfileprefix: ../../../
:mrdocs:

Same as the preceding overload, also marking characters in the specified `hardDelimiters` as hard delimiter characters&period;

== Synopsis

Declared in `&lt;bdlb&lowbar;tokenizer&period;h&gt;`

[source,cpp,subs="verbatim,replacements,macros,-callouts"]
----
Tokenizer&lowbar;Data(
    std::string&lowbar;view const& softDelimiters,
    std::string&lowbar;view const& hardDelimiters);
----


[.small]#Created with https://www.mrdocs.com[MrDocs]#
