[#BloombergLP-bdlb-Tokenizer_Data-2constructor-07]
= xref:BloombergLP.adoc[BloombergLP]::xref:BloombergLP/bdlb.adoc[bdlb]::xref:BloombergLP/bdlb/Tokenizer_Data.adoc[Tokenizer&lowbar;Data]::Tokenizer&lowbar;Data
:relfileprefix: ../../../
:mrdocs:

Constructors

== Synopses

Declared in `&lt;bdlb&lowbar;tokenizer&period;h&gt;`

Create a `Tokenizer&lowbar;Data` from the specified soft delimiters&period;


[source,cpp,subs="verbatim,replacements,macros,-callouts"]
----
explicit
xref:BloombergLP/bdlb/Tokenizer_Data/2constructor-04.adoc[Tokenizer&lowbar;Data](std::string&lowbar;view const& softDelimiters);
----

[.small]#xref:BloombergLP/bdlb/Tokenizer_Data/2constructor-04.adoc[_» more&period;&period;&period;_]#

Create a `Tokenizer&lowbar;Data` from soft and hard delimiter sets&period;


[source,cpp,subs="verbatim,replacements,macros,-callouts"]
----
xref:BloombergLP/bdlb/Tokenizer_Data/2constructor-00.adoc[Tokenizer&lowbar;Data](
    std::string&lowbar;view const& softDelimiters,
    std::string&lowbar;view const& hardDelimiters);
----

[.small]#xref:BloombergLP/bdlb/Tokenizer_Data/2constructor-00.adoc[_» more&period;&period;&period;_]#

== Parameters

[cols="1,4"]
|===
| Name| Description
| *softDelimiters*
| characters treated as soft delimiters
| *hardDelimiters*
| characters treated as hard delimiters
|===


[.small]#Created with https://www.mrdocs.com[MrDocs]#
