[#BloombergLP-baljsn-JsonTokenizer]
= xref:BloombergLP.adoc[BloombergLP]::xref:BloombergLP/baljsn.adoc[baljsn]::JsonTokenizer
:relfileprefix: ../../
:mrdocs:

This class provides a tokenizer for non&hyphen;scalar `bdljsn&colon;&colon;Json` objects&period;

== Synopsis

Declared in `&lt;baljsn&lowbar;jsontokenizer&period;h&gt;`

[source,cpp,subs="verbatim,replacements,macros,-callouts"]
----
class JsonTokenizer;
----

== Description

This class implements a mechanism that makes the organization and values of a non&hyphen;scalar `bdljsn&colon;&colon;Json` object available as a series of tokens&period; Some tokens have associated values&period; See &period;

== Type Aliases

[cols="1,4"]
|===
| Name| Description
| xref:BloombergLP/baljsn/JsonTokenizer/allocator_type.adoc[`allocator&lowbar;type`] 
| Type of the allocator used to supply memory&period;
|===


== Enums

[cols="1,4"]
|===
| Name| Description
| xref:BloombergLP/baljsn/JsonTokenizer/TokenType-06.adoc[`TokenType`] 
| Enumeration of tokenizer token types&period;
|===


== Member Functions

[cols="1,4"]
|===
| Name| Description
| xref:BloombergLP/baljsn/JsonTokenizer/2constructor-0d.adoc[`JsonTokenizer`]         [.small]#[constructor]#
| Constructors
| xref:BloombergLP/baljsn/JsonTokenizer/2destructor.adoc[`&#126;JsonTokenizer`] [.small]#[destructor]#
| Destroy this object&period;
| xref:BloombergLP/baljsn/JsonTokenizer/advanceToNextToken.adoc[`advanceToNextToken`] 
| Move to the next token in the source object&period;
| xref:BloombergLP/baljsn/JsonTokenizer/get_allocator.adoc[`get&lowbar;allocator`] 
| Return the allocator used by this object to supply memory&period;
| xref:BloombergLP/baljsn/JsonTokenizer/reset.adoc[`reset`] 
| Reset this tokenizer to use the specified `json` as a source object for tokens&period;
| xref:BloombergLP/baljsn/JsonTokenizer/tokenType-09.adoc[`tokenType`] 
| Return the type of the current token&period;
| xref:BloombergLP/baljsn/JsonTokenizer/value-05.adoc[`value`] 
| Load into the specified `data` the value of the current token&period;
|===


== Static Member Functions

[cols="1,4"]
|===
| Name| Description
| xref:BloombergLP/baljsn/JsonTokenizer/print.adoc[`print`] 
| Write the string representation of the specified `value` to `stream`&period;
| xref:BloombergLP/baljsn/JsonTokenizer/toAscii.adoc[`toAscii`] 
| Return the string representation of the specified enumeration `value`&period;
|===


== Friends

[cols="1,4"]
|===
| Name| Description
| `xref:BloombergLP/baljsn/JsonTokenizer_Visitor.adoc[BloombergLP::baljsn::JsonTokenizer&lowbar;Visitor]`
| This class extracts token information from a `bdljsn&colon;&colon;Json` object&period;
|===


[.small]#Created with https://www.mrdocs.com[MrDocs]#
