[#BloombergLP-baljsn-JsonTokenizer]
= xref:BloombergLP.adoc[BloombergLP]::xref:BloombergLP/baljsn.adoc[baljsn]::JsonTokenizer
:relfileprefix: ../../
:mrdocs:

This class provides a tokenizer for non‐scalar `bdljsn::Json` objects.

== Synopsis

Declared in `<baljsn_jsontokenizer.h>`

[source,cpp,subs="verbatim,replacements,macros,-callouts"]
----
class JsonTokenizer;
----

== Description

This class implements a mechanism that makes the organization and values of a non‐scalar `bdljsn::Json` object available as a series of tokens. Some tokens have associated values. See .

== Type Aliases

[cols="1,4"]
|===
| Name| Description
| xref:BloombergLP/baljsn/JsonTokenizer/allocator_type.adoc[`allocator_type`] 
| Type of the allocator used to supply memory.
|===


== Enums

[cols="1,4"]
|===
| Name| Description
| xref:BloombergLP/baljsn/JsonTokenizer/TokenType-06.adoc[`TokenType`] 
| Enumeration of tokenizer token types.
|===


== Member Functions

[cols="1,4"]
|===
| Name| Description
| xref:BloombergLP/baljsn/JsonTokenizer/2constructor-0d.adoc[`JsonTokenizer`]         [.small]#[constructor]#
| Constructors
| xref:BloombergLP/baljsn/JsonTokenizer/2destructor.adoc[`~JsonTokenizer`] [.small]#[destructor]#
| Destroy this object.
| xref:BloombergLP/baljsn/JsonTokenizer/advanceToNextToken.adoc[`advanceToNextToken`] 
| Move to the next token in the source object.
| xref:BloombergLP/baljsn/JsonTokenizer/get_allocator.adoc[`get_allocator`] 
| Return the allocator used by this object to supply memory.
| xref:BloombergLP/baljsn/JsonTokenizer/reset.adoc[`reset`] 
| Reset this tokenizer to use the specified `json` as a source object for tokens.
| xref:BloombergLP/baljsn/JsonTokenizer/tokenType-09.adoc[`tokenType`] 
| Return the type of the current token.
| xref:BloombergLP/baljsn/JsonTokenizer/value-05.adoc[`value`] 
| Load into the specified `data` the value of the current token.
|===


== Static Member Functions

[cols="1,4"]
|===
| Name| Description
| xref:BloombergLP/baljsn/JsonTokenizer/print.adoc[`print`] 
| Write the string representation of the specified `value` to `stream`.
| xref:BloombergLP/baljsn/JsonTokenizer/toAscii.adoc[`toAscii`] 
| Return the string representation of the specified enumeration `value`.
|===


== Friends

[cols="1,4"]
|===
| Name| Description
| `xref:BloombergLP/baljsn/JsonTokenizer_Visitor.adoc[BloombergLP::baljsn::JsonTokenizer_Visitor]`
| This class extracts token information from a `bdljsn::Json` object.
|===


[.small]#Created with https://www.mrdocs.com[MrDocs]#