BloombergLP::bdljsn::Tokenizer::Tokenizer

Create a Tokenizer object.

Synopsis

Declared in <bdljsn_tokenizer.h>

explicit
Tokenizer(bslma::Allocator* basicAllocator = 0);

Description

Optionally specify a basicAllocator used to supply memory. If basicAllocator is 0, the currently installed default allocator is used. By default, the conformanceMode is e_RELAXED and the value of the Tokenizer options are: ` allowConsecutiveSeparators() == true; allowFormFeedAsWhitespace() == true; allowHeterogeneousArrays() == true; allowNonUtf8StringLiterals() == true; allowStandAloneValues() == true; allowTrailingTopLevelComma() == true; allowUnescapedControlCharacters() == true; ` The reset method must be called before any calls to advanceToNextToken or resetStreamBufGetPointer.

Parameters

Name

Description

basicAllocator

memory allocator; 0 uses the default

Created with MrDocs