Public Member Functions

Tokenizer Class Reference

#include <Tokenizer.h>

Collaboration diagram for Tokenizer:
Collaboration graph
[legend]

Public Member Functions

inkcoreapi Tokenizer (const char *StrOfDelimiters)
inkcoreapi ~Tokenizer ()
int Initialize (char *str, int opt)
inkcoreapi int Initialize (const char *str)
const char * operator[] (int index)
void setMaxTokens (int max)
int getMaxTokens ()
int getNumber ()
void Print ()
inkcoreapi const char * iterFirst (tok_iter_state *state)
inkcoreapi const char * iterNext (tok_iter_state *state)

Detailed Description

Definition at line 126 of file Tokenizer.h.


Constructor & Destructor Documentation

Tokenizer::Tokenizer ( const char *  StrOfDelimiters  ) 

Definition at line 38 of file Tokenizer.cc.

References memcpy.

Tokenizer::~Tokenizer (  ) 

Definition at line 60 of file Tokenizer.cc.

References ats_free(), COPY_TOKS, tok_node::el, and tok_node::next.


Member Function Documentation

int Tokenizer::getMaxTokens (  )  [inline]

Definition at line 138 of file Tokenizer.h.

int Tokenizer::getNumber (  ) 

Definition at line 283 of file Tokenizer.cc.

int Tokenizer::Initialize ( char *  str,
int  opt 
)
int Tokenizer::Initialize ( const char *  str  ) 

Definition at line 88 of file Tokenizer.cc.

References COPY_TOKS, and Initialize().

const char * Tokenizer::iterFirst ( tok_iter_state state  ) 
const char * Tokenizer::iterNext ( tok_iter_state state  ) 
const char * Tokenizer::operator[] ( int  index  ) 

Definition at line 264 of file Tokenizer.cc.

References tok_node::el, ink_assert, tok_node::next, and TOK_NODE_ELEMENTS.

void Tokenizer::Print (  ) 

Definition at line 324 of file Tokenizer.cc.

References tok_node::el, tok_node::next, and TOK_NODE_ELEMENTS.

void Tokenizer::setMaxTokens ( int  max  )  [inline]

Definition at line 134 of file Tokenizer.h.


The documentation for this class was generated from the following files: