PHP Tokenizer Functions
EditRocket provides the following information on Tokenizer functions in the PHP source code builder.
array token_get_all ( string $source ) - token_get_all() parses the given source string into PHP language tokens using the Zend engine's lexical scanner.
string token_name ( int $token ) - token_name() gets the symbolic name for a PHP token value.