PHP Tokenizer Functions

EditRocket provides the following information on Tokenizer functions in the PHP source code builder.

array token_get_all ( string $source ) - token_get_all() parses the given source string into PHP language tokens using the Zend engine's lexical scanner.

string token_name ( int $token ) - token_name() gets the symbolic name for a PHP token value.