Searched defs:new_token (Results 1 – 5 of 5) sorted by relevance
| /external/antlr/antlr-3.4/runtime/Ruby/test/unit/ | ||
| D | test-trees.rb | 302 def new_token(type, opts = {}) method in TestTreeNodeStream |
| D | test-streams.rb | 404 def new_token(type, opts = {}) method in TestCommonTokenStream |
| /external/libtextclassifier/smartselect/ | ||
| D | tokenizer.cc | 71 Token new_token("", 0, 0); in Tokenize() local |
| D | feature-processor.cc | 98 Token new_token(token_word.UTF8Substring(last_start, split_point), in SplitTokensOnSelectionBoundaries() local |
| /external/mesa3d/src/glsl/glcpp/ | ||
| D | glcpp-parse.y | 838 token_t *new_token = ralloc (copy, token_t); in _token_list_copy() local |