Searched defs:tokenize (Results 1 – 5 of 5) sorted by relevance
155 def tokenize(readline, tokeneater=printtoken): function
156 def tokenize(readline, tokeneater=printtoken): function
160 def tokenize(readline, tokeneater=printtoken): function
65 def tokenize(self, s): member in GenericScanner
61 def tokenize(self, input): member in ASDLScanner