Searched refs:setTokenizer (Results 1 – 1 of 1) sorted by relevance
318 def setTokenizer(self, tokenizer): member in CppTokenizerTester354 tester.setTokenizer(CppStringTokenizer("#an/example && (01923_xy)"))358 tester.setTokenizer(CppStringTokenizer("FOO(BAR) && defined(BAZ)"))362 tester.setTokenizer(CppStringTokenizer("/*\n#\n*/"))365 tester.setTokenizer(CppStringTokenizer("first\nsecond"))368 tester.setTokenizer(CppStringTokenizer("first second\n third"))373 tester.setTokenizer(CppStringTokenizer("boo /* what the\nhell */"))376 tester.setTokenizer(CppStringTokenizer("an \\\n example"))