Searched defs:tokenize (Results 1 – 3 of 3) sorted by relevance
99 Token[] tokenize(final String seq) { in tokenize() method in LevenshteinSuggestionFormatter
98 private void tokenize(char character, Token token) { in tokenize() method in HanziToPinyin
321 public int tokenize(String[] tokens, String fullName) { in tokenize() method in NameSplitter