1Tokenize module now implicitly emits a NEWLINE when provided with input that
2does not have a trailing new line.  This behavior now matches what the C
3tokenizer does internally.  Contributed by Ammar Askar.
4