The first version of LIPS Scheme had regex based tokenizer. It was using a single regex to split the input string into tokens. In this article, I will show the internals of the new Lexer in LIPS Scheme.

LIPS Scheme support regular expression literals, but it's not the only one implementation that support those. Other implementation includes Gauche and Kawa.

Unfortunetlly, you can't easily use those regular expressions in GNU Emacs, my main editor of choice.

This is the first article on LIPS blog. In this article I will write about the history of LIPS Scheme interpreter.