Prolog(Elex): A New Tool
to Generate Prolog Tokenizers

Gertjan van Noord
Alfa-Informatica & BCN
University of Groningen
vannoord@let.rug.nl

Abstract
This paper presents a tool called Elex(Prolog) to construct tokenizers (lexical analysers, scanners, lexers) in Prolog. It is based on Elex, a multilingual scanner generator by Matthew Phillips. The paper motivates the tool, and presents its functionality and implementation. It also compares Elex(Prolog) to the only alternative Prolog scanner generator that we are aware of: plex.