LexiC is a simple and modular C project that converts source code into a stream of tokens. It handles token counting, segmentation, and full tokenization, forming the first stage of a compiler or interpreter pipeline.
c parsing lexer lexical-analyzer compiler-frontend tokenization c-programming source-code-analysis lexi-c
-
Updated
May 24, 2025 - C