lexer
A grammar describes the syntax of a programming language, and might be defined in Backus-Naur form (BNF). A lexer performs lexical analysis, turning text into tokens. A parser takes tokens and builds a data structure like an abstract syntax tree (AST). The parser is concerned with context: does the sequence of tokens fit the grammar? A compiler is a combined lexer and parser, built for a specific grammar.
Here are 230 public repositories matching this topic...
MATLAB Independent, Small & Safe, High Integrity Tools - code formatter and more
-
Updated
Sep 2, 2024 - Python
Simple C Compiler written in Python
-
Updated
Aug 25, 2022 - Python
Mathematica/Wolfram Language lexer and highlighter for Pygments
-
Updated
Mar 16, 2025 - Python
A pure Python protobuf parser
-
Updated
Mar 31, 2025 - Python
OSL to GLSL converter
-
Updated
Aug 25, 2020 - Python
Fortran static analysis tool written in pure Python
-
Updated
Oct 28, 2024 - Python
Python implementation code for The Dragon Book ( Compilers Principles, Techniques, & Tools )
-
Updated
Apr 2, 2020 - Python
Mini-Java Compiler with parser framework for Compiler Design Course
-
Updated
Mar 4, 2024 - Python
Text Processing & Segmentation Framework
-
Updated
Mar 26, 2025 - Python
一个微型的 LL/LR/LALR 语法解析器 | A micro compiler project to provide LL/LR/LALR syntax parser
-
Updated
Dec 3, 2020 - Python
An open source lexer generator
-
Updated
Oct 21, 2018 - Python
- Followers
- 10.9k followers
- Wikipedia
- Wikipedia