Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Menhir parser #1295

Draft
wants to merge 151 commits into
base: master
Choose a base branch
from
Draft

Menhir parser #1295

wants to merge 151 commits into from

Conversation

jonludlam
Copy link
Member

This is @FayCarson's work.

There are still some fixes that need to be made. See src/parser/TODO.md for a list.

@FayCarsons
convert lexer to use menhir tokens
6958fd5
@FayCarsons
lexer uses new tokens
6654f63
@FayCarsons
unwrap tokens received from lexer, notes
333e446
@FayCarsons
remove modules directive from parser/test/dune
1ba3a63
@FayCarsons
Add media tokens, null parser will compile, separate types and utils
21135d8
@FayCarsons
trivial/whitespace tests passing
a42097c
@FayCarsons
Add inline element and list rules
a2a9083
@FayCarsons
Fix naming in list rule, add dummy 'nestable block element' rule
36befac
@FayCarsons
Refactor 'tag' rule to support variants w/ children
54fef41
@FayCarsons
Rewrite 'located' parser util to use new menhir syntax; formatting
68cb3b0
@FayCarsons
move tag parser helpers to Menhir header
0c4f9c1
@FayCarsons
Add heavy list and nestable element rules
1408d3f
@FayCarsons
Use located modifier, formatting
d255bde
@FayCarsons
Add rules to main
6fa50f2 
Add `nestable_block_element` to main, making for 2/3 top level rules
done
@FayCarsons
Pass current filename to Menhir parser so that it is used in AST loca…
146e4cc 
…tions
@FayCarsons
refactor exception handling + debug exns
7f32a00
@FayCarsons
Add printer for Debug exceptions
bcb99df
@FayCarsons
Add rule for headers
b5287d5
@FayCarsons
Refactor table tokens to follow Menhir all-caps convention
ee2bc70
@FayCarsons
Add table rules
aa5d1f4
@FayCarsons
Simplify and add comment for unwrapped_token in `Odoc_parser.parse_…
44e5cb6 
…comment`
@FayCarsons
Clean up nestable_block_element rule producers, list rule
6934b99
@FayCarsons
Add section delimiting comments, clean up ref producers
a953140
@FayCarsons
Add braces and whitespace to producers
4c5fefd
@FayCarsons
Refactor toplevels, add delimiters where missing, format
76a6c64
@FayCarsons
Formatting, fix list_heavy rule, swap empty + nonempty lists where …
1377328 
…needed
@FayCarsons
remove unused COMMENT token
bf52c6c
@FayCarsons
Remove reference to COMMENT token in parser_utils.ml
31e7b96
@FayCarsons
Add (previously forgotten) end-of-input handling :3
bf33d8e
@FayCarsons
Add toplevel whitespace handling
5ab9a68
@FayCarsons
make light_table more robust
16ad51e
@FayCarsons
Cleanup, break helper functions out into parser_aux.ml
34b01cc
@FayCarsons
Fix Paragraph_style location
31572d0
@FayCarsons
Cleanup, formatting, consistency
603da72
@FayCarsons
Improve light list parsing
6d51e8e
@FayCarsons
Merge Menhir parser into main
108077f
@FayCarsons
Add Menhir tokens for new tags
ebe4c0f
@FayCarsons
Remove old files, add parsing rules for new tags
a9daa8c
@FayCarsons
refactor tags
9424178
@FayCarsons
Make paragraph parsing more robust, lex horizontal space folowing new…
5fc1d05 
…lines
@FayCarsons
Fix whitespace in lexer, consume all leading whitespace in comment
bd16e11
@FayCarsons
Fix heavy list ambiguity
9a1d5a6
@FayCarsons
Refactor references/media to pass location
116987b
@FayCarsons
Fix paragraph splitting
0fff83f
@FayCarsons
Parameterize nestable block elements over legal paragraphs
cf9f849
@FayCarsons
Add blank line delimiter for tags with block element content
9543168
@FayCarsons
Fix heavy list whitespace handling
46c4d0a
@FayCarsons
fix light list locations
2f64b98
@FayCarsons
Actually(!) fix light list item locations
3e9188e
@FayCarsons
Fix top-level line-break handling
cd67627
@FayCarsons
improve light list error handling
82f0126
@FayCarsons
Clean and add comments
167895b
@FayCarsons
Add comments, TODO file
d1dcf17
@FayCarsons
fix unclosed links and refs
e7c41b9
@FayCarsons
update lexbuf line from Code_block content
2e89908
@FayCarsons
Warn empty code_block
10f9113
@FayCarsons
Note on location problems
9a11534
@FayCarsons
Notes in TODO.md
3f1cb49
@FayCarsons
Note about emulating context
405b59e
@jonludlam jonludlam marked this pull request as draft January 27, 2025 16:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jonludlam @FayCarsons