feat: dict based Hyphenation (#305)

Browse Source

## Summary

* Adds (optional) Hyphenation for English, French, German, Russian
languages

## Additional Context

* Included hyphenation dictionaries add approximately 280kb to the flash
usage (German alone takes 200kb)
* Trie encoded dictionaries are adopted from hypher project
(https://github.com/typst/hypher)
* Soft hyphens (and other explicit hyphens) take precedence over
dict-based hyphenation. Overall, the hyphenation rules are quite
aggressive, as I believe it makes more sense on our smaller screen.

---------

Co-authored-by: Dave Allie <dave@daveallie.com>

...

This commit is contained in:

Arthur Tazhitdinov

2026-01-19 17:56:26 +05:00

committed by GitHub

parent 5fef99c641

commit 8824c87490

40 changed files with 36465 additions and 52 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

5012

test/hyphenation_eval/resources/english_hyphenation_tests.txt Normal file

File diff suppressed because it is too large Load Diff