Generate our own unicode block constants

Add a script to generate a custom unicode_block module with constants representing unicode blocks. This replaces the blocks from unic-ucd-blocks. Also refactor CharacterType::Range to use a RangeInclusive so we can also remove the dependency on unic-char-range.
mullvad · Aug 30, 2024 · c80dcd2 · c80dcd2
1 parent d133394
commit c80dcd2
Show file tree

Hide file tree

Showing 10 changed files with 1,098 additions and 41 deletions.
diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md
@@ -15,3 +15,7 @@ issues are raised.
 
 Please follow the guidelines at https://cbea.ms/git-commit/ for git commit message style. There is a CI
 job that will enforce this.
+
+## Updating unicode blocks
+
+Use the `generate-unicode-blocks-consts` script to update character blocks constants from Unicode Consortium data:
diff --git a/Cargo.lock b/Cargo.lock
diff --git a/Cargo.toml b/Cargo.toml
@@ -22,8 +22,6 @@ tree-sitter = "0.22.6"
 tree-sitter-javascript = "0.21.2"
 tree-sitter-python = "0.21.0"
 unic-ucd-name = "0.9.0"
-unic-ucd-block = "0.9.0"
-unic-char-range = "0.9.0"
 toml = "0.8.14"
 serde = { version = "1.0.203", features = ["derive"] }
 walkdir = "2.5.0"

diff --git a/README.md b/README.md
@@ -99,4 +99,3 @@ default = {
 [language.python]
 paths = ["./build", "run-tests", "*.py"]
 ```
-
Original file line number	Diff line number	Diff line change
Expand Up		@@ -99,4 +99,3 @@ default = {
		[language.python]
		paths = ["./build", "run-tests", "*.py"]
		```