Commit graph

  • 16494d50b0
    Merge f2f756102e into bab29c0de9 Petr Zahradník 2025-01-18 19:04:22 +00:00
  • f2f756102e Do not panic on missing .html petrzjunior/missing-html petrzjunior/missing-html Petr Zahradnik 2025-01-18 19:57:38 +01:00
  • bab29c0de9 Preserve whitespace of removed "empty" elements main petrzjunior/main Evan Lloyd New-Schmidt 2024-07-08 14:19:16 -04:00
  • 3579410659 Remove pretty-printing Evan Lloyd New-Schmidt 2024-07-08 13:40:04 -04:00
  • 457bd548ec Preserve whitespace of removed "empty" elements Evan Lloyd New-Schmidt 2024-07-08 14:19:16 -04:00
  • e4219d94fd Remove pretty-printing Evan Lloyd New-Schmidt 2024-07-08 13:40:04 -04:00
  • f2692d2ede Add Arabic language Evan Lloyd New-Schmidt 2024-06-12 11:36:57 -04:00
  • 96cc5d04cc Add Arabic language Evan Lloyd New-Schmidt 2024-06-12 11:36:57 -04:00
  • 1245d6365a Reorganize README for readability Evan Lloyd New-Schmidt 2024-03-15 12:40:44 -04:00
  • 775e23cf1e Add links to additional title/lang requirements Evan Lloyd New-Schmidt 2024-04-28 14:25:37 -04:00
  • 3d908a2866 Add warnings to commands that expect stdin Evan Lloyd New-Schmidt 2024-03-14 15:12:30 -04:00
  • aa4bc75168 Reorganize README for readability Evan Lloyd New-Schmidt 2024-03-15 12:40:44 -04:00
  • df26010ea9 Add links to additional title/lang requirements Evan Lloyd New-Schmidt 2024-04-28 14:25:37 -04:00
  • af980f44e6 Add warnings to commands that expect stdin Evan Lloyd New-Schmidt 2024-03-14 15:12:30 -04:00
  • e61f12d014 Make parse functions collection-agnostic Evan Lloyd New-Schmidt 2024-03-15 13:30:00 -04:00
  • d723452ec5 Use tracing-logfmt Evan Lloyd New-Schmidt 2024-03-15 12:40:26 -04:00
  • 1f7d0695e2 Add option to dump input json to stdout Evan Lloyd New-Schmidt 2023-11-16 13:48:09 -05:00
  • f5f7df400e Make parse functions collection-agnostic Evan Lloyd New-Schmidt 2024-03-15 13:30:00 -04:00
  • 9621eeec8d Use tracing-logfmt Evan Lloyd New-Schmidt 2024-03-15 12:40:26 -04:00
  • 677b79c530 Add option to dump input json to stdout Evan Lloyd New-Schmidt 2023-11-16 13:48:09 -05:00
  • 98dcf08fdc
    Merge 02c845524a into cb835fcbc6 Jonathan Davies 2024-04-28 16:23:27 +02:00
  • cb835fcbc6 Remove header sections by sibling instead of parent section Evan Lloyd New-Schmidt 2024-04-27 11:31:04 -04:00
  • 578f8a319d Check for elements in sections before header Evan Lloyd New-Schmidt 2023-11-17 20:11:45 -05:00
  • ad7052d24a Remove header sections by sibling instead of parent section Evan Lloyd New-Schmidt 2024-04-27 11:31:04 -04:00
  • cb8f795bcc Check for elements in sections before header Evan Lloyd New-Schmidt 2023-11-17 20:11:45 -05:00
  • cd03fed762
    Add check for unicode normalization in config (#44) Evan Lloyd New-Schmidt 2024-04-24 10:34:11 -04:00
  • 62a16d2da7 Add caveats to section removal doc Evan Lloyd New-Schmidt 2024-04-24 10:22:42 -04:00
  • 58864b4fcc Add check for unicode normalization in config Evan Lloyd New-Schmidt 2024-04-21 12:11:19 -04:00
  • 19d9f2c42a
    Exclude more Korean sections (#43) Lens0021 / Leslie 2024-04-22 00:22:27 +09:00
  • ee88ba34b0 Undo exclude "둘러보기", which is used as 'Nearby places' lens0021 2024-04-21 22:14:07 +09:00
  • 267b9db9e1 Exclude more Korean sections lens0021 2024-04-21 21:59:55 +09:00
  • b2eabf8538 Add Korean language Lens0021 / Leslie 2024-04-20 17:48:13 +09:00
  • 9aa33cc508 Add Korean language Lens0021 / Leslie 2024-04-20 17:48:13 +09:00
  • 02c845524a nix: Enabled tooling with cargo2nix. jpds/nix-tooling jpds/nix-tooling Jonathan Davies 2024-03-17 00:20:20 +00:00
  • 701390ea2e Cargo.lock: Bump versions. Jonathan Davies 2024-03-17 00:15:53 +00:00
  • a4caf23e35 Cargo.toml: Enabled LTO for release build. jpds/main Jonathan Davies 2024-03-11 21:43:32 +00:00
  • f48d99e840 Cargo.toml: Enabled LTO for release build. jpds/cargo-lto Jonathan Davies 2024-03-11 21:43:32 +00:00
  • 2dc0b1bc34 Log redirect name instead of article on error Evan Lloyd New-Schmidt 2023-11-16 13:46:58 -05:00
  • 580b60bdd4 Use tracing with pid, lang, title, url, line, and byte fields Evan Lloyd New-Schmidt 2023-10-09 13:49:14 -04:00
  • bfdb3c17a9 Detect language with simplify subcommand Evan Lloyd New-Schmidt 2023-11-17 20:08:24 -05:00
  • 7d453d5e63 Reorganize html module Evan Lloyd New-Schmidt 2023-10-04 16:20:50 -04:00
  • b5f0b22f7a Only modify attributes on attached elements Evan Lloyd New-Schmidt 2023-10-03 16:26:03 -04:00
  • cd5132f28c Fix panics on empty trees Evan Lloyd New-Schmidt 2023-10-03 14:35:53 -04:00
  • 9858994f93 Create output directory after processing html Evan Lloyd New-Schmidt 2023-09-29 15:14:03 -04:00
  • 1da8ec212a Add checks for article redirects, empty articles, and sniff language Evan Lloyd New-Schmidt 2023-09-26 14:55:19 -04:00
  • d52c3305c5 Log redirect name instead of article on error Evan Lloyd New-Schmidt 2023-11-16 13:46:58 -05:00
  • fee3e6f973 Use tracing with pid, lang, title, url, line, and byte fields Evan Lloyd New-Schmidt 2023-10-09 13:49:14 -04:00
  • 780a5530db Detect language with simplify subcommand Evan Lloyd New-Schmidt 2023-11-17 20:08:24 -05:00
  • 4b29cdfc72 Reorganize html module Evan Lloyd New-Schmidt 2023-10-04 16:20:50 -04:00
  • 27621fcf66 Only modify attributes on attached elements Evan Lloyd New-Schmidt 2023-10-03 16:26:03 -04:00
  • c84bd1cb0c Fix panics on empty trees Evan Lloyd New-Schmidt 2023-10-03 14:35:53 -04:00
  • dad2a2b311 Create output directory after processing html Evan Lloyd New-Schmidt 2023-09-29 15:14:03 -04:00
  • 385641ce16 Add checks for article redirects, empty articles, and sniff language Evan Lloyd New-Schmidt 2023-09-26 14:55:19 -04:00
  • e31027893e Exclude notes and references for en Alexander Borsuk 2024-01-20 02:06:26 +02:00
  • 6d8671dbc7 Bump checkout to v4 Jean-BaptisteC 2023-11-08 19:10:23 +01:00
  • 051cdc8177 Bump checkout to v4 Jean-BaptisteC 2023-11-08 19:10:23 +01:00
  • af16cb6513 Exit early with error if any jobs fail Evan Lloyd New-Schmidt 2023-10-03 12:23:36 -04:00
  • 99c3b72e51 Add option to use existing tag file Evan Lloyd New-Schmidt 2023-10-03 12:22:21 -04:00
  • 922ca41d21 Exit early with error if any jobs fail Evan Lloyd New-Schmidt 2023-10-03 12:23:36 -04:00
  • 7ad30db3d2 Add option to use existing tag file Evan Lloyd New-Schmidt 2023-10-03 12:22:21 -04:00
  • 54230ee4ff
    Add portuguese language (#34) Evan Lloyd New-Schmidt 2023-10-02 11:56:20 -04:00
  • 73d61a734d Add portuguese language Evan Lloyd New-Schmidt 2023-10-02 11:18:02 -04:00
  • 9d1ad01f33
    Improve script warnings/errors (#32) Evan Lloyd New-Schmidt 2023-09-29 16:12:36 -04:00
  • 29d90376f3 Move file parsing out of wm module Evan Lloyd New-Schmidt 2023-08-25 15:24:39 -04:00
  • faf4b760b2 Add OSM object metadata Evan Lloyd New-Schmidt 2023-08-25 14:05:26 -04:00
  • a584498c65 Add additional checks for langs/titles Evan Lloyd New-Schmidt 2023-08-25 11:23:44 -04:00
  • 292eeac081 Add command to write tag errors to file Evan Lloyd New-Schmidt 2023-08-24 15:42:19 -04:00
  • 218e55931f Remove debug info from release builds Evan Lloyd New-Schmidt 2023-09-29 15:11:07 -04:00
  • c3162c9fed Reduce unnecessary rebuilds Evan Lloyd New-Schmidt 2023-08-25 09:35:40 -04:00
  • e439256903 Move file parsing out of wm module Evan Lloyd New-Schmidt 2023-08-25 15:24:39 -04:00
  • fe0d556ef0 Add OSM object metadata Evan Lloyd New-Schmidt 2023-08-25 14:05:26 -04:00
  • 9780e1428e Add additional checks for langs/titles Evan Lloyd New-Schmidt 2023-08-25 11:23:44 -04:00
  • 0a9813941f Add command to write tag errors to file Evan Lloyd New-Schmidt 2023-08-24 15:42:19 -04:00
  • d8265838de Remove debug info from release builds Evan Lloyd New-Schmidt 2023-09-29 15:11:07 -04:00
  • aec75f22bf Reduce unnecessary rebuilds Evan Lloyd New-Schmidt 2023-08-25 09:35:40 -04:00
  • 33174511dd Handle simplification panics Evan Lloyd New-Schmidt 2023-09-03 22:29:52 -04:00
  • 3de06a3209 Disable printing backtraces by default. Evan Lloyd New-Schmidt 2023-09-16 08:12:24 -04:00
  • 4ddb49cab2 Handle simplification panics Evan Lloyd New-Schmidt 2023-09-03 22:29:52 -04:00
  • cb04d494b3 Disable printing backtraces by default. Evan Lloyd New-Schmidt 2023-09-16 08:12:24 -04:00
  • c6fb8ccb5a Improve script warnings/errors Evan Lloyd New-Schmidt 2023-09-26 13:42:54 -04:00
  • 481ace45ce
    Add Download script (#22) Evan Lloyd New-Schmidt 2023-09-26 11:45:07 -04:00
  • b21a999da7 Fix typos Evan Lloyd New-Schmidt 2023-09-26 11:38:15 -04:00
  • 8191c36a5e Format let-else Evan Lloyd New-Schmidt 2023-09-26 11:03:13 -04:00
  • 90bf023a26 Format let-else Evan Lloyd New-Schmidt 2023-09-26 11:03:13 -04:00
  • d0480e9089 Make thread pool control similar to osmium Evan Lloyd New-Schmidt 2023-08-15 18:06:56 -04:00
  • 4b6161333f Make thread pool control similar to osmium Evan Lloyd New-Schmidt 2023-08-15 18:06:56 -04:00
  • b118724892 Use custom user agent with email Evan Lloyd New-Schmidt 2023-08-22 10:20:23 -04:00
  • f08fd7d479 Clarify -c behavior Evan Lloyd New-Schmidt 2023-08-21 17:17:48 -04:00
  • 4be00cd392 Make concurrent downloads configurable Evan Lloyd New-Schmidt 2023-08-21 16:15:29 -04:00
  • cf1ac059be Make base url configurable Evan Lloyd New-Schmidt 2023-08-21 15:58:40 -04:00
  • e7b5c19426 Fix link replacement Evan Lloyd New-Schmidt 2023-08-18 14:24:52 -04:00
  • 5c8be74302 Write requested help to stdout Evan Lloyd New-Schmidt 2023-08-18 14:19:33 -04:00
  • 4d9199235a Use wget2 by default Evan Lloyd New-Schmidt 2023-08-18 14:08:11 -04:00
  • 9d2d2e5f39 Add option to delete old dumps Evan Lloyd New-Schmidt 2023-08-18 13:51:29 -04:00
  • 82f2993b21 Remove extra whitespace Evan Lloyd New-Schmidt 2023-08-16 20:12:05 -04:00
  • 38faebbc54 Remove old workaround for lack of pipefail Evan Lloyd New-Schmidt 2023-08-16 20:11:02 -04:00
  • b06167f9d9 Clarify LANGUAGES parsing Evan Lloyd New-Schmidt 2023-08-16 20:08:01 -04:00
  • 187e294d99 Fix typo typo Evan Lloyd New-Schmidt 2023-08-16 17:59:23 -04:00
  • 30b19caeef Fix typo Evan Lloyd New-Schmidt 2023-08-16 17:57:44 -04:00
  • 98d5a8a95f Mention download.sh in README Evan Lloyd New-Schmidt 2023-08-16 17:55:42 -04:00