Download script #22

Merged
newsch merged 28 commits from download into main 2023-09-26 15:45:08 +00:00

28 commits

Author SHA1 Message Date
Evan Lloyd New-Schmidt
b21a999da7 Fix typos
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-09-26 11:38:15 -04:00
Evan Lloyd New-Schmidt
b118724892 Use custom user agent with email
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-22 10:25:41 -04:00
Evan Lloyd New-Schmidt
f08fd7d479 Clarify -c behavior
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-21 17:17:48 -04:00
Evan Lloyd New-Schmidt
4be00cd392 Make concurrent downloads configurable
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-21 16:26:31 -04:00
Evan Lloyd New-Schmidt
cf1ac059be Make base url configurable
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-21 16:26:31 -04:00
Evan Lloyd New-Schmidt
e7b5c19426 Fix link replacement
Without -T, ln interprets an existing LATEST_LINK as a directory to
place the link in, instead of a link to replace.

Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-18 14:24:52 -04:00
Evan Lloyd New-Schmidt
5c8be74302 Write requested help to stdout
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-18 14:19:33 -04:00
Evan Lloyd New-Schmidt
4d9199235a Use wget2 by default
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-18 14:15:40 -04:00
Evan Lloyd New-Schmidt
9d2d2e5f39 Add option to delete old dumps
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-18 14:15:39 -04:00
Evan Lloyd New-Schmidt
82f2993b21 Remove extra whitespace
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 20:12:05 -04:00
Evan Lloyd New-Schmidt
38faebbc54 Remove old workaround for lack of pipefail
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 20:11:02 -04:00
Evan Lloyd New-Schmidt
b06167f9d9 Clarify LANGUAGES parsing
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 20:08:01 -04:00
Evan Lloyd New-Schmidt
187e294d99 Fix typo typo
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 17:59:23 -04:00
Evan Lloyd New-Schmidt
30b19caeef Fix typo
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 17:57:44 -04:00
Evan Lloyd New-Schmidt
98d5a8a95f Mention download.sh in README
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 17:55:42 -04:00
Evan Lloyd New-Schmidt
af80f2ad75 Check for DUMP_DIR existence
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 17:14:51 -04:00
Evan Lloyd New-Schmidt
4c2c6e97ff Rename temp dir
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 17:11:56 -04:00
Evan Lloyd New-Schmidt
5077ed02f2 Document usage
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 17:09:43 -04:00
Evan Lloyd New-Schmidt
bce44d1ab9 Store in subdirs
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 16:44:23 -04:00
Evan Lloyd New-Schmidt
54727b968d Working downloads
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 16:27:35 -04:00
Evan Lloyd New-Schmidt
27ff9cb4dc Track number of missing dumps
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 14:46:58 -04:00
Evan Lloyd New-Schmidt
0a1e0592ff Use real enterprise dump url
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 14:46:58 -04:00
Evan Lloyd New-Schmidt
fe295b2379 Fix jq list output
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 14:46:58 -04:00
Evan Lloyd New-Schmidt
bae03b91c8 Improve comments
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 14:46:58 -04:00
Evan Lloyd New-Schmidt
9ee1e8d594 Fix check for uninitialized variable
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 14:46:57 -04:00
Evan Lloyd New-Schmidt
3a4d1214dc Canonicalize input paths
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 14:09:16 -04:00
Evan Lloyd New-Schmidt
7254bc3ec8 Add requested changes
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 13:29:13 -04:00
Evan Lloyd New-Schmidt
28c17a28eb WIP download script
Signed-off-by: Evan Lloyd New-Schmidt <evan@new-schmidt.com>
2023-08-16 13:29:13 -04:00