Commit graph

111 commits

Author SHA1 Message Date
Anatoly Serdtcev
fd63ea617c [geocoder] Fix correct rank for eponymous Town and Hamlet: calculate result ranks by kind field (in jsonl) 2019-11-27 15:37:31 +03:00
Anatoly Serdtcev
1711eb5454 [generator:features] Speedup features generation: reuse vector's 2019-11-27 15:32:15 +03:00
Anatoly Serdtcev
684443bcbf [geocoder] Add method for data version retrieve from jsonl-file 2019-11-25 14:02:54 +03:00
Anatoly Serdtcev
2d8ecec4d5 [generator:features] Speedup nodes reading: mmap() + MADV_WILLNEED usage 2019-11-25 12:45:09 +03:00
Anatoly Serdtcev
d56ec9ed08 [generator:preprocess] Fix read ahead the o5m file for asynchronously mode. 2019-11-25 12:34:57 +03:00
Anatoly Serdtcev
2ffce3cfde [generator] Refactor features generator: delete unused preload and force-reload modes 2019-11-25 12:34:57 +03:00
Anatoly Serdtcev
79ee32b690 [generator] Optimize features generatrion: share intermediate data for all translators 2019-11-25 12:34:57 +03:00
Anatoly Serdtcev
08474d499f [generator] Optimize features generatrion: async load intermediate data 2019-11-25 12:34:57 +03:00
Anatoly Serdtcev
214ec3520b [generator:preprocess] Optimize intermediate data reading 2019-11-22 15:55:31 +03:00
Anatoly Serdtcev
48b23eed46 [generator] Add "kind" field in jsonl to improve rank in forward geocoder 2019-11-22 13:44:31 +03:00
Anatoly Serdtcev
e8c8e74f7d [generator:preprocess] Optimize node file write: async write by mmap() 2019-11-22 12:14:20 +03:00
Anatoly Serdtcev
a88f11131f [generator] Use tcmalloc for efficient multithreading processing 2019-11-21 14:02:49 +03:00
Anatoly Serdtcev
4a302bee84 [generator] Optimize features generation: o5m parallel reading 2019-11-18 16:14:03 +03:00
Anatoly Serdtcev
a49738bd7c [generator:preprocess] Optimize o5m reading: parallel reading 2019-11-18 16:14:03 +03:00
Anatoly Serdtcev
22c08911d2 [generator] Add o5m chunk reading 2019-11-18 16:14:03 +03:00
Anatoly Serdtcev
7c4744f0ae [generator:preprocess] Optimize o5m reading: aggressive readahead 2019-11-11 18:09:16 +02:00
Maksim Andrianov
1c62760907
Merge pull request #45 from mapsme/generator.preprocess.o5m-readahead
[generator:preprocess] Optimize o5m reading: readahead usage
2019-11-11 15:31:03 +03:00
Anatoly Serdtcev
797457330e [generator:preprocess] Optimize o5m reading: readahead usage 2019-11-11 15:01:03 +03:00
Anatoly Serdtcev
7fd4934dd6 [generator:preprocess] Optimize o5m reading: parallel reading 2019-11-11 12:32:41 +03:00
Anatoly Serdtcev
7b111c1583 [generator] Fix stack overflow in o5m reader 2019-11-08 11:37:33 +03:00
Anatoly Serdtcev
7d331ef83e [generator] Add o5m chunk reading 2019-11-06 17:07:02 +03:00
Sergey Yershov
89194cb45b Fix xcode projects and remove unused files 2019-11-06 16:29:11 +03:00
Sergey Yershov
bd9b33759e Speedup o5m reading 2019-11-06 16:29:11 +03:00
Anatoly Serdtcev
9a9585f212 [generator:preprocess] Optimize system call lseek() usage 2019-11-06 16:12:58 +03:00
Anatoly Serdtcev
18701d6e43 [generator:tests] Fix node test data: JOSM update format -> OSM format 2019-11-06 13:12:47 +03:00
Anatoly Serdtcev
2fcf2e4632 [generator:tests] Increase code coverage: relation intermediate data generation tests 2019-11-06 13:12:47 +03:00
Anatoly Serdtcev
0d68e7699e [generator:tests] Refactor intermediate data generation tests: decomposition for reuse in new tests 2019-11-06 13:12:47 +03:00
Anatoly Serdtcev
eefe68e58e [generator] Optimize preprocessor stage: move osm element fields for intermediate data 2019-11-06 13:12:47 +03:00
Anatoly Serdtcev
d906330912 [generator] Optimize preprocessing stage: output buffer large size 2019-11-06 13:08:57 +03:00
Anatoly Serdtcev
221e880b0b [generator:tests] Add ScapedDir usage for code coverage increase 2019-11-05 13:57:02 +03:00
Anatoly Serdtcev
68b5276514 [generator:tests] Add way intermediate generation test 2019-11-05 13:57:02 +03:00
Anatoly Serdtcev
9ed90b4537 [generator:tests] Fix way test data: JOSM update format -> OSM format 2019-11-05 13:57:02 +03:00
Anatoly Serdtcev
64db2c5392 [generator:tests] Add directory recursive cleaner helper 2019-11-05 13:57:02 +03:00
Anatoly Serdtcev
4d68905469 [generator] Refactor intermediate data builders: std::istream usage 2019-11-05 13:57:02 +03:00
cc-engineering
b2c5fc5a0b [ci] Update package index 2019-11-01 18:25:05 +03:00
Anatoly Serdtcev
84a6da2745 [generator] Update for review 2019-11-01 18:25:05 +03:00
Anatoly Serdtcev
3fafbb3633 [generator:geo_objects] Change for review 2019-11-01 18:25:05 +03:00
Anatoly Serdtcev
546de0847f [generator:tests] Add ways index generation test for coverage reach 2019-11-01 18:25:05 +03:00
Anatoly Serdtcev
20cd3eeae2 [generator] Refactor geo_objects data generator: explicit interface for streets features 2019-11-01 18:25:05 +03:00
Anatoly Serdtcev
c13e5aa144 [geneator] Remove todo code for feature version 2019-10-31 13:55:15 +03:00
Anatoly Serdtcev
fdba6d7338 [generator] Refactor threads count parameter passing 2019-10-30 14:22:14 +03:00
Anatoly Serdtcev
765344777f [generator] Optimize pre-processing stage: clear osm element 2019-10-30 13:42:21 +03:00
LaGrunge
bb337ffbae rm dummy sha1 2019-10-29 10:26:31 +03:00
LaGrunge
7b61ba4bb0 Review notes 2019-10-29 10:17:47 +03:00
LaGrunge
407531c1b7 remove unused include 2019-10-29 10:17:47 +03:00
LaGrunge
316b6b7d08 Add test for OsmElement::AddTag 2019-10-29 10:17:47 +03:00
l.fedorov
817a8195db Use vanill cttrie with pragma metaheader 2019-10-29 10:17:47 +03:00
l.fedorov
bdc372d9e4 proper trim for som_element 2019-10-29 10:17:47 +03:00
l.fedorov
26a4b0121f Use cttrie instead of strcmp 2019-10-29 10:17:47 +03:00
l.fedorov
96dec8a1f3 Add cttrie 2019-10-29 10:17:47 +03:00