Commit graph

123 commits

Author SHA1 Message Date
Anatoly Serdtcev
c572f3e57e [geocoder] Refactor for code review: rename *tokenIds -> *tokensPositions 2019-12-17 14:06:56 +03:00
Anatoly Serdtcev
73f20dd198 [geocoder] Fix tests 2019-12-17 14:06:56 +03:00
Anatoly Serdtcev
45609ef3cd [geocoder] Fix rank for house number candidate with extra tokens 2019-12-17 14:06:56 +03:00
Anatoly Serdtcev
eaf07a172d [generator] Delete unused class CalculateMidPoints 2019-12-17 13:06:28 +03:00
Anatoly Serdtcev
5ebb0ca11a [generator:locidx-building] Speedup: skip middle points 2019-12-16 18:44:38 +03:00
Anatoly Serdtcev
d5f93204b2 [generator:regions] Fix Budapest suburbs 2019-12-16 18:44:18 +03:00
Anatoly Serdtcev
03f036a647 [generator:geo_objects] Fix write jsonl file. 2019-12-16 16:15:25 +03:00
Anatoly Serdtcev
7e785156e9 [generator] Optimize region's info getter: exclude conversion string -> JSON 2019-12-13 18:58:05 +03:00
Anatoly Serdtcev
33467bf76b [generator:geo_objects] Add parallel KV write 2019-12-12 18:43:29 +03:00
Anatoly Serdtcev
b09d2df50e [generator:regions] Fix Hawai as country: ignore enclave ways 2019-12-10 14:06:05 +03:00
Anatoly Serdtcev
152eb7bd1d [generator] Speedup generation: features file parallel reading 2019-12-05 15:08:51 +03:00
Anatoly Serdtcev
6d388bc614 [geocoder] Fix for integration tests: stable order of equal rank candidates 2019-11-29 17:16:55 +03:00
Anatoly Serdtcev
fd63ea617c [geocoder] Fix correct rank for eponymous Town and Hamlet: calculate result ranks by kind field (in jsonl) 2019-11-27 15:37:31 +03:00
Anatoly Serdtcev
1711eb5454 [generator:features] Speedup features generation: reuse vector's 2019-11-27 15:32:15 +03:00
Anatoly Serdtcev
684443bcbf [geocoder] Add method for data version retrieve from jsonl-file 2019-11-25 14:02:54 +03:00
Anatoly Serdtcev
2d8ecec4d5 [generator:features] Speedup nodes reading: mmap() + MADV_WILLNEED usage 2019-11-25 12:45:09 +03:00
Anatoly Serdtcev
d56ec9ed08 [generator:preprocess] Fix read ahead the o5m file for asynchronously mode. 2019-11-25 12:34:57 +03:00
Anatoly Serdtcev
2ffce3cfde [generator] Refactor features generator: delete unused preload and force-reload modes 2019-11-25 12:34:57 +03:00
Anatoly Serdtcev
79ee32b690 [generator] Optimize features generatrion: share intermediate data for all translators 2019-11-25 12:34:57 +03:00
Anatoly Serdtcev
08474d499f [generator] Optimize features generatrion: async load intermediate data 2019-11-25 12:34:57 +03:00
Anatoly Serdtcev
214ec3520b [generator:preprocess] Optimize intermediate data reading 2019-11-22 15:55:31 +03:00
Anatoly Serdtcev
48b23eed46 [generator] Add "kind" field in jsonl to improve rank in forward geocoder 2019-11-22 13:44:31 +03:00
Anatoly Serdtcev
e8c8e74f7d [generator:preprocess] Optimize node file write: async write by mmap() 2019-11-22 12:14:20 +03:00
Anatoly Serdtcev
a88f11131f [generator] Use tcmalloc for efficient multithreading processing 2019-11-21 14:02:49 +03:00
Anatoly Serdtcev
4a302bee84 [generator] Optimize features generation: o5m parallel reading 2019-11-18 16:14:03 +03:00
Anatoly Serdtcev
a49738bd7c [generator:preprocess] Optimize o5m reading: parallel reading 2019-11-18 16:14:03 +03:00
Anatoly Serdtcev
22c08911d2 [generator] Add o5m chunk reading 2019-11-18 16:14:03 +03:00
Anatoly Serdtcev
7c4744f0ae [generator:preprocess] Optimize o5m reading: aggressive readahead 2019-11-11 18:09:16 +02:00
Maksim Andrianov
1c62760907
Merge pull request #45 from mapsme/generator.preprocess.o5m-readahead
[generator:preprocess] Optimize o5m reading: readahead usage
2019-11-11 15:31:03 +03:00
Anatoly Serdtcev
797457330e [generator:preprocess] Optimize o5m reading: readahead usage 2019-11-11 15:01:03 +03:00
Anatoly Serdtcev
7fd4934dd6 [generator:preprocess] Optimize o5m reading: parallel reading 2019-11-11 12:32:41 +03:00
Anatoly Serdtcev
7b111c1583 [generator] Fix stack overflow in o5m reader 2019-11-08 11:37:33 +03:00
Anatoly Serdtcev
7d331ef83e [generator] Add o5m chunk reading 2019-11-06 17:07:02 +03:00
Sergey Yershov
89194cb45b Fix xcode projects and remove unused files 2019-11-06 16:29:11 +03:00
Sergey Yershov
bd9b33759e Speedup o5m reading 2019-11-06 16:29:11 +03:00
Anatoly Serdtcev
9a9585f212 [generator:preprocess] Optimize system call lseek() usage 2019-11-06 16:12:58 +03:00
Anatoly Serdtcev
18701d6e43 [generator:tests] Fix node test data: JOSM update format -> OSM format 2019-11-06 13:12:47 +03:00
Anatoly Serdtcev
2fcf2e4632 [generator:tests] Increase code coverage: relation intermediate data generation tests 2019-11-06 13:12:47 +03:00
Anatoly Serdtcev
0d68e7699e [generator:tests] Refactor intermediate data generation tests: decomposition for reuse in new tests 2019-11-06 13:12:47 +03:00
Anatoly Serdtcev
eefe68e58e [generator] Optimize preprocessor stage: move osm element fields for intermediate data 2019-11-06 13:12:47 +03:00
Anatoly Serdtcev
d906330912 [generator] Optimize preprocessing stage: output buffer large size 2019-11-06 13:08:57 +03:00
Anatoly Serdtcev
221e880b0b [generator:tests] Add ScapedDir usage for code coverage increase 2019-11-05 13:57:02 +03:00
Anatoly Serdtcev
68b5276514 [generator:tests] Add way intermediate generation test 2019-11-05 13:57:02 +03:00
Anatoly Serdtcev
9ed90b4537 [generator:tests] Fix way test data: JOSM update format -> OSM format 2019-11-05 13:57:02 +03:00
Anatoly Serdtcev
64db2c5392 [generator:tests] Add directory recursive cleaner helper 2019-11-05 13:57:02 +03:00
Anatoly Serdtcev
4d68905469 [generator] Refactor intermediate data builders: std::istream usage 2019-11-05 13:57:02 +03:00
cc-engineering
b2c5fc5a0b [ci] Update package index 2019-11-01 18:25:05 +03:00
Anatoly Serdtcev
84a6da2745 [generator] Update for review 2019-11-01 18:25:05 +03:00
Anatoly Serdtcev
3fafbb3633 [generator:geo_objects] Change for review 2019-11-01 18:25:05 +03:00
Anatoly Serdtcev
546de0847f [generator:tests] Add ways index generation test for coverage reach 2019-11-01 18:25:05 +03:00