organicmaps/wikiparser
13
Fork 0
Code Issues 13 Pull requests 2 Projects Releases Wiki Activity Actions

Triage OSM tag errors #25

New issue
Open
opened 2023-08-09 18:21:19 +00:00 by newsch · 3 comments
newsch commented 2023-08-09 18:21:19 +00:00 (Migrated from github.com)
Copy link

There are around 600 wikipedia/wikidata tags in the full planet dump that cannot be parsed by our current setup.
See #19 and #23 for more details.

They should all be values that don't conform to the expected format.
Some of these can be fixed on OSM by us, we can leave notes on others.

  • Add error for titles greater than 255 bytes of UTF-8
  • Add error for langs greater than some amount - check standard
  • Add a subcommand to dump the errors to disk in a structured way (started in #23).
  • Categorize them by solution
  • Add any new issues for parsing problems
  • Contribute fixes/notes to OSM
There are around 600 wikipedia/wikidata tags in the full planet dump that cannot be parsed by our current setup. See #19 and #23 for more details. They should all be values that don't conform to the expected format. Some of these can be fixed on OSM by us, we can leave notes on others. - [x] Add error for titles greater than 255 bytes of UTF-8 - [x] Add error for langs greater than some amount - check standard - [x] Add a subcommand to dump the errors to disk in a structured way (started in #23). - [ ] Categorize them by solution - [ ] Add any new issues for parsing problems - [ ] Contribute fixes/notes to OSM
biodranik commented 2023-08-09 18:49:16 +00:00 (Migrated from github.com)
Copy link

You can create an issue and share a file with OSM community.

You can create an issue and share a file with OSM community.
newsch commented 2023-08-09 19:30:22 +00:00 (Migrated from github.com)
Copy link

Do you mean this forum? I haven't used it before but I will add a note: https://community.openstreetmap.org

Do you mean this forum? I haven't used it before but I will add a note: https://community.openstreetmap.org
biodranik commented 2023-08-09 21:06:17 +00:00 (Migrated from github.com)
Copy link

It's better to ask on some chat channels like IRC or Telegram. Or make a post with a question in our chat, there are some OSMers who may help.

It's better to ask on some chat channels like IRC or Telegram. Or make a post with a question in our chat, there are some OSMers who may help.
👍 1
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
No results found.
Labels
Clear labels   
bug

Something isn't working

  
documentation

Improvements or additions to documentation

  
duplicate

This issue or pull request already exists

  
enhancement

New feature or request

  
good first issue

Good for newcomers

  
help wanted

Extra attention is needed

  
invalid

This doesn't seem right

  
question

Further information is requested

  
wontfix

This will not be worked on

No labels
bug
documentation
duplicate
enhancement
good first issue
help wanted
invalid
question
wontfix
Milestone
Clear milestone
No items
No milestone
v0.2
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: organicmaps/wikiparser#25
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?