abstreet/importer
Michael Kirk 61c46461e4
PERF: lower memory requirements for clip_osm (#585)
* PERF: lower memory requirements for clip_osm

- don't accumulate things unless they are at least partially within the boundary
- accumulate id's, not entire objects.

This entails doing a second pass of the file, but keeps memory usage
much lower.

e.g. a largeish area of Los Angeles, covering east hollywood to downtown, clipped thus:
- north: San Fernando Blvd
- east: LA River east of Downtown
- south: the 10
- west: Western ave,

Before: importing the above stalled out for me during clipping, which
had ballooned into swap at more than 16GB.

After: in the above scenario, clipping peaks around 55MB, and the import
process as a whole peaks during pathfinding - at around 4.0GB.

* fixup! PERF: lower memory requirements for clip_osm

Remove unnecessary casting
2021-03-24 18:03:33 -07:00
..
config Import Tripoli for WeCode Libya, also adding an Arabic font 2021-03-23 06:51:47 -07:00
src PERF: lower memory requirements for clip_osm (#585) 2021-03-24 18:03:33 -07:00
actdev_houses.sh Generate buildings for all the new actdev sites too 2021-02-15 11:57:41 -08:00
actdev_scenarios.sh Rebuild actdev scenarios again, remembering to include return and lunch trips. cyipt/actdev#132 2021-03-08 13:17:52 -08:00
actdev_site.sh Remove the separate_cycleways experiment flag. Always import cyclepaths 2021-02-26 14:58:57 -08:00
Cargo.toml Refactor a method to asynchronously download a file on native, with a simple progress bar. #523 2021-03-15 19:51:45 -07:00