Sarah Hoffmann
2a6e8ad68e
add bbox whereclause to make postgis 3.0 happy
...
Normally ST_Covers() should include a bbox index use,
so adding a bbox where clause is not really necessary.
However, the query planner messes up and uses a parallel
index search with a second index instead of exclusively
running on the geometry index, when the bbox part is
missing.
2020-02-16 14:10:22 +01:00
Sarah Hoffmann
55c8a0ac08
Merge pull request #1678 from lonvia/early-drop
...
Clean up intermediate tables earlier with --drop
2020-02-13 22:50:41 +01:00
Sarah Hoffmann
6073d948e6
fix duplicate keys in tests
...
The tests suddenly failed because the unique key constraint
is more strict and does no longer include the type.
2020-02-12 11:29:33 +01:00
Sarah Hoffmann
b9171dd10b
clean up intermediate tables earlier with --drop
...
When --drop is given, we can remove all node geometry information
already after the import with osm2pgsql. Also drop all unnecessary
tables before creating the final indices.
2020-02-12 11:03:20 +01:00
Sarah Hoffmann
97b892fac2
Merge pull request #1675 from lonvia/refresh-connection-while-indexing
...
Fix a couple of issues with the new Python nominatim script
2020-02-12 08:18:09 +01:00
Sarah Hoffmann
b3fdf19b85
Merge pull request #1674 from mtmail/testdb-how-to-select-tiger-data
...
document how to extract subset of TIGER data needed for API tests
2020-02-11 22:57:39 +01:00
Sarah Hoffmann
8c89e16ad2
Merge pull request #1673 from mtmail/wikidata-wget-incomplete
...
wikipedia: wget didnt download, skip index generation
2020-02-11 22:56:45 +01:00
Sarah Hoffmann
960409c701
psycopg 2.6 is now usable on ubuntu 16
2020-02-11 22:49:03 +01:00
Sarah Hoffmann
d1eeaa59a6
nominatim.py: use async in connect() function
...
The _async parameter name is only supported since psycopg 2.7.
However, async is a keyword in Python >= 3.7, so using this
gives us a syntax error. Working around this by defining the
parameters in a dict and handing that into the connect function.
2020-02-11 22:16:17 +01:00
Sarah Hoffmann
882f496e0a
nominatim.py: also catch deadlocks on final wait
2020-02-11 22:16:17 +01:00
Sarah Hoffmann
8b8aa1b4e6
regularly close connection while indexing
...
Postgres sooner or later runs out of memory when the connection
is used for too long.
2020-02-11 22:16:17 +01:00
marc tobias
932ac23f18
document how to extract subset of TIGER data needed for API tests
2020-02-11 18:50:27 +01:00
marc tobias
6c6560ca53
wikipedia: wget didnt download, skip index generation
2020-02-10 17:20:11 +01:00
Sarah Hoffmann
0698757e6e
Merge pull request #1670 from lonvia/permalinks-for-tiger-and-interpolation
...
Enable Permalinks to dtails for tiger and interpolation
2020-02-09 21:07:19 +01:00
Sarah Hoffmann
3a3f9b3496
fix formatting
2020-02-09 16:57:55 +01:00
Sarah Hoffmann
97d87895bf
details: also look for interpolations when way id is given
2020-02-09 16:50:04 +01:00
Sarah Hoffmann
c36fd72f99
use detailsPermaLink function on main website as well
2020-02-09 16:05:22 +01:00
Sarah Hoffmann
57ae3d03a1
return place_id link to details when not an OSM object
...
Stop-gap solution to find the right object for Tiger and
interpolation objects.
2020-02-09 15:45:38 +01:00
Sarah Hoffmann
3737712044
Merge pull request #1667 from mtmail/setup-delete-invalid-indices
...
setup: delete invalid indices in create-search-indices step
2020-02-09 14:21:17 +01:00
Sarah Hoffmann
8531339b4e
Remove hack that changes the class/type of cities
...
This interferes badly with the details view.
Fixes #1668 .
2020-02-09 12:14:32 +01:00
marc tobias
540b12537a
setup: delete invalid indices in create-search-indices step
2020-02-08 15:16:20 +01:00
Sarah Hoffmann
9e2fb45783
Merge pull request #1665 from mtmail/centos7-php7
...
CentOS7: update from PHP 5.4 to 7.2, add psycopg2
2020-02-07 20:43:49 +01:00
Sarah Hoffmann
e7c128b973
Merge pull request #1666 from mtmail/ubuntu-installs-add-psycopg2
...
Vagrant Ubuntu: psycopg2 is required
2020-02-07 20:42:38 +01:00
marc tobias
d4a3470c9e
Vagrant Ubuntu: psycopg2 is required
2020-02-07 15:26:09 +01:00
marc tobias
4165b8c011
CentOS7: update from PHP 5.4 to 7.2
2020-02-07 15:18:46 +01:00
Sarah Hoffmann
357ba2f64d
Merge pull request #1663 from mtmail/vagrant-centos-8
...
Vagrant setup for CentOS 8
2020-02-06 21:12:28 +01:00
Sarah Hoffmann
3ce8818045
Merge pull request #1664 from mtmail/check-import-finished-for-reverse-only
...
check_import_finished.php - reverse_only mode has less indices
2020-02-06 21:07:04 +01:00
marc tobias
76082ac7cb
check_import_finished.php - reverse_only mode has less indices
2020-02-06 16:48:06 +01:00
marc tobias
4a451671d3
Vagrant setup for CentOS 8
2020-02-06 00:43:30 +01:00
marc tobias
a3728b7188
details html page: no longer use place_id in URLs
2020-02-02 01:16:31 +01:00
Sarah Hoffmann
a8711ab013
fix verboseness of nominiatim script during updates
2020-01-31 18:18:50 +01:00
Sarah Hoffmann
3e4754febd
Merge pull request #1648 from lonvia/nominatim-as-python-script
...
Replace C Nominatim indexer with Python script
2020-01-31 17:53:49 +01:00
Sarah Hoffmann
da1d661fa0
remove libxml dependency for travis as well
2020-01-31 15:15:35 +01:00
Sarah Hoffmann
1801db523b
fix typo
2020-01-29 11:50:30 +01:00
Sarah Hoffmann
2979c39628
also adapt indexing command in update script
2020-01-29 11:36:12 +01:00
Sarah Hoffmann
bb9bb40287
update cMake build documentation
...
Remove the dependency on libxml, no longer needed.
2020-01-24 22:53:26 +01:00
Sarah Hoffmann
8f6fdfeb0b
forgot to index last rank
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
b4e6d72fde
replace nominatim C program
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
a338ebfce0
fix log levels
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
4144364a15
add time display for nominatim.py
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
11c0dd235b
clean up and document script
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
4a9502bf88
fix SQL and some other stuff
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
6c0d6d3178
Revert "switch to threading"
...
This reverts commit 8b1c2181be5aa5335c68d36a49cab9c4e2cd8bef.
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
0a26ca7104
switch to threading
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
2a15b2522f
use generator for thread choice
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
c11d1d78e9
add prepared statement
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
7e51aa4cef
simple implementation
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
9abb96fa6b
Merge pull request #1647 from lonvia/split-out-linking
...
Split up placex update trigger code
2020-01-24 21:55:19 +01:00
Sarah Hoffmann
879aafc916
fix indent
2020-01-24 21:16:26 +01:00
Sarah Hoffmann
5ec25122f6
rename functions where return parameter changed
...
Postgresql cannot cleanly reimport these functions when
upgrading, so simply rename to avoid errors.
2020-01-23 22:28:43 +01:00
