Sarah Hoffmann
0f54d42863
indexer: get rid of special handling of few places
...
Given that we do not distiribute geometry sectors to threads anymore,
there is no point in this kind of special handling.
2020-08-03 10:32:39 +02:00
Sarah Hoffmann
cca366196d
Disable JIT and parallel workers when indexing
...
Locally disable jit and parallel workers in the connection that
do indexing. The query planner tends to be overenthusiatic about
using JIT. But with the rather less complex queries we have, the
overhead tends to be larger than the performance gain.
Fixes #1677 .
2020-05-30 11:20:16 +02:00
Sarah Hoffmann
431948d768
nominatim: always use deadlock-protected wait
...
Fixes #1785 .
2020-05-15 18:49:27 +02:00
Sarah Hoffmann
5469d02d03
nominatim.py: fix wrong use of assert
...
Fixes #1762 .
2020-04-19 17:59:49 +02:00
Sarah Hoffmann
d1eeaa59a6
nominatim.py: use async in connect() function
...
The _async parameter name is only supported since psycopg 2.7.
However, async is a keyword in Python >= 3.7, so using this
gives us a syntax error. Working around this by defining the
parameters in a dict and handing that into the connect function.
2020-02-11 22:16:17 +01:00
Sarah Hoffmann
882f496e0a
nominatim.py: also catch deadlocks on final wait
2020-02-11 22:16:17 +01:00
Sarah Hoffmann
8b8aa1b4e6
regularly close connection while indexing
...
Postgres sooner or later runs out of memory when the connection
is used for too long.
2020-02-11 22:16:17 +01:00
Sarah Hoffmann
1801db523b
fix typo
2020-01-29 11:50:30 +01:00
Sarah Hoffmann
8f6fdfeb0b
forgot to index last rank
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
b4e6d72fde
replace nominatim C program
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
a338ebfce0
fix log levels
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
4144364a15
add time display for nominatim.py
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
11c0dd235b
clean up and document script
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
4a9502bf88
fix SQL and some other stuff
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
6c0d6d3178
Revert "switch to threading"
...
This reverts commit 8b1c2181be5aa5335c68d36a49cab9c4e2cd8bef.
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
0a26ca7104
switch to threading
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
2a15b2522f
use generator for thread choice
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
c11d1d78e9
add prepared statement
2020-01-24 22:06:30 +01:00
Sarah Hoffmann
7e51aa4cef
simple implementation
2020-01-24 22:06:30 +01:00
Eric Stadtherr
62747c934d
Work on setup/update scripts, unit tests, and documentation to enable Postgres server to be optionally configured on a remote host
2018-07-21 12:09:47 -06:00
Sarah Hoffmann
4ac1bf2d47
clean up byte order detection
...
Check for existence of the expected functions and macros
and error out if nothing appropriate can be found.
2018-03-16 23:09:40 +01:00
Sarah Hoffmann
8f23ba076b
replace non-standard uint type with unsigned
...
See #879 .
2018-01-10 23:27:49 +01:00
Jonathan Montane
c54fc44b33
feat(export): added linked_place_id as an attribute to feature element
2017-12-18 10:34:05 +01:00
Sarah Hoffmann
9a47e1834f
reduce message frequency during indexing
2017-09-17 20:13:05 +02:00
Edward Betts
7e3af2debc
correct spelling mistakes
2017-03-08 15:06:50 +00:00
Melvyn Sopacua
13ab03a03a
Fix warnings:
...
- be consistent with (const char *) casts when assigning
- use xmlStrlen instead of strlen when dealing with xmlChar *
2017-02-15 10:17:43 +01:00
Melvyn Sopacua
6eb6f35f24
BSD compat: use sys/endian.h if available
...
<byteswap.h> is a linuxism. On BSD-like systems this is <sys/endian.h>
2017-02-13 14:30:48 +01:00
Sarah Hoffmann
ea5fe54c6b
force language of pgsql to C
...
Fixes #558 .
2017-01-15 21:31:14 +01:00
markigail
f07d620ee8
Change load-data in setup.php.
2016-05-11 10:22:03 +02:00
markigail
190a72cab5
Fix bug in index.c and remove column admin_level from location_property_osmline.
2016-05-08 16:46:42 +02:00
markigail
1a4f369e2b
fix small bug in index.c
2016-05-03 12:52:08 +02:00
Markus Gail
db719d489f
index on geometry of interpolation lines, and more improvements.
2016-04-27 17:42:59 +02:00
Markus Gail
7879ad44cd
Remove interpolation lines from placex and save them in an extra table.
2016-04-25 09:44:01 +02:00
Sarah Hoffmann
932abeb0e2
add actual cmake file
2016-02-29 22:26:55 +01:00
Sarah Hoffmann
35a0f1b246
move from autotools to cmake and update osm2pgsql
2016-02-29 22:26:55 +01:00
Sarah Hoffmann
7822b1bc25
adapt to new configure variables for postgres
2015-08-29 12:15:19 +02:00
Sarah Hoffmann
7854075c5c
hasn't been svn for a while
2013-10-02 19:03:13 +02:00
Sarah Hoffmann
89af917105
properly close connections to postgres
2012-12-16 16:23:50 +01:00
Sarah Hoffmann
b11718699e
fail on error
...
- stop indexing if there is any other error than deadlock from the DB
- stop import if osm2pgsql or indexing fails
2012-07-31 00:31:38 +02:00
Sarah Hoffmann
980632053f
put libraries in right place when linking
2012-07-03 16:09:00 +03:00
Sarah Hoffmann
f52038d010
yet another autogenerated file removed
2012-06-16 01:38:27 +02:00
Sarah Hoffmann
69ed04a441
remove autogenerated files
2012-06-16 01:36:13 +02:00
Sarah Hoffmann
de46b62186
create a globale configure/make
...
- move the configure from nominatim out and add checks for all dependencies
- bring module under automake control
- add osm2pgsql as a submodule, configure and build with the others
2012-06-16 01:25:16 +02:00
Sarah Hoffmann
35fdb7af0f
more verbose error messages
2012-05-24 00:26:16 +02:00
Brian Quinion
b99a043c78
Use GB postcode table as definitive source. resort by pressence of search word in output address and other misc very minor changes not commited from MQ servers
2012-03-22 00:34:56 +00:00
Sarah Hoffmann
1edcd7208b
don't classify normal SQL errors as deadlocks
2012-01-28 23:33:28 +00:00
Sarah Hoffmann
cc564e2f31
- remove dependency on intarray extension
...
- new config options for postgresql version and
location of osm2pgsql and osmosis binaries
- new option --no-npi for update.php that supresses writing of NPIs in
osmosis update mode
- add more GRANTs for www-data
2012-01-21 10:21:42 +00:00
Brian Quinion
4d16677d2e
update place_id to BIGINT
2011-06-14 13:42:46 +00:00
Brian Quinion
588a3a5702
memory leak on large imports
2011-05-16 14:46:57 +00:00
Brian Quinion
b3f2bdb822
addresses not claculated for some named poi
2011-04-08 15:10:31 +00:00
Brian Quinion
1028c2444c
move partiondef config file to settings, add --create-website option to build symlinks automatically
2011-04-06 18:19:40 +00:00
Brian Quinion
1767968f7c
extra validation on import
2011-04-06 18:16:55 +00:00
Brian Quinion
44aa62d899
loading rank wrong way round
2011-03-21 10:15:29 +00:00
Brian Quinion
2148d81474
calculate search position based to 'importance' rather than address rank
2011-03-18 09:52:16 +00:00
Frederik Ramm
fb6d13a1a7
log progress to stderr instead of stdout, to make use of unbuffered output
2011-02-21 12:41:44 +00:00
Brian Quinion
c71cb63f38
stop treating capital cities as villages, memory leak on deadlock
2011-02-08 12:09:11 +00:00
Brian Quinion
3ea1b35b32
add logging of broken polygons, improve address export, better diff output in export, bug in address calculation( #3522 ), reaply #3520 , lost in migration
2011-02-07 11:13:18 +00:00
Brian Quinion
31273a42bd
aux properties, memory leaks, tweaks to search order
2011-01-21 10:40:44 +00:00
Brian Quinion
2be00f37c1
finally fix adminitrative spelling error, disable fast_update on indexes by default (performance), fixes for incremental updates on new codebase
2011-01-05 14:07:26 +00:00
Brian Quinion
52cdaba0f1
clean up formatting
2010-12-10 16:13:07 +00:00
Brian Quinion
1427753846
be a bit efficient about queuing up the places to be indexed
2010-12-10 16:09:43 +00:00
Brian Quinion
631e8d09ab
postcode/zipcode improvements, finish work on handling extratags
2010-12-07 13:41:02 +00:00
Brian Quinion
bfe56e6a45
change partition from char to int, partition search_name on country
2010-11-09 10:19:36 +00:00
Brian Quinion
756f328ac9
more multi-processor improvements
2010-11-02 11:37:11 +00:00
Brian Quinion
e6d983474b
data partitioning
2010-10-26 15:22:41 +00:00
Brian Quinion
4c2c499860
default path fixes
2010-10-25 12:22:22 +00:00
Brian Quinion
a98bc3fae8
nominatim refactoring
2010-10-25 10:50:52 +00:00
Brian Quinion
ab6a996772
nominatim refactoring
2010-10-23 23:12:37 +00:00
