marc tobias
d4b633bfc5
replace database abstraction DB with PDO
2019-03-09 00:18:15 +01:00
marc tobias
178cb98795
query.php - we no longer support PHP < 5.4
2019-02-24 16:22:55 +01:00
Sarah Hoffmann
8237aba840
Do not allow --no-index together with --import-osmosis-all
...
Fixes #1283 .
2019-01-26 15:25:00 +01:00
Sarah Hoffmann
63781c4953
set import_status when indexing only
...
Makes sure that things work as expected when running
`--import-osmosis --no-index` and `--index` separately.
Fixes #1284 .
2019-01-26 15:01:39 +01:00
Sarah Hoffmann
caa8210112
Switch to configurable style for osm2pgsql
...
Includes the full style, which is the same as now (minus
sidwalk exclusion) and a minimal style for boundaries only.
2019-01-08 22:54:41 +01:00
Sarah Hoffmann
1c85edbda9
adapt warm.php to new Result objects
...
Fixes #1276 .
2019-01-08 22:45:21 +01:00
Sarah Hoffmann
181e238b55
Do not log file sizes in the index step on updates
...
Fixes #1274 .
2019-01-04 21:51:18 +01:00
Sarah Hoffmann
56839ba50f
No longer install phrase configuration
...
Instead add it as a configurable path with the one from
the source directory as the default.
Also reinstates that settings/defaults.php is installed as
settings/settings.php.
2018-12-02 11:50:44 +01:00
Sarah Hoffmann
fe6a2e9f14
Remove server_compare from list of installed scripts
...
This is a stand alone script and does not depend on
the configured environment.
2018-12-02 11:21:09 +01:00
Sarah Hoffmann
e70f405abd
Restructure script and website installation
...
Just make cmake install a small stub that includes
the settings from the build directory and then the
script from the source directory. Remove executable
rights from php files in utils/ so that they cannot
be accidentally executed.
2018-12-02 11:13:48 +01:00
Sarah Hoffmann
8b8ee00725
remove blocks script
...
Belongs to the rate-limiting code that has been
removed a long time ago.
2018-12-02 10:18:54 +01:00
Sarah Hoffmann
e99dc2a3da
Add function to update address levels
2018-11-24 16:21:16 +01:00
Sarah Hoffmann
5d98c09ee9
Add reverse-only parameter to setup
...
Avoids creating the search_name table. Useful when only /reverse
is used or the content is directly exported to photon.
Fixes #939 .
2018-11-21 19:36:21 +01:00
Sarah Hoffmann
409ded385f
simplify connection handling in setup script
...
- factor out runWithEnv
- require explicit connect() call to avoid rechecking for oDB
(more for readability than for speed)
- clean DSNInfo of empty strings and simplify check for entries
2018-11-20 22:51:37 +01:00
Sarah Hoffmann
e2d0c9f3c1
fix variable prefix
2018-11-20 21:07:24 +01:00
marc tobias
aa41b813b8
2018 TIGER data conversion scripts, add documentation to /docs/data-sources
2018-11-15 23:01:08 +01:00
Sarah Hoffmann
3afd12f977
simplify constructor of SetupFunctions
...
Also cleans up spacing.
2018-10-02 23:42:33 +02:00
ThomasBarris
0273e128f4
change variables for class SetupClass.php instantiation
2018-09-18 21:28:05 +02:00
ThomasBarris
a0dbeabed1
move setupclass, move command line array, remove args from update array
2018-09-17 10:28:00 +02:00
ThomasBarris
08c2f03ccc
moving comment to right position
2018-09-08 10:14:08 +02:00
ThomasBarris
9e35e5c2b0
move checkModilePresence to class, delete own debug echo
2018-09-08 09:26:23 +02:00
ThomasBarris
d10f63b666
format change revert, removed bogus CL options, SetupClass to a new dir
2018-09-05 22:01:03 +02:00
ThomasBarris
42e79bfab9
delete an empty line to make the pendantic Mister Travis happy
2018-08-31 21:44:49 +02:00
ThomasBarris
a3b4f80c99
small fixes on setup.php and a bring update.php to work
2018-08-31 21:31:38 +02:00
ThomasBarris
b2f3cfde0b
splitted createTables and changed formatting to please Travis
2018-08-29 22:54:28 +02:00
ThomasBarris
c036480ce2
first draft of setupClass
2018-08-29 21:31:19 +02:00
ThomasBarris
14aca11dcd
moving functions from setup.php to a lib file in lib/setup_functions.php and change a passthru in setup.php by calling the function with this new lib
2018-08-24 16:15:39 +02:00
Sarah Hoffmann
1ee636461c
Mute notices from postgresql during setup
...
They are mostly warnings about tables that do not exists. This
is intentional and would only confuse the casual user.
2018-08-23 21:14:34 +02:00
ThomasBarris
5859f9a3cb
just add missing semicolon in importWikipedia.php line 312
2018-08-23 19:36:13 +02:00
ThomasBarris
a825414558
push the right version of update.php
2018-08-23 10:02:34 +02:00
ThomasBarris
6577be3744
delete PHP_BIN from default and add @PHP_BIN@ to passthru function in update.php
2018-08-23 09:24:51 +02:00
ThomasBarris
e936041713
Revert "Split of setup.php into one file with functions and one with the control of the workflow. The functions will also be included by update.php to avoid the passthru"
...
This reverts commit 55fa051d3a
2018-08-23 08:07:40 +02:00
ThomasBarris
a8b31090a1
Revert "code beauty improvements"
...
This reverts commit ee3973f507
2018-08-23 08:07:08 +02:00
ThomasBarris
ee3973f507
code beauty improvements
2018-08-22 21:33:17 +02:00
ThomasBarris
55fa051d3a
Split of setup.php into one file with functions and one with the control of the workflow. The functions will also be included by update.php to avoid the passthru
2018-08-22 21:06:55 +02:00
ThomasBarris
e286536959
replaced all shebangs in utility scripts with @PHP_BIN@, to be replaced with detected PHP binary on install
2018-08-21 13:21:08 +02:00
Eric Stadtherr
87d78e87d2
changed nominatim.so module path to be a runtime configuration setting as opposed to a command line argument
2018-07-24 15:25:12 -06:00
Eric Stadtherr
bf5063de9a
fix variable reference
2018-07-21 21:59:03 -06:00
Eric Stadtherr
13efedde34
fix omitted initialization
2018-07-21 21:53:41 -06:00
Eric Stadtherr
c1beefd543
PR review changes
2018-07-21 21:45:23 -06:00
Eric Stadtherr
1d81c17335
fix a couple errors with naming convention changes
2018-07-21 20:43:48 -06:00
Eric Stadtherr
b8b87716db
adapt PR changes to use new variable naming convention
2018-07-21 17:09:59 -06:00
Eric Stadtherr
1108bf7d86
PR review changes
2018-07-21 12:09:47 -06:00
Eric Stadtherr
62747c934d
Work on setup/update scripts, unit tests, and documentation to enable Postgres server to be optionally configured on a remote host
2018-07-21 12:09:47 -06:00
Sarah Hoffmann
83270557a7
more sanity checks for pyosmium tools
2018-07-17 21:54:37 +02:00
Sarah Hoffmann
80a6751c51
make phpcs happy
2018-07-06 22:06:05 +02:00
Sarah Hoffmann
ac29f8bc91
Merge branch 'better-reverse' of https://github.com/gemo1011/Nominatim into gemo1011-better-reverse
2018-07-02 21:33:27 +02:00
Unknown
ec6a427e0a
edited indices an setup file to grant select for table country_osm_grid
2018-06-28 11:34:19 +02:00
Sarah Hoffmann
d0548caa76
use computed postcode by default in export script
2018-06-27 21:39:00 +02:00
gemo1011
073221d321
changed export.php to work with current master
2018-06-27 14:17:08 +02:00
Sarah Hoffmann
dfb9579a73
initial version of an export script
...
So far supports type selection down to street level, restriction to
country or an OSM place and postcode printing. Output is standard CSV.
2018-06-27 14:11:14 +02:00
Frederik Ramm
8139a079f8
limit default threads to 15
...
When no explicit number of threads is given, don't simply use getProcessorCount()-1, but limit to max. 15
2018-06-20 14:17:07 +02:00
Marc Tobias Metten
f6a76ebcd5
phpcs: remove trailing whitespace from comments
2018-03-27 01:43:02 +02:00
marc tobias
27bc8d4f7b
replace PHP sizeof() with either count() or empty()
2018-03-22 12:36:24 +01:00
Sarah Hoffmann
3fda792929
ignore empty flatnode file option
...
Fixes #902 .
2018-02-12 20:47:04 +01:00
marc tobias
e9407cd48d
shorten line to please PHP style guide
2018-02-08 17:52:26 +01:00
Marc Tobias Metten
1d6861667b
update.php - check file exists before deleting
2018-01-31 00:38:05 +01:00
Sarah Hoffmann
2cf1ff41c0
move nominatim.org links to https
...
Solves #737 .
2018-01-10 23:21:21 +01:00
Sarah Hoffmann
118517b076
Merge pull request #874 from lonvia/check-for-updates
...
Add function to check if new updates are available
2018-01-10 22:51:12 +01:00
Sarah Hoffmann
45abcbc301
update drop list for new postcode table
...
Fixes #875 .
2018-01-05 22:41:25 +01:00
Sarah Hoffmann
d5df1c8ae3
fix setup when no us_postcode is available
2018-01-05 22:41:05 +01:00
Sarah Hoffmann
9712decefe
update URLs in code and documentation
...
Use https for all openstreetmap addresses, remove defunct
mapquest link and redirect documentation links to
nominatim.org.
2018-01-05 22:38:51 +01:00
Sarah Hoffmann
b06bc799bc
add function to check if new updates are available
2018-01-01 22:23:29 +01:00
Sarah Hoffmann
cbaabe7c24
add function to recalculate counts for full-word search term
2017-12-17 16:00:28 +01:00
Marc Tobias Metten
1a1e0ef138
update utils/tiger_county_fips.json data
2017-10-28 00:08:59 +02:00
Sarah Hoffmann
6c1977b448
replace double-quoting with single quotes where applicable
2017-10-26 21:40:33 +02:00
Sarah Hoffmann
9ac401267a
tiger import: convert counties to str
...
For python2 the gdal features come out as str and
cannot be combined with unicode strings.
2017-10-24 22:27:09 +02:00
marc tobias
a71200a57a
huge cleanup of tigerAddressImport.py
2017-10-24 22:27:09 +02:00
marc tobias
b062e7e774
huge cleanup of tigerAddressImport.py
2017-10-24 22:27:09 +02:00
marc tobias
8eed1a8bec
Tiger 2017 data no longer contains -divroad- field
2017-10-20 15:17:51 +02:00
Sarah Hoffmann
8e0ffde3e0
fix CodeSniffer violations
2017-10-08 17:00:59 +02:00
Sarah Hoffmann
bafbf679b6
add script for updating postcodes
2017-10-03 15:58:14 +02:00
Sarah Hoffmann
8e2ef2842e
move psqlRunScript implementation into cmd lib
...
Function needed for update.php as well.
2017-10-03 14:26:59 +02:00
Sarah Hoffmann
61ed3b8ab3
setup: bail out earl when something is wrong with nominatim.so
2017-09-17 20:07:03 +02:00
Sarah Hoffmann
bb1552be29
setup: error out when web site user does not exist
...
User is needed to be able to grant rights.
2017-09-17 19:51:00 +02:00
Sarah Hoffmann
5614ece9a1
run psql in quiet mode unless 'verbose' is enabled
2017-09-17 11:34:35 +02:00
Sarah Hoffmann
3546b30473
timestamp info message and repeat warnings at end
2017-09-17 11:06:52 +02:00
Sarah Hoffmann
909b0c7462
Merge pull request #782 from lonvia/rework-postcodes
...
Rework handling of artificial postcode centroids
2017-09-16 15:54:55 +02:00
Sarah Hoffmann
8c4bcd36ea
check that replication URL points to a repo of OSM diffs
...
Also check that pyosmium does not return None to work around
a bad return code in the current release of pyosmium-get-changes.
Fixes #784 .
2017-08-29 21:05:54 +02:00
Sarah Hoffmann
e55ac77c94
add simple tests for postcode import
2017-08-19 19:37:06 +02:00
Sarah Hoffmann
3c9af7f151
move adding postcodes to word table to calculation step
2017-08-19 19:37:06 +02:00
Sarah Hoffmann
5b4bbab9be
include GB CodePoint data into location_postcode table
2017-08-19 19:37:06 +02:00
Sarah Hoffmann
53f8459e97
move postcode indexing to end of setup
...
The search_name tables are needed for finding the parent,
so the rest of the database must be indexed.
2017-08-19 19:37:05 +02:00
Sarah Hoffmann
80ef6cbaab
add indexing of artificial postcodes
2017-08-19 19:37:05 +02:00
Sarah Hoffmann
15dbb6383c
add new location_postcode table
...
Artifical postcode centroids are now saved in there.
2017-08-19 19:37:05 +02:00
Sarah Hoffmann
896421fe9f
improve update interval computation
...
Don't do anything if a downloaded diff is empty after all
(may be happening when an empty diff was published upstream).
Correctly compute the waiting interval before checking for new
data. As the interval is now computed based on the date of the
newest object in the database, the configured intervals need
to be adjusted slightly to take into account the time it takes
for the server to publish a diff.
2017-06-11 09:21:24 +02:00
Sarah Hoffmann
4e6c75040e
Guard against network failures in getDatabaseDate()
...
When updating use the date from the diff file instead
as we are guaranteed to get this if the file has been
successfully loaded.
2017-06-09 21:49:31 +02:00
Sarah Hoffmann
0628aa887f
adapt postcode centroid import to new address hstore
...
The postcode now needs to be saved in address->'postcode'
not in the postcode column which is derived only later while
indexing.
Fixes #746 .
Thanks to @kkoop.
2017-06-06 20:42:13 +02:00
Sarah Hoffmann
54393addd3
disregard special phrases that do not match fully
...
Compare the normalized terms imported with the special
terms script with the normalized version of the query string.
Disregard them if they cannot be found. This avoids a significant
number of mismatches due to transliteration issues.
The match will only be done when a normalized word has been set
making this change backwards compatible with older databases.
2017-06-04 23:12:09 +02:00
Sarah Hoffmann
e3fb706c65
add normalized version of special search terms on import
...
Requires the PHP bindings for libicu, so add that as a requirement.
2017-06-04 23:12:09 +02:00
Sarah Hoffmann
1876fe42c9
updates: always remove output file and start with correct sequence id
2017-05-27 17:02:34 +02:00
Sarah Hoffmann
86acaa5264
fix name of constant
2017-05-27 16:42:01 +02:00
Sarah Hoffmann
bd4b1b2d08
switch from osmosis to pyosmium for updates
...
Pyosmium comes with convenient functions for finding the
right state and does not require external files for
rembering the state. Updates can now conveniently
set up by simply running ./utils/update.php --init-updates
and state is kept directly in the import_status table.
This change requires an update in the database schema.
Run the following to update:
ALTER TABLE import_status ADD COLUMN sequence_id integer;
ALTER TABLE import_status ADD COLUMN indexed boolean;
ALTER TABLE import_osmosis_log ADD COLUMN batchseq integer;
2017-05-25 16:26:09 +02:00
Sarah Hoffmann
b15b996cc4
remove base country grid from repo
...
The updated country grid is significantly larger, so expect it to
be downloaded from the nominatim.org website instead.
2017-05-12 23:02:50 +02:00
Sarah Hoffmann
86d5209118
Merge branch 'roques-tetris'
2017-04-22 18:14:05 +02:00
Sarah Hoffmann
291a161cc6
make sure no invalid geometries end up in placex
2017-04-22 10:34:03 +02:00
Sarah Hoffmann
4c7145c293
Merge branch 'tetris' of https://github.com/roques/Nominatim into roques-tetris
2017-04-20 20:56:44 +02:00
Sarah Hoffmann
71e6d5f9a6
fix typo
2017-04-18 22:44:39 +02:00
Sarah Hoffmann
446a5a95bc
get pg error on correct connection
2017-04-18 22:29:21 +02:00
Sarah Hoffmann
19edbd3581
send address interpolation import to correct postgres conn
2017-04-18 22:11:58 +02:00
