maplibre/martin
1
1
Fork 0
mirror of https://github.com/maplibre/martin.git synced 2024-12-19 04:41:46 +03:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
629eaea189
martin/Cargo.toml

113 lines
3.7 KiB
TOML
Raw Normal View History

Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
[workspace]
cleanup func docs, lints (#842) this also fixes new rust version lints
2023-08-28 04:07:29 +03:00
resolver = "2"
Rename martin-mbtiles crate to mbtiles (#976) This simplifies usage as both a crate and as a tool
2023-10-28 11:50:49 +03:00
members = ["martin", "martin-tile-utils", "mbtiles"]
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
[workspace.package]
edition = "2021"
license = "MIT OR Apache-2.0"
update lock, minor toml sort cleanup
2023-07-06 03:56:23 +03:00
repository = "https://github.com/maplibre/martin"
Add binary diff for mbtiles (#1358) * `mbtiles diff` now has an additional `--patch-type` param with `whole`, `bin-diff-raw` and `bin-diff-gz` values: * `whole` stores different tiles as before - as whole tiles in the `tiles` table * `bin-diff-raw` computes binary difference between tiles, and stores them as brotli-encoded value in a `bsdiffraw` table, together with a `xxh3_64` hash of the tile as it will be stored after patching * `bin-diff-gz` same as `bin-diff-raw`, but assumes the tiles are gzip-compressed, so it uncompresses them before comparing. The `xxh3_64` stores the hash of the uncompressed tile. The data will be stored in the `bsdiffrawgz` table (identical structure with above) * `mbtiles copy --apply-patch` will automatically detect if `bsdiffrawgz` or `bsdiffraw` tables exist, and will use binary patching. * `mbtiles apply-patch` does not support binary patching yet * `mbtiles copy --diff-with-file ... --patch-type ...` is an alias to `mbtiles diff --patch-type ...`
2024-06-25 22:34:14 +03:00
rust-version = "1.76"
Debian package (#730) Add deb package by [cargo-deb](https://crates.io/crates/cargo-deb) - [ ] add deb package metadata - [ ] more research on systemd integration To inspect the package: ```shell # install cargo-deb dependices sudo apt install dpkg sudo apt install dpkg-dev sudo apt install liblzma-dev cargo install cargo-deb cd martin cargo deb The Debian package will be created in `target/debian/martin_0.8.7_amd64.deb` . ``` To decompress this package: ```shell dpkg -x martin_0.8.7_amd64.deb path_of_decompress ``` --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com>
2023-07-10 21:38:48 +03:00
readme = "README.md"
homepage = "https://martin.maplibre.org/"
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
Use Rust's 1.74 cargo lint section (#1006) https://blog.rust-lang.org/2023/11/16/Rust-1.74.0.html
2023-11-17 03:29:25 +03:00
[workspace.lints.rust]
mbtiles improvements, minor changes (#1013) # MBTiles * New `--agg-hash (update|verify|off)` flag replaces `--update-agg-tiles-hash` (still supported, but not shown in the help screen). This allows bypassing aggregate hash validation entirely, without either updating or validating it. * Simplify MBTiles SQL generation * MBTiles now uses faster `1 << zoom` everywhere, and a dedicated TMS inversion fn * split up metadata insert and delete into separate fn * consolidated schema initialization * ensure db settings (like pragma) are always reset on new files # Other * Always sort JSON-serialized keys for consistency * this affects `/catalog` key ordering, but content is the same * Minor code cleanup
2023-11-19 13:06:37 +03:00
unused_qualifications = "warn"
Minor cleanup (#1008) - Add separators to long literal. - Use first() instead of get(0) - Move some SQL-making code to their own functions - Minor mathematics and rounding cleanup --------- Co-authored-by: Yuri Astrakhan <YuriAstrakhan@gmail.com>
2023-11-17 21:55:05 +03:00
# Lints inheritance from workspace is not yet supported
# Crate mbtiles uses unsafe code, so we can't forbid it here
# unsafe_code = "forbid"
Use Rust's 1.74 cargo lint section (#1006) https://blog.rust-lang.org/2023/11/16/Rust-1.74.0.html
2023-11-17 03:29:25 +03:00
[workspace.lints.clippy]
Add `martin-cp` tool to bulk-copy tiles from any Martin-supported sources (#1011) This adds a new utility called `martin-cp` that allows copying any number of tiles from a single source (or a composite source) to an mbtiles file. `martin-cp` is a tool for generating tiles in bulk, and save retrieved tiles into a new or an existing MBTiles file. It can be used to generate tiles for a large area or multiple areas. If multiple areas overlap, it will generate tiles only once. `martin-cp` supports the same configuration file and CLI arguments as Martin server, so it can support all sources and even combining sources.
2023-11-20 09:27:51 +03:00
pedantic = { level = "warn", priority = -1 }
Use Rust's 1.74 cargo lint section (#1006) https://blog.rust-lang.org/2023/11/16/Rust-1.74.0.html
2023-11-17 03:29:25 +03:00
derive_partial_eq_without_eq = "allow"
implicit_hasher = "allow"
missing_errors_doc = "allow"
missing_panics_doc = "allow"
module_name_repetitions = "allow"
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
[workspace.dependencies]
bump dependencies
2024-06-27 00:15:27 +03:00
actix-cors = "0.7"
feat: use latest actix, switch to bb8 (async everywhere), remove actions (#377) * remove all actions and other low-level magic code, making it more straightforward for the most common usage * replace r2d2 with bb8 to make it all async * use first significant version in cargo.toml - this makes it easier to maintain This fixes #349
2022-08-15 16:54:48 +03:00
actix-http = "3"
actix-rt = "2"
actix-web = "4"
add web UI placeholder (#1395) Add an optional web UI interface for Martin, including docker-based cross-compilation support. The UI itself is a placeholder with a logo, but will grow in subsequent PRs. This was branched off of https://github.com/maplibre/martin/pull/1142 to address the PR feedback from @nyurik . --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com> Co-authored-by: Tomer Ronen <tomer207@gmail.com> Co-authored-by: tomeronen <45331634+tomeronen@users.noreply.github.com>
2024-07-14 20:39:29 +03:00
actix-web-static-files = "4"
Add `mbtiles meta-get` utility (#701) * Add functionality to retrieve a metadata value in an mbtiles file by key; simple implementation for one of the items in #667 * Also, disable TTY in docker-up `just` target
2023-06-03 03:40:22 +03:00
anyhow = "1.0"
Add mbtiles statistics command (#986) - [x] Add tile statistics to mbtiles tools - [x] Add test - [x] Use 4326 instead of 3857 for tile bounds - [x] Add document - [x] Use size-format to prettify output - [x] Statistics struct Refactor - [x] Cleanup and reformat Closes #964 --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com>
2023-11-13 09:03:40 +03:00
approx = "0.5.1"
feat: use latest actix, switch to bb8 (async everywhere), remove actions (#377) * remove all actions and other low-level magic code, making it more straightforward for the most common usage * replace r2d2 with bb8 to make it all async * use first significant version in cargo.toml - this makes it easier to maintain This fixes #349
2022-08-15 16:54:48 +03:00
async-trait = "0.1"
bump deps and the lock file (#1424)
2024-07-19 05:54:42 +03:00
bit-set = "0.8"
Fix a few CI issues and bump deps (#1341)
2024-05-17 08:05:19 +03:00
brotli = ">=5, <7"
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
cargo-husky = { version = "1", features = ["user-hooks"], default-features = false }
Breakup config for pg and srv (#420) Getting ready for multi-backend system, where each backend would have its own configuration. All 3 config structs (clap args, config, and configbuilder) are now separated into 3 files - the main one, one for service (actix stuff), and one for PostgreSQL. The files have been moved to `/pg` and `/srv`, but otherwise the logic should be mostly intact.
2022-10-01 10:48:11 +03:00
clap = { version = "4", features = ["derive"] }
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
criterion = { version = "0.5", features = ["async_futures", "async_tokio", "html_reports"] }
ctor = "0.2"
bump dependencies
2024-06-27 00:15:27 +03:00
deadpool-postgres = "0.14"
Add metadat copy/apply-diff, new testing framework (#921) * Fix metadata copying * Introduce a new metadata field `agg_tiles_hash_after_apply` for diff files * Added a lot of new info and debug logging * Simplified Copying interface - not much value in having all the complex builder pattern here it seems, might as well use a simple object. ## Testing * Generate SQLite DBs in memory on the fly to validate just what we need * Use `insta` for validating DB content There is now a function `dump(connection) -> Vec<Entry>` to dump the content of the entire SQLite DB into text with `serde`. At many steps through the testing, the DB content is validated with the corresponding .snap file with `insta` crate (which makes this process mega-simple, including a simple way to "bless" (update) any changes). ## Discovered bugs * Seems like normalized files do not get copied properly - they contain extras that should be removed.
2023-10-10 18:10:17 +03:00
enum-display = "0.1"
Bump dependencies
2024-01-21 03:52:09 +03:00
env_logger = "0.11"
Switch bb8 to DeadPool (#570) DeadPool seem to be better maintained, and most importantly, it properly reports connection errors - something bb8 does not support yet. I also removed connection timeout config param - it was introduced while trying to solve bb8 issue - not needed because connection string supports it already. This should resolve some of the issues in #496
2023-02-08 19:55:37 +03:00
flate2 = "1"
Add binary diff for mbtiles (#1358) * `mbtiles diff` now has an additional `--patch-type` param with `whole`, `bin-diff-raw` and `bin-diff-gz` values: * `whole` stores different tiles as before - as whole tiles in the `tiles` table * `bin-diff-raw` computes binary difference between tiles, and stores them as brotli-encoded value in a `bsdiffraw` table, together with a `xxh3_64` hash of the tile as it will be stored after patching * `bin-diff-gz` same as `bin-diff-raw`, but assumes the tiles are gzip-compressed, so it uncompresses them before comparing. The `xxh3_64` stores the hash of the uncompressed tile. The data will be stored in the `bsdiffrawgz` table (identical structure with above) * `mbtiles copy --apply-patch` will automatically detect if `bsdiffrawgz` or `bsdiffraw` tables exist, and will use binary patching. * `mbtiles apply-patch` does not support binary patching yet * `mbtiles copy --diff-with-file ... --patch-type ...` is an alias to `mbtiles diff --patch-type ...`
2024-06-25 22:34:14 +03:00
flume = "0.11"
Multi-source support, new path structure (#456) Partial implementation of the #430 * New endpoint structure: * `GET /` -- a placeholder for the future home page * `GET /catalog` -- get a list of available sources, as a list of json blobs. * `[{id, name, description, attribution, vector_layer}, ...]` (some fields might be missing) * `GET /<id>` -- get tilejson for the given source, or a combination of sources. No `.json` extension * `GET /<id>/<z>/<x>/<y>` -- get a tile. No format extension. * `GET /health` -- healthcheck * Introduce a new tile format support crate (using code from the maplibre/mbtileserve project) * Removed the `/rpc/...` routes - all source IDs are accessed in the same way * Can print auto-generated configuration or save it to a file * Refactored to support multiple sources from multiple backends, with a proper naming conflict resolution TODO: * benchmarks need to be rewritten - they were relying on some internal structures that are no longer there. This might be done as a separate PR due to a very different internal architecture - might need to rethink benchmarking approaches.
2022-11-26 12:46:40 +03:00
futures = "0.3"
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
indoc = "2"
Fix martin integration tests (#952) Turns out some integration tests were not running after `martin` was moved to subdir
2023-10-20 06:40:08 +03:00
insta = "1"
Fix a few CI issues and bump deps (#1341)
2024-05-17 08:05:19 +03:00
itertools = "0.13"
json-patch = "2.0"
Add AWS Lambda support (#1127) This adds the lambda-web crate to adapt the actix App to speak to Lambda by way of the lambda_runtime crate. AWS Lambda has native support for scripting languages to execute a function directly; compiled languages must embed a runtime to fetch incoming events from Lambda and post the responses. This detects the environment variables to start up in Lambda mode instead of the normal HTTP server, and is added as an optional feature. Lambda has five (!) distinct ways of routing HTTP requests to a function; this supports some of them. (Specifically, the most obvious way to do this is with a Function URL, which is newest and simplest, and perhaps with CloudFront, which speaks to the Function URL and not Lambda directly.) The error handling could probably be refined, I was just trying to get this to compile. (Supported: API Gateway HTTP API with payload format version 2.0; API Gateway REST API; Lambda function URLs / Not supported: API Gateway HTTP API with payload format version 1.0; Application Load Balancer) Necessary for #1102 to be able to run the released packages directly, and only having to configure the appropriate environment. --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com>
2024-02-01 21:56:40 +03:00
lambda-web = { version = "0.2.1", features = ["actix4"] }
Update sqlite-hashes dependency (#1268) Minor internal breaking changes
2024-03-23 00:04:16 +03:00
libsqlite3-sys = { version = ">=0.27", features = ["bundled"] }
WIP: refactoring
2018-03-26 14:12:43 +03:00
log = "0.4"
Optimize produced release binaries (#1385) Minor optimization to create a slightly more compact code (should be the same performance, or possibly even faster)
2024-06-27 03:31:41 +03:00
martin-tile-utils = { path = "./martin-tile-utils", version = "0.5.1" }
mbtiles = { path = "./mbtiles", version = "0.11.1" }
Add binary diff for mbtiles (#1358) * `mbtiles diff` now has an additional `--patch-type` param with `whole`, `bin-diff-raw` and `bin-diff-gz` values: * `whole` stores different tiles as before - as whole tiles in the `tiles` table * `bin-diff-raw` computes binary difference between tiles, and stores them as brotli-encoded value in a `bsdiffraw` table, together with a `xxh3_64` hash of the tile as it will be stored after patching * `bin-diff-gz` same as `bin-diff-raw`, but assumes the tiles are gzip-compressed, so it uncompresses them before comparing. The `xxh3_64` stores the hash of the uncompressed tile. The data will be stored in the `bsdiffrawgz` table (identical structure with above) * `mbtiles copy --apply-patch` will automatically detect if `bsdiffrawgz` or `bsdiffraw` tables exist, and will use binary patching. * `mbtiles apply-patch` does not support binary patching yet * `mbtiles copy --diff-with-file ... --patch-type ...` is an alias to `mbtiles diff --patch-type ...`
2024-06-25 22:34:14 +03:00
md5 = "0.7.0"
Implement http pmtiles (#991) PMTiles is a web-optimized format, allowing the actual file to be read with HTTP range requests. Supporting this use case instantly allows Martin to function as a lambda executable accessing PMTiles, but without any significant investment into devops or hosting large file. PMTiles config now also allows `http` and `https` protocol. ``` # Publish PMTiles files pmtiles: paths: # specific pmtiles file will be published as mypmtiles source # (use last portion of the URL without extension) - http://example.org/path/to/mypmtiles.pmtiles sources: # named source matching source name to a single file pm-src1: https://example.org/path/to/some_pmtiles.pmtiles ``` fixes #884 --------- Co-authored-by: Kyle Slugg-Urbino <35903887+kyleslugg@users.noreply.github.com>
2023-12-22 09:01:50 +03:00
moka = { version = "0.12", features = ["future"] }
feat: use latest actix, switch to bb8 (async everywhere), remove actions (#377) * remove all actions and other low-level magic code, making it more straightforward for the most common usage * replace r2d2 with bb8 to make it all async * use first significant version in cargo.toml - this makes it easier to maintain This fixes #349
2022-08-15 16:54:48 +03:00
num_cpus = "1"
chore(deps): Bump pbf_font_tools from 2.5.0 to 2.5.1 (#1191) Bumps [pbf_font_tools](https://github.com/stadiamaps/sdf_font_tools) from 2.5.0 to 2.5.1. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/stadiamaps/sdf_font_tools/releases">pbf_font_tools's releases</a>.</em></p> <blockquote> <h2>tools-v2.5.1</h2> <h2>What's Changed</h2> <ul> <li>Housekeeping by <a href="https://github.com/ianthetechie"><code>@​ianthetechie</code></a> in <a href="https://redirect.github.com/stadiamaps/sdf_font_tools/pull/17">stadiamaps/sdf_font_tools#17</a></li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/stadiamaps/sdf_font_tools/compare/cli-v1.4.1...sdf-v1.0.1">https://github.com/stadiamaps/sdf_font_tools/compare/cli-v1.4.1...sdf-v1.0.1</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/stadiamaps/sdf_font_tools/commit/011f994a593af4b5bb3e95d3157cafe788fb207c"><code>011f994</code></a> Housekeeping (<a href="https://redirect.github.com/stadiamaps/sdf_font_tools/issues/17">#17</a>)</li> <li><a href="https://github.com/stadiamaps/sdf_font_tools/commit/97c5634b8e3515ac7761d0a4f67d12e7f688b042"><code>97c5634</code></a> Fix CI issues round 2</li> <li>See full diff in <a href="https://github.com/stadiamaps/sdf_font_tools/compare/tools-v2.5.0...tools-v2.5.1">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=pbf_font_tools&package-manager=cargo&previous-version=2.5.0&new-version=2.5.1)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-13 05:59:51 +03:00
pbf_font_tools = { version = "2.5.1", features = ["freetype"] }
Fix a few CI issues and bump deps (#1341)
2024-05-17 08:05:19 +03:00
pmtiles = { version = "0.10", features = ["http-async", "mmap-async-tokio", "tilejson", "reqwest-rustls-tls-native-roots"] }
feat: use latest actix, switch to bb8 (async everywhere), remove actions (#377) * remove all actions and other low-level magic code, making it more straightforward for the most common usage * replace r2d2 with bb8 to make it all async * use first significant version in cargo.toml - this makes it easier to maintain This fixes #349
2022-08-15 16:54:48 +03:00
postgis = "0.9"
cargo update (#395) * bump postgres features * update to latest
2022-09-13 09:18:01 +03:00
postgres = { version = "0.19", features = ["with-time-0_3", "with-uuid-1", "with-serde_json-1"] }
feat: use latest actix, switch to bb8 (async everywhere), remove actions (#377) * remove all actions and other low-level magic code, making it more straightforward for the most common usage * replace r2d2 with bb8 to make it all async * use first significant version in cargo.toml - this makes it easier to maintain This fixes #349
2022-08-15 16:54:48 +03:00
postgres-protocol = "0.6"
better bench test
2023-12-27 21:50:07 +03:00
pprof = { version = "0.13", features = ["flamegraph", "criterion"] }
Add metadat copy/apply-diff, new testing framework (#921) * Fix metadata copying * Introduce a new metadata field `agg_tiles_hash_after_apply` for diff files * Added a lot of new info and debug logging * Simplified Copying interface - not much value in having all the complex builder pattern here it seems, might as well use a simple object. ## Testing * Generate SQLite DBs in memory on the fly to validate just what we need * Use `insta` for validating DB content There is now a function `dump(connection) -> Vec<Entry>` to dump the content of the entire SQLite DB into text with `serde`. At many steps through the testing, the DB content is validated with the corresponding .snap file with `insta` crate (which makes this process mega-simple, including a simple way to "bless" (update) any changes). ## Discovered bugs * Seems like normalized files do not get copied properly - they contain extras that should be removed.
2023-10-10 18:10:17 +03:00
pretty_assertions = "1"
Improve SSL support (#567) This is a partial fix for #496 * BREAKING: Now Martin behaves the same way as `psql` -- by default, if SSL is available on the server, it will be used, even though it will not verify that the server has a valid SSL certificate * Martin now understands `PGSSLCERT`, `PGSSLKEY`, and `PGSSLROOTCERT` env vars (and corresponding config keys) - same as psql. * Martin can now process `?sslmode=verify-ca` and `verify-full` (just like psql). The verify modes require root and/or client cert & key. * remove `danger_accept_invalid_certs` -- turns out that behavior is expected by default unless ssl mode is set to verify - which upstream lib [does not support](https://github.com/sfackler/rust-postgres/issues/768) - PR [submitted](https://github.com/sfackler/rust-postgres/pull/988). * added connection_timeout_ms option for postgres and set it to 5 seconds by default. This way it will fail out earlier. * added error reporting to bb8 - but it is currently [broken upstream](https://github.com/djc/bb8/issues/151) - not sure we can fix it easily, so may need to switch to deadpool later. * added docker-based TLS test (horray!) - wasn't trivial at all, despite ending up fairly simple.
2023-02-06 22:32:28 +03:00
regex = "1"
Bump a few more dependencies (#1510)
2024-09-12 01:46:48 +03:00
rstest = "0.22"
chore(deps): Bump rustls from 0.23.11 to 0.23.12 (#1434) Bumps [rustls](https://github.com/rustls/rustls) from 0.23.11 to 0.23.12. <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/rustls/rustls/commit/ebda3856602f3af2ced19a792e6fed1d70c500e4"><code>ebda385</code></a> Update version to 0.23.12</li> <li><a href="https://github.com/rustls/rustls/commit/127a0a769ff5d8fd250170be1fd4e12b49928f8f"><code>127a0a7</code></a> build(deps): bump openssl from 0.10.64 to 0.10.66</li> <li><a href="https://github.com/rustls/rustls/commit/3cc2c2db8a2aef1d6bb59d614bdf70919fedb984"><code>3cc2c2d</code></a> Support P521 SHA-256/SHA-384 signatures with aws-lc-rs (<a href="https://redirect.github.com/rustls/rustls/issues/2050">#2050</a>)</li> <li><a href="https://github.com/rustls/rustls/commit/e58aaa8487fd4c0b8408ee2d9fe9ff31dfc47b54"><code>e58aaa8</code></a> ci: add rebaseWhen to renovate config</li> <li><a href="https://github.com/rustls/rustls/commit/dfc8ae597aec24bc159b116ee2d4272dc81e9407"><code>dfc8ae5</code></a> ci: remove stabilityDays from renovate config</li> <li><a href="https://github.com/rustls/rustls/commit/49c31cb91739c16cec52c49c99954764b1eba331"><code>49c31cb</code></a> chore(deps): lock file maintenance</li> <li><a href="https://github.com/rustls/rustls/commit/63eecac0a20c84263bd18faa90fe2ecf731de91f"><code>63eecac</code></a> chore(deps): update rust crate tikv-jemallocator to 0.6</li> <li>See full diff in <a href="https://github.com/rustls/rustls/compare/v/0.23.11...v/0.23.12">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=rustls&package-manager=cargo&previous-version=0.23.11&new-version=0.23.12)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-24 05:49:01 +03:00
rustls = "0.23.12"
upgrade dependencies, Nasm on Windows (#1295) * Install `nasm` when running CI on Windows (required by rustls new faster crypto-provider) * In integration testing, wrap connection in mutex due to `rstest` now requiring `once` fixtures to be `Sync` * Upgrade to Brotli v4, and disable FFI due to compilation conflict
2024-04-10 02:36:40 +03:00
# ring feature does not require NASM windows executable, but works slower
#rustls = { version = "0.23", default-features = false, features = ["logging", "std", "tls12", "ring"] }
Bump a few more dependencies (#1510)
2024-09-12 01:46:48 +03:00
rustls-native-certs = "0.8"
Upgrade to Rustls 0.22 (#1136) Fix #1036
2024-01-17 04:42:11 +03:00
rustls-pemfile = "2"
feat: use latest actix, switch to bb8 (async everywhere), remove actions (#377) * remove all actions and other low-level magic code, making it more straightforward for the most common usage * replace r2d2 with bb8 to make it all async * use first significant version in cargo.toml - this makes it easier to maintain This fixes #349
2022-08-15 16:54:48 +03:00
semver = "1"
Rework and consolidate CI (#467) Rework CI to run tests locally using the VM-installed Postgres on all target platforms. ### CI jobs * Build release versions on Linux/Win/Mac and save build results as output artifacts * In a separate VMs (Linux/Win/Mac) * use [nyurik/action-setup-postgis](https://github.com/nyurik/action-setup-postgis) to install postgis and run tests using the built artifacts * run `cargo test` on Linux only * copy built artifacts from the build step, and run tests using the release martin binary * package and publish if this is a release ### Other changes * Port some minor changes from the rewrite to porting easier * minor cleanups * remove all "expected" data files - too unstable to be usable
2022-10-31 23:28:21 +03:00
serde = { version = "1", features = ["derive"] }
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
serde_json = "1"
simplify serde optional handling (#998)
2023-11-13 06:22:04 +03:00
serde_with = "3"
chore(deps): bump serde_yaml from 0.8.26 to 0.9.0 (#369) Bumps [serde_yaml](https://github.com/dtolnay/serde-yaml) from 0.8.26 to 0.9.0. - [Release notes](https://github.com/dtolnay/serde-yaml/releases) - [Commits](https://github.com/dtolnay/serde-yaml/compare/0.8.26...0.9.0) --- updated-dependencies: - dependency-name: serde_yaml dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-07-29 12:20:49 +03:00
serde_yaml = "0.9"
Add mbtiles statistics command (#986) - [x] Add tile statistics to mbtiles tools - [x] Add test - [x] Use 4326 instead of 3857 for tile bounds - [x] Add document - [x] Use size-format to prettify output - [x] Statistics struct Refactor - [x] Cleanup and reformat Closes #964 --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com>
2023-11-13 09:03:40 +03:00
size_format = "1.0.2"
bump lock
2023-12-07 10:20:32 +03:00
spreet = { version = "0.11", default-features = false }
chore(deps): Bump sqlite-compressions from 0.2.13 to 0.2.14 (#1435) Bumps [sqlite-compressions](https://github.com/nyurik/sqlite-compressions) from 0.2.13 to 0.2.14. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/nyurik/sqlite-compressions/releases">sqlite-compressions's releases</a>.</em></p> <blockquote> <h2>v0.2.14</h2> <h2>What's Changed</h2> <ul> <li>Fix release pipeline</li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/nyurik/sqlite-compressions/compare/v0.2.13...v0.2.14">https://github.com/nyurik/sqlite-compressions/compare/v0.2.13...v0.2.14</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/nyurik/sqlite-compressions/commit/342ca4563f284683540f13528bc2db5c640d5fec"><code>342ca45</code></a> fix release ci, dep update</li> <li><a href="https://github.com/nyurik/sqlite-compressions/commit/74c36a82aba209aac7152917366137b725cbb5c9"><code>74c36a8</code></a> Bump env_logger from 0.11.3 to 0.11.4 (<a href="https://redirect.github.com/nyurik/sqlite-compressions/issues/39">#39</a>)</li> <li><a href="https://github.com/nyurik/sqlite-compressions/commit/089cc4e4dfc095e2d5336a1e0834221df2b235c6"><code>089cc4e</code></a> bump version</li> <li>See full diff in <a href="https://github.com/nyurik/sqlite-compressions/compare/v0.2.13...v0.2.14">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=sqlite-compressions&package-manager=cargo&previous-version=0.2.13&new-version=0.2.14)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-25 06:40:56 +03:00
sqlite-compressions = { version = "0.2.14", default-features = false, features = ["bsdiffraw", "gzip"] }
chore(deps): Bump sqlite-hashes from 0.7.4 to 0.7.5 (#1436) Bumps [sqlite-hashes](https://github.com/nyurik/sqlite-hashes) from 0.7.4 to 0.7.5. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/nyurik/sqlite-hashes/releases">sqlite-hashes's releases</a>.</em></p> <blockquote> <h2>v0.7.5</h2> <h2>What's Changed</h2> <ul> <li>Fix CI release process</li> </ul> <p><strong>Full Changelog</strong>: <a href="https://github.com/nyurik/sqlite-hashes/compare/v0.7.3...v0.7.5">https://github.com/nyurik/sqlite-hashes/compare/v0.7.3...v0.7.5</a></p> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/nyurik/sqlite-hashes/commit/271d4ff354345dadcf54cd2e5b34f88a692cab80"><code>271d4ff</code></a> improve published version check</li> <li><a href="https://github.com/nyurik/sqlite-hashes/commit/56434f0dea4e155ace0bf0378af53ff973c1f1d8"><code>56434f0</code></a> Bump env_logger from 0.11.3 to 0.11.4 (<a href="https://redirect.github.com/nyurik/sqlite-hashes/issues/38">#38</a>)</li> <li><a href="https://github.com/nyurik/sqlite-hashes/commit/c74129ea1b2e40f48d31bb4904b8aa4b52bf0300"><code>c74129e</code></a> bump version</li> <li>See full diff in <a href="https://github.com/nyurik/sqlite-hashes/compare/v0.7.4...v0.7.5">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=sqlite-hashes&package-manager=cargo&previous-version=0.7.4&new-version=0.7.5)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-25 06:18:29 +03:00
sqlite-hashes = { version = "0.7.5", default-features = false, features = ["md5", "aggregate", "hex"] }
mbtiles: remove tls features, CI streamlining (#908)
2023-09-30 03:40:32 +03:00
sqlx = { version = "0.7", features = ["sqlite", "runtime-tokio"] }
add web UI placeholder (#1395) Add an optional web UI interface for Martin, including docker-based cross-compilation support. The UI itself is a placeholder with a logo, but will grow in subsequent PRs. This was branched off of https://github.com/maplibre/martin/pull/1142 to address the PR feedback from @nyurik . --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com> Co-authored-by: Tomer Ronen <tomer207@gmail.com> Co-authored-by: tomeronen <45331634+tomeronen@users.noreply.github.com>
2024-07-14 20:39:29 +03:00
static-files = "0.2"
update lock
2023-09-06 07:30:40 +03:00
subst = { version = "0.3", features = ["yaml"] }
Strongly-type errors, fix bounds escaping (#516) * Since this is a library, all errors should have a strongly typed enum. * table bounds computing function was not escaping identifiers * table bounds computation was also silently ignoring all errors
2022-12-13 13:02:38 +03:00
thiserror = "1"
Bump all dependencies, fix CI (#1353)
2024-05-25 08:17:26 +03:00
tile-grid = "0.6"
Add `martin-cp` tool to bulk-copy tiles from any Martin-supported sources (#1011) This adds a new utility called `martin-cp` that allows copying any number of tiles from a single source (or a composite source) to an mbtiles file. `martin-cp` is a tool for generating tiles in bulk, and save retrieved tiles into a new or an existing MBTiles file. It can be used to generate tiles for a large area or multiple areas. If multiple areas overlap, it will generate tiles only once. `martin-cp` supports the same configuration file and CLI arguments as Martin server, so it can support all sources and even combining sources.
2023-11-20 09:27:51 +03:00
tilejson = "0.4"
bump lock
2023-11-10 06:28:15 +03:00
tokio = { version = "1", features = ["macros"] }
upgrade dependencies, Nasm on Windows (#1295) * Install `nasm` when running CI on Windows (required by rustls new faster crypto-provider) * In integration testing, wrap connection in mutex due to `rstest` now requiring `once` fixtures to be `Sync` * Upgrade to Brotli v4, and disable FFI due to compilation conflict
2024-04-10 02:36:40 +03:00
tokio-postgres-rustls = "0.12"
Implement http pmtiles (#991) PMTiles is a web-optimized format, allowing the actual file to be read with HTTP range requests. Supporting this use case instantly allows Martin to function as a lambda executable accessing PMTiles, but without any significant investment into devops or hosting large file. PMTiles config now also allows `http` and `https` protocol. ``` # Publish PMTiles files pmtiles: paths: # specific pmtiles file will be published as mypmtiles source # (use last portion of the URL without extension) - http://example.org/path/to/mypmtiles.pmtiles sources: # named source matching source name to a single file pm-src1: https://example.org/path/to/some_pmtiles.pmtiles ``` fixes #884 --------- Co-authored-by: Kyle Slugg-Urbino <35903887+kyleslugg@users.noreply.github.com>
2023-12-22 09:01:50 +03:00
url = "2.5"
Add binary diff for mbtiles (#1358) * `mbtiles diff` now has an additional `--patch-type` param with `whole`, `bin-diff-raw` and `bin-diff-gz` values: * `whole` stores different tiles as before - as whole tiles in the `tiles` table * `bin-diff-raw` computes binary difference between tiles, and stores them as brotli-encoded value in a `bsdiffraw` table, together with a `xxh3_64` hash of the tile as it will be stored after patching * `bin-diff-gz` same as `bin-diff-raw`, but assumes the tiles are gzip-compressed, so it uncompresses them before comparing. The `xxh3_64` stores the hash of the uncompressed tile. The data will be stored in the `bsdiffrawgz` table (identical structure with above) * `mbtiles copy --apply-patch` will automatically detect if `bsdiffrawgz` or `bsdiffraw` tables exist, and will use binary patching. * `mbtiles apply-patch` does not support binary patching yet * `mbtiles copy --diff-with-file ... --patch-type ...` is an alias to `mbtiles diff --patch-type ...`
2024-06-25 22:34:14 +03:00
xxhash-rust = { version = "0.8", features = ["xxh3"] }
Move Martin crate to its own subdir (#699) This cleans up the code a bit, making all crates to be on the same level.
2023-06-04 05:50:55 +03:00
add encoding=UTF8 pragma, refactoring (#919)
2023-10-04 04:20:41 +03:00
[profile.dev.package]
Move Martin crate to its own subdir (#699) This cleans up the code a bit, making all crates to be on the same level.
2023-06-04 05:50:55 +03:00
# See https://github.com/launchbadge/sqlx#compile-time-verification
add encoding=UTF8 pragma, refactoring (#919)
2023-10-04 04:20:41 +03:00
sqlx-macros.opt-level = 3
Add metadat copy/apply-diff, new testing framework (#921) * Fix metadata copying * Introduce a new metadata field `agg_tiles_hash_after_apply` for diff files * Added a lot of new info and debug logging * Simplified Copying interface - not much value in having all the complex builder pattern here it seems, might as well use a simple object. ## Testing * Generate SQLite DBs in memory on the fly to validate just what we need * Use `insta` for validating DB content There is now a function `dump(connection) -> Vec<Entry>` to dump the content of the entire SQLite DB into text with `serde`. At many steps through the testing, the DB content is validated with the corresponding .snap file with `insta` crate (which makes this process mega-simple, including a simple way to "bless" (update) any changes). ## Discovered bugs * Seems like normalized files do not get copied properly - they contain extras that should be removed.
2023-10-10 18:10:17 +03:00
# See https://docs.rs/insta/latest/insta/#optional-faster-runs
insta.opt-level = 3
similar.opt-level = 3
Preparing release, version bump
2023-12-19 04:24:43 +03:00
#[patch.crates-io]
Improve `mbtiles update`, update min/max zoom on `martin-cp` (#1096) * `mbtiles update` now allows different types of zoom updates - reset to content, grow only, or skip (dry run) * `martin-cp` will now update (grow-only) metadata zooms Addresses a few concerns in the #1081
2023-12-24 12:30:45 +03:00
#enum-display = { path = "../enum-display" }
Minor cleanup and just reorg (#992) Only run git push diff on linux to make development on non-linux easier, and a few preparations for pmtiles over http serving Fixes #855
2023-11-09 03:46:23 +03:00
#pmtiles = { path = "../pmtiles-rs" }
Add `martin-cp` tool to bulk-copy tiles from any Martin-supported sources (#1011) This adds a new utility called `martin-cp` that allows copying any number of tiles from a single source (or a composite source) to an mbtiles file. `martin-cp` is a tool for generating tiles in bulk, and save retrieved tiles into a new or an existing MBTiles file. It can be used to generate tiles for a large area or multiple areas. If multiple areas overlap, it will generate tiles only once. `martin-cp` supports the same configuration file and CLI arguments as Martin server, so it can support all sources and even combining sources.
2023-11-20 09:27:51 +03:00
#sqlite-hashes = { path = "../sqlite-hashes" }
mbtiles improvements, minor changes (#1013) # MBTiles * New `--agg-hash (update|verify|off)` flag replaces `--update-agg-tiles-hash` (still supported, but not shown in the help screen). This allows bypassing aggregate hash validation entirely, without either updating or validating it. * Simplify MBTiles SQL generation * MBTiles now uses faster `1 << zoom` everywhere, and a dedicated TMS inversion fn * split up metadata insert and delete into separate fn * consolidated schema initialization * ensure db settings (like pragma) are always reset on new files # Other * Always sort JSON-serialized keys for consistency * this affects `/catalog` key ordering, but content is the same * Minor code cleanup
2023-11-19 13:06:37 +03:00
#tilejson = { path = "../tilejson" }
Add `martin-cp` tool to bulk-copy tiles from any Martin-supported sources (#1011) This adds a new utility called `martin-cp` that allows copying any number of tiles from a single source (or a composite source) to an mbtiles file. `martin-cp` is a tool for generating tiles in bulk, and save retrieved tiles into a new or an existing MBTiles file. It can be used to generate tiles for a large area or multiple areas. If multiple areas overlap, it will generate tiles only once. `martin-cp` supports the same configuration file and CLI arguments as Martin server, so it can support all sources and even combining sources.
2023-11-20 09:27:51 +03:00
#pmtiles = { git = "https://github.com/nyurik/pmtiles-rs", branch = "override" }
#tilejson = { git = "https://github.com/nyurik/tilejson", branch = "btreemap" }
Optimize produced release binaries (#1385) Minor optimization to create a slightly more compact code (should be the same performance, or possibly even faster)
2024-06-27 03:31:41 +03:00
[profile.release]
# Make release binaries a bit smaller
lto = true
codegen-units = 1
Reference in New Issue Copy Permalink