maplibre/martin
1
1
Fork 0
mirror of https://github.com/maplibre/martin.git synced 2024-12-22 06:11:33 +03:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
154484d2f9
martin/mbtiles/Cargo.toml

57 lines
1.6 KiB
TOML
Raw Normal View History

Minor cleanup (#1008) - Add separators to long literal. - Use first() instead of get(0) - Move some SQL-making code to their own functions - Minor mathematics and rounding cleanup --------- Co-authored-by: Yuri Astrakhan <YuriAstrakhan@gmail.com>
2023-11-17 21:55:05 +03:00
lints.workspace = true
Add .mbtiles support (#549) Adds a new [.mbtiles](https://github.com/mapbox/mbtiles-spec/blob/master/1.3/spec.md) backend, without the grid support. Uses extensive tile content detection, i.e. if the content is gzipped, png, jpeg, gif, webp. From CLI, can be as easy as adding a path to a directory that contains a .mbtiles file (works just like pmtiles support) ```bash # All *.mbtiles files in this dir will be published. # The filename will be used as the source ID martin ./tests/fixtures ``` From configuration file, the path can be specified in a number of ways (same as pmtiles) ```yaml mbtiles: paths: # scan this whole dir, matching all *.mbtiles files - /dir-path # specific mbtiles file will be published as mbtiles2 source - /path/to/mbtiles2.mbtiles sources: # named source matching source name to a single file pm-src1: /tmp/mbtiles.mbtiles # named source, where the filename is explicitly set. This way we will be able to add more options later pm-src2: path: /tmp/mbtiles.mbtiles ``` Fixes #494
2023-01-09 08:10:23 +03:00
[package]
Rename martin-mbtiles crate to mbtiles (#976) This simplifies usage as both a crate and as a tool
2023-10-28 11:50:49 +03:00
name = "mbtiles"
Add compression and query to martin-cp (#1019) * Use gzip compression for MVT tiles by default * Allow user to set compression with `--encoding` parameter (same as browser's header, e.g. use `br,gzip' to encode with brotli as first choice, unless already encoded as gzip) * Allow user to pass a query to the Postgres functions with `--url-query` * A bit of a cleanup for `mbtiles summary` output
2023-11-22 08:26:53 +03:00
version = "0.8.1"
Prepare for sub-crate publish, detection bug fix (#615) * tile format detection would crash on a rare edge case * add some formatting and info about utils and mbtiles crates
2023-03-25 21:37:42 +03:00
authors = ["Yuri Astrakhan <YuriAstrakhan@gmail.com>", "MapLibre contributors"]
description = "A simple low-level MbTiles access and processing library, with some tile format detection and other relevant heuristics."
martin-mbtiles/Cargo.toml publishing
2023-03-25 21:44:36 +03:00
keywords = ["mbtiles", "maps", "tiles", "mvt", "tilejson"]
Add crate categories
2023-10-31 01:52:21 +03:00
categories = ["science::geo", "database"]
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
edition.workspace = true
license.workspace = true
update lock, minor toml sort cleanup
2023-07-06 03:56:23 +03:00
repository.workspace = true
rust-version.workspace = true
Add .mbtiles support (#549) Adds a new [.mbtiles](https://github.com/mapbox/mbtiles-spec/blob/master/1.3/spec.md) backend, without the grid support. Uses extensive tile content detection, i.e. if the content is gzipped, png, jpeg, gif, webp. From CLI, can be as easy as adding a path to a directory that contains a .mbtiles file (works just like pmtiles support) ```bash # All *.mbtiles files in this dir will be published. # The filename will be used as the source ID martin ./tests/fixtures ``` From configuration file, the path can be specified in a number of ways (same as pmtiles) ```yaml mbtiles: paths: # scan this whole dir, matching all *.mbtiles files - /dir-path # specific mbtiles file will be published as mbtiles2 source - /path/to/mbtiles2.mbtiles sources: # named source matching source name to a single file pm-src1: /tmp/mbtiles.mbtiles # named source, where the filename is explicitly set. This way we will be able to add more options later pm-src2: path: /tmp/mbtiles.mbtiles ``` Fixes #494
2023-01-09 08:10:23 +03:00
Refactor mbtiles lib, mbtiles tool tests & CI (#702) * Broke up martin-mbtiles into multiple files * Made all mbtiles functions take a `SqliteExecutor` -- this way they can be used with any SQLX connection structs - either a pool connection or an individual non-pooled connection. * Simplified mbtiles bin a bit - I realized there is really no need to pretty print the output for the single value retrieval. Easier to just dump it to console as is. * Bump martin-mbtiles to v0.2.0 * Minor fixes in tools docs, cargo.toml, and justfile * MBTiles tool Integration tests and release publishing Major thanks to the [stackoverflow](https://stackoverflow.com/questions/76394665/how-to-pass-sqlx-connection-a-mut-trait-as-a-fn-parameter-in-rust/76395111) quick reply by @cafce25 on how to use generic sql executor!
2023-06-04 01:54:50 +03:00
[features]
mbtiles: remove tls features, CI streamlining (#908)
2023-09-30 03:40:32 +03:00
default = ["cli"]
cli = ["dep:anyhow", "dep:clap", "dep:env_logger", "dep:serde_yaml", "dep:tokio"]
Refactor mbtiles lib, mbtiles tool tests & CI (#702) * Broke up martin-mbtiles into multiple files * Made all mbtiles functions take a `SqliteExecutor` -- this way they can be used with any SQLX connection structs - either a pool connection or an individual non-pooled connection. * Simplified mbtiles bin a bit - I realized there is really no need to pretty print the output for the single value retrieval. Easier to just dump it to console as is. * Bump martin-mbtiles to v0.2.0 * Minor fixes in tools docs, cargo.toml, and justfile * MBTiles tool Integration tests and release publishing Major thanks to the [stackoverflow](https://stackoverflow.com/questions/76394665/how-to-pass-sqlx-connection-a-mut-trait-as-a-fn-parameter-in-rust/76395111) quick reply by @cafce25 on how to use generic sql executor!
2023-06-04 01:54:50 +03:00
Add .mbtiles support (#549) Adds a new [.mbtiles](https://github.com/mapbox/mbtiles-spec/blob/master/1.3/spec.md) backend, without the grid support. Uses extensive tile content detection, i.e. if the content is gzipped, png, jpeg, gif, webp. From CLI, can be as easy as adding a path to a directory that contains a .mbtiles file (works just like pmtiles support) ```bash # All *.mbtiles files in this dir will be published. # The filename will be used as the source ID martin ./tests/fixtures ``` From configuration file, the path can be specified in a number of ways (same as pmtiles) ```yaml mbtiles: paths: # scan this whole dir, matching all *.mbtiles files - /dir-path # specific mbtiles file will be published as mbtiles2 source - /path/to/mbtiles2.mbtiles sources: # named source matching source name to a single file pm-src1: /tmp/mbtiles.mbtiles # named source, where the filename is explicitly set. This way we will be able to add more options later pm-src2: path: /tmp/mbtiles.mbtiles ``` Fixes #494
2023-01-09 08:10:23 +03:00
[dependencies]
Add metadat copy/apply-diff, new testing framework (#921) * Fix metadata copying * Introduce a new metadata field `agg_tiles_hash_after_apply` for diff files * Added a lot of new info and debug logging * Simplified Copying interface - not much value in having all the complex builder pattern here it seems, might as well use a simple object. ## Testing * Generate SQLite DBs in memory on the fly to validate just what we need * Use `insta` for validating DB content There is now a function `dump(connection) -> Vec<Entry>` to dump the content of the entire SQLite DB into text with `serde`. At many steps through the testing, the DB content is validated with the corresponding .snap file with `insta` crate (which makes this process mega-simple, including a simple way to "bless" (update) any changes). ## Discovered bugs * Seems like normalized files do not get copied properly - they contain extras that should be removed.
2023-10-10 18:10:17 +03:00
enum-display.workspace = true
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
futures.workspace = true
log.workspace = true
Refactor mbtiles lib, mbtiles tool tests & CI (#702) * Broke up martin-mbtiles into multiple files * Made all mbtiles functions take a `SqliteExecutor` -- this way they can be used with any SQLX connection structs - either a pool connection or an individual non-pooled connection. * Simplified mbtiles bin a bit - I realized there is really no need to pretty print the output for the single value retrieval. Easier to just dump it to console as is. * Bump martin-mbtiles to v0.2.0 * Minor fixes in tools docs, cargo.toml, and justfile * MBTiles tool Integration tests and release publishing Major thanks to the [stackoverflow](https://stackoverflow.com/questions/76394665/how-to-pass-sqlx-connection-a-mut-trait-as-a-fn-parameter-in-rust/76395111) quick reply by @cafce25 on how to use generic sql executor!
2023-06-04 01:54:50 +03:00
martin-tile-utils.workspace = true
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
serde_json.workspace = true
Add mbtiles statistics command (#986) - [x] Add tile statistics to mbtiles tools - [x] Add test - [x] Use 4326 instead of 3857 for tile bounds - [x] Add document - [x] Use size-format to prettify output - [x] Statistics struct Refactor - [x] Cleanup and reformat Closes #964 --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com>
2023-11-13 09:03:40 +03:00
serde.workspace = true
simplify serde optional handling (#998)
2023-11-13 06:22:04 +03:00
serde_with.workspace = true
Add mbtiles statistics command (#986) - [x] Add tile statistics to mbtiles tools - [x] Add test - [x] Use 4326 instead of 3857 for tile bounds - [x] Add document - [x] Use size-format to prettify output - [x] Statistics struct Refactor - [x] Cleanup and reformat Closes #964 --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com>
2023-11-13 09:03:40 +03:00
size_format.workspace = true
mbtiles: remove tls features, CI streamlining (#908)
2023-09-30 03:40:32 +03:00
sqlite-hashes.workspace = true
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
sqlx.workspace = true
thiserror.workspace = true
tilejson.workspace = true
Add .mbtiles support (#549) Adds a new [.mbtiles](https://github.com/mapbox/mbtiles-spec/blob/master/1.3/spec.md) backend, without the grid support. Uses extensive tile content detection, i.e. if the content is gzipped, png, jpeg, gif, webp. From CLI, can be as easy as adding a path to a directory that contains a .mbtiles file (works just like pmtiles support) ```bash # All *.mbtiles files in this dir will be published. # The filename will be used as the source ID martin ./tests/fixtures ``` From configuration file, the path can be specified in a number of ways (same as pmtiles) ```yaml mbtiles: paths: # scan this whole dir, matching all *.mbtiles files - /dir-path # specific mbtiles file will be published as mbtiles2 source - /path/to/mbtiles2.mbtiles sources: # named source matching source name to a single file pm-src1: /tmp/mbtiles.mbtiles # named source, where the filename is explicitly set. This way we will be able to add more options later pm-src2: path: /tmp/mbtiles.mbtiles ``` Fixes #494
2023-01-09 08:10:23 +03:00
Implement rudimentary mbtiles binary (#696) This will be the entry point for #667
2023-06-01 17:13:20 +03:00
# Bin dependencies
Refactor mbtiles lib, mbtiles tool tests & CI (#702) * Broke up martin-mbtiles into multiple files * Made all mbtiles functions take a `SqliteExecutor` -- this way they can be used with any SQLX connection structs - either a pool connection or an individual non-pooled connection. * Simplified mbtiles bin a bit - I realized there is really no need to pretty print the output for the single value retrieval. Easier to just dump it to console as is. * Bump martin-mbtiles to v0.2.0 * Minor fixes in tools docs, cargo.toml, and justfile * MBTiles tool Integration tests and release publishing Major thanks to the [stackoverflow](https://stackoverflow.com/questions/76394665/how-to-pass-sqlx-connection-a-mut-trait-as-a-fn-parameter-in-rust/76395111) quick reply by @cafce25 on how to use generic sql executor!
2023-06-04 01:54:50 +03:00
anyhow = { workspace = true, optional = true }
clap = { workspace = true, optional = true }
Fix mbtiles validation, CI, and logging (#903)
2023-09-29 21:37:18 +03:00
env_logger = { workspace = true, optional = true }
mbtiles: remove tls features, CI streamlining (#908)
2023-09-30 03:40:32 +03:00
serde_yaml = { workspace = true, optional = true }
Upgrade sqlx to v0.7 (#743) This is mostly a noop, just updating to the new way of storing cached queries and a few other changes per https://github.com/launchbadge/sqlx/blob/main/CHANGELOG.md#070---2023-06-30 Note that this uses some of the code from #729 (thanks @upsicleclown !) A minor unrelated change - a reformat of `martin/release.toml`
2023-07-04 15:05:23 +03:00
tokio = { workspace = true, features = ["rt-multi-thread"], optional = true }
Implement rudimentary mbtiles binary (#696) This will be the entry point for #667
2023-06-01 17:13:20 +03:00
Add .mbtiles support (#549) Adds a new [.mbtiles](https://github.com/mapbox/mbtiles-spec/blob/master/1.3/spec.md) backend, without the grid support. Uses extensive tile content detection, i.e. if the content is gzipped, png, jpeg, gif, webp. From CLI, can be as easy as adding a path to a directory that contains a .mbtiles file (works just like pmtiles support) ```bash # All *.mbtiles files in this dir will be published. # The filename will be used as the source ID martin ./tests/fixtures ``` From configuration file, the path can be specified in a number of ways (same as pmtiles) ```yaml mbtiles: paths: # scan this whole dir, matching all *.mbtiles files - /dir-path # specific mbtiles file will be published as mbtiles2 source - /path/to/mbtiles2.mbtiles sources: # named source matching source name to a single file pm-src1: /tmp/mbtiles.mbtiles # named source, where the filename is explicitly set. This way we will be able to add more options later pm-src2: path: /tmp/mbtiles.mbtiles ``` Fixes #494
2023-01-09 08:10:23 +03:00
[dev-dependencies]
# For testing, might as well use the same async framework as the Martin itself
Consolidate all crate dependencies (#694) This moves all dependency version management to one location
2023-06-01 16:05:06 +03:00
actix-rt.workspace = true
Add mbtiles statistics command (#986) - [x] Add tile statistics to mbtiles tools - [x] Add test - [x] Use 4326 instead of 3857 for tile bounds - [x] Add document - [x] Use size-format to prettify output - [x] Statistics struct Refactor - [x] Cleanup and reformat Closes #964 --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com>
2023-11-13 09:03:40 +03:00
approx.workspace = true
Add metadat copy/apply-diff, new testing framework (#921) * Fix metadata copying * Introduce a new metadata field `agg_tiles_hash_after_apply` for diff files * Added a lot of new info and debug logging * Simplified Copying interface - not much value in having all the complex builder pattern here it seems, might as well use a simple object. ## Testing * Generate SQLite DBs in memory on the fly to validate just what we need * Use `insta` for validating DB content There is now a function `dump(connection) -> Vec<Entry>` to dump the content of the entire SQLite DB into text with `serde`. At many steps through the testing, the DB content is validated with the corresponding .snap file with `insta` crate (which makes this process mega-simple, including a simple way to "bless" (update) any changes). ## Discovered bugs * Seems like normalized files do not get copied properly - they contain extras that should be removed.
2023-10-10 18:10:17 +03:00
ctor.workspace = true
env_logger.workspace = true
Add mbtiles statistics command (#986) - [x] Add tile statistics to mbtiles tools - [x] Add test - [x] Use 4326 instead of 3857 for tile bounds - [x] Add document - [x] Use size-format to prettify output - [x] Statistics struct Refactor - [x] Cleanup and reformat Closes #964 --------- Co-authored-by: Yuri Astrakhan <yuriastrakhan@gmail.com>
2023-11-13 09:03:40 +03:00
insta = { workspace = true, features = ["toml", "yaml"] }
Add metadat copy/apply-diff, new testing framework (#921) * Fix metadata copying * Introduce a new metadata field `agg_tiles_hash_after_apply` for diff files * Added a lot of new info and debug logging * Simplified Copying interface - not much value in having all the complex builder pattern here it seems, might as well use a simple object. ## Testing * Generate SQLite DBs in memory on the fly to validate just what we need * Use `insta` for validating DB content There is now a function `dump(connection) -> Vec<Entry>` to dump the content of the entire SQLite DB into text with `serde`. At many steps through the testing, the DB content is validated with the corresponding .snap file with `insta` crate (which makes this process mega-simple, including a simple way to "bless" (update) any changes). ## Discovered bugs * Seems like normalized files do not get copied properly - they contain extras that should be removed.
2023-10-10 18:10:17 +03:00
pretty_assertions.workspace = true
rstest.workspace = true
Implement rudimentary mbtiles binary (#696) This will be the entry point for #667
2023-06-01 17:13:20 +03:00
[lib]
path = "src/lib.rs"
[[bin]]
name = "mbtiles"
Minor refactoring and cleanup (#1007) * remove benchmarks - not used for now, will need to be rewritten * move some CLI settings to a separate struct * move config saving to a shared function * simplify zoom level CLI parsing * rename main.rs to be the same name as generated binary (we can have multiple bins later)
2023-11-17 03:59:43 +03:00
path = "src/bin/mbtiles.rs"
cleanup cargo optional dep: in features
2023-06-17 02:11:13 +03:00
required-features = ["cli"]
Reference in New Issue Copy Permalink