sapling/lib/encoding/Cargo.toml

[package]
name = "encoding"
version = "0.1.0"

[target.'cfg(windows)'.dependencies]
local-encoding = "*"
winapi = "0.2.7"
kernel32-sys = "0.2.2"
pathencoding: utility for converting between bytes and paths Summary: A simple utility that does paths <-> local bytes conversion. It's needed since Mercurial stores paths using local encoding in manifests. For POSIX, the code is zero-cost - no real conversion or error can happen. This is in theory cheaper than what treedirstate does. For Windows, the "local_encoding" crate is selected as Yuya suggested the `MultiByteToWideChar` Win32 API [1] and "local_encoding" uses it. It does the right thing given my experiment with GBK (Chinese, simplified) encoding. ``` .... C:\Users\quark\enc>hg debugshell --config extensions.debugshell= >>> repo[0].manifest().text() '\xc4\xbf\xc2\xbc1/\xce\xc4\xbc\xfe1\x00b80de5d138758541c5f05265ad144ab9fa86d1db\n' >>> repo[0].files() ['\xc4\xbf\xc2\xbc1/\xce\xc4\xbc\xfe1'] extern crate local_encoding; use std::path::PathBuf; use local_encoding::{Encoder, Encoding}; const mpath: &[u8] = b"\xc4\xbf\xc2\xbc1/\xce\xc4\xbc\xfe1"; fn main() { let p = PathBuf::from(Encoding::OEM.to_string(mpath).unwrap()); println!("exists: {}", p.exists()); println!("mpath len: {}, osstr len: {}", mpath.len(), p.as_path().as_os_str().len()); } exists: true mpath len: 11, osstr len: 15 ``` In the future, we might normalize the paths to UTF-8 before storing them in manifest to avoid issues. Differential Revision: D7319604 fbshipit-source-id: a7ed5284be116c4176598b4c742e8228abcc3b02 2018-03-22 20:57:22 +03:00			`[package]`
hg: rename pathencoding into encoding Summary: In the later diffs I'll add some more functionality there, not strictly related to encoding paths. Reviewed By: quark-zju Differential Revision: D9441427 fbshipit-source-id: 069ab30a24761038fa2c1a4f180bbc0699d38ef9 2018-08-22 18:55:46 +03:00			`name = "encoding"`
pathencoding: utility for converting between bytes and paths Summary: A simple utility that does paths <-> local bytes conversion. It's needed since Mercurial stores paths using local encoding in manifests. For POSIX, the code is zero-cost - no real conversion or error can happen. This is in theory cheaper than what treedirstate does. For Windows, the "local_encoding" crate is selected as Yuya suggested the `MultiByteToWideChar` Win32 API [1] and "local_encoding" uses it. It does the right thing given my experiment with GBK (Chinese, simplified) encoding. ``` .... C:\Users\quark\enc>hg debugshell --config extensions.debugshell= >>> repo[0].manifest().text() '\xc4\xbf\xc2\xbc1/\xce\xc4\xbc\xfe1\x00b80de5d138758541c5f05265ad144ab9fa86d1db\n' >>> repo[0].files() ['\xc4\xbf\xc2\xbc1/\xce\xc4\xbc\xfe1'] extern crate local_encoding; use std::path::PathBuf; use local_encoding::{Encoder, Encoding}; const mpath: &[u8] = b"\xc4\xbf\xc2\xbc1/\xce\xc4\xbc\xfe1"; fn main() { let p = PathBuf::from(Encoding::OEM.to_string(mpath).unwrap()); println!("exists: {}", p.exists()); println!("mpath len: {}, osstr len: {}", mpath.len(), p.as_path().as_os_str().len()); } exists: true mpath len: 11, osstr len: 15 ``` In the future, we might normalize the paths to UTF-8 before storing them in manifest to avoid issues. Differential Revision: D7319604 fbshipit-source-id: a7ed5284be116c4176598b4c742e8228abcc3b02 2018-03-22 20:57:22 +03:00			`version = "0.1.0"`

			`[target.'cfg(windows)'.dependencies]`
			`local-encoding = "*"`
hg: extract platform-specific bits of encoding into separate files Summary: I think it's more readable to split the implementations into platform-specific bits. Reviewed By: quark-zju Differential Revision: D9441424 fbshipit-source-id: 136d5a00aa4ed8cf4f0886bda0f77a40cba1f542 2018-08-22 18:55:51 +03:00			`winapi = "0.2.7"`
			`kernel32-sys = "0.2.2"`