facebook/sapling
1
1
Fork 0
mirror of https://github.com/facebook/sapling.git synced 2024-10-07 15:27:13 +03:00
Code Issues Projects Releases Wiki Activity
5c80b1b5fe
sapling/tests/test-remotefilelog-repack-fast.t

388 lines
15 KiB
Perl
Raw Normal View History

remotefilelog: adjust PYTHONPATH during tests When remotefilelog moved from its own repo, the tests needed to be updated to adjust the PYTHONPATH to ensure the in-repo remotefilelog was loaded instead of the system one. This meant any local runs of remotefilelog tests would've been using the system remotefilelog unless the user had manually set the PYTHONPATH themselves.
2017-02-10 05:02:52 +03:00
$ PYTHONPATH=$TESTDIR/..:$PYTHONPATH
$ export PYTHONPATH
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ . "$TESTDIR/library.sh"
datapack: allow 'long' for metadata types Summary: Previously the code required that sizes be of type int. Since python plays loose with integer types, we also need to support long. Test Plan: The existing test-remotefilelog-repack-fast.t test was completely broken. It only enabled fast datapacks for the server repo, not the clients. Enabling it for the clients as well catches this issue and verifies the fix. Reviewers: #fbhgext, quark Reviewed By: #fbhgext, quark Differential Revision: https://phab.mercurial-scm.org/D54
2017-07-12 03:02:15 +03:00
$ cat >> $HGRCPATH <<EOF
> [remotefilelog]
> fastdatapack=True
> EOF
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ hginit master
$ cd master
$ cat >> .hg/hgrc <<EOF
> [remotefilelog]
> server=True
> serverexpiration=-1
> EOF
$ echo x > x
$ hg commit -qAm x
$ echo x >> x
$ hg commit -qAm x2
$ cd ..
$ hgcloneshallow ssh://user@dummy/master shallow -q
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over *s (glob)
remotefilelog: limit number of changesets to be prefetched Summary: Added config option 'prefetchdays' which indicates that commits older than 'prefetchdays' days should not be prefetched. This option is necessary to avoid prefetch of huge amount of data. The default value is set to 14 days. Test Plan: Ensure that unit tests pass Reviewers: ryanmce, simonfar, durham, #fbhgext, simpkins Reviewed By: #fbhgext, simpkins Subscribers: simpkins Differential Revision: https://phab.mercurial-scm.org/D420
2017-08-16 23:21:31 +03:00
# Set the prefetchdays config to zero so that all commits are prefetched
# no matter what their creation date is.
$ cd shallow
$ cat >> .hg/hgrc <<EOF
> [remotefilelog]
> prefetchdays=0
> EOF
$ cd ..
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
# Test that repack cleans up the old files and creates new packs
$ cd shallow
$ find $CACHEDIR | sort
$TESTTMP/hgcache
$TESTTMP/hgcache/master
$TESTTMP/hgcache/master/11
$TESTTMP/hgcache/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072
$TESTTMP/hgcache/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/aee31534993a501858fb6dd96a065671922e7d51
$TESTTMP/hgcache/repos
$ hg repack
$ find $CACHEDIR | sort
$TESTTMP/hgcache
$TESTTMP/hgcache/master
$TESTTMP/hgcache/master/packs
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
$TESTTMP/hgcache/master/packs/276d308429d0303762befa376788300f0310f90e.histidx
$TESTTMP/hgcache/master/packs/276d308429d0303762befa376788300f0310f90e.histpack
datapack: update the format about metadata Summary: This diff makes 2 changes to v1 packfile metadata: 1. Move `key` in a metadata entry to before `size`. ``` old: [entry-size: 2 byte] [key: 1 byte] [data: var length] new: [key: 1 byte] [data-size: 2 byte] [data: var length] ``` Previously `entry-size == 0` does not make sense. 2. Use binary to represent sizes, instead of ASCII. Related utility methods are cleaned up a bit so it's harder to make mistakes. Test Plan: Updated existing tests Reviewers: #mercurial, durham Reviewed By: durham Subscribers: durham, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983189 Signature: t1:4983189:1493689852:22d544d73ed63fac83f849786de035af304161ce
2017-05-02 05:03:25 +03:00
$TESTTMP/hgcache/master/packs/8e25dec685d5e0bb1f1b39df3acebda0e0d75c6e.dataidx
$TESTTMP/hgcache/master/packs/8e25dec685d5e0bb1f1b39df3acebda0e0d75c6e.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$TESTTMP/hgcache/repos
# Test that the packs are readonly
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ ls_l $CACHEDIR/master/packs
histpack: add per-node index Summary: Previously looking up a particular node in a histpack required a bisect to find the file section, then a linear scan to find the particular node. If you needed to look up the latest 3000 nodes one by one, that involved 3000 linear scans, many of which traversed the same nodes over and over. This patch adds additional index at the end of the current histidx file. In a future patch, we will change getnodeinfo() to use this index instead of the linear scan logic. Test Plan: Ran the tests. I haven't actually verified that the data in these indexes is correct. My next patch will add logic that reads these indexes and will add tests around it. I won't land this until I've confirmed it's correct. Reviewers: quark, #mercurial, rmcelroy Reviewed By: rmcelroy Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983690 Signature: t1:4983690:1493798877:ae0802b4896b54bf066df9f684d94554855fd35a
2017-05-03 20:19:45 +03:00
-r--r--r-- 1145 276d308429d0303762befa376788300f0310f90e.histidx
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
-r--r--r-- 172 276d308429d0303762befa376788300f0310f90e.histpack
packs: add entry count to pack index Summary: Previously, we used the length of the index file to determine the upper bounds of the bisect. In a future patch we'll want to add more data to the end of the index file, so we need to record how long the index portion of the index is. This patch adds that information. Test Plan: Ran the tests. Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983682 Signature: t1:4983682:1493693255:57ab9af2030847fedff05b6755113ba8ce0c933b
2017-05-03 20:19:45 +03:00
-r--r--r-- 1074 8e25dec685d5e0bb1f1b39df3acebda0e0d75c6e.dataidx
datapack: update the format about metadata Summary: This diff makes 2 changes to v1 packfile metadata: 1. Move `key` in a metadata entry to before `size`. ``` old: [entry-size: 2 byte] [key: 1 byte] [data: var length] new: [key: 1 byte] [data-size: 2 byte] [data: var length] ``` Previously `entry-size == 0` does not make sense. 2. Use binary to represent sizes, instead of ASCII. Related utility methods are cleaned up a bit so it's harder to make mistakes. Test Plan: Updated existing tests Reviewers: #mercurial, durham Reviewed By: durham Subscribers: durham, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983189 Signature: t1:4983189:1493689852:22d544d73ed63fac83f849786de035af304161ce
2017-05-02 05:03:25 +03:00
-r--r--r-- 69 8e25dec685d5e0bb1f1b39df3acebda0e0d75c6e.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
# Test that the data in the new packs is accessible
$ hg cat -r . x
x
x
# Test that adding new data and repacking it results in the loose data and the
# old packs being combined.
$ cd ../master
$ echo x >> x
$ hg commit -m x3
$ cd ../shallow
$ hg pull -q
$ hg up -q tip
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over * (glob)
$ find $CACHEDIR -type f | sort
$TESTTMP/hgcache/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/d4a3ed9310e5bd9887e3bf779da5077efab28216
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
$TESTTMP/hgcache/master/packs/276d308429d0303762befa376788300f0310f90e.histidx
$TESTTMP/hgcache/master/packs/276d308429d0303762befa376788300f0310f90e.histpack
datapack: update the format about metadata Summary: This diff makes 2 changes to v1 packfile metadata: 1. Move `key` in a metadata entry to before `size`. ``` old: [entry-size: 2 byte] [key: 1 byte] [data: var length] new: [key: 1 byte] [data-size: 2 byte] [data: var length] ``` Previously `entry-size == 0` does not make sense. 2. Use binary to represent sizes, instead of ASCII. Related utility methods are cleaned up a bit so it's harder to make mistakes. Test Plan: Updated existing tests Reviewers: #mercurial, durham Reviewed By: durham Subscribers: durham, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983189 Signature: t1:4983189:1493689852:22d544d73ed63fac83f849786de035af304161ce
2017-05-02 05:03:25 +03:00
$TESTTMP/hgcache/master/packs/8e25dec685d5e0bb1f1b39df3acebda0e0d75c6e.dataidx
$TESTTMP/hgcache/master/packs/8e25dec685d5e0bb1f1b39df3acebda0e0d75c6e.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$TESTTMP/hgcache/repos
$ hg repack --traceback
$ find $CACHEDIR -type f | sort
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
$TESTTMP/hgcache/master/packs/077e7ce5dfe862dc40cc8f3c9742d96a056865f2.histidx
$TESTTMP/hgcache/master/packs/077e7ce5dfe862dc40cc8f3c9742d96a056865f2.histpack
datapack: update the format about metadata Summary: This diff makes 2 changes to v1 packfile metadata: 1. Move `key` in a metadata entry to before `size`. ``` old: [entry-size: 2 byte] [key: 1 byte] [data: var length] new: [key: 1 byte] [data-size: 2 byte] [data: var length] ``` Previously `entry-size == 0` does not make sense. 2. Use binary to represent sizes, instead of ASCII. Related utility methods are cleaned up a bit so it's harder to make mistakes. Test Plan: Updated existing tests Reviewers: #mercurial, durham Reviewed By: durham Subscribers: durham, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983189 Signature: t1:4983189:1493689852:22d544d73ed63fac83f849786de035af304161ce
2017-05-02 05:03:25 +03:00
$TESTTMP/hgcache/master/packs/935861cae0be6ce41a0d47a529e4d097e9e68a69.dataidx
$TESTTMP/hgcache/master/packs/935861cae0be6ce41a0d47a529e4d097e9e68a69.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$TESTTMP/hgcache/repos
# Verify all the file data is still available
$ hg cat -r . x
x
x
x
$ hg cat -r '.^' x
x
x
# Test that repacking again without new data does not delete the pack files
# and did not change the pack names
$ hg repack
$ find $CACHEDIR -type f | sort
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
$TESTTMP/hgcache/master/packs/077e7ce5dfe862dc40cc8f3c9742d96a056865f2.histidx
$TESTTMP/hgcache/master/packs/077e7ce5dfe862dc40cc8f3c9742d96a056865f2.histpack
datapack: update the format about metadata Summary: This diff makes 2 changes to v1 packfile metadata: 1. Move `key` in a metadata entry to before `size`. ``` old: [entry-size: 2 byte] [key: 1 byte] [data: var length] new: [key: 1 byte] [data-size: 2 byte] [data: var length] ``` Previously `entry-size == 0` does not make sense. 2. Use binary to represent sizes, instead of ASCII. Related utility methods are cleaned up a bit so it's harder to make mistakes. Test Plan: Updated existing tests Reviewers: #mercurial, durham Reviewed By: durham Subscribers: durham, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983189 Signature: t1:4983189:1493689852:22d544d73ed63fac83f849786de035af304161ce
2017-05-02 05:03:25 +03:00
$TESTTMP/hgcache/master/packs/935861cae0be6ce41a0d47a529e4d097e9e68a69.dataidx
$TESTTMP/hgcache/master/packs/935861cae0be6ce41a0d47a529e4d097e9e68a69.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$TESTTMP/hgcache/repos
# Run two repacks at once
$ hg repack --config "hooks.prerepack=sleep 3" &
$ sleep 1
$ hg repack
abort: skipping repack - another repack is already running
[255]
$ hg debugwaitonrepack >/dev/null 2>&1
# Run repack in the background
$ cd ../master
$ echo x >> x
$ hg commit -m x4
$ cd ../shallow
$ hg pull -q
$ hg up -q tip
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over * (glob)
$ find $CACHEDIR -type f | sort
$TESTTMP/hgcache/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/1bb2e6237e035c8f8ef508e281f1ce075bc6db72
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
$TESTTMP/hgcache/master/packs/077e7ce5dfe862dc40cc8f3c9742d96a056865f2.histidx
$TESTTMP/hgcache/master/packs/077e7ce5dfe862dc40cc8f3c9742d96a056865f2.histpack
datapack: update the format about metadata Summary: This diff makes 2 changes to v1 packfile metadata: 1. Move `key` in a metadata entry to before `size`. ``` old: [entry-size: 2 byte] [key: 1 byte] [data: var length] new: [key: 1 byte] [data-size: 2 byte] [data: var length] ``` Previously `entry-size == 0` does not make sense. 2. Use binary to represent sizes, instead of ASCII. Related utility methods are cleaned up a bit so it's harder to make mistakes. Test Plan: Updated existing tests Reviewers: #mercurial, durham Reviewed By: durham Subscribers: durham, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983189 Signature: t1:4983189:1493689852:22d544d73ed63fac83f849786de035af304161ce
2017-05-02 05:03:25 +03:00
$TESTTMP/hgcache/master/packs/935861cae0be6ce41a0d47a529e4d097e9e68a69.dataidx
$TESTTMP/hgcache/master/packs/935861cae0be6ce41a0d47a529e4d097e9e68a69.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$TESTTMP/hgcache/repos
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ hg repack --background
(running background repack)
$ sleep 0.5
$ hg debugwaitonrepack >/dev/null 2>&1
$ find $CACHEDIR -type f | sort
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
$TESTTMP/hgcache/master/packs/094b530486dad4427a0faf6bcbc031571b99ca24.histidx
$TESTTMP/hgcache/master/packs/094b530486dad4427a0faf6bcbc031571b99ca24.histpack
datapack: update the format about metadata Summary: This diff makes 2 changes to v1 packfile metadata: 1. Move `key` in a metadata entry to before `size`. ``` old: [entry-size: 2 byte] [key: 1 byte] [data: var length] new: [key: 1 byte] [data-size: 2 byte] [data: var length] ``` Previously `entry-size == 0` does not make sense. 2. Use binary to represent sizes, instead of ASCII. Related utility methods are cleaned up a bit so it's harder to make mistakes. Test Plan: Updated existing tests Reviewers: #mercurial, durham Reviewed By: durham Subscribers: durham, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983189 Signature: t1:4983189:1493689852:22d544d73ed63fac83f849786de035af304161ce
2017-05-02 05:03:25 +03:00
$TESTTMP/hgcache/master/packs/8fe685c56f6f7edf550bfcec74eeecc5f3c2ba15.dataidx
$TESTTMP/hgcache/master/packs/8fe685c56f6f7edf550bfcec74eeecc5f3c2ba15.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$TESTTMP/hgcache/repos
# Test debug commands
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ hg debugdatapack $TESTTMP/hgcache/master/packs/*.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
x
Node Delta Base Delta Length
1bb2e6237e03 000000000000 8
d4a3ed9310e5 1bb2e6237e03 12
aee31534993a d4a3ed9310e5 12
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ hg debugdatapack --long $TESTTMP/hgcache/master/packs/*.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
x
Node Delta Base Delta Length
1bb2e6237e035c8f8ef508e281f1ce075bc6db72 0000000000000000000000000000000000000000 8
d4a3ed9310e5bd9887e3bf779da5077efab28216 1bb2e6237e035c8f8ef508e281f1ce075bc6db72 12
aee31534993a501858fb6dd96a065671922e7d51 d4a3ed9310e5bd9887e3bf779da5077efab28216 12
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ hg debugdatapack $TESTTMP/hgcache/master/packs/*.datapack --node d4a3ed9310e5bd9887e3bf779da5077efab28216
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
x
Node Delta Base Delta SHA1 Delta Length
d4a3ed9310e5bd9887e3bf779da5077efab28216 1bb2e6237e035c8f8ef508e281f1ce075bc6db72 77029ab56e83ea2115dd53ff87483682abe5d7ca 12
Node Delta Base Delta SHA1 Delta Length
1bb2e6237e035c8f8ef508e281f1ce075bc6db72 0000000000000000000000000000000000000000 7ca8c71a64f7b56380e77573da2f7a5fdd2ecdb5 8
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
$ hg debughistorypack $TESTTMP/hgcache/master/packs/*.histidx
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
x
Node P1 Node P2 Node Link Node Copy From
1bb2e6237e03 d4a3ed9310e5 000000000000 0b03bbc9e1e7
d4a3ed9310e5 aee31534993a 000000000000 421535db10b6
aee31534993a 1406e7411862 000000000000 a89d614e2364
1406e7411862 000000000000 000000000000 b292c1e3311f
# Test copy tracing from a pack
$ cd ../master
$ hg mv x y
$ hg commit -m 'move x to y'
$ cd ../shallow
$ hg pull -q
$ hg up -q tip
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over * (glob)
$ hg repack
$ hg log -f y -T '{desc}\n'
move x to y
x4
x3
x2
x
# Test copy trace across rename and back
tweakdefaults: fix check config test Summary: This fixes test-check-config-hg.t for tweakdefaults. And did some clean-up for other minor issues. I was trying to implement another feature (along with the clean-up) in tweakdefaults and finally realized it's infeasible and drop the feature. But the clean-up seems useful thus sent here. Also change `cp -r` to `cp -R` to pass the usptream check-code test. Test Plan: `arc unit` Reviewers: #sourcecontrol, mitrandir Reviewed By: mitrandir Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4253852 Signature: t1:4253852:1480613350:398e9b234fcc2360dcb8a3e3ad4e5bc5c4377857
2016-11-30 23:58:08 +03:00
$ cp -R $TESTTMP/hgcache/master/packs $TESTTMP/backuppacks
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ cd ../master
$ hg mv y x
$ hg commit -m 'move y back to x'
$ hg revert -r 0 x
$ mv x y
$ hg add y
treemanifest: fix test flakiness Summary: The old test output had some flakiness where: 1. The linknode for y:1406e7411862 would flicker between commit 0 and commit 6, even though y never existed in commit 0. This is caused by some ambiguity in how the store represents the ancestor list (it's keyed on node instead of (name, node)). To fix the test let's just modify file y so it doesn't have the same hash as file x at any point. 2. The order of nodes in the histpack would flicker because there was no link between the two separate histories of file y. This is caused by a lack of sorting of the separate roots before writing to the histpack. Test Plan: Ran the test many times Reviewers: #mercurial, quark Reviewed By: quark Subscribers: quark, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4915472 Signature: t1:4915472:1492641328:d4542665e3a69fe2fc188b450f75ff10e6d681de
2017-04-20 07:14:04 +03:00
$ echo >> y
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ hg revert x
$ hg commit -m 'add y back without metadata'
$ cd ../shallow
$ hg pull -q
$ hg up -q tip
2 files fetched over 2 fetches - (2 misses, 0.00% hit ratio) over * (glob)
$ hg repack
$ ls $TESTTMP/hgcache/master/packs
datapack: update the format about metadata Summary: This diff makes 2 changes to v1 packfile metadata: 1. Move `key` in a metadata entry to before `size`. ``` old: [entry-size: 2 byte] [key: 1 byte] [data: var length] new: [key: 1 byte] [data-size: 2 byte] [data: var length] ``` Previously `entry-size == 0` does not make sense. 2. Use binary to represent sizes, instead of ASCII. Related utility methods are cleaned up a bit so it's harder to make mistakes. Test Plan: Updated existing tests Reviewers: #mercurial, durham Reviewed By: durham Subscribers: durham, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983189 Signature: t1:4983189:1493689852:22d544d73ed63fac83f849786de035af304161ce
2017-05-02 05:03:25 +03:00
e634f60d2a9539fc595b1f4db480c64556a396c7.dataidx
e634f60d2a9539fc595b1f4db480c64556a396c7.datapack
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
ebbd7411e00456c0eec8d1150a77e2b3ef490f3f.histidx
ebbd7411e00456c0eec8d1150a77e2b3ef490f3f.histpack
treemanifest: fix test flakiness Summary: The old test output had some flakiness where: 1. The linknode for y:1406e7411862 would flicker between commit 0 and commit 6, even though y never existed in commit 0. This is caused by some ambiguity in how the store represents the ancestor list (it's keyed on node instead of (name, node)). To fix the test let's just modify file y so it doesn't have the same hash as file x at any point. 2. The order of nodes in the histpack would flicker because there was no link between the two separate histories of file y. This is caused by a lack of sorting of the separate roots before writing to the histpack. Test Plan: Ran the test many times Reviewers: #mercurial, quark Reviewed By: quark Subscribers: quark, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4915472 Signature: t1:4915472:1492641328:d4542665e3a69fe2fc188b450f75ff10e6d681de
2017-04-20 07:14:04 +03:00
$ hg debughistorypack $TESTTMP/hgcache/master/packs/*.histidx
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
x
Node P1 Node P2 Node Link Node Copy From
cd410a44d584 577959738234 000000000000 609547eda446 y
1bb2e6237e03 d4a3ed9310e5 000000000000 0b03bbc9e1e7
d4a3ed9310e5 aee31534993a 000000000000 421535db10b6
aee31534993a 1406e7411862 000000000000 a89d614e2364
1406e7411862 000000000000 000000000000 b292c1e3311f
y
Node P1 Node P2 Node Link Node Copy From
577959738234 1bb2e6237e03 000000000000 c7faf2fc439a x
treemanifest: move history sorting responsibility into MutableHistoryPack Summary: Previously, the logic that added data to a mutable history pack was required to add it in the correct order (all entries for a certain file at once, and in newest-first order). This required the callers to jump through weird hoops if the data came in out of order or at different times in the transaction. This patch moves the ordering logic to be inside MutableHistoryPack, so callers can add the data in any order they wish, and it will get sorted before being serialized. This does add memory pressure to things that read a lot of history, like repack. If this becomes a problem we may want to add a 'historypack.flush()' api that let's us tell the history pack it's ok to flush it's current contents to disk. Test Plan: Ran the tests Reviewers: #mercurial, quark Reviewed By: quark Subscribers: quark, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4956096 Signature: t1:4956096:1493264693:a2275a49e35565d4b11244e3e5dd82c25de7e16e
2017-04-27 20:44:34 +03:00
21f46f2721e7 000000000000 000000000000 d6868642b790
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ hg strip -r '.^'
1 files updated, 0 files merged, 1 files removed, 0 files unresolved
treemanifest: fix test flakiness Summary: The old test output had some flakiness where: 1. The linknode for y:1406e7411862 would flicker between commit 0 and commit 6, even though y never existed in commit 0. This is caused by some ambiguity in how the store represents the ancestor list (it's keyed on node instead of (name, node)). To fix the test let's just modify file y so it doesn't have the same hash as file x at any point. 2. The order of nodes in the histpack would flicker because there was no link between the two separate histories of file y. This is caused by a lack of sorting of the separate roots before writing to the histpack. Test Plan: Ran the test many times Reviewers: #mercurial, quark Reviewed By: quark Subscribers: quark, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4915472 Signature: t1:4915472:1492641328:d4542665e3a69fe2fc188b450f75ff10e6d681de
2017-04-20 07:14:04 +03:00
saved backup bundle to $TESTTMP/shallow/.hg/strip-backup/609547eda446-b26b56a8-backup.hg (glob)
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ hg -R ../master strip -r '.^'
1 files updated, 0 files merged, 1 files removed, 0 files unresolved
treemanifest: fix test flakiness Summary: The old test output had some flakiness where: 1. The linknode for y:1406e7411862 would flicker between commit 0 and commit 6, even though y never existed in commit 0. This is caused by some ambiguity in how the store represents the ancestor list (it's keyed on node instead of (name, node)). To fix the test let's just modify file y so it doesn't have the same hash as file x at any point. 2. The order of nodes in the histpack would flicker because there was no link between the two separate histories of file y. This is caused by a lack of sorting of the separate roots before writing to the histpack. Test Plan: Ran the test many times Reviewers: #mercurial, quark Reviewed By: quark Subscribers: quark, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4915472 Signature: t1:4915472:1492641328:d4542665e3a69fe2fc188b450f75ff10e6d681de
2017-04-20 07:14:04 +03:00
saved backup bundle to $TESTTMP/master/.hg/strip-backup/609547eda446-b26b56a8-backup.hg (glob)
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ rm -rf $TESTTMP/hgcache/master/packs
tweakdefaults: fix check config test Summary: This fixes test-check-config-hg.t for tweakdefaults. And did some clean-up for other minor issues. I was trying to implement another feature (along with the clean-up) in tweakdefaults and finally realized it's infeasible and drop the feature. But the clean-up seems useful thus sent here. Also change `cp -r` to `cp -R` to pass the usptream check-code test. Test Plan: `arc unit` Reviewers: #sourcecontrol, mitrandir Reviewed By: mitrandir Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4253852 Signature: t1:4253852:1480613350:398e9b234fcc2360dcb8a3e3ad4e5bc5c4377857
2016-11-30 23:58:08 +03:00
$ cp -R $TESTTMP/backuppacks $TESTTMP/hgcache/master/packs
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
# Test repacking datapack without history
$ rm -rf $CACHEDIR/master/packs/*hist*
$ hg repack
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ hg debugdatapack $TESTTMP/hgcache/master/packs/*.datapack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
x
Node Delta Base Delta Length
1bb2e6237e03 000000000000 8
datapack: remove delta reuse Summary: This code that reused deltas if the delta parent wasn't available was bugged because it meant you could end up with a cycle in the delta chains. This was an old optimization from before trees had history, so let's drop the optimization (since trees now have history and can be correctly repacked). Test Plan: Ran repack on a packfile that previously caused cycles. Verified the new version did not with `hg debugdatapack foo.datapack' Reviewers: #mercurial Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4724520
2017-03-19 05:38:45 +03:00
aee31534993a 000000000000 4
d4a3ed9310e5 000000000000 6
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
y
Node Delta Base Delta Length
577959738234 000000000000 70
$ hg cat -r ".^" x
x
x
x
x
Incremental repack
$ rm -rf $CACHEDIR/master/packs/*
$ cat >> .hg/hgrc <<EOF
> [remotefilelog]
> data.generations=60
> 150
> fetchpacks=True
> EOF
Single pack - repack does nothing
$ hg prefetch -r 0
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ ls_l $TESTTMP/hgcache/master/packs/ | grep datapack
-r--r--r-- 59 5b7dec902026f0cddb0ef8acb62f27b5698494d4.datapack
$ ls_l $TESTTMP/hgcache/master/packs/ | grep histpack
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
-r--r--r-- 90 c3399b56e035f73c3295276ed098235a08a0ed8c.histpack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ hg repack --incremental
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ ls_l $TESTTMP/hgcache/master/packs/ | grep datapack
-r--r--r-- 59 5b7dec902026f0cddb0ef8acb62f27b5698494d4.datapack
$ ls_l $TESTTMP/hgcache/master/packs/ | grep histpack
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
-r--r--r-- 90 c3399b56e035f73c3295276ed098235a08a0ed8c.histpack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
3 gen1 packs, 1 gen0 pack - packs 3 gen1 into 1
$ hg prefetch -r 1
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
$ hg prefetch -r 2
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
$ hg prefetch -r 3
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ ls_l $TESTTMP/hgcache/master/packs/ | grep datapack
-r--r--r-- 59 5b7dec902026f0cddb0ef8acb62f27b5698494d4.datapack
-r--r--r-- 65 6c499d21350d79f92fd556b4b7a902569d88e3c9.datapack
-r--r--r-- 61 817d294043bd21a3de01f807721971abe45219ce.datapack
-r--r--r-- 63 ff45add45ab3f59c4f75efc6a087d86c821219d6.datapack
$ ls_l $TESTTMP/hgcache/master/packs/ | grep histpack
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
-r--r--r-- 254 077e7ce5dfe862dc40cc8f3c9742d96a056865f2.histpack
-r--r--r-- 336 094b530486dad4427a0faf6bcbc031571b99ca24.histpack
-r--r--r-- 172 276d308429d0303762befa376788300f0310f90e.histpack
-r--r--r-- 90 c3399b56e035f73c3295276ed098235a08a0ed8c.histpack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ hg repack --incremental
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ ls_l $TESTTMP/hgcache/master/packs/ | grep datapack
-r--r--r-- 59 5b7dec902026f0cddb0ef8acb62f27b5698494d4.datapack
-r--r--r-- 213 f3c56163b762b2931865bbbb1250b4fae09e782c.datapack
$ ls_l $TESTTMP/hgcache/master/packs/ | grep histpack
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
-r--r--r-- 336 094b530486dad4427a0faf6bcbc031571b99ca24.histpack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
1 gen3 pack, 1 gen0 pack - does nothing
$ hg repack --incremental
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ ls_l $TESTTMP/hgcache/master/packs/ | grep datapack
-r--r--r-- 59 5b7dec902026f0cddb0ef8acb62f27b5698494d4.datapack
-r--r--r-- 213 f3c56163b762b2931865bbbb1250b4fae09e782c.datapack
$ ls_l $TESTTMP/hgcache/master/packs/ | grep histpack
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
-r--r--r-- 336 094b530486dad4427a0faf6bcbc031571b99ca24.histpack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
Pull should run background repack
$ cat >> .hg/hgrc <<EOF
> [remotefilelog]
> backgroundrepack=True
> EOF
$ clearcache
$ hg prefetch -r 0
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
$ hg prefetch -r 1
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
$ hg prefetch -r 2
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
$ hg prefetch -r 3
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ ls_l $TESTTMP/hgcache/master/packs/ | grep datapack
-r--r--r-- 59 5b7dec902026f0cddb0ef8acb62f27b5698494d4.datapack
-r--r--r-- 65 6c499d21350d79f92fd556b4b7a902569d88e3c9.datapack
-r--r--r-- 61 817d294043bd21a3de01f807721971abe45219ce.datapack
-r--r--r-- 63 ff45add45ab3f59c4f75efc6a087d86c821219d6.datapack
$ ls_l $TESTTMP/hgcache/master/packs/ | grep histpack
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
-r--r--r-- 254 077e7ce5dfe862dc40cc8f3c9742d96a056865f2.histpack
-r--r--r-- 336 094b530486dad4427a0faf6bcbc031571b99ca24.histpack
-r--r--r-- 172 276d308429d0303762befa376788300f0310f90e.histpack
-r--r--r-- 90 c3399b56e035f73c3295276ed098235a08a0ed8c.histpack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
$ hg pull
pulling from ssh://user@dummy/master
searching for changes
no changes found
(running background incremental repack)
$ sleep 0.5
$ hg debugwaitonrepack >/dev/null 2>&1
remotefilelog: let content stores support metadata Summary: This diffs add a `getmeta` method to all content stores. The cdatapack code is modified to pass the tests, it needs further change to support `getmeta`. The datapack format is bumped to v1 from v0. For v1, we append a `metadata` dict at the end of each revision. The dict is currently used to store revlog flags and rawsize of raw revlog fulltext. In the future we can put more data like a second hash etc, without changing API or format again. This diff focuses on correctness. A datapack caching layer to speed up `getmeta` will be added later. Tests are updated since we write new v1 packfile now and the format change leads to different content and packfile names. `Makefile`, `ls-l.py` are added to make tests easier to maintain. Test Plan: Updated existing tests. Reviewers: #mercurial, rmcelroy, durham Reviewed By: durham Subscribers: rmcelroy, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4903917 Signature: t1:4903917:1493255844:7ef5d487096cd2f78f2aaae672a68d49f33632ee
2017-04-27 05:50:36 +03:00
$ ls_l $TESTTMP/hgcache/master/packs/ | grep datapack
-r--r--r-- 59 5b7dec902026f0cddb0ef8acb62f27b5698494d4.datapack
-r--r--r-- 213 f3c56163b762b2931865bbbb1250b4fae09e782c.datapack
$ ls_l $TESTTMP/hgcache/master/packs/ | grep histpack
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
-r--r--r-- 336 094b530486dad4427a0faf6bcbc031571b99ca24.histpack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
Test environment variable resolution
$ CACHEPATH=$TESTTMP/envcache hg prefetch --config 'remotefilelog.cachepath=$CACHEPATH'
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
$ find $TESTTMP/envcache | sort
$TESTTMP/envcache
$TESTTMP/envcache/master
$TESTTMP/envcache/master/packs
$TESTTMP/envcache/master/packs/54afbfda203716c1aa2636029ccc0df18165129e.dataidx
$TESTTMP/envcache/master/packs/54afbfda203716c1aa2636029ccc0df18165129e.datapack
histpack: add version 1 Summary: This patch just bumps the histpack version number to 1 and adds a config flag to enable writing v1 pack files. The format hasn't actually changed in this patch, I'm just doing the verison bump so I can update all the hashes in the tests without working about functionality change. In the next patch I will modify the index format, which won't affect the hashes. Test Plan: Ran the tests. I also ran the tests with some debug code to manually force the sha to include 0 instead of 1 and verified that the hash didn't change (which confirms that all of these hash changes are just because of that one byte version change). Reviewers: #mercurial, quark Reviewed By: quark Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D4983675 Signature: t1:4983675:1493692444:5d88df4d46ce487f1b791417754ba000ecf10a1e
2017-05-03 20:19:45 +03:00
$TESTTMP/envcache/master/packs/dcebd8e8d4d97ee88e40dd8f92d8678c10e1a3ad.histidx
$TESTTMP/envcache/master/packs/dcebd8e8d4d97ee88e40dd8f92d8678c10e1a3ad.histpack
[cdatapack] create a fastdatapack class Summary: fastdatapack is the same as datapack. add selector in datapackstore to determine which datapack to create. test-datapack-fast.t is the same as tset-datapack.t, except it enables fastdatapack Test Plan: pass test-datapack.t test-datapack-fast.t Reviewers: #fastmanifest, durham Reviewed By: durham Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3666932 Signature: t1:3666932:1470426499:45292064e2868caab152d9a5b788840c5f63e4e4
2016-08-06 00:35:29 +03:00
Test local remotefilelog blob is correct when based on a pack
$ hg prefetch -r .
1 files fetched over 1 fetches - (0 misses, 100.00% hit ratio) over * (glob)
$ echo >> y
$ hg commit -m y2
$ hg debugremotefilelog .hg/store/data/95cb0bfd2977c761298d9624e4b4d4c72a39974a/b70860edba4f8242a1d52f2a94679dd23cb76808
size: 9 bytes
path: .hg/store/data/95cb0bfd2977c761298d9624e4b4d4c72a39974a/b70860edba4f8242a1d52f2a94679dd23cb76808
key: b70860edba4f
node => p1 p2 linknode copyfrom
b70860edba4f => 577959738234 000000000000 08d3fbc98c48
577959738234 => 1bb2e6237e03 000000000000 c7faf2fc439a x
1bb2e6237e03 => d4a3ed9310e5 000000000000 0b03bbc9e1e7
d4a3ed9310e5 => aee31534993a 000000000000 421535db10b6
aee31534993a => 1406e7411862 000000000000 a89d614e2364
1406e7411862 => 000000000000 000000000000 b292c1e3311f
Reference in New Issue Copy Permalink