facebook/sapling
1
1
Fork 0
mirror of https://github.com/facebook/sapling.git synced 2024-10-07 07:17:55 +03:00
Code Issues Projects Releases Wiki Activity
39fb6f6f14
sapling/tests/test-repack.t

180 lines
5.9 KiB
Perl
Raw Normal View History

store: add simple test for repack Summary: This adds a simple test for repack that ensures the old blobs are cleaned up and the new data is still accessible. Test Plan: Ran the tests Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3250673 Signature: t1:3250673:1462235487:bcb5015b9a3665c5bb54776de6d110b1b8a64078
2016-05-05 00:52:37 +03:00
$ . "$TESTDIR/library.sh"
$ hginit master
$ cd master
$ cat >> .hg/hgrc <<EOF
> [remotefilelog]
> server=True
> serverexpiration=-1
> EOF
$ echo x > x
$ hg commit -qAm x
$ echo x >> x
$ hg commit -qAm x2
$ cd ..
$ hgcloneshallow ssh://user@dummy/master shallow -q
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over *s (glob)
# Test that repack cleans up the old files and creates new packs
$ cd shallow
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$ find $CACHEDIR -type f | sort
store: add simple test for repack Summary: This adds a simple test for repack that ensures the old blobs are cleaned up and the new data is still accessible. Test Plan: Ran the tests Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3250673 Signature: t1:3250673:1462235487:bcb5015b9a3665c5bb54776de6d110b1b8a64078
2016-05-05 00:52:37 +03:00
$TESTTMP/hgcache/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/aee31534993a501858fb6dd96a065671922e7d51
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$TESTTMP/hgcache/repos
store: add revision count to historypack filesection Summary: Previously, given a historypack file, we had no way of reading the contents, since we had no way to know when to stop reading the revision entries for a given file section. This patch changes the format to have a revision count value after the filename and before the revisions. The documentation already documented the format like this, and therefore doesn't need updating. A future patch will use this information to iterate over all the revisions in the pack. Test Plan: Added a test in a future patch Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3251538 Signature: t1:3251538:1462393282:f46b50e79237bfa8a25ff1957344588622b2699a
2016-05-05 00:52:43 +03:00
store: add simple test for repack Summary: This adds a simple test for repack that ensures the old blobs are cleaned up and the new data is still accessible. Test Plan: Ran the tests Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3250673 Signature: t1:3250673:1462235487:bcb5015b9a3665c5bb54776de6d110b1b8a64078
2016-05-05 00:52:37 +03:00
$ hg repack
store: add revision count to historypack filesection Summary: Previously, given a historypack file, we had no way of reading the contents, since we had no way to know when to stop reading the revision entries for a given file section. This patch changes the format to have a revision count value after the filename and before the revisions. The documentation already documented the format like this, and therefore doesn't need updating. A future patch will use this information to iterate over all the revisions in the pack. Test Plan: Added a test in a future patch Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3251538 Signature: t1:3251538:1462393282:f46b50e79237bfa8a25ff1957344588622b2699a
2016-05-05 00:52:43 +03:00
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$ find $CACHEDIR -type f | sort
store: add simple test for repack Summary: This adds a simple test for repack that ensures the old blobs are cleaned up and the new data is still accessible. Test Plan: Ran the tests Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3250673 Signature: t1:3250673:1462235487:bcb5015b9a3665c5bb54776de6d110b1b8a64078
2016-05-05 00:52:37 +03:00
$TESTTMP/hgcache/master/packs/817d294043bd21a3de01f807721971abe45219ce.dataidx
$TESTTMP/hgcache/master/packs/817d294043bd21a3de01f807721971abe45219ce.datapack
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$TESTTMP/hgcache/master/packs/bc0153a5326a2f0bcae9f659ad3376c04350119f.histidx
$TESTTMP/hgcache/master/packs/bc0153a5326a2f0bcae9f659ad3376c04350119f.histpack
$TESTTMP/hgcache/repos
store: add simple test for repack Summary: This adds a simple test for repack that ensures the old blobs are cleaned up and the new data is still accessible. Test Plan: Ran the tests Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3250673 Signature: t1:3250673:1462235487:bcb5015b9a3665c5bb54776de6d110b1b8a64078
2016-05-05 00:52:37 +03:00
store: make pack files read-only Summary: Since pack files should never change after they are created, let's create them with read-only permissions. It turns out that the Mercurial vfs doesn't apply the correct permissions to files created by mkstemp (and we have to use mkstemp since we don't know the name of the file until after we've written all the data to it), so we have to manually call the permission fixing code. We also need to fix our mmap calls to be readonly now, otherwise we get a runtime permission denied exception. Test Plan: Added a test Reviewers: #mercurial, ttung, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3255816 Signature: t1:3255816:1462321201:dff4fb4c9301d67a77043ecc1d96262bb5d6a54a
2016-05-05 00:53:07 +03:00
# Test that the packs are readonly
$ ls -l $CACHEDIR/master/packs
* (glob)
-r--r--r--* 817d294043bd21a3de01f807721971abe45219ce.dataidx (glob)
-r--r--r--* 817d294043bd21a3de01f807721971abe45219ce.datapack (glob)
store: add copyfrom information to history index Summary: Previously we were throwing away copy information when we repacked things into pack files. The hope was that we could store copy information somewhere else, and keep the history pack using fixed length entries. Since storing copy information elsewhere is a long ways off, let's just go ahead and put copy info in the pack file. This makes the entries non-fixed length, which means any iteration over them has to read the length of each entry. This also affects the historypack filename hashes since they are content based, so the tests had to change. This matches the old remotefilelog behavior more closely (which is why no code had to change outside the pack logic). Test Plan: Added a test Reviewers: #mercurial, mitrandir, ttung Reviewed By: mitrandir Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3262185 Signature: t1:3262185:1462562602:935683692276c7fa569d381b18aa3b18656793b1
2016-05-16 20:59:09 +03:00
-r--r--r--* bc0153a5326a2f0bcae9f659ad3376c04350119f.histidx (glob)
-r--r--r--* bc0153a5326a2f0bcae9f659ad3376c04350119f.histpack (glob)
store: make pack files read-only Summary: Since pack files should never change after they are created, let's create them with read-only permissions. It turns out that the Mercurial vfs doesn't apply the correct permissions to files created by mkstemp (and we have to use mkstemp since we don't know the name of the file until after we've written all the data to it), so we have to manually call the permission fixing code. We also need to fix our mmap calls to be readonly now, otherwise we get a runtime permission denied exception. Test Plan: Added a test Reviewers: #mercurial, ttung, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3255816 Signature: t1:3255816:1462321201:dff4fb4c9301d67a77043ecc1d96262bb5d6a54a
2016-05-05 00:53:07 +03:00
store: add simple test for repack Summary: This adds a simple test for repack that ensures the old blobs are cleaned up and the new data is still accessible. Test Plan: Ran the tests Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3250673 Signature: t1:3250673:1462235487:bcb5015b9a3665c5bb54776de6d110b1b8a64078
2016-05-05 00:52:37 +03:00
# Test that the data in the new packs is accessible
$ hg cat -r . x
x
x
store: add a test for repacking packs Summary: This adds a test for 'hg repack' in the case where some data exists in packs, and some data exists in loose objects. We expect the old packs and objects to be cleaned up, and one new datapack and historypack to remain. Test Plan: Ran it Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3251545 Signature: t1:3251545:1462315943:fbe9f76322587d2c19bc753d97d8f809b1e13ca2
2016-05-05 00:52:52 +03:00
# Test that adding new data and repacking it results in the loose data and the
# old packs being combined.
$ cd ../master
$ echo x >> x
$ hg commit -m x3
$ cd ../shallow
$ hg pull -q
$ hg up -q tip
store: read recent packs first Summary: Since recent packs are likely to contain more recent data, let's put them at the front of the pack list so they are checked first. In a future diff I'll come back and refact the common code between datapack and historypack into one base class. Test Plan: Ran the tests. Used the debugger to verify that the sort order was correct. Reviewers: #mercurial, ttung, mjpieters Reviewed By: mjpieters Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3259823 Signature: t1:3259823:1462388395:8ee48a7b02c6abc079878e53c5b336675249cb91
2016-05-05 00:53:16 +03:00
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over * (glob)
store: add a test for repacking packs Summary: This adds a test for 'hg repack' in the case where some data exists in packs, and some data exists in loose objects. We expect the old packs and objects to be cleaned up, and one new datapack and historypack to remain. Test Plan: Ran it Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3251545 Signature: t1:3251545:1462315943:fbe9f76322587d2c19bc753d97d8f809b1e13ca2
2016-05-05 00:52:52 +03:00
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$ find $CACHEDIR -type f | sort
$TESTTMP/hgcache/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/d4a3ed9310e5bd9887e3bf779da5077efab28216
store: add a test for repacking packs Summary: This adds a test for 'hg repack' in the case where some data exists in packs, and some data exists in loose objects. We expect the old packs and objects to be cleaned up, and one new datapack and historypack to remain. Test Plan: Ran it Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3251545 Signature: t1:3251545:1462315943:fbe9f76322587d2c19bc753d97d8f809b1e13ca2
2016-05-05 00:52:52 +03:00
$TESTTMP/hgcache/master/packs/817d294043bd21a3de01f807721971abe45219ce.dataidx
$TESTTMP/hgcache/master/packs/817d294043bd21a3de01f807721971abe45219ce.datapack
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$TESTTMP/hgcache/master/packs/bc0153a5326a2f0bcae9f659ad3376c04350119f.histidx
$TESTTMP/hgcache/master/packs/bc0153a5326a2f0bcae9f659ad3376c04350119f.histpack
$TESTTMP/hgcache/repos
store: add a test for repacking packs Summary: This adds a test for 'hg repack' in the case where some data exists in packs, and some data exists in loose objects. We expect the old packs and objects to be cleaned up, and one new datapack and historypack to remain. Test Plan: Ran it Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3251545 Signature: t1:3251545:1462315943:fbe9f76322587d2c19bc753d97d8f809b1e13ca2
2016-05-05 00:52:52 +03:00
$ hg repack --traceback
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$ find $CACHEDIR -type f | sort
store: add a test for repacking packs Summary: This adds a test for 'hg repack' in the case where some data exists in packs, and some data exists in loose objects. We expect the old packs and objects to be cleaned up, and one new datapack and historypack to remain. Test Plan: Ran it Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3251545 Signature: t1:3251545:1462315943:fbe9f76322587d2c19bc753d97d8f809b1e13ca2
2016-05-05 00:52:52 +03:00
$TESTTMP/hgcache/master/packs/1e386660a2bca1c6949a1cbf5b095765e98fd241.dataidx
$TESTTMP/hgcache/master/packs/1e386660a2bca1c6949a1cbf5b095765e98fd241.datapack
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$TESTTMP/hgcache/master/packs/3ed57673383638cd7c2c873a5a00a1f40f26b0b8.histidx
$TESTTMP/hgcache/master/packs/3ed57673383638cd7c2c873a5a00a1f40f26b0b8.histpack
$TESTTMP/hgcache/repos
store: add a test for repacking packs Summary: This adds a test for 'hg repack' in the case where some data exists in packs, and some data exists in loose objects. We expect the old packs and objects to be cleaned up, and one new datapack and historypack to remain. Test Plan: Ran it Reviewers: lcharignon, ttung, rmcelroy, quark, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3251545 Signature: t1:3251545:1462315943:fbe9f76322587d2c19bc753d97d8f809b1e13ca2
2016-05-05 00:52:52 +03:00
# Verify all the file data is still available
$ hg cat -r . x
x
x
x
$ hg cat -r '.^' x
x
x
store: record what files were created during a repack Summary: Previously, if you ran repack twice in a row, it would actually delete your packs, because the repack produced files with the same name as before, and the cleanup then deleted them. The fix is to have the stores record what files they produced in the ledger, then future clean up work can avoid deleting anything that was created during the repack. Test Plan: Added a test Reviewers: #mercurial, ttung, mitrandir Reviewed By: mitrandir Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3255819 Signature: t1:3255819:1462393814:d32155b12535990f72fbe48de045eddbb6f7fab6
2016-05-05 00:53:10 +03:00
# Test that repacking again without new data does not delete the pack files
# and did not change the pack names
$ hg repack
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$ find $CACHEDIR -type f | sort
store: record what files were created during a repack Summary: Previously, if you ran repack twice in a row, it would actually delete your packs, because the repack produced files with the same name as before, and the cleanup then deleted them. The fix is to have the stores record what files they produced in the ledger, then future clean up work can avoid deleting anything that was created during the repack. Test Plan: Added a test Reviewers: #mercurial, ttung, mitrandir Reviewed By: mitrandir Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3255819 Signature: t1:3255819:1462393814:d32155b12535990f72fbe48de045eddbb6f7fab6
2016-05-05 00:53:10 +03:00
$TESTTMP/hgcache/master/packs/1e386660a2bca1c6949a1cbf5b095765e98fd241.dataidx
$TESTTMP/hgcache/master/packs/1e386660a2bca1c6949a1cbf5b095765e98fd241.datapack
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$TESTTMP/hgcache/master/packs/3ed57673383638cd7c2c873a5a00a1f40f26b0b8.histidx
$TESTTMP/hgcache/master/packs/3ed57673383638cd7c2c873a5a00a1f40f26b0b8.histpack
$TESTTMP/hgcache/repos
repack: add lock to limit it to only one repack Summary: This adds a lock that limits us to running only one repack at a time. We also add a simple prerepack hook to allow the tests to insert a sleep to test this functionality. Test Plan: Added a test Reviewers: #mercurial, ttung, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3260428 Signature: t1:3260428:1462393311:3e1bf5dd047e7f3521679ca7640b448f5e784913
2016-05-05 00:53:19 +03:00
# Run two repacks at once
$ hg repack --config "hooks.prerepack=sleep 2" &
$ hg repack
abort: skipping repack - another repack is already running
[255]
repack: add --background option Summary: This allows triggering a repack that can be run in the background. In the future we will trigger this automatically under certain circumstances (like too many pack files). Test Plan: Added a test Reviewers: #mercurial, ttung, quark Reviewed By: quark Subscribers: quark Differential Revision: https://phabricator.intern.facebook.com/D3261161 Signature: t1:3261161:1462398568:5ae25f3e5a9acd0f4b34490b34a62be33cc69e3c
2016-05-05 00:53:23 +03:00
$ sleep 3
# Run repack in the background
$ cd ../master
$ echo x >> x
$ hg commit -m x4
$ cd ../shallow
$ hg pull -q
$ hg up -q tip
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over * (glob)
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$ find $CACHEDIR -type f | sort
$TESTTMP/hgcache/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/1bb2e6237e035c8f8ef508e281f1ce075bc6db72
repack: add --background option Summary: This allows triggering a repack that can be run in the background. In the future we will trigger this automatically under certain circumstances (like too many pack files). Test Plan: Added a test Reviewers: #mercurial, ttung, quark Reviewed By: quark Subscribers: quark Differential Revision: https://phabricator.intern.facebook.com/D3261161 Signature: t1:3261161:1462398568:5ae25f3e5a9acd0f4b34490b34a62be33cc69e3c
2016-05-05 00:53:23 +03:00
$TESTTMP/hgcache/master/packs/1e386660a2bca1c6949a1cbf5b095765e98fd241.dataidx
$TESTTMP/hgcache/master/packs/1e386660a2bca1c6949a1cbf5b095765e98fd241.datapack
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$TESTTMP/hgcache/master/packs/3ed57673383638cd7c2c873a5a00a1f40f26b0b8.histidx
$TESTTMP/hgcache/master/packs/3ed57673383638cd7c2c873a5a00a1f40f26b0b8.histpack
$TESTTMP/hgcache/repos
repack: add --background option Summary: This allows triggering a repack that can be run in the background. In the future we will trigger this automatically under certain circumstances (like too many pack files). Test Plan: Added a test Reviewers: #mercurial, ttung, quark Reviewed By: quark Subscribers: quark Differential Revision: https://phabricator.intern.facebook.com/D3261161 Signature: t1:3261161:1462398568:5ae25f3e5a9acd0f4b34490b34a62be33cc69e3c
2016-05-05 00:53:23 +03:00
$ hg repack --background
$ sleep 2
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$ find $CACHEDIR -type f | sort
store: add copyfrom information to history index Summary: Previously we were throwing away copy information when we repacked things into pack files. The hope was that we could store copy information somewhere else, and keep the history pack using fixed length entries. Since storing copy information elsewhere is a long ways off, let's just go ahead and put copy info in the pack file. This makes the entries non-fixed length, which means any iteration over them has to read the length of each entry. This also affects the historypack filename hashes since they are content based, so the tests had to change. This matches the old remotefilelog behavior more closely (which is why no code had to change outside the pack logic). Test Plan: Added a test Reviewers: #mercurial, mitrandir, ttung Reviewed By: mitrandir Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3262185 Signature: t1:3262185:1462562602:935683692276c7fa569d381b18aa3b18656793b1
2016-05-16 20:59:09 +03:00
$TESTTMP/hgcache/master/packs/3bebfba849e7aed8e598b92b296aeaff4784393b.histidx
$TESTTMP/hgcache/master/packs/3bebfba849e7aed8e598b92b296aeaff4784393b.histpack
repack: add --background option Summary: This allows triggering a repack that can be run in the background. In the future we will trigger this automatically under certain circumstances (like too many pack files). Test Plan: Added a test Reviewers: #mercurial, ttung, quark Reviewed By: quark Subscribers: quark Differential Revision: https://phabricator.intern.facebook.com/D3261161 Signature: t1:3261161:1462398568:5ae25f3e5a9acd0f4b34490b34a62be33cc69e3c
2016-05-05 00:53:23 +03:00
$TESTTMP/hgcache/master/packs/92a06d8b76a23b6e6150cf877ea75ed993e0b2d8.dataidx
$TESTTMP/hgcache/master/packs/92a06d8b76a23b6e6150cf877ea75ed993e0b2d8.datapack
test: add sort to all find commands Summary: Turns out the find output is not deterministic, so it was producing different results in some environments. Let's throw in a sort call for all find output. Test Plan: Ran the tests Reviewers: mitrandir, #mercurial Differential Revision: https://phabricator.intern.facebook.com/D3306533
2016-05-18 17:22:10 +03:00
$TESTTMP/hgcache/repos
store: add copyfrom information to history index Summary: Previously we were throwing away copy information when we repacked things into pack files. The hope was that we could store copy information somewhere else, and keep the history pack using fixed length entries. Since storing copy information elsewhere is a long ways off, let's just go ahead and put copy info in the pack file. This makes the entries non-fixed length, which means any iteration over them has to read the length of each entry. This also affects the historypack filename hashes since they are content based, so the tests had to change. This matches the old remotefilelog behavior more closely (which is why no code had to change outside the pack logic). Test Plan: Added a test Reviewers: #mercurial, mitrandir, ttung Reviewed By: mitrandir Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3262185 Signature: t1:3262185:1462562602:935683692276c7fa569d381b18aa3b18656793b1
2016-05-16 20:59:09 +03:00
packs: add debug commands to view pack contents Summary: Some simple debug commands to print the contents of each pack. Test Plan: Ran it manually, and added a simple test Reviewers: #mercurial, ttung, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3277233 Signature: t1:3277233:1463085196:c54fc875d536a96150bb1461b77247a5d7a9402c
2016-05-16 20:59:09 +03:00
# Test debug commands
$ hg debugdatapack $TESTTMP/hgcache/master/packs/92a06d8b76a23b6e6150cf877ea75ed993e0b2d8
x
Node Delta Base Delta Length
1bb2e6237e03 000000000000 13
d4a3ed9310e5 1bb2e6237e03 17
aee31534993a d4a3ed9310e5 17
$ hg debughistorypack $TESTTMP/hgcache/master/packs/3bebfba849e7aed8e598b92b296aeaff4784393b
x
Node P1 Node P2 Node Link Node Copy From
1bb2e6237e03 d4a3ed9310e5 000000000000 0b03bbc9e1e7
d4a3ed9310e5 aee31534993a 000000000000 421535db10b6
aee31534993a 1406e7411862 000000000000 a89d614e2364
1406e7411862 000000000000 000000000000 b292c1e3311f
store: add copyfrom information to history index Summary: Previously we were throwing away copy information when we repacked things into pack files. The hope was that we could store copy information somewhere else, and keep the history pack using fixed length entries. Since storing copy information elsewhere is a long ways off, let's just go ahead and put copy info in the pack file. This makes the entries non-fixed length, which means any iteration over them has to read the length of each entry. This also affects the historypack filename hashes since they are content based, so the tests had to change. This matches the old remotefilelog behavior more closely (which is why no code had to change outside the pack logic). Test Plan: Added a test Reviewers: #mercurial, mitrandir, ttung Reviewed By: mitrandir Subscribers: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3262185 Signature: t1:3262185:1462562602:935683692276c7fa569d381b18aa3b18656793b1
2016-05-16 20:59:09 +03:00
# Test copy tracing from a pack
$ cd ../master
$ hg mv x y
$ hg commit -m 'move x to y'
$ cd ../shallow
$ hg pull -q
$ hg up -q tip
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over * (glob)
$ hg repack
$ hg log -f y -T '{desc}\n'
move x to y
x4
x3
x2
x
repack: don't require complete history during data repack Summary: Previously, when repacking deltas we would require a full history of the node so we could order the hashes optimally. In some situations though, we don't have the full history available (like if we're only repacking a subset of packs), so we need to be able to repack even without full history. This patch handles the case where a given delta doesn't have history information. We just store it as a full text. This becomes useful in an upcoming series that will introduce incremental packing that only packs a subset of the packs. Test Plan: Added a test Reviewers: #mercurial, ttung, mitrandir Reviewed By: mitrandir Differential Revision: https://phabricator.intern.facebook.com/D3278346 Signature: t1:3278346:1463086170:54c0fbefe78f9cafa7efc4b6f037887a924ab4a5
2016-05-16 20:59:09 +03:00
# Test repacking datapack without history
$ rm -rf $CACHEDIR/master/packs/*hist*
$ hg repack
$ hg debugdatapack $TESTTMP/hgcache/master/packs/60ed975b3589fc9708a374155083fbdc7da397cb
x
Node Delta Base Delta Length
1bb2e6237e03 000000000000 13
aee31534993a 000000000000 9
d4a3ed9310e5 000000000000 11
y
Node Delta Base Delta Length
577959738234 000000000000 74
$ hg cat -r ".^" x
x
x
x
x
Reference in New Issue Copy Permalink