sapling/eden/scm/tests/test-fb-hgext-remotefilelog-repack-corrupt.t
Xavier Deguillard 04a09ec571 remotefilelog: adapt tests for remotefilelog to support LFS
Summary:
The hgcache will soon contain an LFS subdirectory, this is uninteresting for
most of the tests, let's change them a bit so they only look at the packs
subdirectory.

With this, enabling remotefilelog.useruststore only has 2 failures. One due a
difference in handling corrupt data, with the ruststore being more explicit
that some data is missing instead of a generic "stream ended unexpectedly". And
the other due to some ordering difference when dealing with LFS data. The
latter will go away with the new LFS implementation.

Reviewed By: DurhamG

Differential Revision: D20543146

fbshipit-source-id: 09c76cacfb4687fd699b82cdf5057665ac6bd521
2020-03-26 19:02:47 -07:00

159 lines
5.8 KiB
Perl

#chg-compatible
$ disable treemanifest
$ . "$TESTDIR/library.sh"
$ hginit master
$ cd master
$ cat >> .hg/hgrc <<EOF
> [remotefilelog]
> server=True
> serverexpiration=-1
> EOF
$ echo x > x
$ echo y > y
$ hg commit -qAm xy
$ echo x >> x
$ echo y >> y
$ hg commit -qAm xy2
$ cd ..
$ hgcloneshallow ssh://user@dummy/master shallow -q
2 files fetched over 1 fetches - (2 misses, 0.00% hit ratio) over * (glob) (?)
Set the prefetchdays config to zero so that all commits are prefetched
no matter what their creation date is.
$ cd shallow
$ cat >> .hg/hgrc <<EOF
> [remotefilelog]
> localdatarepack=True
> prefetchdays=0
> EOF
$ cd ..
$ cd shallow
$ findfilessorted $CACHEDIR/master/packs
$TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histidx
$TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histpack
$TESTTMP/hgcache/master/packs/9ae82bbfd147f28ff04367cf066c5ed3ef429be4.dataidx
$TESTTMP/hgcache/master/packs/9ae82bbfd147f28ff04367cf066c5ed3ef429be4.datapack
$ hg repack
$ findfilessorted $CACHEDIR/master/packs
$TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histidx
$TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histpack
$TESTTMP/hgcache/master/packs/9ae82bbfd147f28ff04367cf066c5ed3ef429be4.dataidx
$TESTTMP/hgcache/master/packs/9ae82bbfd147f28ff04367cf066c5ed3ef429be4.datapack
$TESTTMP/hgcache/master/packs/repacklock
Create some new data to pack into it
$ cd ../master
$ echo a > a
$ echo b > b
$ hg commit -qAm ab
$ echo a >> a
$ echo b >> b
$ hg commit -qAm ab2
$ cd ../shallow
$ hg pull -q
$ hg up -q tip
2 files fetched over 1 fetches - (2 misses, 0.00% hit ratio) over * (glob) (?)
$ findfilessorted $CACHEDIR/master/packs
$TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histidx
$TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histpack
$TESTTMP/hgcache/master/packs/767371d087d35f549346611a68c10805fa2e5083.dataidx
$TESTTMP/hgcache/master/packs/767371d087d35f549346611a68c10805fa2e5083.datapack
$TESTTMP/hgcache/master/packs/8054aa368dd33acb92013013096b517dfdfaf184.histidx
$TESTTMP/hgcache/master/packs/8054aa368dd33acb92013013096b517dfdfaf184.histpack
$TESTTMP/hgcache/master/packs/9ae82bbfd147f28ff04367cf066c5ed3ef429be4.dataidx
$TESTTMP/hgcache/master/packs/9ae82bbfd147f28ff04367cf066c5ed3ef429be4.datapack
$TESTTMP/hgcache/master/packs/repacklock
Truncate the historypack file in the middle of the filename length for "y"
$ chmod +w $TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histpack
$ python $TESTDIR/truncate.py --size 173 $TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histpack
Repack
$ hg repack
$ findfilessorted $CACHEDIR/master/packs
$TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histidx
$TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440.histpack
$TESTTMP/hgcache/master/packs/60374dd52300114836388912c35fe94f80e74889.dataidx
$TESTTMP/hgcache/master/packs/60374dd52300114836388912c35fe94f80e74889.datapack
$TESTTMP/hgcache/master/packs/8335018efaefd765d52fad1c07f44addc0371202.histidx
$TESTTMP/hgcache/master/packs/8335018efaefd765d52fad1c07f44addc0371202.histpack
$TESTTMP/hgcache/master/packs/repacklock
The history for y has to be refetched from the server.
$ hg log -f y -T '{desc}\n'
deleting corrupt pack '$TESTTMP/hgcache/master/packs/37db2caec222ca26824a52d6bdc778344e0d1440'
xy2
xy
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over 0.00s (?)
Next, do the same for local data. This time there is data loss, as there are no more copies
of the data available.
Create some local commits and pack them into a pack file
$ echo m > m
$ echo n > n
$ echo o > o
$ hg commit -qAm mno
$ echo m >> m
$ echo n >> n
$ echo o >> o
$ hg commit -qAm mno2
$ hg repack
Truncate the history in the middle of the filename length for "n"
$ chmod +w .hg/store/packs/822f755410ca9f664d7c706957b8391248327318.histpack
$ python $TESTDIR/truncate.py --size 173 .hg/store/packs/822f755410ca9f664d7c706957b8391248327318.histpack
Truncate the data in the middle of the filename length for "o"
$ chmod +w .hg/store/packs/f0a7036b83e36fd41dc1ea89cc67e6a01487f2cf.datapack
$ python $TESTDIR/truncate.py --size 130 .hg/store/packs/f0a7036b83e36fd41dc1ea89cc67e6a01487f2cf.datapack
Repack
$ hg repack
$ findfilessorted .hg/store/packs
.hg/store/packs/822f755410ca9f664d7c706957b8391248327318.histidx
.hg/store/packs/822f755410ca9f664d7c706957b8391248327318.histpack
.hg/store/packs/f0a7036b83e36fd41dc1ea89cc67e6a01487f2cf.dataidx
.hg/store/packs/f0a7036b83e36fd41dc1ea89cc67e6a01487f2cf.datapack
The local data and history for m is still available
$ hg cat m
m
m
$ hg log -f m -T '{desc}\n'
mno2
mno
The local data for n is still available
$ hg cat n
n
n
The history for n is lost
$ hg log -qf n
detected corrupt pack '$TESTTMP/shallow/.hg/store/packs/822f755410ca9f664d7c706957b8391248327318' - ignoring it
abort: stream ended unexpectedly (got 0 bytes, expected 2)
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over * (glob) (?)
[255]
The local data and history for o is lost
$ hg cat -q o
detected corrupt pack '$TESTTMP/shallow/.hg/store/packs/f0a7036b83e36fd41dc1ea89cc67e6a01487f2cf' - ignoring it
abort: stream ended unexpectedly (got 0 bytes, expected 2)
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over 0.00s (?)
[255]
$ hg log -qf o
detected corrupt pack '$TESTTMP/shallow/.hg/store/packs/822f755410ca9f664d7c706957b8391248327318' - ignoring it
abort: stream ended unexpectedly (got 0 bytes, expected 2)
1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over * (glob) (?)
[255]