sapling/remotefilelog
Tony Tung 30ba9cdd24 [cdatapack] madvise the memory away
Summary: Once we're done reading the delta data, we madvise it away.

Test Plan:
dump all the hashes from a datapack into a separate file.  then run a script to fetch all the delta chains.  observed that the memory footprint did not increase significantly.

```
#!/usr/bin/env python

import binascii

import cdatapack

dp = cdatapack.datapack('/dev/shm/hgcache/fbsource/packs/8b5d28f7a5bd7391a0b060c88af8cca3af357c24')

for ix, line in enumerate(open('/tmp/hashes', 'r')):
    line = line.strip()
    dp.getdeltachain(binascii.unhexlify(line))
```

Reviewers: #fastmanifest, durham

Reviewed By: durham

Subscribers: durham, mitrandir

Differential Revision: https://phabricator.intern.facebook.com/D3686830

Signature: t1:3686830:1470716333:e8fc8e3e3fa29c1931f69222c17e10f519a4a8c2
2016-08-15 11:39:14 -07:00
..
cdatapack [cdatapack] madvise the memory away 2016-08-15 11:39:14 -07:00
ctreemanifest [ctree] fix build on clang 2016-08-10 13:04:38 -07:00
__init__.py repack: move background repack into requirement check 2016-08-05 10:00:22 -07:00
basepack.py repack: unmap memory occasionally to reclaim space 2016-07-12 11:46:48 -07:00
basestore.py cachegroup: fix directory permissions for shared cache 2016-07-07 15:58:59 -07:00
cacheclient.py checkcode: fix errors in cacheclient and debugcommands 2016-04-26 13:00:31 -07:00
constants.py store: basic wire protocol for bundle delivery 2016-05-16 10:59:09 -07:00
contentstore.py unionstore: allow incomplete delta chains 2016-05-26 02:15:46 -07:00
datapack.py [cdatapack] create a fastdatapack class 2016-08-05 14:35:29 -07:00
debugcommands.py [datapack] add --node as a parameter to dump extra data about a node 2016-07-28 17:15:21 -07:00
fileserverclient.py fileserverclient: remotefilepeer could have not implemented "cleanup" 2016-08-11 15:14:54 +01:00
historypack.py repack: unmap memory occasionally to reclaim space 2016-07-12 11:46:48 -07:00
metadatastore.py unionstore: allow partial history output from union stores 2016-05-26 02:13:53 -07:00
remotefilectx.py checkcode: fix remotefilectx and remotefilelog 2016-04-26 13:00:31 -07:00
remotefilelog.py copyfrom: fix copy metadata in local blobs 2016-06-06 14:16:06 -07:00
remotefilelogserver.py flogheads: return an empty list when requesting heads of a non-existing filelog 2016-08-02 10:41:41 -07:00
repack.py repack: fix repack heuristic to account for unusual copies 2016-07-07 15:58:47 -07:00
shallowbundle.py shallowbundle: specifically compare instance to remotefilelog.remotefilelog 2016-07-15 23:53:09 -07:00
shallowrepo.py [cdatapack] create a fastdatapack class 2016-08-05 14:35:29 -07:00
shallowstore.py Add more comments explaining various complexities 2013-11-05 17:19:59 -08:00
shallowutil.py cachegroup: fix directory permissions for shared cache 2016-07-07 15:58:59 -07:00
shallowverifier.py remotefilelog: removing filelog check from verification process 2016-01-07 16:57:39 -08:00