sapling/fastmanifest/constants.py

# constants.py
#
# Copyright 2016 Facebook, Inc.
#
# This software may be used and distributed according to the terms of the
# GNU General Public License version 2 or any later version.

# fastmanifests are cached in .hg/store/<CACHE_SUBDIR>
CACHE_SUBDIR = "manifestcache"

# See _systemawarecachelimit in cachemanager
# for an explanation of these coefficients
DEFAULT_LOWGROWTH_TRESHOLDGB = 20
DEFAULT_MAXCACHESIZEGB = 6
DEFAULT_LOWGROWTH_SLOPE = 0.1
DEFAULT_HIGHGROWTHSLOPE = 0.2

# How old of a lock do we tolerate before we spawn off a new worker to populate
# the cache
WORKER_SPAWN_LOCK_STEAL_TIMEOUT = 300

# How many entries we keep in the in memory cache?
DEFAULT_MAX_MEMORY_ENTRIES = 10
[fastmanifest] split fastmanifest.py into separate files Summary: This combines D3351047, D3351086, and D3351137 into one diff. This allows mercurial to better remember where things came from since these are all hg cp commands followed by some edits. However, they were separated into multiple diffs for ease of reviews. Test Plan: run unit tests Reviewers: lcharignon Reviewed By: lcharignon Subscribers: mitrandir, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3354405 Signature: t1:3354405:1464291057:da140a02b9c87186b1dd9f03f8236d5996319fff 2016-05-26 22:34:38 +03:00			`# constants.py`
			`#`
			`# Copyright 2016 Facebook, Inc.`
			`#`
			`# This software may be used and distributed according to the terms of the`
			`# GNU General Public License version 2 or any later version.`

fastmanifest: add documentation of constants Summary: We change pydoc to comment for the lock timeout and document the remaining constants Test Plan: documentation change, tests pass Reviewers: ttung Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3398903 2016-06-09 00:28:14 +03:00			`# fastmanifests are cached in .hg/store/<CACHE_SUBDIR>`
[fastmanifest] split fastmanifest.py into separate files Summary: This combines D3351047, D3351086, and D3351137 into one diff. This allows mercurial to better remember where things came from since these are all hg cp commands followed by some edits. However, they were separated into multiple diffs for ease of reviews. Test Plan: run unit tests Reviewers: lcharignon Reviewed By: lcharignon Subscribers: mitrandir, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3354405 Signature: t1:3354405:1464291057:da140a02b9c87186b1dd9f03f8236d5996319fff 2016-05-26 22:34:38 +03:00			`CACHE_SUBDIR = "manifestcache"`
fastmanifest: add documentation of constants Summary: We change pydoc to comment for the lock timeout and document the remaining constants Test Plan: documentation change, tests pass Reviewers: ttung Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3398903 2016-06-09 00:28:14 +03:00
			`# See _systemawarecachelimit in cachemanager`
			`# for an explanation of these coefficients`
[fastmanifest] move cache management code to cachemanager.py Summary: yay modularization Test Plan: pass unit tests. Reviewers: lcharignon Reviewed By: lcharignon Subscribers: mitrandir, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3355420 Signature: t1:3355420:1464304331:718192fa25d5c6c7de0b18fb79c5f4fd3108ea88 2016-05-27 03:05:01 +03:00			`DEFAULT_LOWGROWTH_TRESHOLDGB = 20`
			`DEFAULT_MAXCACHESIZEGB = 6`
			`DEFAULT_LOWGROWTH_SLOPE = 0.1`
			`DEFAULT_HIGHGROWTHSLOPE = 0.2`
[fastmanifest] apply a loose lock to the cache priming process Summary: We lock right before we fork, but we only unlock in the child process. We don't want to unlock in the main process because that would mean we don't block the heavy work from mutual exclusion. Test Plan: pass existing tests, muck around in fbsource with it. Reviewers: lcharignon Subscribers: mitrandir, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3354927 Tasks: 11385124 2016-05-27 23:08:12 +03:00
fastmanifest: add documentation of constants Summary: We change pydoc to comment for the lock timeout and document the remaining constants Test Plan: documentation change, tests pass Reviewers: ttung Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3398903 2016-06-09 00:28:14 +03:00			`# How old of a lock do we tolerate before we spawn off a new worker to populate`
			`# the cache`
[fastmanifest] apply a loose lock to the cache priming process Summary: We lock right before we fork, but we only unlock in the child process. We don't want to unlock in the main process because that would mean we don't block the heavy work from mutual exclusion. Test Plan: pass existing tests, muck around in fbsource with it. Reviewers: lcharignon Subscribers: mitrandir, mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3354927 Tasks: 11385124 2016-05-27 23:08:12 +03:00			`WORKER_SPAWN_LOCK_STEAL_TIMEOUT = 300`
fastmanifest: limit number of entries stored in inmemory cache Summary: Before this patch we were not limiting the number of entries stored in the in-memory cache. This patch adds a limit and makes it configurable. As a followup we will need to add instrumentation. Test Plan: Tests still pass Reviewers: ttung Subscribers: mjpieters Differential Revision: https://phabricator.intern.facebook.com/D3372517 2016-06-01 23:42:03 +03:00
			`# How many entries we keep in the in memory cache?`
			`DEFAULT_MAX_MEMORY_ENTRIES = 10`