Commit Graph

198 Commits

Author SHA1 Message Date
Joe Bryan
e171596d98 adds (disabled) code to print and save comet "keyfile" 2019-05-04 21:22:37 -07:00
Joe Bryan
3d7b82936e fixes reference counts in _pier_work_boot() 2019-05-04 21:22:37 -07:00
Joe Bryan
f3867966bb fixes u3m_soft early-return bail type 2019-05-03 08:13:50 -07:00
Joe Bryan
dc1bf0c7d2 refactors u3v_boot/_lite, fixes reference miscount 2019-05-03 08:12:17 -07:00
Joe Bryan
a16450f62f use static keyword for local vortex.c functions 2019-05-02 17:10:09 -07:00
Joe Bryan
ff0be87001 removes unused .sys member of persistent u3A struct 2019-05-02 16:26:24 -07:00
Joe Bryan
7cd0b09cd4 Merge branch 'cc-release' into ccr-noun-clean
* cc-release:
  Get cross-compilation ready for release. (#1263)
  Use a typed size_t instead.
  Set the maximum event log size to forty gigabytes.
2019-05-02 16:26:11 -07:00
benjamin-tlon
ade1e59ce1
Get cross-compilation ready for release. (#1263)
* Add cross-compilation for `lmdb`.
* Got built caching working in CI with `cachix`.
* Cache cross compilation dependencies and toolchains.
* Do release builds in CI.
* Upload release builds to `bootstrap.urbit.org` on successful build.
* Lots of optimization work for CI.
* Boot from a solid pill in CI and load arvo with `-A`.
* Increase `vere` HTTP timeout to 15m.
2019-05-02 13:13:48 -07:00
Joe Bryan
08a181a6e2 removes obsolete u3v functions, refactor u3v_boot(_lite) 2019-05-02 11:35:52 -07:00
Elliot Glaysher
c06e8dbdb4 Use a typed size_t instead. 2019-05-02 10:50:59 -07:00
Joe Bryan
1565eede94 removes obsolete u3m_boot, renames new boot functions 2019-05-02 10:46:19 -07:00
Elliot Glaysher
7d246813f7 Set the maximum event log size to forty gigabytes. 2019-05-02 10:45:28 -07:00
Joe Bryan
1604313207 removes duplicate manage.c init, fixes call sites 2019-05-02 10:42:26 -07:00
Joe Bryan
46b14af63b Merge branch 'master' into ccr-noun-clean
* master:
  Update link to docs for swap space help
  Add `git` to default.nix dependencies
  Handle trailing newline in keyfile.
2019-05-02 10:40:57 -07:00
Elliot Glaysher
60196a9910 General patch cleanup 2019-04-29 14:23:27 -07:00
Elliot Glaysher
812b841f20 Attempt at fixing compile on CI. 2019-04-29 13:45:40 -07:00
Elliot Glaysher
06cfb81d60 Fix multi-event commit. 2019-04-29 10:59:15 -07:00
Elliot Glaysher
2fe916faac Merge remote-tracking branch 'origin/cc-release' into cc-batched-writes 2019-04-29 10:16:33 -07:00
Elliot Glaysher
8d691a63af Theoretically multi-event writes.
I'm having trouble testing this, though. Every constructed write request
is still only 1 event.
2019-04-29 10:06:03 -07:00
Joe Bryan
a378aac5ff
Merge pull request #1255 from urbit/ccr-cleanup
cc-release general cleanup
2019-04-26 14:53:12 -07:00
Joe Bryan
2c3bf6a9f2 corrects inaccurate u3m_reclaim comment in worker 2019-04-26 14:38:24 -07:00
Joe Bryan
e4db6edb24 restores perror() calls in terminal hijack/lojack to avoid possible reentrance 2019-04-26 14:36:38 -07:00
Joe Bryan
4f3f3897f8 moves _pier_apply into uv_idle_t, runs once per libuv turn 2019-04-26 14:24:01 -07:00
Joe Bryan
9196f7cc4a removes obsolete members from persistent u3A struct 2019-04-26 13:59:37 -07:00
Joe Bryan
56750c5f59 updates worker to store interim lifecycle events in u3V 2019-04-26 13:57:11 -07:00
Joe Bryan
1f86128b69 restores external arvo time on event failure 2019-04-26 13:56:42 -07:00
Joe Bryan
be254c57ae moves mug chaining enforcement entirely into the worker 2019-04-26 13:31:29 -07:00
Joe Bryan
b6b84b5369 updates the worker to track in-progress vs completed event numbers 2019-04-26 11:27:20 -07:00
Joe Bryan
45fff7f8da restores kernel mug when restarting the worker (on %play) 2019-04-26 11:13:49 -07:00
Elliot Glaysher
51253dca5d Build write request struct. 2019-04-26 11:08:10 -07:00
Joe Bryan
6b362c4008 tweaks event reference counting and fixes mis-fixed memory leak 2019-04-26 08:55:26 -07:00
Joe Bryan
3900d1a0c2 removes superfluous seeding of the openssl prng 2019-04-25 23:17:59 -07:00
Joe Bryan
edc142019e replaces perror() with u3l_log() 2019-04-25 23:17:59 -07:00
Joe Bryan
3b9a19d2f9 adds lmdb to library version report 2019-04-25 23:17:59 -07:00
Joe Bryan
5d0f1e1465 Merge branch 'master' into ccr-cleanup
* master:
  bump urbit version number
  if sweep gives 0 and reference count != 0, leak
  added urbit, curl and argon2 to version reporting (urbit -R)
  [CI] bump pinned arvo commit
  bump urbit version number to 0.7.3
  Consistently use "boot:" printf prefix
  Be more precise about the snapshot contents
  Re-add printf to notify of snapshot download
2019-04-25 22:56:14 -07:00
Joe Bryan
df59b1a489
Merge branch 'cc-release' into cc-event-replay-check 2019-04-25 17:04:39 -07:00
Joe Bryan
8fe2835e90
Merge pull request #1251 from BernardoDeLaPlaz/vere_build_warnings
remove all build warnings
2019-04-25 16:53:11 -07:00
Elliot Glaysher
ce0c78d1ea Cleanup 2019-04-25 16:35:29 -07:00
Elliot Glaysher
563214c2a2 Verify mugs on log replay to detect nondeterministic replay.
Joe helped write the worker/main.c changes so that we consistently
return the mug of the current state on each %done message. Then
enabled a check in _pier_work_complete() which asserts that the
recomputed event produces the same state as the next event was
expecting to be applied to.
2019-04-25 16:22:41 -07:00
BernardoDeLaPlaz
043333f767 -Werror turned on 2019-04-25 18:23:53 -04:00
BernardoDeLaPlaz
e9a2784982 Merge branch 'vere_build_warnings' of https://github.com/BernardoDeLaPlaz/urbit into vere_build_warnings 2019-04-25 18:07:06 -04:00
BernardoDeLaPlaz
c0403d2096 code review 2019-04-25 18:05:26 -04:00
Elliot Glaysher
a4ce72355d Store [mug job] instead of the entire IPC message. 2019-04-25 14:57:26 -07:00
~rigdyn-sondur
8db9653168
Merge branch 'cc-release' into vere_build_warnings 2019-04-25 16:37:08 -04:00
Joe Bryan
ac59fb749c updates arvo submodule and brass.pill to latest arvo next 2019-04-25 13:35:34 -07:00
BernardoDeLaPlaz
22fe68f67c fix one new build warning 2019-04-25 16:24:55 -04:00
Joe Bryan
4258c3c8ba Merge branch 'cc-release' into ccr-replay-reform
* cc-release: (26 commits)
  Rmoves all calls to u3m_bail() in the database layer. Everything returns an error code.
  Cleaner slog replay + fix spelling error
  Misc cleanup blocking CC-Release. (#1249)
  Use Joe's suggested change to u3_pier_snap().
  u3m_lmdb -> u3_lmdb
  updates libnoun to ignore SIGINT upon completion of a soft
  Cleanup
  Don't print %slog on replay.
  Finish cc-release cross-compilation. (#1202)
  removes clay mount auto-sync on restart
  Cleanup and enable MDB_NOOVERWRITE.
  Remove most u3_foil_* functions.
  Read the latest event number out of lmdb.
  Event log replay succeeds.
  removes obsolete, commented-out signal handling in main.c
  First version which appears to replay most of the event log. Still crashes at the end.
  corrects typos in libnoun commented-out code
  consolidates daemon signal handling
  consistently aborts immediately on ctrl-z (SIGTSTP)
  The entire log appears to be loaded from the database; still need to queue events, but exciting
  ...
2019-04-25 13:06:03 -07:00
Elliot Glaysher
0a0d7e0e57
Merge pull request #1248 from urbit/cc-lmdb-log-storage
Use lmdb for log storage instead of hand-rolled structure
2019-04-25 12:50:49 -07:00
~rigdyn-sondur
b7c7b7f6be
Merge branch 'cc-release' into vere_build_warnings 2019-04-25 14:46:11 -04:00
Elliot Glaysher
e0e9a09b58 Rmoves all calls to u3m_bail() in the database layer. Everything returns an error code. 2019-04-25 11:22:26 -07:00
BernardoDeLaPlaz
61bf83ff56 remove all build warnings 2019-04-25 14:01:21 -04:00
Elliot Glaysher
f8ca7b39dd Cleaner slog replay + fix spelling error 2019-04-25 10:47:37 -07:00
Joe Bryan
d0269662c8 fixes memory leak in worker %save handler 2019-04-24 22:21:36 -07:00
Joe Bryan
cfb6202edb tweaks replacement events: %crud contents, %warn structure 2019-04-24 22:21:09 -07:00
benjamin-tlon
3c3f7e761e
Misc cleanup blocking CC-Release. (#1249)
* Move extraneous stuff out of pkg/urbit/*
* s/urb/herb/g
* Removed some boilerplate for `urbit` builds.
* Build urbit tests and run them in the nix build.
2019-04-24 17:27:27 -07:00
Elliot Glaysher
0841e797a9 Use Joe's suggested change to u3_pier_snap(). 2019-04-24 17:05:34 -07:00
Elliot Glaysher
175fd18585 u3m_lmdb -> u3_lmdb 2019-04-24 16:26:27 -07:00
Joe Bryan
62e7c8272b
Merge pull request #1243 from urbit/ccr-signal-reform
cc-release: cleanup of signal handling
2019-04-24 12:52:26 -07:00
Joe Bryan
96ad21c476 updates libnoun to ignore SIGINT upon completion of a soft 2019-04-24 11:29:12 -07:00
Elliot Glaysher
16788f92c1 Cleanup 2019-04-24 11:22:54 -07:00
Elliot Glaysher
d320a7cafe Don't print %slog on replay. 2019-04-24 10:54:19 -07:00
Joe Bryan
d4321aa28c
Merge pull request #1247 from urbit/ccr-start-nosync
cc-release: removes clay mount auto-sync on restart
2019-04-23 20:20:52 -07:00
benjamin-tlon
edd57d380d
Finish cc-release cross-compilation. (#1202)
- Fixes the IPC bug
- Fixes the terminfo bug
- Moves the OSX SDK out of our nixcrpkgs fork.
- Vendor nixcrpkgs instead of having it be a submodule.
2019-04-23 19:50:38 -07:00
Joe Bryan
3b5644f582 removes clay mount auto-sync on restart 2019-04-23 18:28:58 -07:00
Joe Bryan
450fd5199e adds additional replacement events
%hole (negative ack) and %warn (%crud failed)
2019-04-23 15:57:46 -07:00
Joe Bryan
1ec9b9eee9 limits event replacement to three attempts 2019-04-23 15:57:46 -07:00
Joe Bryan
6d778bee3f aligns worker printfs, adjusts function indentation 2019-04-23 15:57:34 -07:00
Elliot Glaysher
45b47c21f7 Cleanup and enable MDB_NOOVERWRITE. 2019-04-23 15:30:56 -07:00
Elliot Glaysher
6570b798fd Remove most u3_foil_* functions. 2019-04-23 15:10:03 -07:00
Joe Bryan
26cbb9c7c8 inject fresh entropy on every restart 2019-04-23 15:07:53 -07:00
Elliot Glaysher
cdc3b6562e Read the latest event number out of lmdb. 2019-04-23 15:02:28 -07:00
Elliot Glaysher
8b4f1d8e93 Event log replay succeeds. 2019-04-23 14:15:11 -07:00
Joe Bryan
4dabad9120 restores -P sample-based profiling 2019-04-23 12:56:03 -07:00
Joe Bryan
23cbb45ffe removes obsolete, commented-out signal handling in main.c 2019-04-23 12:04:12 -07:00
Elliot Glaysher
281e352c14 First version which appears to replay most of the event log. Still crashes at the end. 2019-04-23 11:12:09 -07:00
Joe Bryan
ead1b2443e corrects typos in libnoun commented-out code 2019-04-23 10:46:34 -07:00
Joe Bryan
beafc011cd consolidates daemon signal handling 2019-04-23 10:46:34 -07:00
Joe Bryan
075bc5109e consistently aborts immediately on ctrl-z (SIGTSTP) 2019-04-23 10:46:29 -07:00
Elliot Glaysher
5d2468056c The entire log appears to be loaded from the database; still need to queue events, but exciting 2019-04-22 16:29:38 -07:00
Elliot Glaysher
dc6e3b2236 (This commit makes sh/make-bootzod work again.) 2019-04-22 10:50:54 -07:00
Elliot Glaysher
96942f3dd5 Joe looked at this; this was because of u3we vs u3ke. 2019-04-19 17:02:57 -07:00
Elliot Glaysher
a849b1b81e WIP: Wrote the skeleton of the reading function. It compiles, but isn't invoked. 2019-04-19 15:49:54 -07:00
Elliot Glaysher
0c36e0da26 Fixes threading so uv_work_t is heap allocated. 2019-04-19 11:17:37 -07:00
Elliot Glaysher
a10beebd47 Wrote out the asynchronous writing, but it crashes in the nock thread now? 2019-04-19 10:28:58 -07:00
Elliot Glaysher
2bef1a30da First minor integration with lmdb.
This stores the ship's identity information in a separate META table in
the lmdb datastore.
2019-04-18 14:01:44 -07:00
Elliot Glaysher
4cf58f27bd Cleanups 2019-04-16 10:14:15 -07:00
Elliot Glaysher
2aa45f828e Restore git submodule screw up. 2019-04-15 15:57:06 -07:00
Elliot Glaysher
29d40e032e Also remove uH/uL macros. 2019-04-15 15:14:07 -07:00
Elliot Glaysher
1e468f75d6 Pass stderr from worker to daemon. 2019-04-15 15:06:19 -07:00
Elliot Glaysher
4f313f05fa Merge remote-tracking branch 'origin/cc-release' into cc-enhancements 2019-04-15 14:25:50 -07:00
Joe Bryan
ea30e715dd uses stderr in daemon mode for slog printing 2019-04-12 22:51:43 -07:00
Joe Bryan
417dbf298b (re-)disable terminal spinner in daemon mode 2019-04-12 22:27:41 -07:00
Joe Bryan
4ccf069458 restores terminal spinner 2019-04-12 22:15:59 -07:00
Joe Bryan
2585e1ca76 adds argument comment to _serf_send_slog 2019-04-12 22:15:59 -07:00
Joe Bryan
05ce835b55 miscellaneous output cleanup 2019-04-12 22:14:55 -07:00
Joe Bryan
daac99c91e moves slog function pointer to u3C (to preserve across roads) 2019-04-12 22:13:00 -07:00
Joe Bryan
4873309e81 send slog hints over the king/serf pipe 2019-04-12 22:12:31 -07:00
Joe Bryan
3eaa470d98 moves slog implementation out of trace.c and libnoun
and removes unused u3t_shiv()
2019-04-12 22:11:49 -07:00
Joe Bryan
3f6c9326fb improves error message when attempting to recreate existing ship 2019-04-12 22:07:31 -07:00
Joe Bryan
3f7f57a247 removes obsolete ames initialization on boot 2019-04-12 21:57:33 -07:00