Commit Graph

114 Commits

Author SHA1 Message Date
Logan Allen
f3001e122f graph-store: clean up old migrations 2021-04-13 15:38:42 -05:00
Logan Allen
faf1f83e8f graph-store: remove obsoleted code necessary to keep graph marks warm 2021-04-06 17:21:09 -05:00
Liam Fitzgerald
417483c4de
Merge branch 'master' into release/next-userspace 2021-04-01 18:35:39 +10:00
Logan Allen
2791cd5d9a graph-store: scry only once during +validate-graph 2021-03-31 16:08:36 -05:00
Logan Allen
d34045f190 graph-store: fewer allocations in +validate-graph 2021-03-31 16:08:31 -05:00
Logan Allen
d939c91e78 graph-store: speed up +validate-graph by using +turn and no longer virtualizing 2021-03-31 16:08:23 -05:00
Liam Fitzgerald
c186bad1c1
graph-store: +on-load 2021-03-24 13:09:58 +10:00
Liam Fitzgerald
54b3982b42
graph-store: upgrade reference content
This commit changes the type of update:graph-store and as such, a new
mark has been created. graph-store now consumes and produces
%graph-update-1. This new mark type is backwards incompatible with the
previous mark.
2021-03-24 13:06:26 +10:00
Liam Fitzgerald
4b305b5450
graph-hooks: upgrade for versioning 2021-03-19 10:05:07 +10:00
Logan Allen
0f7ff055df graph-store: only calculate hash when necessary, only check signatures if necessary 2021-02-25 13:06:26 -06:00
Logan Allen
83edfd67ba graph-push-hook: fixed bunted bowl issue 2021-02-03 13:08:53 -06:00
Isaac Visintainer
59e070e46e graph-store: updated tree type in import flow 2021-01-26 14:32:38 -08:00
Liam Fitzgerald
69a5675a86
graph-store: log %add-graph
When a graph is joined, the subscriber receives an %add-graph update
that corresponds to the current state of the graph. This was not logged,
so if the graph did not recieve any updates before the subscription was
kicked, the whole graph would be have to be sent again. This would be
largely asymptomatic, however hark-store assumes that %add-graph will
only be emitted when a new graph is joined or created. As such, we log
this initial update, so that the push-hook can correctly ascertain the
backlog it needs to send and so %add-graph is only emitted once per
graph. This also opens the door for time-varying scries into
graph-store.

Fixes #4290
2021-01-20 10:52:19 +10:00
Liam Fitzgerald
9c7ac3773a
hark, graph-store: address L review 2021-01-12 08:15:14 +10:00
Liam Fitzgerald
1ed0477663
graph-store: emit affected descended nodes in %remove-nodes
When %remove-nodes is sent as an update, it may refer to a parent node,
in which case the deletion of all the parent's children is implied. If
we hold onto references to nodes outside of graph-store, we are unable
to tell which of our references were affected, other than iterating over
every reference to check if one of the deleted indices is a prefix of
the reference. This is obviously undesirable, so we emit all of the
nodes we deleted, including the nodes deleted implicitly.
2021-01-11 17:44:25 +10:00
Liam Fitzgerald
7e0af9cfca
graph-store: add node existence query 2021-01-11 17:44:25 +10:00
Liam Fitzgerald
44ac3130f8
graph-store: use +bap for update-log listification 2021-01-05 08:23:12 +10:00
Liam Fitzgerald
fa7c347870
graph-store: add TODO comment for backwards tap 2020-12-16 09:42:01 +10:00
Liam Fitzgerald
2c915af179
graph-store: run update log in correct order
tapping an ordered map returns a list with the smallest keys first.
However, graph-store's update-log is defined backwards, such that the
list will have the most recent updates in the front of the list. We
therefore flop the update log before iterating over it, in order to
process the updates in the order they occurred
2020-12-15 21:37:50 +10:00
Logan Allen
504e02a6c8 graph-store: turn back on noisy duplicates 2020-12-12 18:06:44 -06:00
Logan Allen
35c2ccd54c graph-store: silence duplicate message assertion temporarily 2020-12-12 14:46:59 -06:00
Logan Allen
386997475b graph-store: no need to iterate through whole list if we find a single duplicate 2020-12-11 18:13:47 -06:00
Logan Allen
78cf4443c2 graph-store: address ted and mark's comments 2020-12-11 18:10:10 -06:00
Logan Allen
e845860e5e graph-store: no-op if we already have *any* of the indexes in an %add-nodes event 2020-12-11 23:05:54 +00:00
Logan Allen
26b9c5a66f graph-store: remove unnecessary clay write upon clobber 2020-12-11 14:53:02 -06:00
Liam Fitzgerald
bce1b3e65e
group-pull-hook: remove group on nack 2020-12-11 14:57:20 +10:00
Liam Fitzgerald
82b668cf3a
graph-store: %node-siblings fixed 2020-12-11 13:05:40 +10:00
Liam Fitzgerald
2b95b308b8
graph-store: simplify node-siblings scries 2020-12-11 12:21:47 +10:00
Liam Fitzgerald
37bb4e9bfe
graph-store: backup overwritten graphs to clay 2020-12-11 11:38:12 +10:00
Liam Fitzgerald
fc189a7c13
graph-store: on overwrite, archive existing graph 2020-12-10 12:36:59 +10:00
Logan Allen
7802a7f8d9 Merge branch 'release/next-userspace' into lf/chat-graph 2020-12-09 15:45:26 -06:00
Joe Bryan
17736990ed arvo: full vane names in $sign 2020-12-07 16:30:22 -08:00
Joe Bryan
5a82f1d4c0 Merge branch 'na-release/candidate' into jb/motion
* na-release/candidate: (36 commits)
  ames: don't crash on forward-lane scry
  jael: cleanup per review
  jael: don't signal breach if first hearing of ship
  pill: update
  vere: compile
  lens: don't de-base64
  vere: make import flow not use base64 encoding
  version: strip trailing newline
  pill: mainnet
  Revert "zuse: change to ropsten"
  chat-hook: fix another poke-import issue
  chat-hook: fix poke-import issue
  apps: reorder maps, sets, and jugs
  apps: reorder maps, sets, and jugs
  kiln: add base-hash and our scries
  lens: fix change lost in merge
  graph-store: leave try-rejoin wire when subscription succeeds
  graphs: import-export
  chat: import/export
  invites: import/export
  ...
2020-12-07 00:27:58 -08:00
Joe Bryan
958bb5acf7 arvo: removes +is and all references to it 2020-12-05 00:51:49 -08:00
Isaac Visintainer
0c3edb1ca9 apps: reorder maps, sets, and jugs 2020-12-02 00:00:03 -08:00
Liam Fitzgerald
3d21dcd19f
Merge branch 'release/next-userspace' into lf/chat-graph 2020-12-02 13:42:02 +10:00
Isaac Visintainer
9ea43121a5 graph-store: leave try-rejoin wire when subscription succeeds 2020-12-01 17:52:24 -08:00
Isaac Visintainer
2f53524e2f graphs: import-export 2020-12-01 17:38:51 -08:00
Liam Fitzgerald
9ee62a2e55
hark: rework unread tracking, again 2020-12-01 15:46:28 +10:00
Liam Fitzgerald
88adb0033a
graph-store: safely peek update-log
Safely returns a null when either the update-log does not exists, or it
is empty

Fixes #3976
2020-11-25 14:41:19 +10:00
Liam Fitzgerald
360d24e11c
hark: add scries for chat 2020-11-24 15:39:53 +10:00
Logan Allen
e7b0ff2c66 graph-store: change atom to %1 for all migrated comments 2020-11-18 20:02:42 -06:00
L
c3c9218083
Merge pull request #3927 from urbit/la/revisions
graph-store: amend %publish and %link validators to allow editing comments
2020-11-18 18:01:13 -06:00
Liam Fitzgerald
5615c10c2b
graph-store: correctly subset in scries 2020-11-17 18:00:29 +10:00
Logan Allen
4f7ca0a0dc graph-store: add overwrite field to %add-graph 2020-11-12 20:40:12 +00:00
Logan Allen
cb990242e8 graph-store: added debugging tool to %validate-graph 2020-11-12 20:19:36 +00:00
Logan Allen
9c9e1160ad graph-store: update %publish and %link schemas, wipe update-logs 2020-11-12 13:47:42 -06:00
matildepark
565fc46660
Merge pull request #3910 from urbit/lf/graph-cleanup
graph-store: run-updates no longer pokes itself
2020-11-10 23:24:24 -05:00
Liam Fitzgerald
5354aae5fa
graph-store: run-updates no longer pokes itself 2020-11-10 15:43:35 +10:00
Liam Fitzgerald
e9d9bb839f Merge branch 'release/next-userspace' into lf/hark-redux 2020-11-03 10:58:52 +10:00