Commit Graph

161 Commits

Author SHA1 Message Date
Logan Allen
2791cd5d9a graph-store: scry only once during +validate-graph 2021-03-31 16:08:36 -05:00
Logan Allen
d34045f190 graph-store: fewer allocations in +validate-graph 2021-03-31 16:08:31 -05:00
Logan Allen
d939c91e78 graph-store: speed up +validate-graph by using +turn and no longer virtualizing 2021-03-31 16:08:23 -05:00
Liam Fitzgerald
c186bad1c1
graph-store: +on-load 2021-03-24 13:09:58 +10:00
Liam Fitzgerald
54b3982b42
graph-store: upgrade reference content
This commit changes the type of update:graph-store and as such, a new
mark has been created. graph-store now consumes and produces
%graph-update-1. This new mark type is backwards incompatible with the
previous mark.
2021-03-24 13:06:26 +10:00
Liam Fitzgerald
4b305b5450
graph-hooks: upgrade for versioning 2021-03-19 10:05:07 +10:00
Logan Allen
0f7ff055df graph-store: only calculate hash when necessary, only check signatures if necessary 2021-02-25 13:06:26 -06:00
Logan Allen
83edfd67ba graph-push-hook: fixed bunted bowl issue 2021-02-03 13:08:53 -06:00
Isaac Visintainer
59e070e46e graph-store: updated tree type in import flow 2021-01-26 14:32:38 -08:00
Liam Fitzgerald
69a5675a86
graph-store: log %add-graph
When a graph is joined, the subscriber receives an %add-graph update
that corresponds to the current state of the graph. This was not logged,
so if the graph did not recieve any updates before the subscription was
kicked, the whole graph would be have to be sent again. This would be
largely asymptomatic, however hark-store assumes that %add-graph will
only be emitted when a new graph is joined or created. As such, we log
this initial update, so that the push-hook can correctly ascertain the
backlog it needs to send and so %add-graph is only emitted once per
graph. This also opens the door for time-varying scries into
graph-store.

Fixes #4290
2021-01-20 10:52:19 +10:00
Liam Fitzgerald
9c7ac3773a
hark, graph-store: address L review 2021-01-12 08:15:14 +10:00
Liam Fitzgerald
1ed0477663
graph-store: emit affected descended nodes in %remove-nodes
When %remove-nodes is sent as an update, it may refer to a parent node,
in which case the deletion of all the parent's children is implied. If
we hold onto references to nodes outside of graph-store, we are unable
to tell which of our references were affected, other than iterating over
every reference to check if one of the deleted indices is a prefix of
the reference. This is obviously undesirable, so we emit all of the
nodes we deleted, including the nodes deleted implicitly.
2021-01-11 17:44:25 +10:00
Liam Fitzgerald
7e0af9cfca
graph-store: add node existence query 2021-01-11 17:44:25 +10:00
Liam Fitzgerald
44ac3130f8
graph-store: use +bap for update-log listification 2021-01-05 08:23:12 +10:00
Liam Fitzgerald
fa7c347870
graph-store: add TODO comment for backwards tap 2020-12-16 09:42:01 +10:00
Liam Fitzgerald
2c915af179
graph-store: run update log in correct order
tapping an ordered map returns a list with the smallest keys first.
However, graph-store's update-log is defined backwards, such that the
list will have the most recent updates in the front of the list. We
therefore flop the update log before iterating over it, in order to
process the updates in the order they occurred
2020-12-15 21:37:50 +10:00
Logan Allen
504e02a6c8 graph-store: turn back on noisy duplicates 2020-12-12 18:06:44 -06:00
Logan Allen
35c2ccd54c graph-store: silence duplicate message assertion temporarily 2020-12-12 14:46:59 -06:00
Logan Allen
386997475b graph-store: no need to iterate through whole list if we find a single duplicate 2020-12-11 18:13:47 -06:00
Logan Allen
78cf4443c2 graph-store: address ted and mark's comments 2020-12-11 18:10:10 -06:00
Logan Allen
e845860e5e graph-store: no-op if we already have *any* of the indexes in an %add-nodes event 2020-12-11 23:05:54 +00:00
Logan Allen
26b9c5a66f graph-store: remove unnecessary clay write upon clobber 2020-12-11 14:53:02 -06:00
Liam Fitzgerald
bce1b3e65e
group-pull-hook: remove group on nack 2020-12-11 14:57:20 +10:00
Liam Fitzgerald
82b668cf3a
graph-store: %node-siblings fixed 2020-12-11 13:05:40 +10:00
Liam Fitzgerald
2b95b308b8
graph-store: simplify node-siblings scries 2020-12-11 12:21:47 +10:00
Liam Fitzgerald
37bb4e9bfe
graph-store: backup overwritten graphs to clay 2020-12-11 11:38:12 +10:00
Liam Fitzgerald
fc189a7c13
graph-store: on overwrite, archive existing graph 2020-12-10 12:36:59 +10:00
Logan Allen
7802a7f8d9 Merge branch 'release/next-userspace' into lf/chat-graph 2020-12-09 15:45:26 -06:00
Joe Bryan
17736990ed arvo: full vane names in $sign 2020-12-07 16:30:22 -08:00
Joe Bryan
5a82f1d4c0 Merge branch 'na-release/candidate' into jb/motion
* na-release/candidate: (36 commits)
  ames: don't crash on forward-lane scry
  jael: cleanup per review
  jael: don't signal breach if first hearing of ship
  pill: update
  vere: compile
  lens: don't de-base64
  vere: make import flow not use base64 encoding
  version: strip trailing newline
  pill: mainnet
  Revert "zuse: change to ropsten"
  chat-hook: fix another poke-import issue
  chat-hook: fix poke-import issue
  apps: reorder maps, sets, and jugs
  apps: reorder maps, sets, and jugs
  kiln: add base-hash and our scries
  lens: fix change lost in merge
  graph-store: leave try-rejoin wire when subscription succeeds
  graphs: import-export
  chat: import/export
  invites: import/export
  ...
2020-12-07 00:27:58 -08:00
Joe Bryan
958bb5acf7 arvo: removes +is and all references to it 2020-12-05 00:51:49 -08:00
Isaac Visintainer
0c3edb1ca9 apps: reorder maps, sets, and jugs 2020-12-02 00:00:03 -08:00
Liam Fitzgerald
3d21dcd19f
Merge branch 'release/next-userspace' into lf/chat-graph 2020-12-02 13:42:02 +10:00
Isaac Visintainer
9ea43121a5 graph-store: leave try-rejoin wire when subscription succeeds 2020-12-01 17:52:24 -08:00
Isaac Visintainer
2f53524e2f graphs: import-export 2020-12-01 17:38:51 -08:00
Liam Fitzgerald
9ee62a2e55
hark: rework unread tracking, again 2020-12-01 15:46:28 +10:00
Liam Fitzgerald
88adb0033a
graph-store: safely peek update-log
Safely returns a null when either the update-log does not exists, or it
is empty

Fixes #3976
2020-11-25 14:41:19 +10:00
Liam Fitzgerald
360d24e11c
hark: add scries for chat 2020-11-24 15:39:53 +10:00
Logan Allen
e7b0ff2c66 graph-store: change atom to %1 for all migrated comments 2020-11-18 20:02:42 -06:00
L
c3c9218083
Merge pull request #3927 from urbit/la/revisions
graph-store: amend %publish and %link validators to allow editing comments
2020-11-18 18:01:13 -06:00
Liam Fitzgerald
5615c10c2b
graph-store: correctly subset in scries 2020-11-17 18:00:29 +10:00
Logan Allen
4f7ca0a0dc graph-store: add overwrite field to %add-graph 2020-11-12 20:40:12 +00:00
Logan Allen
cb990242e8 graph-store: added debugging tool to %validate-graph 2020-11-12 20:19:36 +00:00
Logan Allen
9c9e1160ad graph-store: update %publish and %link schemas, wipe update-logs 2020-11-12 13:47:42 -06:00
matildepark
565fc46660
Merge pull request #3910 from urbit/lf/graph-cleanup
graph-store: run-updates no longer pokes itself
2020-11-10 23:24:24 -05:00
Liam Fitzgerald
5354aae5fa
graph-store: run-updates no longer pokes itself 2020-11-10 15:43:35 +10:00
Liam Fitzgerald
e9d9bb839f Merge branch 'release/next-userspace' into lf/hark-redux 2020-11-03 10:58:52 +10:00
Liam Fitzgerald
f4483fdecb graph-store: update indices of leaf posts 2020-10-30 10:23:08 +10:00
Liam Fitzgerald
5f0855d278 graph-store: update indices in post on migrate 2020-10-30 10:20:35 +10:00
Logan Allen
c0bb44175d Merge branch 'lf/graph-publish-fe' of github.com:urbit/urbit into lf/graph-publish-fe 2020-10-30 00:09:10 +00:00
Logan Allen
27cc2c435d graph-store: indentation fix 2020-10-30 00:09:00 +00:00
Liam Fitzgerald
9c8e1bab2d graph-store: prevent infinite loop 2020-10-30 10:05:59 +10:00
Liam Fitzgerald
b768cd3dd0 graph-store: normalize @da in indices
As links is the only application currently using graph-store, we migrate
all indices to @da instead of a @da or a unix timestamp. Rolls over
current graphs and update log to rectify this. Additionally, applies the
link validator mark to graphs, as this was missing. Fixes a latent bug
in graph-store where the removal of a graph that triggered a mark build
would prevent the mark from being rebuilt. Fixes mark input and index
formatting from the frontend as well.
2020-10-29 14:11:55 +10:00
Liam Fitzgerald
fbf505c0d9 graph-store: mark unmarked graphs 2020-10-29 13:11:18 +10:00
Logan Allen
0eb0ef9479 graph-store: if null timestamp, replace with now 2020-10-28 14:37:26 -05:00
Liam Fitzgerald
e336ad1c77 graph-store: add graph-mark scry 2020-10-21 15:59:39 +10:00
Liam Fitzgerald
fdbf225c66 graph-store: restore @ud encoding 2020-10-05 15:27:26 +10:00
Liam Fitzgerald
ef7bb37f8f Merge branch 'release/next-userspace' into lf/graph-publish-fe 2020-10-01 09:43:34 +10:00
L
f00d476fcb
Merge pull request #3521 from urbit/ted/link
graph import/export generators
2020-09-24 20:06:46 -05:00
Logan Allen
bc9b508d77 Merge branch 'release/next-userspace' into release/link 2020-09-22 15:52:42 -05:00
Ted Blackman
9ee1a1751c :graph-store: remove stray printf 2020-09-21 10:50:03 -04:00
Ted Blackman
d6899857f4 +graph-store/import-graph 2020-09-18 16:50:34 -04:00
Ted Blackman
3c03d61038 +graph-store/export-graph and associated scry handler 2020-09-18 16:21:00 -04:00
Ted Blackman
f334854318 WIP: +graph-export 2020-09-18 15:50:54 -04:00
L
3bf91ddebe
Merge pull request #3458 from urbit/lf/graph-fixes
graph-store: fix signatures & marks
2020-09-16 11:48:54 -05:00
Logan Allen
6c0589e32f Merge branch 'release/next-userspace' into lt/link-migration 2020-09-15 12:42:36 -05:00
Liam Fitzgerald
dd3fd3b6a9 graph-store: allow recursive add-nodes from JSON 2020-09-15 15:32:04 +10:00
Matilde Park
c7f8af1fd2 Merge branch 'release/next-userspace' 2020-09-08 20:32:02 -04:00
Liam Fitzgerald
2c2a61746b graph-store: fix signatures & marks 2020-09-04 15:37:39 +10:00
Matilde Park
ef3b9282c2 various: add [landscape] marker to apps in arvo 2020-08-31 21:54:39 -04:00
Logan Allen
bbf854d956 graph-store: updated scry interface to return %graph-store marks so as to properly do %json conversion 2020-08-27 17:31:36 -05:00
Logan Allen
928e5f7362 graph-hooks: initial sketch 2020-08-19 12:22:20 -07:00
Logan Allen
d7b31680f4 graph-store: moved ~| to within var declarations so crashes don't affect anything else 2020-07-30 15:06:48 -07:00
Logan Allen
871818b241 graph-store: if there is no hash in added node, replace signatures with ~, otherwise check validity of signatures 2020-07-30 15:02:04 -07:00
Logan Allen
7fb50a3f97 graph-store: respond to phil's comments, request %next for clay, and compare +tear to hash 2020-07-30 14:43:40 -07:00
Logan Allen
77bdc63899 graph-store: null scry results are now [~ ~] 2020-07-28 12:32:18 -07:00
Logan Allen
452d6ea4e1 graph-store: fully tested mark validation system 2020-07-28 12:03:09 -07:00
Logan Allen
0a2e721d7f graph-store: move over to +sham from +mug 2020-07-22 13:32:47 -07:00
Logan Allen
c06eb4d8c0 graph-store: removed +mop from sur and added test validator for chat 2020-07-21 17:38:06 -07:00
Logan Allen
6dddcd98e8 graph-store: style fix and fixed mark validation 2020-07-21 16:01:46 -07:00
Logan Allen
65eb56785c graph-store: prevent crashes in %add-nodes based on mug-ordering by making sure smaller indices are added first 2020-07-21 15:57:44 -07:00
Logan Allen
85d086e6d6 graph-store: respond to ted's review 2020-07-21 11:04:18 -07:00
Logan Allen
233b61199d graph: improved type naming 2020-07-07 17:53:18 -04:00
Logan Allen
39933ca848 graph: hooks compile and higher-order mark implementation first-pass 2020-07-06 19:31:57 -04:00
Logan Allen
299b54baa1 graph-view: fix front-end 2020-07-01 12:40:33 -04:00
Logan Allen
ee5e80cf44 graph-store: enforce that only logged-updates may be sent via %run-updates, and enforce that they only affect the intended resource 2020-06-30 14:08:22 -04:00
Logan Allen
849556491c graph-store: updated action-log to update-log and added timestamp to +update 2020-06-29 21:14:55 -04:00
Logan Allen
e4110c4d77 graph-hooks: stubbed out resubscribe on kick case 2020-06-26 20:29:22 -04:00
Logan Allen
e055ba98ae graph-store+view: added a variety of query types for subset fetching, individual post fetching, child fetching, etc 2020-06-26 14:38:11 -04:00
Logan Allen
7443ba6bcb graph-view: accept %json mark and convert to graph-action 2020-06-23 14:09:31 -04:00
Logan Allen
a245a1b095 graph-store: added archiving functionality 2020-06-23 14:01:04 -04:00
Logan Allen
634b0d1175 graph-store: added jet hints and a json conversion path 2020-06-23 14:01:04 -04:00
Logan Allen
f5be1389ef graph-store: fixed nested node scry 2020-06-23 14:01:04 -04:00
Logan Allen
e6e4e370d3 graph-store/view: move all signing out to %graph-view 2020-06-23 14:01:04 -04:00
Logan Allen
d4ff1cf7bc graph-store: turned off signatures for now 2020-06-23 14:01:04 -04:00
Logan Allen
71fda84056 graph: remove extraneous prints 2020-06-23 14:01:04 -04:00
Logan Allen
ec432a5b10 graph: got some things working and fixed an issue introduced by rebase 2020-06-23 14:01:04 -04:00
Logan Allen
90a8df104b graph-store: wrote basic queries 2020-06-23 14:00:15 -04:00
Logan Allen
07cf374462 graph-store: all json encoders/decoders work 2020-06-23 14:00:15 -04:00
Logan Allen
6493c75463 wip: all JSON decoders but %add-graph work 2020-06-23 14:00:15 -04:00