Commit Graph

15020 Commits

Author SHA1 Message Date
drbeefsupreme
ca3140a8b3 hoon: doccord parsing fixes
addressing @Fang- comments on the parser
2022-12-05 17:13:03 -05:00
Philip Monk
4132a00cbf Merge remote-tracking branch 'origin/next/417' into next/417 2022-12-05 14:36:42 -07:00
Philip Monk
4a07be3904 Merge remote-tracking branch 'origin/t/grid-bump-flow' into next/417 2022-12-05 14:36:33 -07:00
Liam Fitzgerald
6841f726a7 metadata-pull-hook: disabling remove on nack 2022-12-05 13:09:30 +10:00
Liam Fitzgerald
e4827915d8 group-pull-hook: disabling remove on nack 2022-12-05 13:08:51 +10:00
Liam Fitzgerald
a4c597d281 graph-pull-hook: do not archive on nack 2022-12-05 11:07:40 +10:00
Joe Bryan
1ac2264a49 test: renames nock-tests to meme-tests 2022-12-02 22:58:07 -05:00
Joe Bryan
7870024df9 test: re-disables failing grq test 2022-12-02 16:56:00 -05:00
Joe Bryan
95a2e06f44 test: re-disables ames decryption test to avoid bail:evil in ci 2022-12-02 16:55:08 -05:00
Joe Bryan
15c4ae7fa7 u3: updates guard-page assertion to account for variable loom sizes 2022-12-02 16:54:27 -05:00
Joe Bryan
5693c965dc u3: protect guard page if necessary after reprotecting loom 2022-12-02 16:39:18 -05:00
Joe Bryan
66c54ad392 u3: protect guard page if necessary after remapping loom 2022-12-02 16:34:34 -05:00
Joe Bryan
e981901b69 Merge branch 'jb/restage/demand' into jb/release/vere 2022-12-02 16:16:33 -05:00
Joe Bryan
ff81dbc62b
Merge pull request #6125 from urbit/jb/ward-safely
u3: ensure a single guard page
2022-12-02 16:13:52 -05:00
Joe Bryan
331c20bb9b
Merge pull request #6121 from urbit/ja/openbsd-7.2-fix
vere: updates whereami dep to support OpenBSD
2022-12-02 16:11:38 -05:00
Joe Bryan
9d34ff6fba
Merge pull request #6108 from urbit/philip/willoc-comment
u3: add comment explaining willoc logic
2022-12-02 15:08:57 -05:00
Zach Alberico
c84fc5d5d0
Merge branch 'next/arvo' into lf/lure 2022-12-02 11:21:48 -08:00
Joe Bryan
62a575f63e u3: switch page size constants to macros to avoid VLAs 2022-12-02 11:55:30 -05:00
Joe Bryan
a7022e75a0 u3: enforce snapshot invariants on segment truncation 2022-12-02 10:27:38 -05:00
Joe Bryan
c111129a5e u3: adds new, batch page tracking implementations + tests 2022-12-02 10:27:35 -05:00
Joe Bryan
d1d1860ac7 u3: cleanup comments about snapshot system limitations 2022-12-02 10:27:32 -05:00
Joe Bryan
fee50375c9 u3: document snapshot system invariants 2022-12-02 10:27:29 -05:00
James Acklin
775e3715ba vere: updates whereami dep to support OpenBSD
fixes urbit/urbit#6100
2022-12-02 08:38:21 -05:00
fang
f8e297c3fc
Merge pull request #6106 from rabsef-bicrym/rb/fix-comment-of-core-in-arvo
Fix Comment: `arvo` comment for `|of` reads `|de`
2022-12-01 23:51:11 +01:00
Hunter Miller
be9e965632 api: bump version and update grid deps 2022-12-01 16:03:31 -06:00
rabsef bicrym
93ef3e8043 arvo: fix |of door comment. 2022-12-01 13:27:36 -08:00
fang
0df6a29b62
Merge branch 'master' into next/arvo 2022-12-01 13:02:15 +01:00
Liam Fitzgerald
02944af669 hoon: add +lure, for turning a singleton into a list 2022-12-01 15:47:04 +10:00
Hunter Miller
7a3066b922 Merge branch 'lf/gladio-2' of github.com:urbit/urbit into lf/gladio-2 2022-11-30 20:15:53 -06:00
Hunter Miller
c3d4c538aa Revert "migration: correcting take-migrate ship"
This reverts commit ec23cc5318.
2022-11-30 20:13:42 -06:00
Hunter Miller
92c6ffa283 Revert "migration: fixing bad @tas"
This reverts commit 81419a8a03.
2022-11-30 20:13:23 -06:00
Hunter Miller
cae675f4d4 Revert "migration: correctly parsing ship"
This reverts commit 173b641df4.
2022-11-30 20:12:23 -06:00
Hunter Miller
feb305b59e Revert "migration: undoing ship/src.bowl change, adding logging to imports"
This reverts commit de1cdcefbb.
2022-11-30 20:12:17 -06:00
Liam Fitzgerald
0f6ae4b74a group-store: fix flag declaration 2022-12-01 11:22:41 +10:00
Tinnus Napbus
3f60cd9f90 eyre: fix %host scry so it still says secure if localhost 2022-12-01 14:17:23 +13:00
Joe Bryan
7ca9ebaa4d u3: updates memory protections and page metadata when moving guard page 2022-11-30 18:24:21 -05:00
Hunter Miller
de1cdcefbb migration: undoing ship/src.bowl change, adding logging to imports 2022-11-30 16:46:47 -06:00
Hunter Miller
173b641df4 migration: correctly parsing ship 2022-11-30 15:31:56 -06:00
Hunter Miller
81419a8a03 migration: fixing bad @tas 2022-11-30 15:26:25 -06:00
Hunter Miller
ec23cc5318 migration: correcting take-migrate ship 2022-11-30 15:20:11 -06:00
Hunter Miller
51262860bb bill: removing notify because contention 2022-11-30 13:47:58 -06:00
drbeefsupreme
f519b4caeb hoon: fix sig rune whitespace to allow doccords
without this, e.g.

~&  %foo
::    dox
1

wouldn't attach dox to 1 as a doccord
2022-11-30 13:39:50 -05:00
tomholford
76dff64b69 grid: address pr feedback
Opting to pause system OTAs also dismisses the notificaiton.
2022-11-29 13:43:56 -08:00
drbeefsupreme
ec74127a43 dprint: dont print (undocumented) on arms
style reasons
2022-11-29 15:22:34 -05:00
drbeefsupreme
0fbdd6808a dprint: refactor some printing logic
for maintainability
2022-11-29 14:23:57 -05:00
Philip Monk
97ef356c2c garden: glob 2022-11-29 12:21:18 -07:00
tomholford
ae0febc832 grid: dismiss Base Blocked notice on Archive 2022-11-29 07:51:57 -08:00
tomholford
d3474705a9 grid: can unsync system OTAs from notifications
When shown the Base Blocked notification, the user can opt to disable
updates so as to continue using out-of-date apps.
2022-11-29 06:31:56 -08:00
tomholford
8239781550 grid: fix tile bullet + suspend notice layout 2022-11-29 05:36:59 -08:00
Liam Fitzgerald
0a555981cc landscape: optionally disable memory mitigations in OTA 2022-11-29 13:25:15 +10:00
Liam Fitzgerald
37339bed31 group-store: cleanup sign handling 2022-11-29 13:17:28 +10:00
Liam Fitzgerald
06a2fe5b69 landscape: crash the event if migration fails 2022-11-29 13:12:10 +10:00
Philip Monk
c23fec3e70 Merge remote-tracking branch 'origin/next/417' into next/arvo 2022-11-28 18:32:05 -07:00
Philip Monk
a90c85023c u3: add comment explaining willoc logic 2022-11-28 16:49:07 -07:00
Philip Monk
4e95a45dab clay: don't clear ford cache on %trim
Most of the memory stays in gall anyway, and this means you need to
recompile everything the next time anything changes, which could be
counterproductive.  It's important that %trim not make things worse.

The functionality is moved to the debug %stir task.
2022-11-28 16:17:41 -07:00
Philip Monk
cb0bbf1e32 clay: don't eagerly build marks
Building the marks adds 50% to the memory requirements for reloading
clay on ~wicdev, from 320MB to 470MB.  This isn't worth it for now.
2022-11-28 16:11:34 -07:00
Philip Monk
38a26041c2 clay: don't add road transitions in clay
These were originally added because they reduced memory usage, primarily
by clearing the memoization cache.  Now that the memoization cache is
no longer used, we use less memory without them.  On ~wicdev-wisryt with
~30 apps, updating Clay now takes ~320MB.
2022-11-28 16:08:41 -07:00
Ted Blackman
35194a6a08
Merge pull request #6102 from urbit/yu/kill-nack-flows
ames, gall: send a %cork if getting a %nack for a %watch
2022-11-28 11:57:07 -06:00
Ted Blackman
da4046a859
Merge pull request #6076 from urbit/yu/remove-num-live
ames: remove num-live from pump-metrics
2022-11-28 11:50:01 -06:00
bacwyls
4a98aa226b zuse: add +moon:title
(addendum to +team change)

address feedback from ~rovnys-ricfer, ~master-morzod,
~ritpub-sipsyl, ~tacryt-socryp, ~wicdev-wisryt, and others.

the original functionality of +team has been split out
between +team:title and +moon:title.

also:
fixes "middle core" and "surface core" comments in title
2022-11-28 11:17:38 -06:00
yosoyubik
a7eee8ae6b Merge branch 'next/arvo' into yu/kill-nack-flows 2022-11-28 17:22:15 +01:00
yosoyubik
403b3eef82 ames, gall: address feedback 2022-11-28 17:21:41 +01:00
fang
42a02074c4
Merge pull request #6101 from urbit/m/debug-dashboard-darkmode
dbug: make sure text is legible in dark mode
2022-11-28 10:48:06 +01:00
Ted Blackman
08c95f2b6f
Merge pull request #5475 from dasrun-fadben/bitcoin-compact-size
bitcoin-utils: Fix parsing of of CompactSize integers
2022-11-27 14:11:06 -06:00
fang
61c1c76570
dbug: make sure text is legible in dark mode
Makes foreground text white by default, if the dark color scheme is
enabled.

Fixes #6013.
2022-11-25 20:56:20 +01:00
fang
3ef5260efc
Merge branch 'next/arvo' into pkova/ruin-comets 2022-11-25 12:20:46 +01:00
Liam Fitzgerald
ce1332565e graph-store: drop signatures 2022-11-25 18:14:53 +10:00
Liam Fitzgerald
8f6366d1c9 landscape: remove testing cruft 2022-11-25 12:32:13 +10:00
~wicrum-wicrun
f988af4555
base-dev: remove +fact-curry from lib/agentio 2022-11-24 13:18:49 +01:00
Liam Fitzgerald
9d0877c219 landscape: support pending state in migration 2022-11-24 15:42:50 +10:00
Liam Fitzgerald
0f7f4d554d graph-store: use standard archive format 2022-11-24 15:16:17 +10:00
Liam Fitzgerald
b76ea6516c graph-store: add thread for recovering archives 2022-11-24 15:12:21 +10:00
Liam Fitzgerald
d9ae7c307b graph-store: standardise archive format 2022-11-24 14:55:02 +10:00
Liam Fitzgerald
ab578c7018 graph-store: nuke groups desk and uninstall 2022-11-24 14:52:03 +10:00
Liam Fitzgerald
a64881ccb2 graph-store: drop archives and backup 2022-11-24 14:41:07 +10:00
Liam Fitzgerald
e41e589367 landscape: add backups to groups 2 migration 2022-11-24 14:21:17 +10:00
Ted Blackman
fc32dde010
Merge pull request #6059 from urbit/ames-verb-fixes
ames: debug print msg formatting fixes
2022-11-23 17:23:16 -06:00
drbeefsupreme
df45bfbf84 hoon: ~master-morzod comments on doccords
TODO items from a pairing session
2022-11-23 17:46:53 -05:00
drbeefsupreme
387ae3e780 hoon: remove +vil
leftover from doccords :: syntax change no longer needed
2022-11-23 14:02:13 -05:00
Joe Bryan
ea6f239811 Merge tag 'urbit-v1.13' into jb/restage/demand
urbit-v1.13

Arvo 417K
Vere 1.13

This release makes the loom variably sized, up to a new maximum of 4GB.
The default remains 2GB -- opt for the max with `--loom 32`.
(NB: larger sizes may require adding swap space.)

Release Notes

- supports setting the loom size on startup. sizes are specified in
  exponents of 2, from 1MB (20) to 4GB (32); can differ between processes
  (`--loom` and `--urth-loom`); and can be set for relevant subcommands
  (`meld`, `pack`, `next`, &c).

- improves bit-slice performance (for noun de/serialization and many atom jets)
  by ensuring that implementation inner loops can be vectorized.

- adds the `vile` command, for exporting the keyfile from a ship

- adds the `%xray` hint, for printing the bytecode of a given expression
  (ty ~topfet-parmed!)

- adds the `eval` command, for running hoon (from stdin) without booting a ship
  (ty ~mopfel-winrux!)

- adds a better error message when a ship is already running as root
  (ty ~dinleb-rambep!)

Contributions:

Joe Bryan (48):
      u3: use size_t in u3m_init()
      u3: normalize home-road stack after snapshot restoration
      u3: refactors custom allocator init for libraries
      bump
      vere: make `prep` and `next` commands non-interactive (no tty required)
      Merge pull request #5928 from urbit/jb/upgrade-no-tty
      u3: remove references to u3a_bits/u3a_bytes/words/pages
      u3: makes loom length configurable
      u3: improves image-related error messages in events
      Merge branch 'master' into next/vere
      u3: suppress bail:evil printf
      Merge pull request #5959 from urbit/jb/silence-evil
      ur: optimizes bitstream bytes-writer implementation
      ur: optimizes bitstream bytes-reader implementation
      Revert "test: move _test_lily into noun_tests"
      u3: rewrites u3r_chop(), optimizing bloq sizes < 5
      u3: removes loom byte-length in favor of recalculation
      Merge pull request #5957 from mopfel-winrux/eval
      vere: style clean for eval cmd
      Merge branch 'jb/hotfix' into jb/fix
      Merge branch 'jb/hotfix' into jb/fix
      Merge branch 'jb/hotfix' into jb/fix
      Merge branch 'jb/hotfix' into jb/fix
      Merge branch 'jb/hotfix' into jb/fix
      Merge tag 'urbit-v1.12' into jb/fix
      Merge commit 'f94875f9ce^2' into jb/release/vere
      Merge commit '264e63330f^2' into jb/release/vere
      u3: backports u3v_soft_peek()
      vere: adds %vile command for extracting keys
      Merge commit '330db284e8^2' into jb/release/vere
      Merge branch 'master' into jb/release/vere
      test: bump loom to 16MB in jam tests
      u3: restages #6001 for release
      u3: adds loom size to u3m_boot() / u3m_boot_lite()
      vere: adds args to set mars/urth looms by binary exponent
      Merge branch 'jb/restage/loom-set' into jb/release/vere
      vere: supports --loom for all relevant subcommands
      Merge branch 'jb/loom-everywhere' into jb/release/vere
      Merge branch 'jb/release/vere' into jb/restage/chop-fast
      u3: bumps maximum reference bits on all platforms
      vere: preserve 2GB defaults for --loom and --loom-urth
      Merge branch 'jb/restage/chop-fast' into jb/release/vere
      Merge branch 'jb/restage/bump' into jb/release/vere
      Merge branch 'jb/fix' into jb/release/vere
      vere: bumps version
      vere: bumps benchmarks to 16MB loom, initializes guard page
      vere: supports --loom in eval cmd
      vere: bumps version

DaneBettis (22):
      Adds %meme and %xray hints.
      adds xray test, reorders tests, fixes sanity checks
      more notes and debugging for xray
      more xray debugs via ~master-morzod
      more xray debugs thanks to ~master-morzod
      partial fix for indexed bytecode args; more to come
      silenced the broken hoon tests
      cleaner expression and docs
      added macro to clarify _slog_bytecode and cleaned hoon hint tests
      first cleanup from meeting with master-morzod
      this branch PR is now for xray only. meme later.
      minimize the diff
      taming int declarations
      docs, tammed ints, better var names, removed redundant funcs
      fixes suggested by master-morzod, and finished int taming
      make _is_indexed() more obvious and less cute
      remove dev-time modifications to manage.c
      WIP stuff re master-morzod
      more refactoring as suggested by master-morzod
      corrected private function names and block comments
      fixed names of vars to follow cvc_TypeLetter style
      simplified xray callsites and rendering

mopfel-winrux (15):
      Added option to run the eval it checks for and prints whatever you pass it as an arguement
      Added basic nock increment evaulation to eval function
      Got basic hoon command compiling and executing
      Fixed a double boot_lite
      Added vase and stack trace wrapper to input, run hoo in virutalization
      added ability to read from stdin rather than being passed an arguement
      changed up how we are executing hoon. This fixes the issue we see with rpevious versions
      cleaned up code
      merged to master fixed conflict in motes.h
      fixed a few of the issues ~master-morzod pointed out
      changed error messages when booting the ivory pill
      changed how the stdin is concatenated. this version should have less memory leaks
      fixed memory leak and cleaned up style
      removed unneeded checks
      Merge branch 'urbit:master' into eval

pkova (1):
      vere: check for permission error on old process kill
2022-11-23 11:24:49 -05:00
Joe Bryan
2e57625e26 Merge tag 'urbit-v1.13' into jb/restage/pread-all
urbit-v1.13

Arvo 417K
Vere 1.13

This release makes the loom variably sized, up to a new maximum of 4GB.
The default remains 2GB -- opt for the max with `--loom 32`.
(NB: larger sizes may require adding swap space.)

Release Notes

- supports setting the loom size on startup. sizes are specified in
  exponents of 2, from 1MB (20) to 4GB (32); can differ between processes
  (`--loom` and `--urth-loom`); and can be set for relevant subcommands
  (`meld`, `pack`, `next`, &c).

- improves bit-slice performance (for noun de/serialization and many atom jets)
  by ensuring that implementation inner loops can be vectorized.

- adds the `vile` command, for exporting the keyfile from a ship

- adds the `%xray` hint, for printing the bytecode of a given expression
  (ty ~topfet-parmed!)

- adds the `eval` command, for running hoon (from stdin) without booting a ship
  (ty ~mopfel-winrux!)

- adds a better error message when a ship is already running as root
  (ty ~dinleb-rambep!)

Contributions:

Joe Bryan (48):
      u3: use size_t in u3m_init()
      u3: normalize home-road stack after snapshot restoration
      u3: refactors custom allocator init for libraries
      bump
      vere: make `prep` and `next` commands non-interactive (no tty required)
      Merge pull request #5928 from urbit/jb/upgrade-no-tty
      u3: remove references to u3a_bits/u3a_bytes/words/pages
      u3: makes loom length configurable
      u3: improves image-related error messages in events
      Merge branch 'master' into next/vere
      u3: suppress bail:evil printf
      Merge pull request #5959 from urbit/jb/silence-evil
      ur: optimizes bitstream bytes-writer implementation
      ur: optimizes bitstream bytes-reader implementation
      Revert "test: move _test_lily into noun_tests"
      u3: rewrites u3r_chop(), optimizing bloq sizes < 5
      u3: removes loom byte-length in favor of recalculation
      Merge pull request #5957 from mopfel-winrux/eval
      vere: style clean for eval cmd
      Merge branch 'jb/hotfix' into jb/fix
      Merge branch 'jb/hotfix' into jb/fix
      Merge branch 'jb/hotfix' into jb/fix
      Merge branch 'jb/hotfix' into jb/fix
      Merge branch 'jb/hotfix' into jb/fix
      Merge tag 'urbit-v1.12' into jb/fix
      Merge commit 'f94875f9ce^2' into jb/release/vere
      Merge commit '264e63330f^2' into jb/release/vere
      u3: backports u3v_soft_peek()
      vere: adds %vile command for extracting keys
      Merge commit '330db284e8^2' into jb/release/vere
      Merge branch 'master' into jb/release/vere
      test: bump loom to 16MB in jam tests
      u3: restages #6001 for release
      u3: adds loom size to u3m_boot() / u3m_boot_lite()
      vere: adds args to set mars/urth looms by binary exponent
      Merge branch 'jb/restage/loom-set' into jb/release/vere
      vere: supports --loom for all relevant subcommands
      Merge branch 'jb/loom-everywhere' into jb/release/vere
      Merge branch 'jb/release/vere' into jb/restage/chop-fast
      u3: bumps maximum reference bits on all platforms
      vere: preserve 2GB defaults for --loom and --loom-urth
      Merge branch 'jb/restage/chop-fast' into jb/release/vere
      Merge branch 'jb/restage/bump' into jb/release/vere
      Merge branch 'jb/fix' into jb/release/vere
      vere: bumps version
      vere: bumps benchmarks to 16MB loom, initializes guard page
      vere: supports --loom in eval cmd
      vere: bumps version

DaneBettis (22):
      Adds %meme and %xray hints.
      adds xray test, reorders tests, fixes sanity checks
      more notes and debugging for xray
      more xray debugs via ~master-morzod
      more xray debugs thanks to ~master-morzod
      partial fix for indexed bytecode args; more to come
      silenced the broken hoon tests
      cleaner expression and docs
      added macro to clarify _slog_bytecode and cleaned hoon hint tests
      first cleanup from meeting with master-morzod
      this branch PR is now for xray only. meme later.
      minimize the diff
      taming int declarations
      docs, tammed ints, better var names, removed redundant funcs
      fixes suggested by master-morzod, and finished int taming
      make _is_indexed() more obvious and less cute
      remove dev-time modifications to manage.c
      WIP stuff re master-morzod
      more refactoring as suggested by master-morzod
      corrected private function names and block comments
      fixed names of vars to follow cvc_TypeLetter style
      simplified xray callsites and rendering

mopfel-winrux (15):
      Added option to run the eval it checks for and prints whatever you pass it as an arguement
      Added basic nock increment evaulation to eval function
      Got basic hoon command compiling and executing
      Fixed a double boot_lite
      Added vase and stack trace wrapper to input, run hoo in virutalization
      added ability to read from stdin rather than being passed an arguement
      changed up how we are executing hoon. This fixes the issue we see with rpevious versions
      cleaned up code
      merged to master fixed conflict in motes.h
      fixed a few of the issues ~master-morzod pointed out
      changed error messages when booting the ivory pill
      changed how the stdin is concatenated. this version should have less memory leaks
      fixed memory leak and cleaned up style
      removed unneeded checks
      Merge branch 'urbit:master' into eval

pkova (1):
      vere: check for permission error on old process kill
2022-11-23 11:24:27 -05:00
Joe Bryan
dac240bdfa vere: bumps version 2022-11-23 10:38:02 -05:00
Liam Fitzgerald
dd04bd8f79 landscape: include club migration 2022-11-23 14:29:40 +10:00
Liam Fitzgerald
bc787310d9 landscape: fix wire consistency in migration 2022-11-23 12:43:11 +10:00
Ted Blackman
99acf3a2c8
Merge pull request #6055 from urbit/jon/lustar-barbuc-lsp
language server: change +* to |$
2022-11-22 19:49:39 -06:00
Philip Monk
c4eb399839
Merge pull request #6094 from urbit/m/jael-broader-subs
jael: send updates to all "general" pubkey subs
2022-11-22 17:27:25 -07:00
Philip Monk
15c5447a05 Merge branch 'philip/agent-clay' into next/arvo 2022-11-22 17:24:15 -07:00
drbeefsupreme
1fed185c29 dprint: refactor +find-item-in-type &co
+find-item-in-type and everything it called was pretty bad spaghetti and
it wasn't clear that it was doing this right thing besides that it
passed tests. this refactors most of that functionality into a door that
has the type and search terms as the sample, and should be much easier
to follow.

the remaining functionality related to arm docs ought to be refactored
as well
2022-11-22 17:59:31 -05:00
fang
95e7b8598e
jael: send updates to all "general" pubkey subs
Subscribing with `[%public-keys ~]` should give updates for all ships we know
about, including moons.
2022-11-22 23:11:39 +01:00
Joe Bryan
2e861dafcf vere: supports --loom in eval cmd 2022-11-22 15:38:15 -05:00
Joe Bryan
670ebc8f8c vere: bumps benchmarks to 16MB loom, initializes guard page 2022-11-22 15:23:29 -05:00
Philip Monk
284043f465 garden: glob 2022-11-21 23:25:16 -07:00
Philip Monk
c136598016 Merge remote-tracking branch 'origin/th/install-system-updates' into philip/agent-clay 2022-11-21 23:20:15 -07:00
Philip Monk
c60e5db6f4 docket: ensure tire stays 2022-11-21 23:17:36 -07:00
Liam Fitzgerald
d5f3374756 landscape: sketch of staggered deployment 2022-11-22 16:09:40 +10:00
tomholford
12a789656c grid: install foreign system updates to local desk
This addresses PR feedback:
https://github.com/urbit/urbit/pull/6093#discussion_r1028798146
2022-11-21 21:52:11 -08:00
Philip Monk
968fec4655 docket: ensure warps start 2022-11-21 22:33:59 -07:00
Philip Monk
d30a6c7a7b garden: glob 2022-11-21 20:40:08 -07:00
Philip Monk
45db57ad3a Merge remote-tracking branch 'origin/th/install-system-updates' into philip/agent-clay 2022-11-21 20:25:48 -07:00
Philip Monk
715c95e742 garden: glob 2022-11-21 20:12:14 -07:00
tomholford
1bd0f4be77 grid: distinguish app sync from system install
By using `%kiln-install` instead of `%kiln-sync` for System Updates, this ensures that the `%kids` desk is also updated.

Also, address UX feedback: render the entire source ship's patp to avoid ambiguity. (as opposed to truncating a moon's name).
2022-11-21 16:10:59 -08:00
drbeefsupreme
1a69393df7 dprint: arms that build cores return core items
this makes it so that when an arm matches a search query in
+find-item-in-type, it checks to see if the arm builds a core with an
arm other than %$. if so, a %core item is returned rather than an %arm
item.

the name of the core will then be considered to be the name of the arm
that builds it
2022-11-21 17:20:28 -05:00
drbeefsupreme
64f64307f3 dprint: +find-item-in-type core name=summary
since cores can't be given names in v0 doccords, this changes the main
search function in lib/dprint to check if the summary of a core
description matches the search term, along with other appropriate
changes downstream of this.

still to be done: use .name in a %core item for either this summary name
or the name of the arm that built the core, if appropriate
2022-11-21 16:04:25 -05:00
Philip Monk
280c1cb19a clay: crash if conflicting agent names 2022-11-21 11:05:55 -07:00
yosoyubik
430233a3de ames, gall: cork flow if getting %nack for %watch 2022-11-21 14:23:19 +01:00
Philip Monk
a600ca0663 clay: don't re-commit %base during kelvin upgrade 2022-11-20 22:06:29 -07:00
Philip Monk
d5ecc3c053 lull: bump to 328 2022-11-20 20:58:39 -07:00
Philip Monk
aacee91e0f arvo: don't assume crud tanks are cells 2022-11-20 20:57:45 -07:00
Philip Monk
1dd993a103 Merge remote-tracking branch 'origin/master' into philip/agent-clay 2022-11-20 18:48:44 -07:00
Philip Monk
8376a759ae clay: make compile 2022-11-20 18:41:00 -07:00
Joe Bryan
6c4b102815 vere: supports --no-demand for all relevant subcommands 2022-11-18 18:38:09 -05:00
Joe Bryan
f40db733ba vere: bumps version 2022-11-18 17:44:46 -05:00
Joe Bryan
efd49ed338 Merge branch 'jb/restage/bump' into jb/release/vere 2022-11-18 17:43:57 -05:00
Joe Bryan
320740c5b9 vere: preserve 2GB defaults for --loom and --loom-urth 2022-11-18 17:41:54 -05:00
Joe Bryan
fd7e84e26d u3: bumps maximum reference bits on all platforms 2022-11-18 17:41:50 -05:00
drbeefsupreme
244d0d2b24 hoon: change apse:docs to parse as a $note
this is to handle potential future cases where doccords might be kinds
of notes other than %help notes. example: #6085 to document invariants
in clay.

$whit (used for apex:docs/batch comments) also ought to be changed but
im still thinking about what that should look like.
2022-11-18 13:53:10 -05:00
Joe Bryan
f78e6a5447 Merge branch 'jb/release/vere' into jb/restage/chop-fast 2022-11-18 10:41:23 -05:00
Joe Bryan
0f7feef5c7 vere: adds --no-demand argument to disable demand paging 2022-11-18 00:11:21 -05:00
Joe Bryan
b102cbb908 u3: adds printf ("live: mapped ...") for demand paging 2022-11-18 00:08:55 -05:00
Joe Bryan
1b5e808ec5 u3: implements full demand paging for the home-road heap 2022-11-18 00:07:23 -05:00
Joe Bryan
a04521585c u3: coalesces memory protection when saving a snapshot 2022-11-18 00:03:13 -05:00
Joe Bryan
0682cc2864 u3: refactors _ce_loom_blit_north(), replacing loop with a single read 2022-11-18 00:00:27 -05:00
Joe Bryan
0959bb60f3 u3: coalesces memory protection when loading a snapshot 2022-11-17 23:58:39 -05:00
Joe Bryan
622f86e714 u3: misc cleanup of snapshot system
corrects comments
removes dead code
makes page and offset calculations more consistent
improves error messages
2022-11-17 23:46:52 -05:00
Joe Bryan
97e7a14123 u3: restages #6062 for release 2022-11-17 23:44:12 -05:00
Joe Bryan
5c3daa265d Merge branch 'jb/loom-everywhere' into jb/release/vere 2022-11-17 22:41:25 -05:00
pkova
2300d4fbcb vere: check for permission error on old process kill 2022-11-17 22:30:53 -05:00
Philip Monk
45b5257c04 clay: document [tare] invariant 2022-11-17 19:32:40 -07:00
Joe Bryan
255c08f53d vere: supports --loom for all relevant subcommands 2022-11-17 20:42:48 -05:00
Joe Bryan
12a7fae0b5 vere: adds args to set mars/urth looms by binary exponent 2022-11-17 19:54:21 -05:00
Philip Monk
8255dcd4bd clay: document [goad] invariant 2022-11-17 17:45:19 -07:00
Philip Monk
54c2b652e5 clay: document [wick] invariant 2022-11-17 17:30:06 -07:00
Philip Monk
3ec3516ccb clay: document [ergo] invariant 2022-11-17 17:19:02 -07:00
Philip Monk
df130fc015 clay: document [wake] invariant 2022-11-17 16:47:56 -07:00
Joe Bryan
7ae6005f87 u3: adds loom size to u3m_boot() / u3m_boot_lite() 2022-11-17 17:44:16 -05:00
Joe Bryan
0f0ab948f1 u3: restages #6001 for release 2022-11-17 17:39:09 -05:00
Joe Bryan
3fe55a9f84 test: bump loom to 16MB in jam tests 2022-11-17 15:46:29 -05:00
Joe Bryan
1c6aba94f2 Merge branch 'master' into jb/release/vere 2022-11-17 15:38:11 -05:00
Joe Bryan
5841d97832 Merge commit '330db284e8^2' into jb/release/vere 2022-11-17 14:57:59 -05:00
Joe Bryan
31b9a4b470 vere: adds %vile command for extracting keys 2022-11-17 14:57:05 -05:00
Joe Bryan
4d57c3c9a0 u3: backports u3v_soft_peek() 2022-11-17 14:57:04 -05:00
Joe Bryan
d0dc3e7710 Merge commit '264e63330f^2' into jb/release/vere 2022-11-17 14:36:01 -05:00
yosoyubik
012c1e19bf ames: don't use num-live from pump-metrics 2022-11-17 08:38:50 -08:00
yosoyubik
8bb969c2ec Revert "ames: remove num-live from pump-metrics"
This reverts commit b2a0f2fd304f961e4db89499aedefe0be95e6239.
2022-11-17 08:38:50 -08:00
yosoyubik
8709476ccd dbug: num-live counts number of packets in flight 2022-11-17 08:38:50 -08:00
yosoyubik
a3e8607cb1 ames: remove num-live from pump-metrics 2022-11-17 08:38:50 -08:00
yosoyubik
4b0c1fab3b ames: count in flight packets in packet pump
num-live is still used—the state update will be addressed later, as well as the update in %lull
2022-11-17 08:38:50 -08:00
yosoyubik
24e047b1eb tests: fix gall request / ames flow killing test
The faliing test was expecting ames to give a %done to %gall
but https://github.com/urbit/urbit/pull/5977, changed that,
so %ames doesnt give %done for %cork acks.
2022-11-17 13:49:22 +01:00
drbeefsupreme
06a7daa16f hoon: change %dict spec to %gist
no semantic changes. %dict was a temporary name
2022-11-16 10:58:10 -05:00
fang
2027907db5
Merge branch 'master' into next/arvo 2022-11-16 16:11:53 +01:00
drbeefsupreme
618fc0fe5a Merge branch 'next/arvo' into jon/doccords 2022-11-15 18:34:10 -05:00
drbeefsupreme
c11d11e415 deco: revision to account for :: doccords syntax
see 2d5b29c73b
2022-11-15 18:25:57 -05:00
drbeefsupreme
f4a84caf30 hoon, dprint: remove |% and |@ core names
partial revert of 3d3ea61d53, which introduced core names by completing
an unimplemented feature that was already present in hoon.hoon. we've
decided to remove this for the initial launch since it violates the
principle of least surprise for the name of a core to end up in its
$garb and yet only be used for doccords, as opposed to something like a
wing resolution. it was also confusing that this only worked for |% and
|@.

this breaks two of the tests for the dprint library, which have been
commented out. these tests ought to be restored once dprint is rewritten
in order to implement a different way to refer to cores not built by arms
2022-11-15 18:25:57 -05:00
drbeefsupreme
bd69f09285 gen: add todo item to +help for doccords 2022-11-15 18:25:57 -05:00
drbeefsupreme
5fc3b3fd0f hoon, dprint: change doccords syntax to ::
this constitutes a pretty major rework of how whitespace is handled in
hoon in order to change the doccords syntax from :> and :< to ::.

in summary: throughout the hoon parser (+vast) many instances of +gap
have been replaced by +jump, which first tries to remove whitespace (+leap)
until it arrives at something that can be parsed as a prefix
doccord (+apex:docs:vast). if it does not encounter a doccord, it
instead uses +gap as normal.

if you follow along with the parser, you will notice that every time
jump is called, it then tries to call +apex:docs via +scye or +seam. if
apex:docs succeeds, it will end up consuming a newline at the end,
hiding the fact that there was valid whitespace from the parser. thus
+apex:docs then inserts a newline after successfully parsing a prefix
doccord, which will then be consumed by a subsequent invocation of +gap,
ensuring that there was proper whitespace if the doccord would have been
consumed by +gap instead of +leap.

there are a few other changes:

+hint in the compiler throws out doccords attached to %noun types. this
was already the behavior before doccords, and the change was made before
i understood what i was doing.

similarly for commenting out the %note case in +open:ap - this was an
earlier mistake

postfix comments for chapters are now enabled.

+expx was unused and removed in order to be rid of the
convention-defying +exp1. other unused +ex(p/q)* were commented out.

arms that handle batch comments (+glow and +whap) were refactored

+toad, which was used to change between tall and wide form, tries to
+jump before +gap. since +jump is ;~(pose leap:docs gap), i would have
thought that just using +jump there would be fine, but it fails for some
reason.

some parsers built with |@ were rewritten to use |*

|$ was made so that any doccords put on the spec are converted into hoon
doccords on the $ arm. it wouldn't compile otherwise. there's probably a
more principled way to do this but it works fine for now.
2022-11-15 18:25:29 -05:00
Joe Bryan
12196d1113 Merge tag 'urbit-v1.12'
urbit-v1.12

Arvo 417K
Vere 1.12

This is a hotfix release, fixing another memory corruption vulnerability
introduced in v1.10 and improving snapshot durability.

Release Notes

- restores the guard page (preventing road stack overflow) after |meld
- improves snapshot error handling and messaging
- fixes an overflow bug affecting jammed scry output (-X)

Contributions:

Joe Bryan (16):
      u3: protect guard page in u3e_yolo()
      vere: bumps version
      u3: assert guard page invariants when saving snapshot
      u3: initialize guard page in u3m_boot_lite()
      vere: bumps version
      nix: update linux-aarch64 overlay to exclude macos m1
      u3: handle partial reads in snapshot system
      u3: handle partial writes in snapshot system
      u3: print mprotect errors in snapshot system
      u3: print error msg if system page size is incompatible
      u3: detect snapshots from a larger loom, print and exit
      u3: normalize home-road stack after snapshot restoration
      u3: handle and print lseek errors in snapshot system
      u3: print errors while deleting snapshot patch
      vere: bumps version
      vere: bumps version

Liam Fitzgerald (1):
      pier: fix jamming archive
2022-11-15 14:43:12 -05:00
Joe Bryan
d07e31ac60 vere: bumps version 2022-11-15 14:07:27 -05:00
zalberico
9da139dada Fix typo setings -> settings 2022-11-15 09:47:13 -08:00
jose
1b4f045499
Merge pull request #6046 from urbit/lf/fix-cork
ames: prevent crashes when corking an alien flow
2022-11-15 08:43:46 +01:00
Joe Bryan
215f6ce650 vere: bumps version 2022-11-14 23:30:29 -05:00
Joe Bryan
58805b8cef u3: print errors while deleting snapshot patch 2022-11-14 23:18:43 -05:00
Joe Bryan
284addf159 u3: handle and print lseek errors in snapshot system 2022-11-14 23:15:11 -05:00
Joe Bryan
4f5f7e2804 u3: normalize home-road stack after snapshot restoration 2022-11-14 23:15:10 -05:00
Joe Bryan
2a1a707900 u3: detect snapshots from a larger loom, print and exit 2022-11-14 23:15:10 -05:00
Joe Bryan
4c930162e0 u3: print error msg if system page size is incompatible 2022-11-14 23:15:10 -05:00
Joe Bryan
adc058724c u3: print mprotect errors in snapshot system 2022-11-14 23:15:10 -05:00
Joe Bryan
6ea0af456e u3: handle partial writes in snapshot system 2022-11-14 23:15:10 -05:00
Joe Bryan
72eb04bf51 u3: handle partial reads in snapshot system 2022-11-14 23:15:10 -05:00
Philip Monk
57be9e28bc clay: light cleanup 2022-11-14 16:12:20 -07:00
Philip Monk
c382eb14f9 clay: call +tare when tire might have changed 2022-11-14 14:59:44 -07:00
Joe Bryan
e8879fb5ab vere: bumps version 2022-11-14 14:10:02 -05:00
Liam Fitzgerald
e1e0ca76d8 pier: fix jamming archive 2022-11-14 13:53:43 -05:00
Joe Bryan
6dea612849 u3: initialize guard page in u3m_boot_lite() 2022-11-14 13:38:50 -05:00
Joe Bryan
f7275b6e67 u3: assert guard page invariants when saving snapshot 2022-11-14 13:38:46 -05:00
Joe Bryan
196bb4ae1f vere: bumps version 2022-11-13 20:27:19 -05:00
Joe Bryan
95650edb3a u3: protect guard page in u3e_yolo() 2022-11-13 20:26:50 -05:00
Joe Bryan
ca6bf97bcf Merge tag 'urbit-v1.11'
urbit-v1.11

Arvo 417K (zuse+417, lull+328)
Vere 1.11

This is a hotfix release, fixing a memory corruption vulnerability
introduced in v1.10, and including official aarch64 binaries.

Release Notes

- repositions the guard page (preventing road stack overflow) on inner roads
- decrements %lull and %zuse kelvins, in preparation for a pending arvo release
- adds support for static aarch64 binaries
- cleans up the terminal on exit when booting a fake ship

Contributions:

Bradley (2):
      vere: changed to use u3_king_bail instead of manual term clean up
      vere: removed unnecessary exit(1) call

Bradley Ray (1):
      vere: clean up terminal on invalid fake ship name

Joe Bryan (11):
      u3: reposition guard page if needed for new roads
      test: initialize guard page in jam-tests
      vere: decrement %lull and %zuse kelvins
      Merge commit 'ac5842fd6e' into jb/hotfix
      vere: bumps version
      build: add aarch64 via buildjet
      build: run unit tests early on linux
      build: run unit tests on windows
      build: updated gcp configuration for buildjet runner
      build: renames "nightly" pace from "often" to "edge"
      vere: bumps version

~botter-nidnul (1):
      nix: enable aarch64-linux platform string
2022-11-11 15:49:58 -05:00
Joe Bryan
0885c23f80 vere: bumps version 2022-11-11 13:01:55 -05:00
~botter-nidnul
a1a2be47fe nix: enable aarch64-linux platform string 2022-11-11 10:43:38 -05:00
tomholford
0d25ac2464 ux: clearer button label
This addresses feedback from the Design team: what is being Unsynced?

Thanks @urcades!
2022-11-11 00:54:23 -08:00
Joe Bryan
efa6477445 vere: bumps version 2022-11-10 18:58:00 -05:00
Joe Bryan
f807699b08 Merge commit 'ac5842fd6e' into jb/hotfix
includes #5915 in hotfix release
2022-11-10 18:29:51 -05:00
Joe Bryan
2a8cc154ce vere: decrement %lull and %zuse kelvins 2022-11-10 18:26:59 -05:00
Joe Bryan
eb7c289ded test: initialize guard page in jam-tests 2022-11-10 13:50:53 -05:00
Joe Bryan
4a5b56eff5 u3: reposition guard page if needed for new roads
this works around a bug wherein the guard page
could become nonoperable if it happened to coincide
with the padding between inner roads
2022-11-10 13:26:07 -05:00
ryjm
82148b0528 kiln: fil and dir not ~ 2022-11-10 02:20:26 -05:00
yosoyubik
3b5110ed1d ames: enqueue %cork in alien-agenda 2022-11-09 16:05:45 +01:00
ryjm
f2577efe42 kiln: indentation 2022-11-08 23:56:54 -05:00
tomholford
53531eaf10 kiln: update %kiln-bump poke and mark 2022-11-08 03:32:32 -08:00
tomholford
6332a8c4e2 grid: remove unused kiln/state logic 2022-11-07 23:58:03 -08:00
tomholford
3c84f0fe1e grid: sync / unsync OTA source in System Prefs 2022-11-07 23:56:49 -08:00
tomholford
5846d0e0ba grid: sync / unsync App Preferences 2022-11-07 23:23:08 -08:00
tomholford
fd0c072c12 kiln: add sync / unsync marks 2022-11-07 23:22:31 -08:00
tomholford
2887008487 prefs: use sync.pike to discern if OTAs enabled
Also, remove the conditional rendering logic for AppPrefs. With the new logic (and before this change) if the User disables OTAs, the toggle would disappear, which feels like an antipattern.
2022-11-07 17:52:13 -08:00
Tinnus Napbus
d3c2c734e3 ames: debug print msg formatting fixes
- fix `fragment-num` and `num-fragments` having duplicate faces
- fix faces being wrapped around wrong things in various places
- fix `bone` not being printed in "hear last in-progess" message
- make pretty tape interpolation style more uniform
2022-11-07 21:46:15 +13:00
Liam Fitzgerald
bc535a5683 landscape: fix broken migration 2022-11-07 13:35:51 +10:00
Liam Fitzgerald
11be7d59d2 landscape: rework migration slightly 2022-11-07 12:02:15 +10:00
ryjm
586c24a5f2 kiln: combine toros 2022-11-06 01:18:40 -05:00
ryjm
ed2d30b65e kiln: recursive |rm
Increments the commit number every time, is there a better way to do
this?
2022-11-06 00:58:45 -04:00
ryjm
69f074bdb2 hood: recursive |tomb and |tomb-lobe
Latter uses %tomb %lobe instead of %worn.
2022-11-05 22:16:56 -04:00
tomholford
d99dc3e3ab devex: update zest.pike comment
Also remove errant gitignore update
2022-11-05 01:45:57 -07:00
drbeefsupreme
3c431baf4b language server: change +* to |$
This old use of +* was deprecated by |$
2022-11-04 19:04:42 -04:00
Patrick O'Sullivan
0254997533 Groups/Garden: Add S3 region to s3 settings 2022-11-04 16:04:22 -05:00
tomholford
a4a022f006 grid: remove deprecated Vats state + helpers 2022-11-04 00:21:03 -07:00
tomholford
842da7e60b grid: SystemMenu consumes pike 2022-11-04 00:20:33 -07:00
tomholford
822957bf94 grid: TreatyInfo consumes pike 2022-11-04 00:20:16 -07:00
tomholford
a514be3142 api: remove deprecated Vats helpers 2022-11-04 00:19:38 -07:00
tomholford
8400992c1d grid: PermalinkRoutes consumes pike 2022-11-04 00:11:06 -07:00
tomholford
302a7483ea grid: SystemUpdatePrefs consumes pike 2022-11-04 00:09:12 -07:00
tomholford
41a7c14b88 grid: Tile consumes pike 2022-11-04 00:07:25 -07:00
tomholford
0584103bee grid: clean up kiln state initialization 2022-11-04 00:05:43 -07:00
tomholford
f8e4ec8915 grid: OnboardingNotification consumes pike 2022-11-03 23:46:55 -07:00
tomholford
11445e2882 grid: AppInfo consumes pike 2022-11-03 23:37:19 -07:00
tomholford
84ea05f17b grid: SystemNotifications consumes pike 2022-11-03 23:21:04 -07:00
tomholford
8293c54dc1 grid: AppPrefs consumes pike 2022-11-03 22:58:12 -07:00
tomholford
2cff3f9f71 grid: kiln-bump poke no longer takes args 2022-11-03 22:35:41 -07:00
tomholford
965db2fff3 kiln: bump poke no longer takes args 2022-11-03 22:34:39 -07:00
tomholford
bb97306432 grid: consume Pike interface and scry 2022-11-03 22:19:36 -07:00
tomholford
31ed4bee6c api: add Pike interfaces and scry 2022-11-03 22:18:58 -07:00
tomholford
4392c00b3b pikes: fix scry 2022-11-03 10:04:36 -07:00
Liam Fitzgerald
0e16d82a46 wip 2022-11-03 12:50:51 +10:00
Philip Monk
da15339c3b Merge remote-tracking branch 'origin/lf/agent-clay-fe' into philip/agent-clay 2022-11-01 22:08:56 -07:00
bacwyls
2b9563f859 zuse: change team:title to return false for moons
in the past, +team meant "our / our moon", but
it has been primarly used to represent "our"

moons as having the full permissions of their
parents doesn't make a lot of sense anymore

this looks like the more elegant solution
instead of changing each instance of +team

I've combed through the uses of +team throughout
urbit/urbit and I'm quite sure that each instance
is better off as just "our"
2022-11-01 17:03:35 -05:00
Liam Fitzgerald
26aac7581a ames: prevent crashes when corking an alien flow
The +on-cork handler asserts that the peer is known to us. This is the
incorrect behaviour, because it will crash when corking a flow to a peer
that is still an %alien. This can happen, for instance, when making a
gall subscription for the first time and then corking it before the
alien naturalises.
2022-11-01 15:50:10 +10:00
Liam Fitzgerald
db34d0cfc8 migrate: fix agent name 2022-10-31 15:41:47 +10:00
Philip Monk
ebf09bd248 clay: defer all calls to %wick 2022-10-26 22:09:53 -07:00
Jared Tobin
7bffd0dd55
jets: patch u3di_apt to match changes in b0dedeec 2022-10-27 08:50:13 +04:00
Jared Tobin
3c0279af05
tests: add +apt:in test for set w/dupes 2022-10-27 08:50:13 +04:00
dachus
b0dedeecfe fix 2022-10-26 11:26:23 -06:00
Liam Fitzgerald
44fe459f6d roller: fix mint-lost 2022-10-26 13:58:36 +10:00
Liam Fitzgerald
ed96e6162c arvo: retool for goerli instead of deprecated ropsten 2022-10-26 13:11:22 +10:00
Liam Fitzgerald
53621ecb98 landscape: migration scripts for heap & dms 2022-10-25 15:20:40 +10:00
Liam Fitzgerald
5e89835c5d landscape: migration works for chat/groups 2022-10-25 13:49:25 +10:00
Liam Fitzgerald
f7e550b1f4 landscape: sketch migration scripts 2022-10-25 13:21:28 +10:00
Philip Monk
301158c40a clay: use single-weft wafts when possible 2022-10-23 14:52:32 -07:00
Philip Monk
096d54f9fc kiln: fix bug in |rein 2022-10-17 21:38:45 -07:00
Philip Monk
4490e98470 clay: move goads into wick 2022-10-17 21:16:54 -07:00
Philip Monk
5f5878cf6f clay: add %stay, which removes commit-in-waiting 2022-10-17 20:20:22 -07:00
Philip Monk
871cfba8f0 kiln: if installing local, start immediately 2022-10-17 19:48:41 -07:00
Philip Monk
5b5af59539 zuse: bump kelvin to 417 2022-10-17 19:38:21 -07:00
pkova
708c95b6b2 ames: correct %ruin comet logic 2022-10-17 23:05:49 +03:00
Philip Monk
8ba63236d8 Merge remote-tracking branch 'origin/jb/gall-mass' into philip/agent-clay 2022-10-13 22:17:24 -07:00
Philip Monk
fb2919594f tests: make pass 2022-10-13 22:14:12 -07:00
Philip Monk
21acf4fdb5 Merge branch 'pr' into philip/agent-clay 2022-10-13 22:02:45 -07:00
Philip Monk
0d34def21c Merge branch 'pr' into philip/agent-clay 2022-10-13 21:57:04 -07:00
Philip Monk
846dda88b4 Merge remote-tracking branch 'origin/m/ames-no-stale-forwards' into philip/agent-clay 2022-10-13 21:42:58 -07:00
Philip Monk
4f5600df15 clay: don't cast in +stay 2022-10-13 21:42:36 -07:00
Philip Monk
8e2ab9e926 dojo: remove commented code 2022-10-13 21:17:39 -07:00
Philip Monk
653a86bd55 Merge branch 'pr' into philip/agent-clay 2022-10-13 21:06:15 -07:00
Philip Monk
7ec89cbac1 Merge remote-tracking branch 'origin/jon/fix-naive-tests' into philip/agent-clay 2022-10-13 21:01:54 -07:00
Philip Monk
fc70193ef6 Merge remote-tracking branch 'origin/next/arvo' into philip/agent-clay 2022-10-13 20:54:00 -07:00
Philip Monk
de76b70286 Merge remote-tracking branch 'origin/tinnus/eyre-https-redirect' into philip/agent-clay 2022-10-13 20:52:10 -07:00
Philip Monk
f0f9e4644a Merge remote-tracking branch 'origin/jb/static-nock' into philip/agent-clay 2022-10-13 20:47:49 -07:00
Philip Monk
478da3b77b clay: support ranges in sys.kelvin 2022-10-13 20:36:33 -07:00
Philip Monk
2cc6abbf78 Merge remote-tracking branch 'origin/tinnus/fix-story-printing' into philip/agent-clay 2022-10-13 20:05:40 -07:00
Philip Monk
ca8249a0be clay: rename %next -> %held 2022-10-13 19:27:50 -07:00
Philip Monk
79f520c56c Merge remote-tracking branch 'origin/master' into philip/agent-clay 2022-10-13 18:42:19 -07:00
Philip Monk
f01f046af3 clay: add verbose output to goad 2022-10-08 22:50:44 -07:00
Philip Monk
2317933e00 docket: don't report charges which are %dead with no agents 2022-10-08 22:22:40 -07:00
Liam Fitzgerald
5eb499186d kiln: add $pikes scry 2022-10-06 18:46:45 -04:00
Liam Fitzgerald
66127d6ae9 kiln: fix behaviour on installing local desk
Sends a %zest when a local desk is asked to be installed on itself, i.e.
the remote and local desk are the same.
2022-10-06 18:05:27 -04:00
Philip Monk
2829f5b354 clay: allow old kelvins on best-effort basis
also add back |bump, with no arguments
2022-10-04 23:57:37 -07:00
pkova
3d8772bde4 jael: remove TODO, fix comment 2022-10-03 17:27:52 +03:00
pkova
dd764c120e Merge branch 'next/arvo' into pkova/ruin-comets 2022-10-03 17:11:39 +03:00
pkova
1d73558163 ames: ruin comets not seen for six months 2022-10-03 17:03:49 +03:00
Tinnus Napbus
cd6432aa86 Merge remote-tracking branch 'origin/tinnus/eyre-https-redirect' into tinnus/eyre-https-redirect 2022-10-01 22:35:24 +13:00
Tinnus Napbus
0fad85b3d0 eyre: change (cury cat 3) to rap in https redirect 2022-10-01 22:31:59 +13:00
Tinnus Napbus
7e59a66fdf story: fix story printing
`+story-list` produced janky indentation because the `$-(story
wain)` functions encoded linefeeds in the cords of the wain and the
printer doesn't like this.

Story printing functions have been changed to produce pure wains without
linefeeds.
2022-10-01 22:21:45 +13:00
Joe Bryan
0959716ad8 vere: style clean for eval cmd 2022-09-30 20:44:38 -04:00
Joe Bryan
a13e832ecc
Merge pull request #5957 from mopfel-winrux/eval
Added hoon eval option to Urbit Binary
2022-09-30 20:27:38 -04:00
Amadeo Bellotti
696c5048ca removed unneeded checks 2022-09-29 19:53:55 -04:00
Amadeo Bellotti
f949bceea9 fixed memory leak and cleaned up style 2022-09-29 16:47:26 -04:00
dr-frmr
7563937e1f get full userspace desk 2022-09-29 14:43:31 -06:00
dr-frmr
29c10540aa make %swap-files poke use file-ovum properly 2022-09-29 14:29:28 -06:00
Amadeo Bellotti
c72a5dfc97 changed how the stdin is concatenated. this version should have less memory leaks 2022-09-29 13:04:03 -04:00
Amadeo Bellotti
94dd977f79 changed error messages when booting the ivory pill 2022-09-29 11:51:04 -04:00
tinnus-napbus
e481aded3c
Update pkg/arvo/sys/vane/eyre.hoon
Co-authored-by: fang <git@fang.io>
2022-09-29 13:32:32 +13:00
tinnus-napbus
66f543289d
Update pkg/arvo/sys/vane/eyre.hoon
Co-authored-by: fang <git@fang.io>
2022-09-29 13:32:18 +13:00
tinnus-napbus
387b48bed6
Update pkg/arvo/sys/vane/eyre.hoon
Co-authored-by: fang <git@fang.io>
2022-09-29 13:32:07 +13:00
tinnus-napbus
c0e2974678
Update pkg/arvo/sys/vane/eyre.hoon
Co-authored-by: fang <git@fang.io>
2022-09-29 13:31:47 +13:00
Tinnus Napbus
ac1dac0c6c eyre: simplify auto-https logic 2022-09-24 21:52:34 +12:00
Joe Bryan
9df08c5e72 ames: ignore pki nponsorship loss 2022-09-22 10:38:39 -04:00
Joe Bryan
ef9b5822fa u3: removes loom byte-length in favor of recalculation 2022-09-21 11:04:15 -04:00
janeway-bot
77842f01ee groups: [skip actions] update glob (0v7.2rpmd.966js.dt2sj.ggv4a.n15nq) 2022-09-20 09:06:47 -07:00
Hunter Miller
01858a4669 groups: fixing build 2022-09-20 10:55:39 -05:00
Hunter Miller
68a350ea5a Merge branch 'master' into next/groups 2022-09-20 10:02:52 -05:00
Joe Bryan
182e8813d0 u3: rewrites u3r_chop(), optimizing bloq sizes < 5 2022-09-20 09:36:17 -04:00
Joe Bryan
8946164b96 Revert "test: move _test_lily into noun_tests"
This reverts commit 5825cbde71.
2022-09-20 09:36:17 -04:00
Joe Bryan
dbda9ed30c ur: optimizes bitstream bytes-reader implementation 2022-09-20 09:36:11 -04:00
Joe Bryan
29bce64669 ur: optimizes bitstream bytes-writer implementation 2022-09-20 09:36:06 -04:00
fang
1c36ad129d
webterm: avoid needless %blew tasks
Any change to the session object was triggering this. But that now includes
an "unacked keystrokes" counter, which updates frequently, and we
definitely don't want to send resize notifications in that case.
2022-09-17 10:38:04 +02:00
fang
bdf9f9d044
Merge pull request #5929 from urbit/jon/remove-dork
clay: remove $dork
2022-09-15 22:23:56 +02:00
fang
92d1b4c300
Merge pull request #5990 from xiphiness/patch-2
dojo dir validation: %ct scry at case da+now if imaginary case 0
2022-09-15 22:23:09 +02:00
fang
16f78af00a
Merge pull request #5982 from urbit/m/eyre-head-down
eyre: look for lowercase last-event-id header
2022-09-15 22:22:32 +02:00
fang
6abe91cd9c
Merge pull request #5808 from dnmfarrell/dnmfarrell/arvo-test-dont-require-a-list
pkg: -test shouldn't require a list of paths
2022-09-15 22:20:15 +02:00
Philip Monk
3eda93cac3
Merge pull request #5360 from urbit/m/new-desk
gen: add |new-desk for creating minimal desks
2022-09-15 11:20:31 -08:00
Edward Amsden
105710d54e
clay: remove stack tracing 2022-09-14 19:28:17 -05:00
Edward Amsden
4f8c851ef7
Don't print a stack trace for read-at-aeon-fail
We shouldn't get a clay stack trace for read-at-aeon-fail because that gives us miles of clay stack trace whenever hoon compilation fails
2022-09-14 19:26:21 -05:00
Philip Monk
77319d20c4 clay: fix kelvin upgrade issues 2022-09-14 01:04:13 -08:00
Philip Monk
44074ad33b tests: make pass 2022-09-13 17:52:32 -08:00
Philip Monk
c3f5fe923a docket: update to use tire instead of kiln 2022-09-13 16:14:43 -08:00
Liam Fitzgerald
06fc1897b7 @urbit/http-api: update version number 2022-09-13 13:00:30 -05:00
Liam Fitzgerald
6756d5768d @urbit/http-api: update version number 2022-09-13 12:56:47 -05:00
Patrick O'Sullivan
b7abdea619
Update pkg/npm/http-api/src/Urbit.ts
Co-authored-by: Hunter Miller <hunter@tlon.io>
2022-09-13 11:44:31 -05:00
matildepark
400a437b08 http-api: authenticate doesn't enforce insecure connections
Instead of forcing people to connect over http://, fall back gracefully to http if no protocol is given.

This fixes an issue where external clients can't use this method, since SameSite cookies need to be secure as per https://web.dev/samesite-cookies-explained/#samesite=none-must-be-secure
2022-09-13 11:27:38 -05:00
Patrick O'Sullivan
ac6ef65a87 Merge branch 'master' into next/npm 2022-09-13 11:26:22 -05:00
Patrick O'Sullivan
aaebd9c01b npm: bump http-api version number 2022-09-13 10:33:12 -05:00
Philip Monk
c46fb686ff kiln: remove resolve XX's 2022-09-12 20:51:39 -08:00
Philip Monk
4ae324849f kiln: remove |bump 2022-09-12 20:29:59 -08:00
Philip Monk
f61d16965a kiln: fix +vat,+vats 2022-09-12 20:22:22 -08:00
Liam Fitzgerald
3f2d7333e6 garden: fix broken treaty JSON
For some reason, a %uv case was added to the JSON serialiser for $case.
$case has no such case in the union, and so this does not make sense.
2022-09-12 15:55:54 -05:00
Patrick O'Sullivan
08f0e4c281
Merge pull request #5993 from urbit/po/return-rejected-promise-for-scry
http-api: If scry fails, return reject response
2022-09-12 14:23:42 -05:00
Patrick O'Sullivan
f5a8d8e937 http-api: If scry fails, return reject response 2022-09-12 09:45:01 -05:00
Amadeo Bellotti
5ae2b48350 fixed a few of the issues ~master-morzod pointed out 2022-09-12 09:02:13 -04:00
Philip Monk
18b65a973f kiln: fix |ota and installing locally 2022-09-07 22:45:11 -08:00
Philip Monk
c82b7c4ff2 kiln: fixes 2022-09-07 22:38:35 -08:00
Philip Monk
0d757b4436 kiln: migrate previous OTA state 2022-09-07 21:56:12 -08:00
fang
50ee2eb1c0
Merge pull request #5951 from urbit/pkova/dns-race
dns-address: subscribe before poke and fix wire mismatch
2022-09-07 19:41:14 +02:00
Philip Monk
1102288d75 kiln: remove old |sync, various fixes 2022-09-06 22:52:59 -08:00
xiphiness
2bc2d5a1bb
dojo dir validation: %ct scry at case da+now if imaginary case 0
PR #5840 mostly fixed #1559, but introduced a new bug. before, you could safely `=dir` into a desk without a case, and it would use the nonexistent case `ud+0` as the beam for dojo state, and switch that out for da+now whenever it tries to resolve the current path. but this check causes it to fail, because `ud+0` is a nonexistent case. this uses he-beam to transform the beam in the conditional to see if the case is 0, and if it is, changes the case to da+now before it scries
2022-09-06 16:24:22 -05:00
fang
108c6253d3
Merge branch 'philip/nuke' into next/arvo 2022-09-06 22:25:19 +02:00
fang
f46d8dd557
Merge pull request #5974 from urbit/m/recork-slower
ames: bump recork timer back up to a day
2022-09-06 22:18:14 +02:00
fang
bc597c25ef
Merge pull request #5978 from urbit/philip/nuke
gall: don't add duplicate nonce in +ap-nuke
2022-09-06 22:17:49 +02:00
fang
7a4034f48a
Merge pull request #5977 from urbit/m/cork-undone
ames, gall: no %done on corks
2022-09-06 22:17:34 +02:00
fang
9c931f844b
Merge pull request #5976 from urbit/m/ames-restir
ames: clean & re-set recork timer during %stir
2022-09-06 22:17:18 +02:00
fang
36dd2f8ace
Merge branch 'next/arvo' into m/recork-slower 2022-09-06 22:16:41 +02:00
fang
e22b198dea
Merge pull request #5972 from urbit/ted/grq-test-2
tests: ames+gall subscribe/kick/resubscribe sequence
2022-09-06 22:15:47 +02:00
fang
fec3c45d30
Merge pull request #5971 from urbit/jb/recork-error
ames: handle failed recork timers
2022-09-06 22:15:12 +02:00
Joe Bryan
e4e0c31975 hoon: updates +slew to avoid dynamic eval 2022-09-06 12:50:44 -04:00
Joe Bryan
d89c73fc79 hoon: update key virtualization gates to use fully-static formulas 2022-09-06 11:05:08 -04:00
Joe Bryan
657c5c5a03 pill: update +solid formulas to be more static 2022-09-06 11:04:46 -04:00
Joe Bryan
f91c6c54db arvo: update bootstrap/lifecycle formulas to be fully static 2022-09-06 11:03:21 -04:00
Tinnus Napbus
27349c51ab eyre: add auto-https redirects
if a cert is configured and a secure port is live it will set the
redirect flag in http-config.state.

When it gets a ++request it will return a 301 redirect to
https://[host]/[path] if:

  1. not already secure
  2. redirect flag set
  3. secure port live
  4. is not requesting /.well-known/acme-challenge/...
  5. the host is in domains.state

It will not happen if forwarded-secured, localhost, local loopback, ip
addresses or domains not in domains.state.

in ++load it checks the secure port is live and a cert is set and
enables it if so (for people who already use in-urbit letencrypt)

%rule %cert tasks also toggle it (only turning it on if secure port
live)

%live tasks also toggle it (only turning it on if cert set)

Have tested with a couple of ships and seems to work fine.

This is useful in combination with pyry's auto arvo.network dns config
system - can finally get rid of reverse proxies entirely.
2022-09-04 02:58:09 +12:00
Philip Monk
8884e7dfbc kiln: make compile 2022-09-02 16:51:39 -08:00
Philip Monk
093f0ae9de Merge branch 'philip/inline-thread' into philip/agent-clay-wip 2022-09-01 19:03:17 -08:00
Mackenzie Davidson
4174fd6829 interface: full width images for notebook posts 2022-08-31 18:08:07 -04:00
Philip Monk
3aea8220bc kiln: add +sync 2022-08-30 18:32:31 -08:00
fang
53cc33b291
eyre: look for lowercase last-event-id header
Eyre always gets passed request headers in lowercase, so we should search for
the lowercased version of the header.

Arguably `+get-header` should lowercase keys before comparing them, but that's
a more serious behavioral change.
2022-08-30 16:44:11 +02:00
Philip Monk
e3a8cab943 khan: support inline threads
This allows you to pass a thread directly into khan, instead of passing
a filename.  This has several implications:

- The friction for using threads from an app is significantly lower.
  Consider:

    =/  shed
      =/  m  (strand ,vase)
      ;<  ~  bind:m  (poke:strandio [our %hood] %helm-hi !>('hi'))
      ;<  ~  bind:m  (poke:strandio [our %hood] %helm-hi !>('there'))
      (pure:m !>('product'))
    [%pass /wire %arvo %k %lard %base shed]

- These threads close over their subject, so you don't need to parse
  arguments out from a vase -- you can just refer to them.  The produced
  value must still be a vase.

    ++  hi-ship
      |=  [=ship msg1=@t msg2=@t]
      =/  shed
        =/  m  (strand ,vase)
        ;<  ~  bind:m  (poke:strandio [ship %hood] %helm-hi !>(msg1))
        ;<  ~  bind:m  (poke:strandio [ship %hood] %helm-hi !>(msg2))
        (pure:m !>('product'))
      [%pass /wire %arvo %k %lard %base shed]

- Inline threads can be added to the dojo, though this PR does not add
  any sugar for this.

    =strandio -build-file %/lib/strandio/hoon
    =sh |=  message=@t
        =/  m  (strand:rand ,vase)
        ;<  ~  bind:m  (poke:strandio [our %hood] %helm-hi !>('hi'))
        ;<  ~  bind:m  (poke:strandio [our %hood] %helm-hi !>(message))
        (pure:m !>('product'))
    |pass [%k %lard %base (sh 'the message')]

Implementation notes:
- Review the commits separately: the first is small and implements the
  real feature.  The second moves the strand types into lull so khan can
  refer to them.

- In lull, I wanted to put +rand inside +khan, but this fails to that
  issue that puts the compiler in a loop.  +rand depends on +gall, which
  depends on +sign-arvo, which depends on +khan.  If +rand is in +khan,
  this spins the compiler.  The usual solution is to either move
  everything into the same battery (very ugly here) or break the
  recursion (which we do here).
2022-08-29 21:04:50 -08:00
Philip Monk
0e14eedb50 spider: accept inline threads 2022-08-29 20:09:08 -08:00
Philip Monk
4bef3277d5 azimuth: remove :azimuth|kick 2022-08-29 10:57:47 -08:00
Philip Monk
fa569cf7f3 kiln: wip 2022-08-29 10:53:36 -08:00
DaneBettis
8c06d19258 simplified xray callsites and rendering 2022-08-26 13:33:36 +00:00
Philip Monk
9a4d754429 clay: add +tire subscription for app state 2022-08-25 19:13:51 -08:00
Philip Monk
1ce53d06ba gall: don't add duplicate nonce in +ap-nuke
This gets added in +ap-handle-peers.  This caused outgoing subscriptions
to not get cleaned up properly.

Issue introduced in c2d77a5d.
2022-08-25 13:29:51 -08:00
fang
ab75e83398
gall: don't enqueue %cork as outstanding
Ames will no longer send acks. Consider it completed immediately, and
clean up the outstanding queue whenever it's empty.
2022-08-25 18:14:40 +02:00
fang
0e5b3b4107
ames: don't give %done on cork
Locally, %cork is guaranteed to succeed instantly. The requesting vane
doesn't need an ack to safely consider the flow "closed".
2022-08-25 18:13:29 +02:00
Ted Blackman
5fb20a57cb tests: give %cork ack to gall 2022-08-25 16:36:14 +03:00
Ted Blackman
9b2f95b7b3 ames: revert added debug print 2022-08-25 16:36:14 +03:00
Ted Blackman
80c5172490 tests: check for correct subscription nonce 2022-08-25 16:36:14 +03:00
Ted Blackman
5ee16c38a1 tests: ames+gall full subscribe+clog+kick+resubscribe sequence 2022-08-25 16:36:14 +03:00
Ted Blackman
f558ad4348 tests: more steps, subscriber ames now sends %cork 2022-08-25 16:36:14 +03:00
Ted Blackman
59d71ecbc9 tests: remove defunct test library 2022-08-25 16:36:14 +03:00
Ted Blackman
e37f738573 /lib/test: add +expect-success helper 2022-08-25 16:36:14 +03:00
Ted Blackman
15861150ba /lib/test/ames-gall: clean up lanes 2022-08-25 16:36:14 +03:00
Ted Blackman
c67a358308 tests: helper core to avoid repeated metamorphoses 2022-08-25 16:36:14 +03:00
Ted Blackman
94cb3952b7 tests: subscriber ames gets kick 2022-08-25 16:36:14 +03:00
Ted Blackman
0b2ba509c3 tests: gall and ames give kick over network 2022-08-25 16:36:14 +03:00
Ted Blackman
c301930fac tests: give %kick from %clog 2022-08-25 16:36:14 +03:00
Ted Blackman
59c5aa0b2a tests: give %clog to gall 2022-08-25 16:36:14 +03:00
Ted Blackman
c0adf6c25c tests: %watch to %watch-ack codepath complete 2022-08-25 16:36:14 +03:00
Ted Blackman
cfdf4d8467 tests: fix 2022-08-25 16:36:14 +03:00
Ted Blackman
583dd42747 tests: ames receives %watch-ack 2022-08-25 16:36:14 +03:00
Ted Blackman
01f761d07a tests: receiver ames sends %watch-ack packet 2022-08-25 16:36:14 +03:00
Ted Blackman
4518cf4838 tests: receiver gall gives %done to ames 2022-08-25 16:36:14 +03:00
Ted Blackman
becb1d7f18 tests: gall runs %pub +on-watch 2022-08-25 16:36:14 +03:00
Ted Blackman
52637ea2fe tests: ames passes %watch to gall on receiver, gall emits %deal to itself 2022-08-25 16:36:14 +03:00
Ted Blackman
1f9e04ab1c tests: ames sends %watch %plea 2022-08-25 16:36:14 +03:00
Ted Blackman
e2e4a102e8 tests: ~nec gall passes %watch to itself 2022-08-25 16:36:13 +03:00
Ted Blackman
3fdc7379a2 tests: get %sub agent to emit %watch 2022-08-25 16:36:13 +03:00
Ted Blackman
317f03e337 tests: test galls can now load %sub and %pub agents 2022-08-25 16:36:13 +03:00
Ted Blackman
c48c2f4b6a /lib/test: add +run-chain for test sequences 2022-08-25 16:36:13 +03:00
Ted Blackman
f2b85df948 tests: initial setup for gall and ames on two ships 2022-08-25 16:36:13 +03:00
Ted Blackman
81bfe17f37 tests: WIP gall request queue tests 2022-08-25 16:36:13 +03:00
fang
81462da7aa
ames: clean & re-set recork timer during %stir
Pre-release ships may have multiple recork timers. This ensures that,
after stir, we always have exactly one.
2022-08-25 14:42:16 +02:00
fang
0871c24e24
ames: bump recork timer back up to a day
We had lowered this initially for easier testing, but a day should be
sufficient for real-world use.
2022-08-25 14:11:45 +02:00
fang
b2422030f7
ames: correctly identify stale routes 2022-08-25 13:41:55 +02:00
fang
eee0484909
tests: expect new %sessions gift in eyre tests
Also adds a dedicated %born test to check if it sends a %sessions gift,
and refactors %init and %born running into separate arms to cut down on
repetition.
2022-08-24 20:16:14 +02:00
fang
aa20b55598
http: check requests for auth using eyre's tokens
Accept the newly added %session effect. Store the tokens received in it,
and refer back to them when checking requests for authentication.

Adds logic for checking requests for authentication based on the
presence of a valid urbauth cookie for the host ship, and updated the
slogstream endpoint to use that instead of the scry-based authentication
check.
2022-08-24 00:41:35 +02:00
fang
9c3c2b13c7
eyre: send valid auth tokens to the runtime
Whenever a session gets created or removed, send the set of valid auth
tokens to the runtime, so that it may use them in determining whether
incoming requests are authenticated or not.
2022-08-24 00:34:08 +02:00
Philip Monk
ed3b028d9a Merge remote-tracking branch 'origin/master' into philip/snap 2022-08-23 14:16:57 -08:00
Joe Bryan
76cc8939d3 ames: fix error slog on failed attestation timer 2022-08-23 14:34:08 -04:00
Joe Bryan
5b8f26558e ames: handle failed recork timers 2022-08-23 14:33:53 -04:00
Joe Bryan
679b38138d ames: prevent larval stage from possibly clobbering adult state 2022-08-23 10:37:01 -04:00
Ted Blackman
5a96f3bdbe ames: drop %hear as larva; check duct before metamorpohse 2022-08-23 16:45:17 +03:00
Ted Blackman
07601c6bee ames: metamorphose on first +take if possible 2022-08-23 16:09:35 +03:00
Ted Blackman
9abe49489d ames: +on-stir clean up comments 2022-08-23 13:31:10 +03:00
Joe Bryan
9439841ce8 ames: refactor %stir, %rest stale/wrong timers 2022-08-22 20:14:02 -04:00
DaneBettis
5048504699 fixed names of vars to follow cvc_TypeLetter style 2022-08-22 08:24:19 +00:00
DaneBettis
a8976385ae corrected private function names and block comments 2022-08-22 08:24:19 +00:00
DaneBettis
41694a306e more refactoring as suggested by master-morzod 2022-08-22 08:24:19 +00:00
DaneBettis
82dbf41ae9 WIP stuff re master-morzod 2022-08-22 08:24:19 +00:00
DaneBettis
99211d84bb remove dev-time modifications to manage.c 2022-08-22 08:24:19 +00:00
DaneBettis
ed1cea48ee make _is_indexed() more obvious and less cute 2022-08-22 08:24:19 +00:00
DaneBettis
c6c1c34db1 fixes suggested by master-morzod, and finished int taming 2022-08-22 08:24:19 +00:00
DaneBettis
6389eaec96 docs, tammed ints, better var names, removed redundant funcs 2022-08-22 08:24:19 +00:00
DaneBettis
9c5d8e9f76 taming int declarations 2022-08-22 08:24:19 +00:00
DaneBettis
86c3dfcde9 minimize the diff 2022-08-22 08:24:19 +00:00
DaneBettis
1b93d43757 this branch PR is now for xray only. meme later. 2022-08-22 08:24:19 +00:00
DaneBettis
903c7151e7 first cleanup from meeting with master-morzod 2022-08-22 08:24:19 +00:00
DaneBettis
e4a204583a added macro to clarify _slog_bytecode and cleaned hoon hint tests 2022-08-22 08:24:19 +00:00
DaneBettis
093db01c2d cleaner expression and docs 2022-08-22 08:24:18 +00:00
DaneBettis
4499f21a25 silenced the broken hoon tests 2022-08-22 08:24:18 +00:00
DaneBettis
a122475e60 partial fix for indexed bytecode args; more to come 2022-08-22 08:24:18 +00:00
DaneBettis
f0695b7ca7 more xray debugs thanks to ~master-morzod 2022-08-22 08:24:18 +00:00
DaneBettis
1e253f2f7b more xray debugs via ~master-morzod 2022-08-22 08:24:18 +00:00
DaneBettis
2f71e52857 more notes and debugging for xray 2022-08-22 08:24:18 +00:00
DaneBettis
0b9559a851 adds xray test, reorders tests, fixes sanity checks 2022-08-22 08:24:18 +00:00
DaneBettis
2dfde98b0f Adds %meme and %xray hints.
%meme reports mem usage at callsite.
%xray prints the vere bytecode of the hoon tree wrapped by the hint.
2022-08-22 08:24:18 +00:00
Philip Monk
43ad38cd82 azimuth: reorder %kick flow
Before this, the %watch to eth-watcher was happening before the %poke,
and so eth-watcher was responding with its entire history immediately.
This is bad because it takes a lot of memory to process that many logs,
and also because those logs are stale.

Now, the %poke happens first, which clears the history.
2022-08-19 20:22:20 -08:00
Philip Monk
c6024c2661 azimuth: clear logs on %kick
%kick is supposed to start back from the snapshot and move forward.
Without this, we would only fetch logs that we hadn't already fetched.
Thus, if you were up-to-date when you kicked, you would miss anything
that happened between the time the snapshot was taken and the present,
though you would see things after the present.

Also reverted lull change to make this a safer upgrade.
2022-08-19 15:04:30 -08:00
fang
a04d564269
Merge pull request #5963 from urbit/m/ames-eager-molt
ames: ensure larva initializes adult's state
2022-08-20 00:35:50 +02:00
fang
3a7938f057
ames: say "metamorphosis" in all relevant cases 2022-08-20 00:05:20 +02:00
fang
53b0e7ecaa
ames: ensure larva initializes adult's state
Previously, when the larva got to processing enqueued events, it was
doing so without loading state into the adult beforehand, resulting in
incorrect processing of events.

Here, we make the larva call +molt more eagerly, ensuring that the adult
always has its state available when we use it.
2022-08-19 23:58:10 +02:00
Philip Monk
ca0a00cb3c Merge remote-tracking branch 'origin/master' into philip/snap 2022-08-19 12:37:25 -08:00
fang
8108595b2b
gall: don't inject potentially-fake acks
We shouldn't be hitting this case anymore. Injecting events into agents
which they might not expect, and might not even be real, is bad.
2022-08-19 21:39:44 +02:00
fang
59f0556e3b
Merge pull request #5958 from urbit/ted/rake
gall: %rake task to clean up dead %leave's
2022-08-19 21:29:08 +02:00
fang
de6f525f02
Merge pull request #5956 from urbit/ted/gen-ames-flows
+ames-flows: diagnostic generator to count ames flows
2022-08-19 21:23:38 +02:00
fang
a79f2f27e5
Merge pull request #5961 from urbit/m/ames-stir-thoroughly
ames: don't skip closing flows in +on-stir
2022-08-19 21:22:49 +02:00
fang
a9a8619daa
Merge pull request #5947 from urbit/ted/staying-alive-rebase
gall: revive %hood and %dojo on keypress
2022-08-19 21:22:28 +02:00
fang
fc019157b8
Merge branch 'master' into next/arvo 2022-08-19 21:21:38 +02:00
fang
ce2e433a8a
ames: don't skip closing flows in +on-stir
Yes, there is a global timer for closing flows, but all that does is
enqueue a cork message. +on-stir needs to set _pump_ timers for all
flows that might still have messages to send, which includes closing
flows.
2022-08-19 20:26:08 +02:00
fang
cfa18b1f1f
gall: when kicked, register %cork as outstanding
When ames notifies us that our subscription has been kicked, we enqueue
a cork to clean up the flow. Unlike the %leave case, however, we were
not registering the cork in the queue of outstanding comms. We would
eventually get an ack, but not know what for, and erroneously inject
%poke-acks and %watch-acks.

Here we simply add a %cork entry to the queue before sending it.
2022-08-19 16:04:36 +02:00
Joe Bryan
9b2b8b3287 u3: suppress bail:evil printf 2022-08-18 20:47:48 -04:00
fang
c8a163fedb
gall: clean up big wire construction 2022-08-18 22:46:58 +02:00
fang
a5335f5851
gall: improve match detection in +ap-rake
Making sure to stringify the nonce and including all the target details in the
wire, and excluding flows that are already closing.
2022-08-18 22:39:54 +02:00
fang
f0620b145b
ames-flows: more fine-grained open flow counting 2022-08-18 22:24:20 +02:00
Ted Blackman
d8df2787a0 gall: %rake task to clean up dead %leave's 2022-08-18 20:34:42 +03:00
Amadeo Bellotti
2e894f8dbc merged to master fixed conflict in motes.h 2022-08-18 10:45:24 -04:00
Amadeo Bellotti
40c7af66bf cleaned up code 2022-08-18 10:43:15 -04:00
Tinnus Napbus
4016211bc0 -dns-address: fix wire mismatch 2022-08-18 23:22:57 +12:00
Ted Blackman
82aea06c02 +ames-flows: diagnostic generator to count ames flows 2022-08-18 12:40:49 +03:00
hosted-fornet
00dc78402a agentio: fix +rest typo 2022-08-17 18:08:37 -07:00
Pyry Kovanen
3135eb6137
dns-address: subscribe before poke 2022-08-17 14:08:33 +03:00
fang
b4331d564e
Merge pull request #5949 from urbit/m/gall-redoff
gall: re-enable doff, only for old-style subs
2022-08-17 10:39:31 +02:00
Philip Monk
50c22343b6 clay: wip 2022-08-16 20:33:25 -08:00
fang
497d790e59
gen: remove printf from +gall-nonces 2022-08-16 23:53:18 +02:00
fang
24cf4497e9
gen: add +gall-nonces for reading all next nonces 2022-08-16 23:24:32 +02:00
fang
18019d6d83
gall: re-enable doff, only for old-style subs
This is sufficient to bring the normal (non-prerelease-bugged) cases
into the new world.

For the prerelease ships that ran a buggier version of the new gall
subscription logic, we note that the conditional may trigger for the
nonce=1 case where it had already triggered for their
(shouldn't-be-possible) nonce=0 case. This results in a %leave on a wire
that wasn't in use. This no-ops on the publisher side though, and the
flow gets corked right away, so this is considered harmless.
2022-08-16 23:02:59 +02:00
Ted Blackman
c972c0fbe2 gall: roundtrip through arvo to revive %hood and %dojo 2022-08-16 01:37:35 +03:00
Ted Blackman
95580f7e83 gall: revive %hood and %dojo on poke 2022-08-16 00:40:38 +03:00
Ted Blackman
a70c2ffe1a gall: now restarts %hood, but not %dojo yet 2022-08-16 00:40:38 +03:00
Ted Blackman
ac072729c2 gall: force load %hood and %dojo on poke 2022-08-16 00:40:38 +03:00
fang
81f18d13ad
gall: remove outdated fixme comment
This is part of the %doff work, which is getting integrated elsewhere.
2022-08-15 12:24:18 +02:00
fang
5e43a9de56
Merge pull request #5941 from urbit/ted/nodoff
gall: disable %doff for now
2022-08-12 19:57:22 +02:00
Amadeo Bellotti
9b095dbec7 changed up how we are executing hoon. This fixes the issue we see with rpevious versions 2022-08-12 11:17:40 -04:00
Joe Bryan
205b5013e4 base: adds generator for getting %ames timer counts 2022-08-11 21:45:09 -04:00
Ted Blackman
1898483a45 gall: disable %doff for now 2022-08-12 00:55:19 +03:00
Joe Bryan
9bdbca6095 Merge branch 'master' into next/vere
* master:
  bitcoin: v0.0.2
  bitcoin-wallet: set state as default case for handle-provider-update
  %bitcoin: Implement additional RPC calls from btc-provider. %histogram, %block-headers, %tx-from-pos, %fee, %psbt are now all callable from the btc-provider agent. These actions are necessary in order to get the lightning network working within Urbit.
  %bitcoin: Added %regtest to arms using the network type definition.
  %bitcoin: add regtest type to network
2022-08-11 15:57:09 -04:00
Ted Blackman
b1bab79f58 gall: add %f scry for sub-nonce's 2022-08-11 22:33:57 +03:00
Ted Blackman
7f35429e22
Merge pull request #5937 from urbit/ted/grq-test
ames: fix comet test
2022-08-11 22:27:15 +03:00
fang
350f33d6ba
Merge branch 'next/arvo' into ted/doff-6 2022-08-11 21:06:30 +02:00
Ted Blackman
91d6956388 tests: fix ames comet test 2022-08-11 20:49:09 +03:00
fang
5b4a964cdf
gall: fix the %doff conditional
No comment.
2022-08-11 19:48:27 +02:00
fang
06b7f52755
gall: print less during %doff 2022-08-11 17:04:44 +02:00
fang
cd0ea06ad4
gall: use a fully-formed wire when sending %cork
In response to clog notification from remote ames, we were sending a
%cork to clean up the flow. However, the wire we were using had the /sys
prefix already stripped off. Here, we put it back in.
2022-08-11 16:53:45 +02:00
fang
39cd895a55
gall: in +ap-doff, process oldest subs first
Start by killing subscription nonce 0, then work our way up instead of
down. We enhance the printf with a "total nonces" indicator so we can
still easily see the progress being made.
2022-08-10 22:51:38 +02:00
fang
8033fe760e
doff: improve generator interface slightly
No longer need to give units as named arguments, instead just the bare
values. The defaults get recognized as the "no filter" case.
2022-08-10 22:51:36 +02:00
fang
2fe27bd8d7
gall: simplify +ap-doff filter conditional 2022-08-10 22:25:01 +02:00
fang
04b7b86cae
gall: support %doff-ing specific apps and/or ships
This gives us more control over exactly which subscriptions get culled,
which is useful in debugging and targetted recovery scenarios.
2022-08-10 20:33:07 +02:00
Ted Blackman
6b836bb56d ames: fix no-op for messages on closing bones 2022-08-10 20:18:57 +03:00
Ted Blackman
20ccac22a2 ames: clean up closing bone check and printfs 2022-08-10 19:55:07 +03:00
Ted Blackman
9e47490c95 gall: fix %doff handling
Previous +ap-doff kicked the agent repeatedly.  We needed to kick
it only once.  Now publisher agents clear their incoming subscription
state without the subscriber making lots of new subscriptions because
of repeated kicking.
2022-08-10 19:48:39 +03:00
Ted Blackman
0baad53fb4 ames: drop pleas on dead bones 2022-08-10 19:47:59 +03:00
Joe Bryan
6e9c0033eb u3: improves image-related error messages in events 2022-08-10 12:14:50 -04:00
Joe Bryan
c9a80338ee u3: makes loom length configurable 2022-08-10 12:14:43 -04:00
Joe Bryan
eec9354849 u3: remove references to u3a_bits/u3a_bytes/words/pages 2022-08-10 12:14:33 -04:00
Ted Blackman
ef09595788 gall: update comment 2022-08-10 19:13:32 +03:00
Ted Blackman
543efac183 gall: kill old subscriptions on %doff (still has bug)
Squashed commit of the following:

commit 1e31ab96c14e7506d5cb746d90153cb5658df6e0
Author: Ted Blackman <ted@tlon.io>
Date:   Wed Aug 10 19:08:39 2022 +0300

    ames: revert prints on bad memos

commit c47f9c6053c05da0177f0c64210a88161e8adc98
Author: Ted Blackman <ted@tlon.io>
Date:   Wed Aug 10 18:44:56 2022 +0300

    Merge fix to +ap-kill-down and use that pattern in +mo-doff.

    This doesn't seem to work properly, but I'm not sure why so far.

commit e696816b8d3ab81534de6c2910d0fd4bebcfb68a
Merge: 4edb247cd7 a5f08643ff
Author: Ted Blackman <ted@tlon.io>
Date:   Wed Aug 10 18:29:42 2022 +0300

    Merge branch 'next/arvo' into ted/doff-revival

commit 4edb247cd77ac988e5b11806d0d9b5e7cec4a39e
Author: Ted Blackman <ted@tlon.io>
Date:   Sat Aug 6 00:09:04 2022 +0300

    ames,gall: fix lopsided bitt/boar state from old doffs

commit b21ffd9cfab0987297f3ae4cd16447ed0c3a467e
Merge: 7d532afaf8 8eb8a1da29
Author: Ted Blackman <ted@tlon.io>
Date:   Fri Aug 5 17:53:15 2022 +0300

    Merge branch 'next/arvo' into ted/kill-subs

commit 7d532afaf80b773139b66d787c4a446e3d6a9a33
Author: Ted Blackman <ted@tlon.io>
Date:   Fri Aug 5 17:52:16 2022 +0300

    gall: add subscription nonce to %doff

commit f750de9aacdb19f796bff527e220df9c10e41e71
Merge: 38540658b5 aad5fa6fae
Author: Ted Blackman <ted@tlon.io>
Date:   Fri Aug 5 11:24:55 2022 +0300

    Merge branch 'next/arvo' into ted/kill-subs

commit 38540658b59d703b0fa162af4f958948b7ee2031
Author: fang <git@fang.io>
Date:   Thu Jul 28 21:10:57 2022 +0200

    gall: account for renaming of subscription state

commit c015dc8446fc02729ad492e24635c9c521f09965
Merge: 7c222e4c60 731e27d5a1
Author: Zach Alberico <git@zalberico.com>
Date:   Thu Jul 28 10:14:24 2022 -0700

    Merge branch 'next/arvo' into ted/kill-subs

commit 7c222e4c60d946042fd06d858086a883bf8a0f7b
Author: Ted Blackman <ted@tlon.io>
Date:   Thu Jul 28 14:01:00 2022 +0200

    hood: |doff generator

commit 8d00cf1bd1b304f30431614b68002827e498d97e
Author: Ted Blackman <ted@tlon.io>
Date:   Thu Jul 28 13:21:45 2022 +0200

    gall: fix compile errors

commit 6a1fd360ffc65d8c6f90e491bb21fa7799a98c31
Author: Ted Blackman <ted@tlon.io>
Date:   Thu Jul 28 13:01:16 2022 +0200

    gall: add %doff task to kill subscriptions
2022-08-10 19:09:47 +03:00
fang
a5f08643ff
Merge pull request #5932 from urbit/ted/ack-crash
ames: fix "ack crash"
2022-08-10 16:02:10 +02:00
fang
682dde904c
Merge pull request #5931 from urbit/m/gall-kill-down-accurately
gall: handle nonces in wires correctly
2022-08-10 00:04:10 +02:00
Ted Blackman
ce9f692ecd ames: clean up %cork plea handling
+on-plea gets called in two very different ways:
1) handling request from local vane to send %plea to peer
2) handling %cork request from another ship, which our local ames has %pass'ed
   to ourselves

In the second case, we shouldn't print misleadingly, or bind a duct in the ossuary.
2022-08-10 00:47:38 +03:00
Ted Blackman
2dc7171dfa ames: no-op on acks on corked bones 2022-08-10 00:44:54 +03:00
fang
db1e8d1b92
gall: explain reason for strange conditional 2022-08-09 21:36:08 +02:00
fang
52d8ef6a99
gall: initialize sub-nonce as 1 during upgrade
This matches the bunt of 1 for the new ship case. A nonce of 0 is
semantically mapped to old-style subscriptions.
2022-08-09 21:22:40 +02:00
fang
c2d77a5d47
gall: in/exclude the nonce from the wire as needed
+ap-nuke was not including the nonce, but should.
+ap-handle-peers was potentially including a zero nonce.

(The latter shouldn't have been possible, but there's a bug in +load
where sub-nonce.yoke gets initialized as 0 instead of 1.)
2022-08-09 21:21:10 +02:00
fang
0a3f542fcc
gall: refactor sub-wire-with-nonce construction
Into +ap-nonce-wire.
2022-08-09 21:20:24 +02:00
fang
1f30dccddf
gall: use correct wires in +ap-kill-down
For potentially-outgoing moves, we need to make sure the nonce is in the
wire so that it gets associated with the right instance of the
subscription.
2022-08-09 20:53:43 +02:00
fang
e396ddcdaa
gall: cork a subscription's ames flow on-kick
Gall tells ames to %cork flows for subscriptions it has closed.
Receiving a kick also closes a subscription, but gall wasn't issuing a
%cork in that case. We correct that here.

Inlines +mo-handle-ames-response's logic at its only callsite.
2022-08-08 22:21:34 +02:00
drbeefsupreme
2b7b3266ac clay: remove $dork
seems that this structure has been unused since
e75ab631a4 and confuses
newbies trying to figure out exactly what the commit
structure is (which is how I came across this)
2022-08-07 13:08:55 -04:00
Joe Bryan
aca7162d7c vere: make prep and next commands non-interactive (no tty required) 2022-08-06 22:59:50 -04:00
Joe Bryan
7c9167b6ae u3: refactors custom allocator init for libraries 2022-08-05 12:45:27 -04:00
Joe Bryan
f996844950 u3: normalize home-road stack after snapshot restoration 2022-08-05 10:47:16 -04:00
Joe Bryan
815d78fa55 u3: use size_t in u3m_init() 2022-08-05 10:47:09 -04:00
Ted Blackman
da591a4078 ames: invert busted conditional in recork timer 2022-08-05 02:37:03 +03:00
Ted Blackman
56d4906a13 ames: try next recork on cork ack
Without this, a ship would send a cork on a max of one flow per
recork timer, which could take years to clear for some ships.
This starts a hot loop of trying the next cork once one gets
positively acked.
2022-08-05 01:35:34 +03:00
Ted Blackman
54cd1a5eca ames: simplify recork timer
The previous recork timer queued up %cork messages without sending them.
It also relied on making sure pump timers didn't get set for recork bones.
This was fragile.

The new design enqueues up to one new %cork message per ship during each
recork timer, based on the state of the flow.  If the flow is closing but
there are no outstanding messages in it, then it needs to be recorked.
Flows will be recorked in ascending numerical order by bone.
2022-08-05 01:13:21 +03:00
fang
9433d3354d
ames: unsent-fragments is a list, not a tree
Measure accordingly.
2022-08-03 21:03:49 +02:00
fang
7af527e605
ames: correctly measure queue size 2022-08-03 20:52:03 +02:00
fang
e6453bae3c
ames: more detailed "future msg" trace
This additional information may come in handy when debugging this crash
we shouldn't be seeing.
2022-08-03 20:46:54 +02:00
fang
e16c499724
ames: make recork timer faster
This will aid visibility and debugging. We'll probably want to make this
slower again later.
2022-08-03 20:33:04 +02:00
fang
7c01ee9b35
ames: account for corked flows during %stir
Also patches the behn scry in %stir handling to be correct for latest behn.
2022-08-03 19:37:53 +02:00
fang
cd10e02b73
bitcoin: v0.0.2 2022-08-03 14:54:06 +02:00
fang
f09122ae78
Merge pull request #5831 from nprz/extend-bitcoin-provider
Extend bitcoin provider
2022-08-03 14:53:02 +02:00
fang
b860bef066
ames: correctly avoid setting pump timer
The condition got butchered during refactor: instead of avoiding the creation
of pump timers during recork wake, it was setting them _exclusively_ during
recork wake.
2022-08-02 23:23:48 +02:00
Ted Blackman
e5e4c8602d ames: properly set recork flag in +on-wake 2022-08-02 23:15:43 +03:00
Ted Blackman
67efb2ad7c ames: don't start pump timers on recork 2022-08-02 23:03:34 +03:00
Bradley
3407de0fd8 vere: removed unnecessary exit(1) call
Previously exit(1) was called after calling u3_king_bail()
which was unnecessary, so removed it.
2022-07-29 11:03:25 -05:00
Bradley
2b99eb2cac vere: changed to use u3_king_bail instead of manual term clean up 2022-07-29 10:54:12 -05:00
Bradley Ray
6d0bdc06dd vere: clean up terminal on invalid fake ship name
Currently when creating a fake ship, if an invalid ship name is given,
then the program exits without ever cleaning up the terminal. This
results in  a bugged termianal that requires closing and repopening
or using the `reset` cmd.

This commits adds a call to `u3_term_log_exit()` and `fflush(stdout)`
before calling `exit(1)` to ensure proper cleanup.

Address issue #5914
2022-07-28 22:15:13 -05:00