on master help sign in
Merge remote-tracking branch 'origin/aa-configst-monadfail' into rc/0.9.0.0

* origin/aa-configst-monadfail: (122 commits) executable-config: Add MonadFail instance for ConfigsT Accept system config argument Consistent styling of install cli Actually just turn nginx access_log off for obelisk Use stdout for nginx's access log by default Use createDirectoryIfMissing instead of mkdir subprocess Use gitProc Add staticWhich around most subprocess paths Add write-ghc-environment-files: never to skeleton Add prompts to successful ob init logs Use recommended nginx proxy settings by default in obelisk deployments executable-config-lookup: Provide android-activity dependency when necessary executable-config-lookup: Clarify dependencies Support multiple frontend exes skeleton: Don't ignore .ghc.environment files so they are conspicuous skeleton: Use -threaded by default in backend exe Fix asset creation when asset file names aren't valid nix drv names Add MFunctor instance for ConfigsT Add HasConfigs instances for StateT(s) Add MonadThrow instance for ConfigsT ...

commitaeaee45f197ee194f29047685e3b177931b58b95 authorAli Abrar <aliabrar@gmail.com> dateMon 19 Oct 2020, 14:28 (6 years ago) parent45141fed4a6c10
54 files changed+877−648
CONTRIBUTING.md+52 ChangeLog.md+12−3 FAQ.md+62−67 README.md+66−165 default.nix+38−26 dep/.gitignore−5 dep/reflex-platform/github.json+2−2 dep/reflex-platform/thunk.nix+9 docs/obelisk-logo-640.png guides/app-deploy/README.md+16−10 haskell-overlays/ghcide.nix+38−32 haskell-overlays/obelisk.nix+5 lib/asset/README.md+16−19 lib/asset/assets.nix+28−5 lib/asset/manifest/obelisk-asset-manifest.cabal+4−2 lib/asset/manifest/src/Obelisk/Asset/Symlink.hs+1−1 lib/asset/serve-snap/obelisk-asset-serve-snap.cabal+4−2 lib/asset/serve-snap/src/Obelisk/Asset/Serve/Snap.hs+1−1 lib/backend/obelisk-backend.cabal+2−2 lib/backend/src/Obelisk/Backend.hs+1−1 lib/cliapp/obelisk-cliapp.cabal+3−1 lib/cliapp/src/Obelisk/CliApp.hs+3 lib/cliapp/src/Obelisk/CliApp/Logging.hs+2−2 lib/cliapp/src/Obelisk/CliApp/Process.hs+48−29 lib/command/obelisk-command.cabal+4−2 lib/command/src/Obelisk/Command.hs+12−8 lib/command/src/Obelisk/Command/Deploy.hs+16−16 lib/command/src/Obelisk/Command/Preprocessor.hs+50−46 lib/command/src/Obelisk/Command/Project.hs+26−15 lib/command/src/Obelisk/Command/Run.hs+64−51 lib/command/src/Obelisk/Command/Thunk.hs+3−3 lib/command/src/Obelisk/Command/Utils.hs+34−2 lib/command/src/Obelisk/Command/VmBuilder.hs+8−8 lib/executable-config/default.nix+13−2 lib/executable-config/inject/obelisk-executable-config-inject.cabal+1−1 lib/executable-config/lookup/obelisk-executable-config-lookup.cabal+10−7 lib/executable-config/lookup/src/Obelisk/Configs.hs+31−12 lib/frontend/obelisk-frontend.cabal+1−1 lib/frontend/src/Obelisk/Frontend.hs+1−1 lib/route/README.md+6 lib/route/obelisk-route.cabal+2−1 lib/route/src/Obelisk/Route.hs+89−46 lib/route/src/Obelisk/Route/Frontend.hs+41−28 lib/run/obelisk-run.cabal+2−2 lib/selftest/src/Obelisk/SelfTest.hs+24 lib/snap-extras/obelisk-snap-extras.cabal+1−2 scripts/ghcid-this-lib−4 skeleton/.gitignore+12−6 skeleton/backend/backend.cabal+2−1 skeleton/cabal.project+1 skeleton/common/common.cabal+1−1 skeleton/default.nix+3−2 skeleton/frontend/frontend.cabal+6−4 skeleton/shell.nix−1
CONTRIBUTING.md+52
@@ -8,6 +8,7 @@ Contributions and issue reports are encouraged and appreciated!
88 - [Guidelines for Pull Requests](#guidelines-for-pull-requests)
99 - [Code Quality](#code-quality)
1010 - [Documentation](#documentation)
11+- [Development Environment](#development-environment)
1112
1213## Opening Issues
1314
@@ -39,6 +40,7 @@ For breaking changes, new features, refactors, or other major changes, the body
3940
4041Wherever possible, pull requests should add a single feature or fix a single bug. Pull requests should not bundle several unrelated changes.
4142
43+
4244### Code Quality
4345
4446#### Warnings
@@ -77,3 +79,53 @@ Add an entry to the changelog when your PR:
7779#### In the [Readme](README.md)
7880The readme is the first place a lot of people look for information about the repository. Update any parts of the readme that are affected by your PR.
7981
82+
83+## Development Environment
84+
85+There are two ways to get live compiler feedback while developing Obelisk libraries. For libraries that are dependencies of the `skeleton` application, the easiest way to get feedback is to
86+
87+```bash
88+cd skeleton
89+ob run
90+```
91+
92+This `ob run` session only loads modules that are dependencies of the skeleton and `obelisk-run`. For example, `obelisk-asset` and `obelisk-route` are used by the skeleton.
93+
94+For other libraries like `obelisk-command` you can use `ghcid`. To launch `ghcid` for `lib/command` you can run
95+
96+```bash
97+nix-shell -A obeliskEnvs.obelisk-command --run "cd lib/command && ghcid"
98+```
99+
100+### Building `ob` for testing
101+
102+To re-install `ob` from source globally you can do
103+
104+```bash
105+nix-env -f /path/to/obelisk -iA command
106+```
107+
108+You can also open a shell with the local version of `ob` available on your `$PATH`:
109+
110+```bash
111+nix run -f /path/to/obelisk command
112+```
113+
114+### Hacking on Obelisk from within an Obelisk project
115+
116+`ob` will defer to the version found in your project's `.obelisk/impl` directory. To work on that version specifically:
117+
118+```bash
119+ob thunk unpack ./.obelisk/impl
120+cd ./.obelisk/impl
121+# apply your changes
122+```
123+
124+If you want to commit your changes, first push them to your fork of obelisk and then
125+
126+```bash
127+cd /your/project/root
128+ob thunk pack .obelisk/impl
129+git add .obelisk/impl
130+git commit -m "Bump obelisk"
131+```
ChangeLog.md+12−3
@@ -7,17 +7,26 @@ This project's release branch is `master`. This log is written from the perspect
77* **(Breaking change)** Backport nixpkgs upgrades to ACME/Let's Encrypt handling so that HTTPS deployments continue to work flawlessly. If your deployment is having trouble renewing [Let's Encrypt](https://letsencrypt.org/) certificates, upgrade to this version.
88 * **IMPORTANT:** In order to use [Let's Encrypt](https://letsencrypt.org/) you must now accept their [terms of service](https://letsencrypt.org/repository/). To do that, add `terms.security.acme.acceptTerms = true;` to the `import ./.obelisk/impl {` section in your `default.nix`. The new skeleton application may serve as an [example](https://github.com/obsidiansystems/obelisk/blob/4759342ab3570888c027d4c58cb5694cb832d624/skeleton/default.nix#L13).
99* Update reflex-platform dependency to v0.6.0.0
10+* ([#715](https://github.com/obsidiansystems/obelisk/pull/715)) In `Obelisk.Route` deprecate `isoEncoder` and `prismEncoder` in favor of more precisely named `viewEncoder` and `reviewEncoder` (respectively) and improve documentation regarding contravariance of `reviewEncoder`.
11+* ([#739](https://github.com/obsidiansystems/obelisk/pull/739)) Improve `ob shell` by allowing commands to be passed verbatim after a `--` argument. For example, `ob shell 'run command'` can now be written `ob shell -- run command`.
12+* ([#735](https://github.com/obsidiansystems/obelisk/pull/735)) Fix regression causing custom `Prelude`s to break `ob run`/`ob watch`/`ob repl`.
13+* ([#737](https://github.com/obsidiansystems/obelisk/pull/737)) Fix bug causing custom `Prelude`s to break `ob profile`.
14+* ([#752](https://github.com/obsidiansystems/obelisk/pull/752)) Fix the `ob` command-line tool to return non-zero exit code when underlying processes fail.
15+* ([#742](https://github.com/obsidiansystems/obelisk/pull/742), [#57](https://github.com/obsidiansystems/obelisk/pull/57), [#406](https://github.com/obsidiansystems/obelisk/pull/406)) Enable `-dedupe` and `-DGHCJS_BROWSER` in GHCJS builds to make JavaScript output considerably smaller leading to faster load/parse times and faster build times.
16+ * **Migration:** New Obelisk projects will automatically benefit from this change, but existing projects need to apply a change similar to [this one](https://github.com/obsidiansystems/obelisk/blob/371cb3302085601c5ec73e9574d51c8b95e3e493/skeleton/frontend/frontend.cabal#L32-L34).
17+* ([#742](https://github.com/obsidiansystems/obelisk/pull/742)) Update `reflex-platform` which includes:
18+ * A new version of GHCJS where `-dedupe` is fixed.
1019
1120## v0.8.0.0
1221
13−* ([#674](https://github.com/obsidiansystems/obelisk/pull/674), [#711](https://github.com/obsidiansystems/obelisk/pull/711)) Introduce a new thunk format to support accessing the thunk's source directly when packed. When packed, thunks have an additional file called `thunk.nix` and `default.nix` is now a think wrapper around that.
22+* ([#674](https://github.com/obsidiansystems/obelisk/pull/674), [#711](https://github.com/obsidiansystems/obelisk/pull/711)) Introduce a new thunk format to support accessing the thunk's source directly when packed. When packed, thunks have an additional file called `thunk.nix` and `default.nix` is now a thin wrapper around that.
1423* ([#665](https://github.com/obsidiansystems/obelisk/pull/665)) Add `--interpret` and `--no-interpret` options to `ob run`/`ob watch`/`ob repl`/`ob shell`. These options allow you to pick which paths will be pre-compiled by `nix` when entering the shell/session and which won't. For example `ob run --no-interpret dep` will ensure that any dependencies found in `./dep` will be built by `nix` before loading the rest of the project into the `ghci` session. The same configuration for `ob shell` will ensure that those packages are built and available in the `ghc` package database inside the shell.
1524
1625 **NOTE:** `ob shell`'s default behavior is now different. By default it now behaves like `ob run`/`ob watch`/`ob repl` in that it does *not* pre-build any packages whose `.cabal` or `package.yaml` files are found in the project. To regain the previous behavior, use `ob shell --no-interpret . --interpret backend --interpret common --interpret frontend` from the project root.
1726* ([#695](https://github.com/obsidiansystems/obelisk/pull/695)) `ob deploy init` now requires that your obelisk project be a clean `git` checkout with pushed changes. It has always required that your obelisk project be a `git` repository, but it did not require that your local changes be committed and pushed. This new requirement is added to ensure users don't accidentally create a deployment pointing to an old version of the project.
1827* ([#705](https://github.com/obsidiansystems/obelisk/pull/705)) Add `Obelisk.Route.packTextEncoder` and generalize `Obelisk.Route.unpackTextEncoder` over any `Data.Text.Lens.IsText`.
1928* ([#712](https://github.com/obsidiansystems/obelisk/pull/712)) Update [`reflex-platform`](https://github.com/reflex-frp/reflex-platform) to version 0.5.3.0.
20−* ([#700](https://github.com/obsidiansystems/obelisk/pull/700)) Ensure `ob init` uses the thunk format of the target obelisk rather than the one currently running the init command. If a user had installed a version of obelisk with a new thunk format, a newly initialized skeleton of an older version would not be able to unpack it's own `.obelisk/impl`.
29+* ([#700](https://github.com/obsidiansystems/obelisk/pull/700)) Ensure `ob init` uses the thunk format of the target obelisk rather than the one currently running the init command. If a user had installed a version of obelisk with a new thunk format, a newly initialized skeleton of an older version would not be able to unpack its own `.obelisk/impl`.
2130* ([#693](https://github.com/obsidiansystems/obelisk/pull/693)) Fix a bug where some packages in `.attr-cache` directories would be incorrectly picked up and used instead of the correct ones when using `ob run`/`ob watch`/`ob repl`.
2231* ([#709](https://github.com/obsidiansystems/obelisk/pull/709)) Fix a bug in obelisk's preprocessor causing it to incorrectly skip files in some circumstances.
2332* ([#663](https://github.com/obsidiansystems/obelisk/pull/663)) Add **experimental** support for [`ghcide`](https://github.com/digital-asset/ghcide). See the README for more information.
@@ -68,7 +77,7 @@ This project's release branch is `master`. This log is written from the perspect
6877* Improve error messaging when a dependency doesn't have the expected `.cabal` or `package.yaml` file. ([#597](https://github.com/obsidiansystems/obelisk/pull/597))
6978* Improve the skeleton in small ways. ([#593](https://github.com/obsidiansystems/obelisk/pull/593), [#589](https://github.com/obsidiansystems/obelisk/pull/589))
7079* Fix `ob` commands to again support running from any subdirectory of an obelisk project ([#591](https://github.com/obsidiansystems/obelisk/pull/591))
71−* Add `reflex-platform-func` argument to Obelisk's `default.nix`. It defaults to it's prior behavior of using the reflex-platform in in `dep`. ([#612](https://github.com/obsidiansystems/obelisk/pull/612))
80+* Add `reflex-platform-func` argument to Obelisk's `default.nix`. It defaults to its prior behavior of using the reflex-platform in in `dep`. ([#612](https://github.com/obsidiansystems/obelisk/pull/612))
7281
7382## v0.3.0.0 - 2019-12-20
7483
FAQ.md+62−67
@@ -1,14 +1,70 @@
11# Frequently Asked Questions
22
3−1. [How do I fix invalid entitlements? ](#how-do-i-fix-invalid-entitlements)
3+1. [How do I declare a new Haskell dependency?](#how-do-i-declare-a-new-haskell-dependency)
4+1. [How do I add or override Haskell dependencies in the package set?](#how-do-i-add-or-override-haskell-dependencies-in-the-package-set)
5+1. [How do I extend my Obelisk application with more local packages?](#how-do-i-extend-my-obelisk-application-with-more-local-packages)
6+1. [How do I use `ob run` over HTTPS?](#how-do-i-use-ob-run-over-https)
7+1. [How do I fix invalid entitlements?](#how-do-i-fix-invalid-entitlements)
481. [`ob thunk update` or `ob deploy update` fails](#ob-thunk-update-or-ob-deploy-update-fails)
591. [How do I fix `Ambiguous module name` errors?](#how-do-i-fix-ambiguous-module-name-errors)
6−1. [What does `ob run` actually do?](#what-does-ob-run-actually-do)
10+
11+### How do I declare a new Haskell dependency?
12+
13+Every component of your Obelisk application is a standard [cabal](https://www.haskell.org/cabal/) package. That means declaring new Haskell dependencies simply involves updating the `build-depends` field in the appropriate cabal file (`backend.cabal` for example). By default, Obelisk will use its curated package set to choose which version of each package you get. It's possible that the package you need is not already in the curated set or the curated version isn't the one you want. See [How do I add or override Haskell dependencies in the package set?](#how-do-i-add-or-override-haskell-dependencies-in-the-package-set) for a solution to this.
14+
15+### How do I add or override Haskell dependencies in the package set?
16+
17+To add a Haskell package that doesn't exist in Obelisk's package set or to override the version of a package, use the `overrides` attribute in your project's `default.nix`. For example, to use a specific version of the `aeson` package fetched from GitHub and a specific version of the `waargonaut` package fetched from Hackage, your `default.nix` will look like:
18+
19+```nix
20+# ...
21+project ./. ({ pkgs, ... }: {
22+# ...
23+ overrides = self: super: let
24+ aesonSrc = pkgs.fetchFromGitHub {
25+ owner = "obsidiansystems";
26+ repo = "aeson-gadt-th";
27+ rev = "ed573c2cccf54d72aa6279026752a3fecf9c1383";
28+ sha256 = "08q6rnz7w9pn76jkrafig6f50yd0f77z48rk2z5iyyl2jbhcbhx3";
29+ };
30+ in
31+ {
32+ aeson = self.callCabal2nix "aeson" aesonSrc {};
33+ waargonaut = self.callHackageDirect {
34+ pkg = "waargonaut";
35+ ver = "0.8.0.1";
36+ sha256 = "1zv28np3k3hg378vqm89v802xr0g8cwk7gy3mr77xrzy5jbgpa39";
37+ } {};
38+ };
39+# ...
40+```
41+
42+For further information see [the Haskell section](https://nixos.org/nixpkgs/manual/#users-guide-to-the-haskell-infrastructure) of nixpkgs "Contributors Guide".
43+
44+### How do I extend my Obelisk application with more local packages?
45+
46+If the standard packages (`frontend`, `backend`, and `common`) are not enough, you may add more local packages by defining them with the `packages` attribute in your `default.nix`. The sources of these packages will be automatically loaded by `ob run`/`ob repl`/etc.
47+
48+```nix
49+# ...
50+project ./. ({ pkgs, ... }: {
51+# ...
52+ packages = {
53+ another = ./dep/another;
54+ };
55+# ...
56+```
57+
58+### How do I use `ob run` over HTTPS?
59+
60+To run your app locally over HTTPS, update the protocol in `config/common/route` to `https`, and then use `ob run` as normal.
61+
62+Obelisk generates a self-signed certificate for running HTTPS so the browser will issue a warning about using an invalid certificate. On Chrome, you can go to `chrome://flags/#allow-insecure-localhost` to enable invalid certificates for localhost.
63+
764
865### How do I fix invalid entitlements?
966
10−You probably did not set `ios.bundleIdentifier` correctly in `default.nix`.
11−When this happens you'll see an error something like this:
67+You probably did not set `ios.bundleIdentifier` correctly in `default.nix`. When this happens you'll see an error something like this:
1268
1369```
14702018-11-25 09:34:22.438 ios-deploy[58106:8521046] [ !! ] Error 0xe8008016: The executable was signed with invalid entitlements. AMDeviceSecureInstallApplication(0, device, url, options, install_callback, 0)
@@ -19,7 +75,7 @@ Fixing the value of `ios.bundleIdentifier` should fix the error.
1975### `ob thunk update` or `ob deploy update` fails
2076Whenever an `ob` command fails, try re-running it with `-v`.
2177
22−If you're using a private repo, and you get a failure in nix-prefetch-url, you may need to unpack and repack the thunk. Here's some example output that shows this issue:
78+If you're using a private repo, and you get a failure in `nix-prefetch-url`, you may need to unpack and repack the thunk. Here's some example output that shows this issue:
2379
2480```
2581Starting Obelisk </nix/store/j8wls8a89xr6s1a47lg6g83gnbdrfd0l-obelisk-command-0.1/bin/.ob-wrapped> args=["deploy","update","-v"] logging-level=Debug
@@ -39,7 +95,7 @@ nix-prefetch-url: Failed to determine sha256 hash of URL https://github.com/obsi
3995
4096And here's how you can fix it:
4197
42−```
98+```bash
4399ob thunk unpack $SOME_THUNK
44100ob thunk pack $SOME_THUNK
45101```
@@ -59,64 +115,3 @@ error:
59115```
60116then specify the package you want in the import, e.g:
61117`import "cryptonite" Crypto.Hash`
62−
63−
64−### What does `ob run` actually do?
65−
66−
67−#### Short version:
68−
69−`ob run` starts a [`ghcid`](https://github.com/ndmitchell/ghcid) process which
70−tries to build your project within a carefully crafted `nix-shell` with all the
71−project's dependencies and,
72−
73−* either displays compilation errors/warnings,
74−* or starts the Obelisk server, which serves:
75− * your backend's route handlers,
76− * the static assets,
77− * the [JSaddle](https://github.com/ghcjs/jsaddle) frontend code (while opening its websocket).
78−
79−#### Longer version:
80−
81−Assuming we are in a project created with `ob init`, `ob run` calls (see
82−`lib/command/src/Obelisk/Command.hs`):
83−
84− nix-shell --pure -A shells.ghc --run 'ob --no-handoff internal run-static-io <real-run-function>'
85−
86−where
87−
88−* `shells.ghc` is defined in `./default.nix` by importing `./.obelisk/impl/default.nix` which
89− is `default.nix` in the present (Obelisk) repository,
90−* `run-static-io` is a logging-enabled command wrapper
91− (cf. `runObelisk` in `lib/command/src/Obelisk/App.hs`).
92−
93−In this case, it runs the function `Obelisk.Command.Command.run` (defined in
94−`lib/command/src/Obelisk/Command/Run.hs`).
95−
96−* It creates a GHCi config from a Nix expression which:
97− * loads three packages: `backend`, `common`, `frontend`,
98− * obtains a free port number.
99−* Then runs `ghcid`
100− * with a command that reruns `Obelisk.Run.run` at each restart (option
101− `--test`).
102−
103−It is defined in `lib/run/src/Obelisk/Run.hs`:
104−
105−* It creates a thread which starts the main backend.
106− This runs `runSnapWithCommandLineArgs` and passes routes:
107− * to the backend (result of the `_backend_run` field of your
108− implementation of the `Backend fullRoute frontendRoute` record),
109− * or to `serveDefaultObeliskApp` (`lib/backend/src/Obelisk/Backend.hs`) to
110− serve static assets.
111−* Starts `runWidget`
112− which itself runs
113− [runSettingsSocket](https://hackage.haskell.org/package/warp-3.2.26/docs/Network-Wai-Handler-Warp.html#v:runSettingsSocket)
114− (the *“TCP listen loop”*):
115− * it binds to TCP socket, and
116− * creates the HTTP connection manager
117− ( [`newManager`](https://hackage.haskell.org/package/http-client-0.6.3/docs/Network-HTTP-Client.html#v:newManager))
118− * calls `obeliskApp` which
119− * has a route to serve the [JSaddle](https://github.com/ghcjs/jsaddle) frontend,
120− * runs the frontend (*on* the server), to produce pre-rendered pages,
121− * starts the JSaddle web-socket,
122− * “falls back” to proxying the backend (`fallbackProxy`).
README.md+66−165
@@ -1,96 +1,75 @@
11# Obelisk
22
33[![Haskell Programming Language](https://img.shields.io/badge/language-Haskell-blue.svg)](http://www.haskell.org)
4−[![BSD3 License](http://img.shields.io/badge/license-BSD3-brightgreen.svg)](https://tldrlegal.com/license/bsd-3-clause-license-%28revised%29)
4+[![BSD3 License](http://img.shields.io/badge/license-BSD3-brightgreen.svg)](https://github.com/obsidiansystems/obelisk/blob/master/LICENSE)
55
6+<p align="center"><img src="docs/obelisk-logo-640.png" width="50%" alt="Obelisk Logo"></p>
67
7−Obelisk provides an easy way to develop and deploy your [Reflex](https://github.com/reflex-frp/reflex) project as web apps and as mobile apps.
8+Functional reactive web and mobile applications, with batteries included. Obelisk's goal is to represent a cohesive, highly-curated set of choices that [Obsidian Systems](https://obsidian.systems/) has made for building these types of applications in a way that is extremely fast but does not compromise on production readiness.
89
10+- [Overview](#overview)
11+ - [Who should consider using it?](#who-should-consider-using-it)
912- [Installing Obelisk](#installing-obelisk)
1013- [Developing an Obelisk project](#developing-an-obelisk-project)
11− - [Adding Packages](#adding-packages)
12− - [Adding Package Overrides](#adding-package-overrides)
13− - [Running over HTTPS](#running-over-https)
1414 - [IDE Support](#ide-support)
15− - [Terminal-based feedback](#terminal-based-feedback)
16− - [Experimental `ghcide` support](#experimental-ghcide-support)
1715- [Deploying](#deploying)
18− - [Locally](#locally)
1916 - [Default EC2 Deployment](#default-ec2-deployment)
2017 - [Custom Non-EC2 Deployment](#custom-non-ec2-deployment)
2118 - [VirtualBox Deployment](#virtualbox-deployment)
19+ - [Locally](#locally)
2220 - [From macOS](#from-macos)
2321 - [Deploying an updated version](#deploying-an-updated-version)
2422- [Mobile](#mobile)
2523 - [iOS](#ios)
2624 - [Android](#android)
25+- [Frequently Asked Questions (FAQ)](#frequently-asked-questions-faq)
26+- [Contributing](#contributing)
27+
28+## Overview
29+
30+Obelisk allows you to build high-quality web and mobile applications very quickly using [Reflex](https://reflex-frp.org/). In minutes you can go from an empty directory to an interactive application that works on web, iOS, and Android, all sharing the same Haskell codebase! Obelisk's development environment also enables extremely rapid development and feedback. You can take advantage of Haskell's type system across the frontend and backend boundary. This means changes to your backend that would break your frontend are immediately detected during development and vice versa. Obelisk uses Haskell's compiler to give you a complete "TODO list" of what needs to be updated.
31+
32+Obelisk is targeted primarily at Haskell developers who want to build high-quality web and/or mobile applications in Haskell, without the distractions of manually choosing and integrating technology for every piece of the system.
33+
34+### Who should consider using it?
35+
36+Obelisk assumes basic knowledge of [Haskell](https://www.haskell.org/) and [Reflex/Reflex-DOM](https://reflex-frp.org/), web technologies like [HTML](https://developer.mozilla.org/en-US/docs/Web/HTML) and [CSS](https://developer.mozilla.org/en-US/docs/Web/CSS), and a terminal shell like [Bash](https://en.wikipedia.org/wiki/Bash_(Unix_shell)). Knowledge of [Nix](https://nixos.org/) helps but is not strictly necessary.
37+
2738
2839## Installing Obelisk
40+
29411. [Install Nix](https://nixos.org/nix/).
3042 If you already have Nix installed, make sure you have version 2.0 or higher. To check your current version, run `nix-env --version`.
31431. Set up nix caches
3244 1. If you are running NixOS, add this to `/etc/nixos/configuration.nix`:
33− ```
45+ ```nix
3446 nix.binaryCaches = [ "https://nixcache.reflex-frp.org" ];
3547 nix.binaryCachePublicKeys = [ "ryantrinkle.com-1:JJiAKaRv9mWgpVAz8dwewnZe0AzzEAzPkagE9SP5NWI=" ];
3648 ```
3749 and rebuild your NixOS configuration (e.g. `sudo nixos-rebuild switch`).
38− 1. If you are using another operating system or linux distribution, ensure that these lines are present in your Nix configuration file (`/etc/nix/nix.conf` on most systems; [see full list](https://nixos.org/nix/manual/#sec-conf-file)):
39− ```
40− binary-caches = https://cache.nixos.org https://nixcache.reflex-frp.org
41− binary-cache-public-keys = cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY= ryantrinkle.com-1:JJiAKaRv9mWgpVAz8dwewnZe0AzzEAzPkagE9SP5NWI=
42− binary-caches-parallel-connections = 40
50+ 1. If you are using another operating system or Linux distribution, ensure that these lines are present in your Nix configuration file (`/etc/nix/nix.conf` on most systems; [see full list](https://nixos.org/nix/manual/#sec-conf-file)):
51+ ```nix
52+ binary-caches = https://cache.nixos.org https://nixcache.reflex-frp.org
53+ binary-cache-public-keys = cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY= ryantrinkle.com-1:JJiAKaRv9mWgpVAz8dwewnZe0AzzEAzPkagE9SP5NWI=
54+ binary-caches-parallel-connections = 40
4355 ```
44− * other Linux: enable sandboxing (see these [issue172](https://github.com/obsidiansystems/obelisk/issues/172#issuecomment-411507818) or [issue6](https://github.com/obsidiansystems/obelisk/issues/6) if you run into build problems)
45− ```
56+ * If you're on a Linux distribution other than NixOS, enable sandboxing (see these [issue 172](https://github.com/obsidiansystems/obelisk/issues/172#issuecomment-411507818) or [issue 6](https://github.com/obsidiansystems/obelisk/issues/6) if you run into build problems) by adding the following:
57+ ```nix
4658 sandbox = true
4759 ```
48− * MacOS: disable sandboxing (there are still some impure dependencies for now)
49− ```
60+ * If you're on MacOS, disable sandboxing (there are still some impure dependencies for now) by adding the following:
61+ ```nix
5062 sandbox = false
5163 ```
5264 then restart the nix daemon
53− ```
65+ ```bash
5466 sudo launchctl stop org.nixos.nix-daemon
5567 sudo launchctl start org.nixos.nix-daemon
5668 ```
57−1. Install obelisk: `nix-env -f https://github.com/obsidiansystems/obelisk/archive/master.tar.gz -iA command`
58−
59−### Contributing to Obelisk
60−
61−When developing on obelisk itself you may launch `ghcid` for the corresponding project as follows. For example to launch ghcid for `lib/backend` project:
62−
63−```bash
64−nix-shell -A obeliskEnvs.obelisk-backend --run "cd lib/backend && ghcid -c 'cabal new-repl'"
65−```
66−
67−Or to launch ghcid for `lib/command` project:
68−
69−```bash
70−nix-shell -A obeliskEnvs.obelisk-command --run "cd lib/command && ghcid -c 'cabal new-repl'"
71−```
72−
73−To re-install `ob` from source do
74−```bash
75−nix-env -f /path/to/obelisk -iA command
76−```
77−
78−Note that `ob` will defer to the version found in your project's `.obelisk/impl` directory. To update that version specifically:
79−
80−```bash
81−ob thunk unpack ./.obelisk/impl
82−cd ./.obelisk/impl
83−# apply your changes
84−```
85−
86−If you want to commit your changes, first push them to your fork of obelisk and then
87−
88−```bash
89−cd /your/project/root
90−ob thunk pack .obelisk/impl
91−git add .obelisk/impl
92−git commit -m "Bump obelisk"
93−```
69+1. Install obelisk:
70+ ```bash
71+ nix-env -f https://github.com/obsidiansystems/obelisk/archive/master.tar.gz -iA command
72+ ```
9473
9574### Accessing private repositories
9675
@@ -120,119 +99,12 @@ Firefox will not be able to properly run the development website due to [issue 4
12099
121100Every time you change the Haskell source files in frontend, common or backend, `ob run` will automatically recompile the modified files and reload the server. Furthermore, it will display on screen compilation errors and warnings if any.
122101
123−### Adding packages
124−
125−In order to add package dependencies, declare them under the build-depends field in the appropriate cabal files (backend, common, and frontend each have their own). The corresponding Nix packages will automatically be selected when building.
126−
127−### Adding package overrides
128−
129−To add a version override to any Haskell package, or to add a Haskell package that doesn't exist in the nixpkgs used by Obelisk, use the `overrides` attribute in your project's `default.nix`. For example, to use a specific version of the `aeson` package fetched from GitHub and a specific version of the `waargonaut` package fetched from Hackage, your `default.nix` will look like:
130−
131−```nix
132−# ...
133−project ./. ({ pkgs, ... }: {
134−# ...
135− overrides = self: super: let
136− aesonSrc = pkgs.fetchFromGitHub {
137− owner = "obsidiansystems";
138− repo = "aeson-gadt-th";
139− rev = "ed573c2cccf54d72aa6279026752a3fecf9c1383";
140− sha256 = "08q6rnz7w9pn76jkrafig6f50yd0f77z48rk2z5iyyl2jbhcbhx3";
141− };
142− in
143− {
144− aeson = self.callCabal2nix "aeson" aesonSrc {};
145− waargonaut = self.callHackageDirect {
146− pkg = "waargonaut";
147− ver = "0.8.0.1";
148− sha256 = "1zv28np3k3hg378vqm89v802xr0g8cwk7gy3mr77xrzy5jbgpa39";
149− } {};
150− };
151−# ...
152−```
153−
154−For further information see [the Haskell section](https://nixos.org/nixpkgs/manual/#users-guide-to-the-haskell-infrastructure) of nixpkgs Contributors Guide.
155−
156−### Adding extra local packages
157−
158−If the standard packages (`frontend`, `backend`, and `common`) are not
159−enough, to add more local Haskell packages, define them with the
160−`packages` parameter. The sources of these packages will be
161−automatically reloaded by `ob run`.
162−
163−```nix
164−# ...
165−project ./. ({ pkgs, ... }: {
166−# ...
167− packages = {
168− another = ./another;
169− };
170−# ...
171−```
172−
173−### Running over HTTPS
174−
175−To run your app locally over HTTPS, update the protocol in `config/common/route` to `https`, and then use `ob run` as normal.
176−
177−Since Obelisk generates a self-signed certificate for running HTTPS, the browser will issue a warning about using an invalid certificate. On Chrome, you can go to `chrome://flags/#allow-insecure-localhost` to enable invalid certificates for localhost.
178−
179102### IDE Support
180103
181−#### Terminal-based feedback
182−
183104Obelisk officially supports terminal-based feedback (akin to [`ghcid`](https://github.com/ndmitchell/ghcid)) in `ob run` and `ob watch`.
184105
185−#### **Experimental** `ghcide` support
186−
187−> **NOTE:** `ghcide` support is strictly **experimental** and **not officially supported**. There is no guarantee that it will work for you or that this support will be maintained over time.
188−
189−To try out the **experimental** [`ghcide`](https://github.com/digital-asset/ghcide) support:
190−
191− * Install a `ghcide` plugin for your editor.
192− * Add `__withGhcide = true;` to your Obelisk project's `default.nix` (inside the call to `project`). With this setting, `ob shell` will provide `ghcide` as well.
193− * Add `hie-bios.sh` to the root of your project:
194− ```shell
195− cat > hie-bios.sh <<'EOF'
196− #!/usr/bin/env bash
197− source "$HOME/.bash_profile"; # NOTE: Some editors need help finding 'ob' and this assumes that `ob` is made available on your `$PATH` in `.bash_profile`
198− ob internal export-ghci-configuration > "$HIE_BIOS_OUTPUT"
199− EOF
200− chmod +x hie-bios.sh
201− ```
202− * **Note:** In some projects you need to use `ob internal export-ghci-configuration --use-relative-paths` in this script instead. This is known to happen when your project contains symlinks to other packages.
203− * Add `hie.yaml` to the root of your project:
204− ```shell
205− echo 'cradle: { bios: { program: hie-bios.sh } }' > hie.yaml
206− ```
207− * Test the configuration with `ob shell ghcide`. Assuming your project compiles and works with `ghcide` otherwise, this should succeed.
208− * Start your editor in a way that it can access the appropriate `ghcide`:
209− * This can sometimes be achieved with `ob shell 'start my editor'`.
210− * If you can't easily start your editor in a way that it inherits your shell, you may need to customize how your `ghcide` plugin finds `ghcide` or create a custom `ghcide` replacement script that you install globally. For example, for Visual Studio Code on macOS adding a script called `ghcide` to your `PATH` like the one below will cause `ghcide` from each project's `ob shell` to be used:
211− ```shell
212− #!/usr/bin/env bash
213− source "$HOME/.bash_profile" # NOTE: This assumes that `ob` is made available on your `$PATH` in `.bash_profile`
214− ob shell "ghcide $@"
215− ```
216−
217106## Deploying
218107
219−### Locally
220−
221−Build everything:
222−
223−```bash
224−nix-build -A exe --no-out-link
225−```
226−
227−Copy the result to a new directory, add configuration, and run!
228−
229−```bash
230−mkdir test-app
231−ln -s $(nix-build -A exe --no-out-link)/* test-app/
232−cp -r config test-app
233−(cd test-app && ./backend)
234−```
235−
236108### Default EC2 Deployment
237109
238110In this section we will demonstrate how to deploy your Obelisk app to an Amazon EC2 instance. Obelisk deployments are configured for EC2 by default (see [Custom Non-EC2 Deployment](#custom-non-ec2-deployment)).
@@ -249,7 +121,7 @@ At this stage your instance should be booting and become accessible shortly. Not
249121Now go to your Obelisk project directory (`~/code/myapp`), and initialize a deployment config (`~/code/myapp-deploy`):
250122Your project directory must be "thunkable", i.e. something on which `ob thunk pack` can be called. Usually it will be a git repository whose current revision has been pushed upstream.
251123
252−```
124+```bash
253125cd ~/code/myapp
254126SERVER=ec2-35-183-22-197.ca-central-1.compute.amazonaws.com
255127ROUTE=https://myapp.com # Publicly accessible route to your app
@@ -268,7 +140,7 @@ This step will also require that you manually verify the authenticity of the hos
268140
269141Next, go to the deployment directory that you just initialized and deploy!
270142
271−```
143+```bash
272144cd ~/code/myapp-deploy
273145ob deploy push
274146```
@@ -297,6 +169,25 @@ Here's a `module.nix` that is configured for deployment to a VirtualBox VM (runn
297169
298170The `{...}:` and following is the [NixOS module](https://nixos.org/nixos/manual/index.html#sec-writing-modules) definition.
299171
172+### Locally
173+
174+If you want deploy your application locally or test a production-oriented build you can build and deploy the app as described below.
175+
176+Build the application:
177+
178+```bash
179+nix-build -A exe --no-out-link
180+```
181+
182+Copy the result to a new directory, add configuration, and run!
183+
184+```bash
185+mkdir test-app
186+ln -s $(nix-build -A exe --no-out-link)/* test-app/
187+cp -r config test-app
188+(cd test-app && ./backend)
189+```
190+
300191### From macOS
301192
302193Deploying from macOS requires some extra setup:
@@ -423,3 +314,13 @@ This should copy over and install the application on your device (if you see a
423314##### Build a release version
424315
425316After having configured signing for your app, you may proceed to build a release version of the app. This is no different to how you build the non-release version, so consult the section [Android](#android) further above for exact instructions on building and deploying to your device.
317+
318+
319+## Frequently Asked Questions (FAQ)
320+
321+Refer to [FAQ](FAQ.md).
322+
323+
324+## Contributing
325+
326+Contributions and issue reports are encouraged and appreciated! Refer to the [Contributing](CONTRIBUTING.md) guide for information about getting started.
default.nix+38−26
@@ -46,7 +46,7 @@ in rec {
4646 pathGit = ./.; # Used in CI by the migration graph hash algorithm to correctly ignore files.
4747 path = reflex-platform.filterGit ./.;
4848 obelisk = ghcObelisk;
49− obeliskEnvs = pkgs.lib.filterAttrs (k: _: pkgs.lib.strings.hasPrefix "obelisk-" k) ghcObeliskEnvs;
49+ obeliskEnvs = pkgs.lib.filterAttrs (k: _: k == "tabulation" || pkgs.lib.strings.hasPrefix "obelisk-" k) ghcObeliskEnvs; #TODO: use thunkSet https://github.com/reflex-frp/reflex-platform/pull/671
5050 command = ghcObelisk.obelisk-command;
5151 shell = pinBuildInputs "obelisk-shell" ([command] ++ command.commandRuntimeDeps);
5252
@@ -77,16 +77,20 @@ in rec {
7777 '';
7878
7979 compressedJs = frontend: optimizationLevel: pkgs.runCommand "compressedJs" {} ''
80− mkdir $out
81− cd $out
82− # TODO profiling + static shouldn't break and need an ad-hoc workaround like that
83− ln -s "${haskellLib.justStaticExecutables frontend}/bin/frontend.jsexe/all.js" all.unminified.js
84− ${if optimizationLevel == null then ''
85− ln -s all.unminified.js all.js
86− '' else ''
87− ${pkgs.closurecompiler}/bin/closure-compiler --externs "${reflex-platform.ghcjsExternsJs}" -O ${optimizationLevel} --jscomp_warning=checkVars --create_source_map="all.js.map" --source_map_format=V3 --js_output_file="all.js" all.unminified.js
88− echo "//# sourceMappingURL=all.js.map" >> all.js
89− ''}
80+ set -euo pipefail
81+ cd '${haskellLib.justStaticExecutables frontend}'
82+ shopt -s globstar
83+ for f in **/all.js; do
84+ dir="$out/$(basename "$(dirname "$f")")"
85+ mkdir -p "$dir"
86+ ln -s "$(realpath "$f")" "$dir/all.unminified.js"
87+ ${if optimizationLevel == null then ''
88+ ln -s "$dir/all.unminified.js" "$dir/all.js"
89+ '' else ''
90+ '${pkgs.closurecompiler}/bin/closure-compiler' --externs '${reflex-platform.ghcjsExternsJs}' -O '${optimizationLevel}' --jscomp_warning=checkVars --create_source_map="$dir/all.js.map" --source_map_format=V3 --js_output_file="$dir/all.js" "$dir/all.unminified.js"
91+ echo '//# sourceMappingURL=all.js.map' >> "$dir/all.js"
92+ ''}
93+ done
9094 '';
9195
9296 serverModules = {
@@ -130,12 +134,16 @@ in rec {
130134 }: {...}: {
131135 services.nginx = {
132136 enable = true;
137+ recommendedProxySettings = true;
133138 virtualHosts."${routeHost}" = {
134139 enableACME = enableHttps;
135140 forceSSL = enableHttps;
136141 locations.${baseUrl} = {
137142 proxyPass = "http://127.0.0.1:" + toString internalPort;
138143 proxyWebsockets = true;
144+ extraConfig = ''
145+ access_log off;
146+ '';
139147 };
140148 };
141149 };
@@ -176,9 +184,9 @@ in rec {
176184 pkgs.runCommand "serverExe" {} ''
177185 mkdir $out
178186 set -eux
179− ln -s "${if profiling then backend else haskellLib.justStaticExecutables backend}"/bin/* $out/
180− ln -s "${mkAssets assets}" $out/static.assets
181− ln -s ${mkAssets (compressedJs frontend optimizationLevel)} $out/frontend.jsexe.assets
187+ ln -s '${if profiling then backend else haskellLib.justStaticExecutables backend}'/bin/* $out/
188+ ln -s '${mkAssets assets}' $out/static.assets
189+ ln -s '${mkAssets (compressedJs frontend optimizationLevel)}'/* $out
182190 echo ${version} > $out/version
183191 '';
184192
@@ -340,29 +348,33 @@ in rec {
340348 __unstable__.profiledObRun = let
341349 profiled = projectOut { inherit system; enableLibraryProfiling = true; };
342350 exeSource = builtins.toFile "ob-run.hs" ''
351+ {-# LANGUAGE NoImplicitPrelude #-}
352+ {-# LANGUAGE PackageImports #-}
343353 module Main where
344354
345− import Control.Exception
346− import Reflex.Profiled
347− import System.Environment
355+ -- Explicitly import Prelude from base lest there be multiple modules called Prelude
356+ import "base" Prelude (IO, (++), read)
357+
358+ import "base" Control.Exception (finally)
359+ import "reflex" Reflex.Profiled (writeProfilingData)
360+ import "base" System.Environment (getArgs)
348361
349− import qualified Obelisk.Run
362+ import qualified "obelisk-run" Obelisk.Run
350363 import qualified Frontend
351364 import qualified Backend
352365
353366 main :: IO ()
354367 main = do
355− args <- getArgs
356− let port = read $ args !! 0
357− assets = args !! 1
358− profileFile = (args !! 2) <> ".rprof"
359− Obelisk.Run.run port (Obelisk.Run.runServeAsset assets) Backend.backend Frontend.frontend `finally` writeProfilingData profileFile
368+ [portStr, assets, profFileName] <- getArgs
369+ Obelisk.Run.run (read portStr) (Obelisk.Run.runServeAsset assets) Backend.backend Frontend.frontend
370+ `finally` writeProfilingData (profFileName ++ ".rprof")
360371 '';
361372 in nixpkgs.runCommand "ob-run" {
362− buildInputs = [ (profiled.ghc.ghcWithPackages (p: [ p.backend p.frontend])) ];
373+ buildInputs = [ (profiled.ghc.ghcWithPackages (p: [p.backend p.frontend])) ];
363374 } ''
364− mkdir -p $out/bin/
365− ghc -x hs -prof -fno-prof-auto -threaded ${exeSource} -o $out/bin/ob-run
375+ cp ${exeSource} ob-run.hs
376+ mkdir -p $out/bin
377+ ghc -x hs -prof -fno-prof-auto -threaded ob-run.hs -o $out/bin/ob-run
366378 '';
367379
368380 linuxExeConfigurable = linuxExe;
dep/.gitignoredeleted−5
@@ -1,5 +0,0 @@
1−*
2−!*/
3−!.gitignore
4−!*/*.json
5−!*/default.nix
dep/reflex-platform/github.json+2−2
@@ -3,6 +3,6 @@
33 "repo": "reflex-platform",
44 "branch": "rc/0.6.0.0",
55 "private": false,
6− "rev": "15547da863b86307738d03a50294b58fa89d4334",
7− "sha256": "008scnpmbnmhpwbr4z2x1l18fs3l2xxbpklaimz1s979rw6iha9m"
6+ "rev": "7bc42b9f9f7d69abca029517131e7ae2a9582dfe",
7+ "sha256": "02g111abkphgw5vgs9wam3qa7a21x0y654pby919z347wd8254dr"
88}
dep/reflex-platform/thunk.nixnew file+9
@@ -0,0 +1,9 @@
1+# DO NOT HAND-EDIT THIS FILE
2+let fetch = { private ? false, fetchSubmodules ? false, owner, repo, rev, sha256, ... }:
3+ if !fetchSubmodules && !private then builtins.fetchTarball {
4+ url = "https://github.com/${owner}/${repo}/archive/${rev}.tar.gz"; inherit sha256;
5+ } else (import <nixpkgs> {}).fetchFromGitHub {
6+ inherit owner repo rev sha256 fetchSubmodules private;
7+ };
8+ json = builtins.fromJSON (builtins.readFile ./github.json);
9+in fetch json
docs/obelisk-logo-640.pngnew file

Binary file not shown.

guides/app-deploy/README.md+16−10
@@ -1,13 +1,14 @@
11# Obelisk Application Deployment Guide
2+
23This document serves two purposes, the first one is to guide new users that want to deploy Obelisk/Reflex apps and the second one to provide a walk-through for test driving Obelisk releases.
34
4−> **Note:** To complete this *entire* guide you need access to a macOS machine running the latest OSX release, a Linux machine (can be a VM on that mac) with Nix installed, an iPhone or iPad, and a recent Android device. It also assumes that you have Nix correctly set up and that your system is set up to fetch from binary caches instead of building everything on your machine. If you notice any of the commands below takes more than 5 minutes, then caches are not likely enabled.
5+> **Note:** This guide can be completed on a Linux host with Nix installed or a macOS host with Nix installed. Each section is labeled regarding which operating system hosts it supports. When going through the guide, start at the beginning and go through all sections that are supported on your host and merely skip sections that are not supported. The sections for iOS deployments require an iPhone or iPad device and the sections for Android deployments require an Android device. This guide assumes that you have Nix correctly set up and that your system is configured to fetch from binary caches instead of building everything on your machine. If you notice any of the commands below takes more than 5 minutes, then caches are not likely enabled.
56>
67> Refer to the [Obelisk Installation Documentation](https://github.com/obsidiansystems/obelisk#installing-obelisk) for instructions on configuring the binary caches for any Nix-compatible setup.
78
8−## a) Get Obelisk
9+## a) Get Obelisk (Linux, Mac)
910
10−There are several ways to install Obelisk, but the one we are going to use here allows us to test a single version of Obelisk in different ways. The approach is to clone Obelisk from it's GitHub repository and start a project that uses that local check out.
11+There are several ways to install Obelisk, but the one we are going to use here allows us to test a single version of Obelisk in different ways. The approach is to clone Obelisk from its GitHub repository and start a project that uses that local check out.
1112
1213Open a terminal and run the following:
1314
@@ -39,7 +40,7 @@ ob init --branch "$OBELISK_BRANCH"
3940
4041> **Note:** If the `--branch` parameter is not used, then Obelisk sets your project up to look at the `master` branch from GitHub. This is quite handy for real life projects but distracting for our test drive since we want to make sure any changes we do to the Obelisk codebase (like testing a pull request) are immediately picked up.
4142
42−## b) Run the Obelisk app on localhost
43+## b) Run the Obelisk app on localhost (Linux, Mac)
4344
4445Let's test that we can run a server on localhost. This is quite easy:
4546
@@ -52,9 +53,10 @@ Now open a browser and point it to http://localhost:8000 (or just click on this
5253
5354![](assets/app-deploy.png)
5455
55−## c) Deploy the web app on a remote machine
56+## c) Prepare a VirtualBox deploy target (Linux, Mac)
5657
5758### Import the NixOS VirtualBox appliance
59+
5860Install [VirtualBox](https://www.virtualbox.org/) on your machine.
5961
6062On NixOS, do this by adding the following line to your `/etc/nixos/configuration.nix` before the last line containing `}`:
@@ -79,7 +81,7 @@ You should now see a NixOS machine in the dashboard:
7981
8082![](assets/virtualbox-dashboard-nixos.png)
8183
82−If you are on a network with DHCP on your wireless or network card then select right-click on the "NixOS" image and click "Settings". Go to the "Network" section and make "Attached to:" set to "Bridged Adapter".
84+If you are on a network with DHCP on your wireless or network card then right-click on the "NixOS" image and click "Settings". Go to the "Network" section and make "Attached to:" set to "Bridged Adapter".
8385
8486![](assets/virtualbox-image-settings-network.png)
8587
@@ -201,7 +203,7 @@ git remote add origin "$WORKDIR/myapp-git-remote"
201203git push -u origin master
202204```
203205
204−### Deploy
206+### Initialize deployment directory
205207
206208With that, we can come back to the Obelisk app and initialize the deployment:
207209
@@ -216,7 +218,11 @@ Then configure the deployment for VirtualBox:
216218echo '{nixosPkgs, ...}: {...}: { imports = [ (nixosPkgs.path + /nixos/modules/virtualisation/virtualbox-image.nix) ]; }' > "$WORKDIR/myappdeploy/module.nix"
217219```
218220
219−And deploy:
221+## d) Deploy to VirtualBox target (Linux only)
222+
223+> Deploying requires a Linux host in order to build the Linux binaries.
224+
225+Now we can deploy to the VirtualBox VM.
220226
221227```bash
222228cd "$WORKDIR/myappdeploy"
@@ -243,7 +249,7 @@ It should look like this:
243249
244250Congratulations! You have deployed an Obelisk application to a remote server via SSH.
245251
246−## d) Deploy an Android app (Linux host only)
252+## e) Deploy an Android app (Linux only)
247253
248254> **Note:** This section requires that you be running a Linux *host*.
249255
@@ -286,7 +292,7 @@ When the deployment is complete opening the app should look something like
286292
287293Congratulations! You have deployed an Obelisk Android app via USB.
288294
289−## e) Deploy an iOS app (macOS host only)
295+## f) Deploy an iOS app (Mac only)
290296
291297> **Note:** This section requires that you be running a macOS *host*.
292298
haskell-overlays/ghcide.nix+38−32
@@ -1,34 +1,40 @@
11self: super:
2− let
3− pkgs = self.callPackage ({ pkgs }: pkgs) {};
4− inherit (pkgs.haskell.lib) dontCheck;
5− in {
6− ghcide = pkgs.haskell.lib.justStaticExecutables (dontCheck ((self.override {
7− overrides = self: super: {
8− ghc-check = self.callHackageDirect {
9− pkg = "ghc-check";
10− ver = "0.1.0.3";
11− sha256 = "038llbvryk5y27jbdpbshp0zw5lw1j6m7qk7vx1n96ykqdzkh649";
12− } {};
13− lsp-test = dontCheck (self.callHackage "lsp-test" "0.6.1.0" {});
14− haddock-library = dontCheck (self.callHackage "haddock-library" "1.8.0" {});
15− haskell-lsp = dontCheck (self.callHackage "haskell-lsp" "0.19.0.0" {});
16− haskell-lsp-types = dontCheck (self.callHackage "haskell-lsp-types" "0.19.0.0" {});
17− regex-posix = dontCheck (self.callHackage "regex-posix" "0.96.0.0" {});
18− test-framework = dontCheck (self.callHackage "test-framework" "0.8.2.0" {});
19− regex-base = dontCheck (self.callHackage "regex-base" "0.94.0.0" {});
20− regex-tdfa = dontCheck (self.callHackage "regex-tdfa" "1.3.1.0" {});
21− shake = dontCheck (self.callHackage "shake" "0.18.4" {});
22− hie-bios = dontCheck (self.callHackageDirect {
23− pkg = "hie-bios";
24− ver = "0.4.0";
25− sha256 = "19lpg9ymd9656cy17vna8wr1hvzfal94gpm2d3xpnw1d5qr37z7x";
26− } {});
27− };
28− }).callCabal2nix "ghcide" (pkgs.fetchFromGitHub {
29− owner = "digital-asset";
30− repo = "ghcide";
31− rev = "v0.1.0";
32− sha256 = "1kf71iix46hvyxviimrcv7kvsj67hcnnqlpdsmazmlmybf7wbqbb";
33− }) {}));
2+let
3+ pkgs = self.callPackage ({ pkgs }: pkgs) { };
4+ inherit (pkgs.haskell.lib) dontCheck justStaticExecutables;
5+ inherit (pkgs.haskellPackages) callHackageDirect callHackage;
6+
7+in {
8+ ghcide = justStaticExecutables (dontCheck (callHackageDirect {
9+ pkg = "ghcide";
10+ ver = "0.2.0";
11+ sha256 = "199l4qzrghhz6wbfkgqdl4gll4wvgpr190kinzhv88idnn9pxm96";
12+ } rec {
13+ ghc-check = callHackageDirect {
14+ pkg = "ghc-check";
15+ ver = "0.3.0.1";
16+ sha256 = "1dj909m09m24315x51vxvcl28936ahsw4mavbc53danif3wy09ns";
17+ } { };
18+ lsp-test = dontCheck (callHackage "lsp-test" "0.6.1.0" { });
19+ haddock-library = dontCheck (callHackage "haddock-library" "1.8.0" { });
20+ haskell-lsp = dontCheck (callHackageDirect {
21+ pkg = "haskell-lsp";
22+ ver = "0.22.0.0";
23+ sha256 = "1q3w46qcvzraxgmw75s7bl0qvb2fvff242r5vfx95sqska566b4m";
24+ } { inherit haskell-lsp-types; });
25+ haskell-lsp-types = dontCheck (callHackageDirect {
26+ pkg = "haskell-lsp-types";
27+ ver = "0.22.0.0";
28+ sha256 = "1apjclphi2v6ggrdnbc0azxbb1gkfj3x1vkwpc8qd6lsrbyaf0n8";
29+ } { });
30+ regex-tdfa = dontCheck (callHackage "regex-tdfa" "1.3.1.0" {
31+ regex-base = dontCheck (callHackage "regex-base" "0.94.0.0" { });
32+ });
33+ shake = dontCheck (callHackage "shake" "0.18.4" { });
34+ hie-bios = dontCheck (callHackageDirect {
35+ pkg = "hie-bios";
36+ ver = "0.5.0";
37+ sha256 = "116nmpva5jmlgc2dgy8cm5wv6cinhzmga1l0432p305074w720r2";
38+ } { });
39+ }));
3440}
haskell-overlays/obelisk.nix+5
@@ -19,7 +19,12 @@ in
1919 obelisk-command = haskellLib.overrideCabal (self.callCabal2nix "obelisk-command" (obeliskCleanSource ../lib/command) {}) {
2020 librarySystemDepends = [
2121 pkgs.jre
22+ pkgs.git
2223 pkgs.nix
24+ pkgs.nix-prefetch-git
25+ pkgs.openssh
26+ pkgs.rsync
27+ pkgs.which
2328 (haskellLib.justStaticExecutables self.ghcid)
2429 ];
2530 };
lib/asset/README.md+16−19
@@ -1,29 +1,26 @@
1−## obelisk-asset
1+# obelisk-asset
22
3−The 'assets.nix' file contains nix expressions that are a mutually
4−recursive set of attributes used to create static asset directories
5−with hashable file encodings. This file should be incorporated within
6−your project's 'default.nix' file. (See ./example/default.nix , line 2)
7−```
8−{assets ? import ./../assets.nix { inherit nixpkgs; }
9−}:
10−```
3+[![Haskell Programming Language](https://img.shields.io/badge/language-Haskell-blue.svg)](http://www.haskell.org)
4+[![BSD3 License](http://img.shields.io/badge/license-BSD3-brightgreen.svg)](https://github.com/obsidiansystems/obelisk/blob/master/LICENSE)
115
12−The 'mkAssets' and 'mkAssetsWith' functions within 'assets.nix' only
13−need to be passed an encoding('zopfliEncodings', 'gzipEncodings',
14−'noEncodings') and a static directory of your choice as arguments.
6+**Efficiently served, aggressively cached static web resources.**
157
16−In this example, 'mkAssets' is used on a directory that has a .png
17−file inside of it. (See ./example/default.nix, line 11)
8+The `assets.nix` file contains nix expressions that are a mutually recursive set of attributes used to create static asset directories with hashable file encodings. This file should be incorporated within your project's `default.nix` file. (See `example/default.nix`, line 2)
9+
10+```nix
11+{ assets ? import ./../assets.nix { inherit nixpkgs; } }:
1812```
13+
14+The `mkAssets` and `mkAssetsWith` functions within `assets.nix` only need to be passed an `encoding("zopfliEncodings", "gzipEncodings", "noEncodings")` and a static directory of your choice as arguments.
15+
16+In this example, `mkAssets` is used on a directory that has a `.png` file inside of it. (See `example/default.nix`, line 11)
17+
18+```nix
1919myAssets = assets.mkAssets ./static;
2020```
2121
22−Once you have successfully incorporated 'assets.nix' into your
23−project's nix file(s), use nix-build to generate a symlink of
24−your 'mkAssets' expression. The following command from
25−example/run-example (line 3) will generate an immutable symlink
26−that holds hashed static assets.
22+Once you have successfully incorporated `assets.nix` into your project's nix file(s), use `nix-build` to generate a symlink of your `mkAssets` expression. The following command from `example/run-example` (line 3) will generate an immutable symlink that holds hashed static assets.
23+
2724```bash
2825nix-build -o static.assets -A myAssets
2926```
lib/asset/assets.nix+28−5
@@ -20,7 +20,7 @@ zopfliEncodings = file:
2020 nixpkgs.stdenv.mkDerivation {
2121 name = "encodings";
2222
23− input = file;
23+ input = mkPath file;
2424
2525 builder = builtins.toFile "builder.sh" ''
2626 source "$stdenv/setup"
@@ -46,7 +46,7 @@ gzipEncodings = file:
4646 nixpkgs.stdenv.mkDerivation {
4747 name = "encodings";
4848
49− input = file;
49+ input = mkPath file;
5050
5151 builder = builtins.toFile "builder.sh" ''
5252 source "$stdenv/setup"
@@ -70,7 +70,7 @@ noEncodings = file:
7070 nixpkgs.stdenv.mkDerivation {
7171 name = "encodings";
7272
73− input = file;
73+ input = mkPath file;
7474
7575 builder = builtins.toFile "builder.sh" ''
7676 source "$stdenv/setup"
@@ -203,7 +203,7 @@ hashFile = path:
203203 nixpkgs.nix
204204 ];
205205 preferLocalBuild = true;
206− inherit path;
206+ path = mkPath path;
207207 } ''
208208 nix-hash --flat --base32 --type sha256 "$path" | tr -d '\n' >"$out"
209209 '');
@@ -224,7 +224,30 @@ symlink = path: {
224224 inherit path;
225225};
226226
227−# Given a encoding generation function and a file entry resulting from readDirRecursive in the form { name :: String, value: { path :: String } },
227+# Tests if a given character (string of length 1) is valid for a derivation path name.
228+# Passing a string of length other than 1 is undefined.
229+# :: Char -> Bool
230+isValidDrvNameChar = c: "a" <= c && c <= "z" || "A" <= c && c <= "Z" || "0" <= c && c <= "9" || c == "+" || c == "-" || c == "_" || c == "?" || c == "=" || c == ".";
231+
232+# Convert a string into a string that could be used in a derivation name.
233+# replacement lets you choose how to replace invalid characters. It may be any length.
234+# If it contains invalid characters then the result will also be invalid.
235+# :: { str :: String, replacement :: String } -> String
236+mkValidDrvName = { str, replacement ? "?" }:
237+ let
238+ newName = stringAsChars (c: if isValidDrvNameChar c then c else replacement) str;
239+ in if builtins.substring 0 1 newName == "." then "_" + newName else newName;
240+
241+# Like builtins.path but always ensures the name is valid.
242+mkPath = path:
243+ if builtins.typeOf path == "path" # Don't mess with non-paths
244+ then builtins.path {
245+ inherit path;
246+ name = mkValidDrvName { str = builtins.baseNameOf path; };
247+ }
248+ else path;
249+
250+# Given an encoding generation function and a file entry resulting from readDirRecursive in the form { name :: String, value: { path :: String } },
228251# build a DirEntry for dirToPath with the various encodings of the asset for dirToPath to build into a final directory tree.
229252mkAsset = encodings: {name, value}:
230253 let nameWithHash = "${hashFile value.path}-${name}";
lib/asset/manifest/obelisk-asset-manifest.cabal+4−2
@@ -24,7 +24,7 @@ library
2424 , template-haskell
2525 , text
2626 , transformers
27− , unix
27+ , unix-compat
2828 , vector
2929 exposed-modules:
3030 Obelisk.Asset.Gather
@@ -33,7 +33,9 @@ library
3333 Obelisk.Asset.TH
3434
3535 other-extensions: TemplateHaskell
36− ghc-options: -Wall -Werror -fno-warn-unused-do-bind -fwarn-tabs -funbox-strict-fields -O2 -fprof-auto-calls
36+ ghc-options:
37+ -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O2
38+ -fno-warn-unused-do-bind -funbox-strict-fields -fprof-auto-calls
3739
3840executable obelisk-asset-manifest-generate
3941 hs-source-dirs: src-bin
lib/asset/manifest/src/Obelisk/Asset/Symlink.hs+1−1
@@ -7,7 +7,7 @@ import Data.Map (Map)
77import qualified Data.Map as Map
88import System.Directory
99import System.FilePath.Posix
10−import System.Posix.Files
10+import System.PosixCompat.Files
1111
1212-- | Copy the given hashed files from one location to hashed paths in another
1313-- location, and symlink the unhashed paths to the hashed ones
lib/asset/serve-snap/obelisk-asset-serve-snap.cabal+4−2
@@ -23,10 +23,12 @@ library
2323 , obelisk-snap-extras
2424 , text
2525 , transformers
26− , unix
26+ , unix-compat
2727 exposed-modules:
2828 Obelisk.Asset.Accept
2929 Obelisk.Asset.Serve.Snap
3030
3131 other-extensions: TemplateHaskell
32− ghc-options: -Wall -Werror -fno-warn-unused-do-bind -fwarn-tabs -funbox-strict-fields -O2 -fprof-auto-calls
32+ ghc-options:
33+ -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O2
34+ -fno-warn-unused-do-bind -funbox-strict-fields -fprof-auto-calls
lib/asset/serve-snap/src/Obelisk/Asset/Serve/Snap.hs+1−1
@@ -31,7 +31,7 @@ import Data.Text.Encoding (decodeUtf8, encodeUtf8)
3131import System.Directory (getDirectoryContents)
3232import System.FilePath ((</>), splitFileName, takeDirectory)
3333import System.IO.Error (isDoesNotExistError)
34−import System.Posix (getFileStatus, fileSize)
34+import System.PosixCompat.Files (getFileStatus, fileSize)
3535
3636-- | Serve static assets from an asset directory generated via @assets.nix@ or, failing that, from a regular directory.
3737--
lib/backend/obelisk-backend.cabal+2−2
@@ -21,10 +21,10 @@ library
2121 obelisk-frontend,
2222 obelisk-route,
2323 obelisk-snap-extras,
24− reflex-dom,
24+ reflex-dom-core,
2525 snap,
2626 snap-server,
2727 text,
2828 universe
2929 exposed-modules: Obelisk.Backend
30− ghc-options: -Wall
30+ ghc-options: -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
lib/backend/src/Obelisk/Backend.hs+1−1
@@ -58,7 +58,7 @@ import qualified Obelisk.ExecutableConfig.Lookup as Lookup
5858import Obelisk.Frontend
5959import Obelisk.Route
6060import Obelisk.Snap.Extras (doNotCache, serveFileIfExistsAs)
61−import Reflex.Dom
61+import Reflex.Dom.Core
6262import Snap (MonadSnap, Snap, commandLineConfig, defaultConfig, getsRequest, httpServe, modifyResponse
6363 , rqPathInfo, rqQueryString, setContentType, writeBS, writeText
6464 , rqCookies, Cookie(..) , setHeader)
lib/cliapp/obelisk-cliapp.cabal+3−1
@@ -19,10 +19,12 @@ library
1919 , monad-loops
2020 , mtl
2121 , process
22+ , shell-escape
2223 , terminal-size
2324 , text
2425 , time
2526 , transformers
27+ , utf8-string
2628 exposed-modules:
2729 Obelisk.CliApp
2830 other-modules:
@@ -32,4 +34,4 @@ library
3234 Obelisk.CliApp.TerminalString
3335 Obelisk.CliApp.Theme
3436 Obelisk.CliApp.Types
35− ghc-options: -Wall -fobject-code
37+ ghc-options: -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
lib/cliapp/src/Obelisk/CliApp.hs+3
@@ -39,7 +39,9 @@ module Obelisk.CliApp
3939 , callCommand
4040 , callProcess
4141 , callProcessAndLogOutput
42+ , createProcess
4243 , createProcess_
44+ , exitCodeToException
4345 , overCreateProcess
4446 , proc
4547 , readCreateProcessWithExitCode
@@ -47,6 +49,7 @@ module Obelisk.CliApp
4749 , readProcessAndLogStderr
4850 , readProcessJSONAndLogStderr
4951 , reconstructCommand
52+ , runProcess_
5053 , setCwd
5154 , setDelegateCtlc
5255 , setEnvOverride
lib/cliapp/src/Obelisk/CliApp/Logging.hs+2−2
@@ -160,7 +160,7 @@ failWith :: (CliThrow e m, AsUnstructuredError e) => Text -> m a
160160failWith = throwError . review asUnstructuredError
161161
162162errorToWarning
163− :: (HasCliConfig e m, CliThrow e m, CliLog m)
163+ :: (HasCliConfig e m, CliLog m)
164164 => e -> m ()
165165errorToWarning e = do
166166 c <- getCliConfig
@@ -177,7 +177,7 @@ withExitFailMessage msg f = f `catch` \(e :: ExitCode) -> do
177177 throwM e
178178
179179-- | Write log to stdout, with colors (unless `noColor`)
180−writeLog :: (MonadIO m, MonadMask m) => Bool -> Bool -> WithSeverity Text -> m ()
180+writeLog :: (MonadIO m) => Bool -> Bool -> WithSeverity Text -> m ()
181181writeLog withNewLine noColor (WithSeverity severity s) = if T.null s then pure () else write
182182 where
183183 write
lib/cliapp/src/Obelisk/CliApp/Process.hs+48−29
@@ -1,7 +1,6 @@
11{-# LANGUAGE FlexibleContexts #-}
22{-# LANGUAGE LambdaCase #-}
33{-# LANGUAGE MultiParamTypeClasses #-}
4−{-# LANGUAGE MultiWayIf #-}
54{-# LANGUAGE OverloadedStrings #-}
65{-# LANGUAGE ScopedTypeVariables #-}
76{-# LANGUAGE TupleSections #-}
@@ -17,6 +16,7 @@ module Obelisk.CliApp.Process
1716 , callProcessAndLogOutput
1817 , createProcess
1918 , createProcess_
19+ , exitCodeToException
2020 , overCreateProcess
2121 , proc
2222 , readCreateProcessWithExitCode
@@ -24,6 +24,7 @@ module Obelisk.CliApp.Process
2424 , readProcessAndLogStderr
2525 , readProcessJSONAndLogStderr
2626 , reconstructCommand
27+ , runProcess_
2728 , setCwd
2829 , setDelegateCtlc
2930 , setEnvOverride
@@ -32,12 +33,14 @@ module Obelisk.CliApp.Process
3233 ) where
3334
3435import Control.Monad ((<=<), join, void)
36+import Control.Monad.Catch (MonadMask, bracketOnError)
3537import Control.Monad.Except (throwError)
3638import Control.Monad.Fail
3739import Control.Monad.IO.Class (MonadIO, liftIO)
3840import Control.Lens (Prism', review)
3941import qualified Data.ByteString as BS
4042import qualified Data.ByteString.Char8 as BSC
43+import qualified Data.ByteString.UTF8 as BSU
4144import Data.Function (fix)
4245import Data.Map (Map)
4346import qualified Data.Map as Map
@@ -54,6 +57,7 @@ import qualified System.IO.Streams as Streams
5457import System.IO.Streams.Concurrent (concurrentMerge)
5558import System.Process (CreateProcess, ProcessHandle, StdStream (CreatePipe), std_err, std_out)
5659import qualified System.Process as Process
60+import Text.ShellEscape (bash, bytes)
5761import qualified Data.Aeson as Aeson
5862
5963import Control.Monad.Log (Severity (..))
@@ -97,7 +101,7 @@ instance AsProcessFailure ProcessFailure where
97101 asProcessFailure = id
98102
99103readProcessAndLogStderr
100− :: (MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e, MonadFail m)
104+ :: (MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e, MonadMask m)
101105 => Severity -> ProcessSpec -> m Text
102106readProcessAndLogStderr sev process = do
103107 (out, _err) <- withProcess process $ \_out err -> do
@@ -105,7 +109,7 @@ readProcessAndLogStderr sev process = do
105109 liftIO $ T.decodeUtf8With lenientDecode <$> BS.hGetContents out
106110
107111readProcessJSONAndLogStderr
108− :: (Aeson.FromJSON a, MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e, MonadFail m)
112+ :: (Aeson.FromJSON a, MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e, MonadMask m)
109113 => Severity -> ProcessSpec -> m a
110114readProcessJSONAndLogStderr sev process = do
111115 (out, _err) <- withProcess process $ \_out err -> do
@@ -118,7 +122,7 @@ readProcessJSONAndLogStderr sev process = do
118122 throwError $ review asProcessFailure $ ProcessFailure (Process.cmdspec $ _processSpec_createProcess process) 0
119123
120124readCreateProcessWithExitCode
121− :: (MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e)
125+ :: (MonadIO m, CliLog m)
122126 => ProcessSpec -> m (ExitCode, String, String)
123127readCreateProcessWithExitCode procSpec = do
124128 process <- mkCreateProcess procSpec
@@ -128,10 +132,10 @@ readCreateProcessWithExitCode procSpec = do
128132-- | Like `System.Process.readProcess` but logs the combined output (stdout and stderr)
129133-- with the corresponding severity.
130134--
131−-- Usually this function is called as `callProcessAndLogOutput (Debug, Error)`. However
135+-- Usually this function is called as `readProcessAndLogOutput (Debug, Error)`. However
132136-- some processes are known to spit out diagnostic or informative messages in stderr, in
133137-- which case it is advisable to call it with a non-Error severity for stderr, like
134−-- `callProcessAndLogOutput (Debug, Debug)`.
138+-- `readProcessAndLogOutput (Debug, Debug)`.
135139readProcessAndLogOutput
136140 :: (MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e, MonadFail m)
137141 => (Severity, Severity) -> ProcessSpec -> m Text
@@ -144,9 +148,7 @@ readProcessAndLogOutput (sev_out, sev_err) process = do
144148 outText <- liftIO $ T.decodeUtf8With lenientDecode <$> BS.hGetContents out
145149 putLogRaw sev_out outText
146150
147− waitForProcess p >>= \case
148− ExitSuccess -> pure outText
149− ExitFailure code -> throwError $ review asProcessFailure $ ProcessFailure (Process.cmdspec $ _processSpec_createProcess process) code
151+ outText <$ (exitCodeToException process =<< waitForProcess p)
150152
151153-- | Like 'System.Process.callProcess' but logs the combined output (stdout and stderr)
152154-- with the corresponding severity.
@@ -156,7 +158,7 @@ readProcessAndLogOutput (sev_out, sev_err) process = do
156158-- which case it is advisable to call it with a non-Error severity for stderr, like
157159-- `callProcessAndLogOutput (Debug, Debug)`.
158160callProcessAndLogOutput
159− :: (MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e, MonadFail m)
161+ :: (MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e, MonadMask m)
160162 => (Severity, Severity) -> ProcessSpec -> m ()
161163callProcessAndLogOutput (sev_out, sev_err) process =
162164 void $ withProcess process $ \out err -> do
@@ -186,12 +188,11 @@ createProcess_ name procSpec = do
186188 liftIO $ Process.createProcess_ name p
187189
188190mkCreateProcess :: MonadIO m => ProcessSpec -> m Process.CreateProcess
189−mkCreateProcess (ProcessSpec p override') = do
190− case override' of
191− Nothing -> pure p
192− Just override -> do
193− procEnv <- Map.fromList <$> maybe (liftIO getEnvironment) pure (Process.env p)
194− pure $ p { Process.env = Just $ Map.toAscList (override procEnv) }
191+mkCreateProcess (ProcessSpec p override') = case override' of
192+ Nothing -> pure p
193+ Just override -> do
194+ procEnv <- Map.fromList <$> maybe (liftIO getEnvironment) pure (Process.env p)
195+ pure $ p { Process.env = Just $ Map.toAscList (override procEnv) }
195196
196197-- | Like `System.Process.callProcess` but also logs (debug) the process being run
197198callProcess
@@ -210,18 +211,30 @@ callCommand cmd = do
210211 liftIO $ Process.callCommand cmd
211212
212213withProcess
213− :: (MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e, MonadFail m)
214+ :: (MonadIO m, CliLog m, CliThrow e m, AsProcessFailure e, MonadMask m)
214215 => ProcessSpec -> (Handle -> Handle -> m ()) -> m (Handle, Handle)
215−withProcess process f = do -- TODO: Use bracket.
216− -- FIXME: Using `withCreateProcess` here leads to something operating illegally on closed handles.
217− (_, Just out, Just err, p) <- createProcess $ overCreateProcess
218− (\x -> x { std_out = CreatePipe , std_err = CreatePipe }) process
219−
220− f out err -- Pass the handles to the passed function
221−
222− waitForProcess p >>= \case
223− ExitSuccess -> return (out, err)
224− ExitFailure code -> throwError $ review asProcessFailure $ ProcessFailure (Process.cmdspec $ _processSpec_createProcess process) code
216+withProcess process f =
217+ bracketOnError
218+ (createProcess $ overCreateProcess
219+ (\x -> x { std_out = CreatePipe , std_err = CreatePipe }) process
220+ )
221+ (liftIO . Process.cleanupProcess)
222+ (\case
223+ (_, Just out, Just err, p) -> do
224+ f out err
225+ (out, err) <$ (exitCodeToException process =<< waitForProcess p)
226+ _ -> error "withProcess: createProcess did not provide handles for CreatePipe as expected"
227+ )
228+
229+-- | Runs a process to completion failing if it does not exit cleanly.
230+runProcess_
231+ :: (MonadIO m, CliLog m, CliThrow e m, MonadMask m, AsProcessFailure e)
232+ => ProcessSpec -> m ()
233+runProcess_ process =
234+ bracketOnError
235+ (createProcess process)
236+ (liftIO . Process.cleanupProcess)
237+ (\(_, _, _, ph) -> exitCodeToException process =<< waitForProcess ph)
225238
226239-- Create an input stream from the file handle, associating each item with the given severity.
227240streamHandle :: Severity -> Handle -> IO (InputStream (Severity, BSC.ByteString))
@@ -240,14 +253,20 @@ streamToLog stream = fix $ \loop -> do
240253waitForProcess :: MonadIO m => ProcessHandle -> m ExitCode
241254waitForProcess = liftIO . Process.waitForProcess
242255
256+-- | Converts an 'ExitCode' to an exception when it's non-zero.
257+exitCodeToException :: (CliThrow e m, AsProcessFailure e) => ProcessSpec -> ExitCode -> m ()
258+exitCodeToException spec = \case
259+ ExitSuccess -> pure ()
260+ ExitFailure code -> throwError $ review asProcessFailure $ ProcessFailure (Process.cmdspec $ _processSpec_createProcess spec) code
261+
243262-- | Pretty print a 'CmdSpec'
244263reconstructCommand :: Process.CmdSpec -> Text
245264reconstructCommand p = case p of
246265 Process.ShellCommand str -> T.pack str
247266 Process.RawCommand c as -> processToShellString c as
248267 where
249− processToShellString cmd args = T.unwords $ map quoteAndEscape (cmd : args)
250− quoteAndEscape x = "'" <> T.replace "'" "'\''" (T.pack x) <> "'"
268+ processToShellString cmd args = T.pack $ unwords $
269+ map (BSU.toString . bytes . bash . BSU.fromString) (cmd : args)
251270
252271reconstructProcSpec :: ProcessSpec -> Text
253272reconstructProcSpec = reconstructCommand . Process.cmdspec . _processSpec_createProcess
lib/command/obelisk-command.cabal+4−2
@@ -39,13 +39,15 @@ library
3939 , optparse-applicative
4040 , placeholders
4141 , process
42+ , shell-escape
4243 , temporary
4344 , terminal-size
4445 , text
4546 , time
4647 , transformers
47− , unix
48+ , unix-compat
4849 , unordered-containers
50+ , utf8-string
4951 , which
5052 , yaml
5153 exposed-modules:
@@ -64,4 +66,4 @@ library
6466executable ob
6567 main-is: src-bin/ob.hs
6668 build-depends: base, obelisk-command
67− ghc-options: -Wall -O2 -threaded
69+ ghc-options: -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O -threaded
lib/command/src/Obelisk/Command.hs+12−8
@@ -22,7 +22,7 @@ import System.Environment
2222import System.FilePath
2323import qualified System.Info
2424import System.IO (hIsTerminalDevice, stdout)
25−import System.Posix.Process (executeFile)
25+import System.Process (rawSystem)
2626
2727import Obelisk.App
2828import Obelisk.CliApp
@@ -114,7 +114,7 @@ obCommand cfg = hsubparser
114114 , command "thunk" $ info (ObCommand_Thunk <$> thunkOption) $ progDesc "Manipulate thunk directories"
115115 , command "repl" $ info (ObCommand_Repl <$> interpretOpts) $ progDesc "Open an interactive interpreter"
116116 , command "watch" $ info (ObCommand_Watch <$> interpretOpts) $ progDesc "Watch current project for errors and warnings"
117− , command "shell" $ info (ObCommand_Shell <$> shellOpts) $ progDesc "Enter a shell with project dependencies"
117+ , command "shell" $ info (ObCommand_Shell <$> shellOpts) $ progDesc "Enter a shell with project dependencies or run a command in such a shell. E.g. ob shell -- ghc-pkg list"
118118 , command "doc" $ info (ObCommand_Doc <$> shellFlags <*> packageNames) $
119119 progDesc "List paths to haddock documentation for specified packages"
120120 <> footerDoc (Just $
@@ -285,7 +285,10 @@ shellOpts :: Parser ShellOpts
285285shellOpts = ShellOpts
286286 <$> shellFlags
287287 <*> interpretOpts
288− <*> optional (strArgument (metavar "COMMAND"))
288+ -- This funny construction is used to support optparse-applicative's @--@ parsing.
289+ -- All arguments after @--@ are left unparsed and instead provided to the last positional parser
290+ -- which must therefore be 'many' in order to consume the rest of the input.
291+ <*> ((\xs -> if null xs then Nothing else Just $ unwords xs) <$> many (strArgument (metavar "COMMAND")))
289292
290293portOpt :: Int -> Parser Int
291294portOpt dfault = option auto (long "port" <> short 'p' <> help "Port number for server" <> showDefault <> value dfault <> metavar "INT")
@@ -363,7 +366,8 @@ main' argsCfg = do
363366 Just impl -> do
364367 -- Invoke the real implementation, using --no-handoff to prevent infinite recursion
365368 putLog Debug $ "Handing off to " <> T.pack impl
366− liftIO $ executeFile impl False ("--no-handoff" : myArgs) Nothing
369+ _ <- liftIO $ rawSystem impl ("--no-handoff" : myArgs)
370+ return ()
367371 case myArgs of
368372 "--no-handoff" : as -> go as -- If we've been told not to hand off, don't hand off
369373 origPath:inPath:outPath:preprocessorName:packagePaths
@@ -398,11 +402,11 @@ ob = \case
398402 ObCommand_Repl interpretPathsList -> withInterpretPaths interpretPathsList runRepl
399403 ObCommand_Watch interpretPathsList -> withInterpretPaths interpretPathsList runWatch
400404 ObCommand_Shell (ShellOpts shellAttr interpretPathsList cmd) -> withInterpretPaths interpretPathsList $ \root interpretPaths ->
401− nixShellForInterpretPaths False shellAttr root interpretPaths cmd
402− ObCommand_Doc shellAttr pkgs -> withProjectRoot "." $ \root ->
403− nixShellForInterpretPaths True shellAttr root emptyPathTree $ Just $ haddockCommand pkgs
405+ nixShellForInterpretPaths False shellAttr root interpretPaths cmd -- N.B. We do NOT bash escape here; we want to run the command as-is
406+ ObCommand_Doc shellAttr pkgs -> withInterpretPaths [] $ \root interpretPaths ->
407+ nixShellForInterpretPaths True shellAttr root interpretPaths $ Just $ haddockCommand pkgs
404408 ObCommand_Hoogle shell' port -> withProjectRoot "." $ \root -> do
405− nixShellWithHoogle root True shell' $ Just $ "hoogle server -p " <> show port <> " --local"
409+ nixShellWithHoogle root True shell' $ Just $ "hoogle server -p" <> show port <> " --local"
406410 ObCommand_Internal icmd -> case icmd of
407411 ObInternal_ApplyPackages origPath inPath outPath packagePaths -> do
408412 liftIO $ Preprocessor.applyPackages origPath inPath outPath packagePaths
lib/command/src/Obelisk/Command/Deploy.hs+16−16
@@ -25,7 +25,7 @@ import GHC.Generics
2525import System.Directory
2626import System.FilePath
2727import System.IO
28−import System.Posix.Files
28+import System.PosixCompat.Files
2929import Text.URI (URI)
3030import qualified Text.URI as URI
3131import Text.URI.Lens
@@ -85,13 +85,12 @@ deployInit' thunkPtr (DeployInitOpts deployDir sshKeyPath hostnames route adminE
8585 --accidentally create a production deployment that uses development
8686 --credentials to connect to some resources. This could result in, e.g.,
8787 --production data backed up to a dev environment.
88− withSpinner "Creating project configuration directories" $ do
89− callProcessAndLogOutput (Notice, Error) $
90− proc "mkdir" [ "-p"
91− , deployDir </> "config" </> "backend"
92− , deployDir </> "config" </> "common"
93− , deployDir </> "config" </> "frontend"
94− ]
88+ withSpinner "Creating project configuration directories" $ liftIO $ do
89+ mapM_ (createDirectoryIfMissing True)
90+ [ deployDir </> "config" </> "backend"
91+ , deployDir </> "config" </> "common"
92+ , deployDir </> "config" </> "frontend"
93+ ]
9594
9695 let srcDir = deployDir </> "src"
9796 withSpinner ("Creating source thunk (" <> T.pack (makeRelative deployDir srcDir) <> ")") $ do
@@ -162,8 +161,8 @@ deployPush deployPath getNixBuilders = do
162161 "nix-copy-closure" ["-v", "--to", "--use-substitutes", "root@" <> host, "--gzip", outputPath]
163162 withSpinner "Uploading config" $ ifor_ buildOutputByHost $ \host _ -> do
164163 callProcessAndLogOutput (Notice, Warning) $
165− proc "rsync"
166− [ "-e ssh " <> unwords sshOpts
164+ proc rsyncPath
165+ [ "-e " <> sshPath <> " " <> unwords sshOpts
167166 , "-qarvz"
168167 , deployPath </> "config"
169168 , "root@" <> host <> ":/var/lib/backend"
@@ -171,9 +170,10 @@ deployPush deployPath getNixBuilders = do
171170 --TODO: Create GC root so we're sure our closure won't go away during this time period
172171 withSpinner "Switching to new configuration" $ ifor_ buildOutputByHost $ \host outputPath -> do
173172 callProcessAndLogOutput (Notice, Warning) $
174− proc "ssh" $ sshOpts <>
173+ proc sshPath $ sshOpts <>
175174 [ "root@" <> host
176175 , unwords
176+ -- Note that we don't want to $(staticWhich "nix-env") here, because this is executing on a remote machine
177177 [ "nix-env -p /nix/var/nix/profiles/system --set " <> outputPath
178178 , "&&"
179179 , "/nix/var/nix/profiles/system/bin/switch-to-configuration switch"
@@ -182,10 +182,10 @@ deployPush deployPath getNixBuilders = do
182182 isClean <- checkGitCleanStatus deployPath True
183183 when (not isClean) $ do
184184 withSpinner "Committing changes to Git" $ do
185− callProcessAndLogOutput (Debug, Error) $ proc "git"
186− ["-C", deployPath, "add", "."]
187− callProcessAndLogOutput (Debug, Error) $ proc "git"
188− ["-C", deployPath, "commit", "-m", "New deployment"]
185+ callProcessAndLogOutput (Debug, Error) $
186+ gitProc deployPath ["add", "."]
187+ callProcessAndLogOutput (Debug, Error) $
188+ gitProc deployPath ["commit", "-m", "New deployment"]
189189 putLog Notice $ "Deployed => " <> T.pack route
190190 where
191191 callProcess' envMap cmd args = do
@@ -315,7 +315,7 @@ readDeployConfig deployDir fname = liftIO $ do
315315
316316verifyHostKey :: MonadObelisk m => FilePath -> FilePath -> String -> m ()
317317verifyHostKey knownHostsPath keyPath hostName =
318− callProcessAndLogOutput (Notice, Warning) $ proc "ssh" $
318+ callProcessAndLogOutput (Notice, Warning) $ proc sshPath $
319319 sshArgs knownHostsPath keyPath True <>
320320 [ "root@" <> hostName
321321 , "-o", "NumberOfPasswordPrompts=0"
lib/command/src/Obelisk/Command/Preprocessor.hs+50−46
@@ -5,6 +5,7 @@ module Obelisk.Command.Preprocessor where
55
66import qualified Data.ByteString.Lazy as BL
77import qualified Data.ByteString.Lazy.Builder as BU
8+import Data.Foldable (for_)
89import Data.List (intersperse, isPrefixOf, sortOn)
910import Data.Maybe (fromMaybe)
1011import qualified Data.Text.Lazy.Builder as TL
@@ -17,79 +18,82 @@ import System.FilePath (hasTrailingPathSeparator, joinPath, splitPath)
1718
1819import Obelisk.Command.Run (CabalPackageInfo (..), parseCabalPackage')
1920
21+-- | This code is intended to be executed via ghci's -pgmF preprocessor option.
22+-- The command line arguments are passed in via ghc, which dictates the first three options and meanings
23+-- In order for this code to execute, origPath must contain either a '.' character or a '/' character.
24+-- (This is to avoid the possibility of the command line syntax conflicting with another ob command)
25+-- We do have control over the remaining arguments, but they must be the same for all files.
26+-- Thus, the fourth command line argument must be "apply-packages", which has already been handled.
27+-- We assume all the remaining arguments passed in are paths to cabal or hpack package specifications.
28+-- Thus we must select among the packagePaths for the file we are going to parse.
2029applyPackages :: FilePath -> FilePath -> FilePath -> [FilePath] -> IO ()
21−applyPackages origPath inPath outPath packagePaths' = withFile outPath WriteMode $ \outFile -> do
22− -- This code is intended to be executed via ghci's -pgmF preprocessor option
23− -- The command line arguments are passed in via ghc, which dictates the first three options and meanings
24− -- In order for this code to execute, origPath must contain either a '.' character or a '/' character.
25− -- (This is to avoid the possibility of the command line syntax conflicting with another ob command)
26− -- We do have control over the remaining arguments, but they must be the same for all files.
27− -- Thus, the fourth command line argument must be "apply-packages", which has already been handled.
28− -- We assume all the remaining arguments passed in are paths to cabal or hpack package specifications.
29− -- Thus we must select among the packagePaths for the file we are going to parse.
30−
30+applyPackages origPath inPath outPath packagePaths' = do
3131 origPathCanonical <- canonicalizePath origPath
3232 packagePaths <- traverse canonicalizePath packagePaths'
3333
34− let takeDirs = takeWhile hasTrailingPathSeparator
35− packageDirs = sortOn (negate . length . takeDirs) $ map splitPath packagePaths
36− origDir = splitPath origPathCanonical
37− matches = [ joinPath d | d <- packageDirs, takeDirs d `isPrefixOf` origDir ]
34+ let
35+ takeDirs = takeWhile hasTrailingPathSeparator
36+ packageDirs = sortOn (negate . length . takeDirs) $ map splitPath packagePaths
37+ origDir = splitPath origPathCanonical
38+ matches = [ joinPath d | d <- packageDirs, takeDirs d `isPrefixOf` origDir ]
3839
39− -- So the first element of matches is going to be the deepest path to a package spec that contains
40+ -- The first element of matches is going to be the deepest path to a package spec that contains
4041 -- our file as a subdirectory.
41−
42− case matches of
43− [] ->
42+ packageInfo' <- case matches of
43+ [] -> do
4444 hPutStrLn stderr $ "Error: Unable to find cabal information for " <> origPath <> "; Skipping preprocessor."
45− packagePath:_ -> do
46− parseCabalPackage' packagePath >>= \case
47− Left err ->
48− hPutStrLn stderr $ "Error: Unable to parse cabal package " <> packagePath <> "; Skipping preprocessor on " <> origPath <> ". Error: " <> show err
49− Right (_warnings, packageInfo) ->
50− hPutTextBuilder outFile (generateHeader origPath packageInfo)
45+ pure Nothing
46+ packagePath:_ -> parseCabalPackage' packagePath >>= \case
47+ Left err -> do
48+ hPutStrLn stderr $ "Error: Unable to parse cabal package " <> packagePath <> "; Skipping preprocessor on " <> origPath <> ". Error: " <> show err
49+ pure Nothing
50+ Right (_, packageInfo) -> pure $ Just packageInfo
5151
52− BL.readFile inPath >>= BL.hPut outFile
52+ writeOutput packageInfo' inPath outPath
5353
54+writeOutput :: Maybe CabalPackageInfo -> FilePath -> FilePath -> IO ()
55+writeOutput packageInfo' origPath outPath = withFile outPath WriteMode $ \hOut -> do
56+ for_ packageInfo' $ \packageInfo -> hPutTextBuilder hOut (generateHeader origPath packageInfo)
57+ BL.readFile origPath >>= BL.hPut hOut
5458 where
5559 hPutTextBuilder h = BU.hPutBuilder h . TL.encodeUtf8Builder . TL.toLazyText
5660
57−
58− -- I'm pretty sure there's a certain amount of oversimplification in CabalPackageInfo, so I doubt this is fully robust.
59−
6061generateHeader :: FilePath -> CabalPackageInfo -> TL.Builder
6162generateHeader origPath packageInfo =
6263 hsExtensions <> ghcOptions <> lineNumberPragma origPath
6364 where
6465 hsExtensions =
65− if not (null extList)
66− then TL.fromText "{-# LANGUAGE "
67− <> mconcat (intersperse (TL.fromText ", ") extList)
68− <> TL.fromText " #-}\n"
69− else mempty
66+ if null extList
67+ then mempty
68+ else pragma $ TL.fromText "LANGUAGE " <> mconcat (intersperse (TL.fromText ", ") extList)
7069 extList = addDefaultLanguage $ concatMap showExt $ _cabalPackageInfo_defaultExtensions packageInfo
7170 addDefaultLanguage =
7271 case _cabalPackageInfo_defaultLanguage packageInfo of
7372 Nothing -> id
7473 Just x -> case x of
75− UnknownLanguage ext -> ( TL.fromString ext :)
76− ext -> ( TL.fromString (show ext) :)
74+ UnknownLanguage ext -> (TL.fromString ext :)
75+ ext -> (TL.fromString (show ext) :)
7776 showExt = \case
7877 EnableExtension ext -> [TL.fromString (show ext)]
7978 DisableExtension _ -> []
8079 UnknownExtension ext -> [TL.fromString ext]
8180
8281 ghcOptions =
83− if not (null optList)
84− then TL.fromText "{-# OPTIONS_GHC "
85− <> mconcat (intersperse (TL.fromText " ") optList)
86− <> TL.fromText " #-}\n"
87− else mempty
88− optList = map TL.fromString
89− $ filter (not . isPrefixOf "-O")
90− $ fromMaybe []
91− $ lookup GHC (_cabalPackageInfo_compilerOptions packageInfo)
82+ if null optList
83+ then mempty
84+ else pragma $
85+ TL.fromText "OPTIONS_GHC " <> mconcat (intersperse (TL.fromText " ") (map TL.fromString optList))
86+ ghcOptList
87+ = filter (not . isPrefixOf "-O")
88+ $ fromMaybe []
89+ $ lookup GHC (_cabalPackageInfo_compilerOptions packageInfo)
90+ optList = _cabalPackageInfo_cppOptions packageInfo <> ghcOptList
9291
9392lineNumberPragma :: FilePath -> TL.Builder
94−lineNumberPragma origPath =
95− TL.fromText "{-# LINE 1 \"" <> TL.fromString origPath <> TL.fromText "\" #-}\n"
93+lineNumberPragma origPath = pragma $ TL.fromText "LINE 1 " <> quoted '"' (TL.fromString origPath)
94+
95+pragma :: TL.Builder -> TL.Builder
96+pragma x = TL.fromText "{-# " <> x <> TL.fromText " #-}\n"
97+
98+quoted :: Char -> TL.Builder -> TL.Builder
99+quoted char x = TL.singleton char <> x <> TL.singleton char
lib/command/src/Obelisk/Command/Project.hs+26−15
@@ -15,6 +15,7 @@ module Obelisk.Command.Project
1515 , toImplDir
1616 , toObeliskDir
1717 , withProjectRoot
18+ , bashEscape
1819 ) where
1920
2021import Control.Concurrent.MVar (MVar, newMVar, withMVarMasked)
@@ -23,6 +24,7 @@ import Control.Monad
2324import Control.Monad.IO.Class (liftIO)
2425import Control.Monad.State
2526import qualified Data.Aeson as Json
27+import qualified Data.ByteString.UTF8 as BSU
2628import Data.Bits
2729import qualified Data.ByteString.Lazy as BSL
2830import Data.Default (def)
@@ -30,15 +32,17 @@ import Data.Function ((&), on)
3032import Data.Map (Map)
3133import Data.Text (Text)
3234import qualified Data.Text as T
33−import Data.Text.Encoding (decodeUtf8)
35+import Data.Text.Encoding (decodeUtf8, encodeUtf8)
3436import Data.Traversable (for)
3537import System.Directory
3638import System.Environment (lookupEnv)
3739import System.FilePath
3840import System.IO.Temp
3941import System.IO.Unsafe (unsafePerformIO)
40−import System.Posix (FileStatus, FileMode, CMode (..), UserID, deviceID, fileID, fileMode, fileOwner, getFileStatus, getRealUserID)
41−import System.Posix.Files
42+import System.PosixCompat.Files
43+import System.PosixCompat.Types
44+import System.PosixCompat.User
45+import Text.ShellEscape (bash, bytes)
4246
4347import GitHub.Data.GitData (Branch)
4448import GitHub.Data.Name (Name)
@@ -47,7 +51,7 @@ import Obelisk.App (MonadObelisk)
4751import Obelisk.CliApp
4852import Obelisk.Command.Nix
4953import Obelisk.Command.Thunk
50−import Obelisk.Command.Utils (nixBuildExePath, nixExePath, toNixPath)
54+import Obelisk.Command.Utils (nixBuildExePath, nixExePath, toNixPath, cp, nixShellPath)
5155
5256--TODO: Make this module resilient to random exceptions
5357
@@ -112,7 +116,7 @@ initProject source force = withSystemTempDirectory "ob-init" $ \tmpDir -> do
112116 skel <- nixBuildAttrWithCache implDir "skeleton" --TODO: I don't think there's actually any reason to cache this
113117
114118 callProcessAndLogOutput (Notice, Error) $
115− proc "cp"
119+ proc cp
116120 [ "-r"
117121 , "--preserve=links"
118122 , obDir
@@ -122,7 +126,7 @@ initProject source force = withSystemTempDirectory "ob-init" $ \tmpDir -> do
122126
123127 withSpinner "Copying project skeleton" $ do
124128 callProcessAndLogOutput (Notice, Error) $
125− proc "cp"
129+ proc cp
126130 [ "-r"
127131 , "--no-preserve=mode"
128132 , "-T"
@@ -133,6 +137,12 @@ initProject source force = withSystemTempDirectory "ob-init" $ \tmpDir -> do
133137 let configDir = "config"
134138 createDirectoryIfMissing False configDir
135139 mapM_ (createDirectoryIfMissing False . (configDir </>)) ["backend", "common", "frontend"]
140+ putLog Notice $ T.intercalate "\n"
141+ [ "An obelisk project has been successfully initialized. Next steps:"
142+ , " 'ob run': Start a development server"
143+ , " 'ob watch': Watch for changes without starting a server"
144+ , " 'ob repl': Load your project into GHCi"
145+ ]
136146
137147callHandoffOb
138148 :: MonadObelisk m
@@ -278,14 +288,17 @@ nixShellRunConfig root isPure command = do
278288 pure $ def
279289 & nixShellConfig_pure .~ isPure
280290 & nixShellConfig_common . nixCmdConfig_target .~ (def & target_path .~ Nothing)
281− & nixShellConfig_run .~ (command <&> \c -> mconcat
282− [ "export NIX_PATH=nixpkgs=", T.unpack nixpkgsPath, "; "
283− , maybe "" (\v -> "export NIX_REMOTE=" <> v <> "; ") nixRemote
284− , c
291+ & nixShellConfig_run .~ (command <&> \cs -> unwords $ concat
292+ [ ["export", BSU.toString . bytes . bash $ "NIX_PATH=nixpkgs=" <> encodeUtf8 nixpkgsPath, ";"]
293+ , maybe [] (\v -> ["export", BSU.toString . bytes . bash $ "NIX_REMOTE=" <> encodeUtf8 (T.pack v), ";"]) nixRemote
294+ , [cs]
285295 ])
286296
297+bashEscape :: String -> String
298+bashEscape = BSU.toString . bytes . bash . BSU.fromString
299+
287300nixShellRunProc :: NixShellConfig -> ProcessSpec
288−nixShellRunProc cfg = setDelegateCtlc True $ proc "nix-shell" $ runNixShellConfig cfg
301+nixShellRunProc cfg = setDelegateCtlc True $ proc nixShellPath $ runNixShellConfig cfg
289302
290303nixShellWithoutPkgs
291304 :: MonadObelisk m
@@ -300,7 +313,7 @@ nixShellWithoutPkgs root isPure chdirToRoot packageNamesAndPaths shellAttr comma
300313 packageNamesAndAbsPaths <- liftIO $ for packageNamesAndPaths makeAbsolute
301314 defShellConfig <- nixShellRunConfig root isPure command
302315 let setCwd_ = if chdirToRoot then setCwd (Just root) else id
303− (_, _, _, ph) <- createProcess_ "nixShellWithoutPkgs" $ setCwd_ $ nixShellRunProc $ defShellConfig
316+ runProcess_ $ setCwd_ $ nixShellRunProc $ defShellConfig
304317 & nixShellConfig_common . nixCmdConfig_target . target_expr ?~
305318 "{root, pkgs, shell}: ((import root {}).passthru.__unstable__.self.extend (_: _: {\
306319 \shellPackages = builtins.fromJSON pkgs;\
@@ -310,18 +323,16 @@ nixShellWithoutPkgs root isPure chdirToRoot packageNamesAndPaths shellAttr comma
310323 , strArg "pkgs" (T.unpack $ decodeUtf8 $ BSL.toStrict $ Json.encode packageNamesAndAbsPaths)
311324 , strArg "shell" shellAttr
312325 ]
313− void $ waitForProcess ph
314326
315327nixShellWithHoogle :: MonadObelisk m => FilePath -> Bool -> String -> Maybe String -> m ()
316328nixShellWithHoogle root isPure shell' command = do
317329 defShellConfig <- nixShellRunConfig root isPure command
318− (_, _, _, ph) <- createProcess_ "nixShellWithHoogle" $ setCwd (Just root) $ nixShellRunProc $ defShellConfig
330+ runProcess_ $ setCwd (Just root) $ nixShellRunProc $ defShellConfig
319331 & nixShellConfig_common . nixCmdConfig_target . target_expr ?~
320332 "{shell}: ((import ./. {}).passthru.__unstable__.self.extend (_: super: {\
321333 \userSettings = super.userSettings // { withHoogle = true; };\
322334 \})).project.shells.${shell}"
323335 & nixShellConfig_common . nixCmdConfig_args .~ [ strArg "shell" shell' ]
324− void $ waitForProcess ph
325336
326337findProjectAssets :: MonadObelisk m => FilePath -> m Text
327338findProjectAssets root = do
lib/command/src/Obelisk/Command/Run.hs+64−51
@@ -14,7 +14,7 @@ module Obelisk.Command.Run where
1414import Control.Arrow ((&&&))
1515import Control.Exception (Exception, bracket)
1616import Control.Lens (ifor, (.~), (&))
17−import Control.Monad (filterM, unless, void)
17+import Control.Monad (filterM, unless)
1818import Control.Monad.Except (runExceptT, throwError)
1919import Control.Monad.IO.Class (liftIO)
2020import Control.Monad.Reader (MonadIO)
@@ -25,12 +25,14 @@ import Data.Default (def)
2525import Data.Either (partitionEithers)
2626import Data.Foldable (fold, for_, toList)
2727import Data.Functor.Identity (runIdentity)
28+import Data.List (intercalate)
2829import Data.List.NonEmpty (NonEmpty)
2930import qualified Data.List.NonEmpty as NE
3031import Data.Map (Map)
3132import qualified Data.Map as Map
3233import qualified Data.Map.Monoidal as MMap
33−import Data.Maybe
34+import Data.Maybe (catMaybes, fromMaybe, mapMaybe)
35+import Data.Ord (comparing)
3436import Data.Set (Set)
3537import qualified Data.Set as Set
3638import Data.String.Here.Interpolated (i)
@@ -44,17 +46,17 @@ import Distribution.Compiler (CompilerFlavor(..))
4446import Distribution.PackageDescription.Parsec (parseGenericPackageDescription)
4547import Distribution.Parsec.ParseResult (runParseResult)
4648import qualified Distribution.System as Dist
47−import Distribution.Types.BuildInfo
48−import Distribution.Types.CondTree
49−import Distribution.Types.GenericPackageDescription
50−import Distribution.Types.Library
51−import Distribution.Utils.Generic
49+import Distribution.Types.BuildInfo (buildable, cppOptions, defaultExtensions, defaultLanguage, hsSourceDirs, options)
50+import Distribution.Types.CondTree (simplifyCondTree)
51+import Distribution.Types.GenericPackageDescription (ConfVar (Arch, Impl, OS), condLibrary)
52+import Distribution.Types.Library (libBuildInfo)
53+import Distribution.Utils.Generic (toUTF8BS, readUTF8File)
5254import qualified Distribution.Parsec.Common as Dist
5355import qualified Hpack.Config as Hpack
5456import qualified Hpack.Render as Hpack
5557import qualified Hpack.Yaml as Hpack
56−import Language.Haskell.Extension
57−import Network.Socket hiding (Debug)
58+import Language.Haskell.Extension (Extension, Language)
59+import qualified Network.Socket as Socket
5860import System.Directory
5961import System.Environment (getExecutablePath)
6062import System.FilePath
@@ -64,19 +66,18 @@ import System.IO.Temp (withSystemTempDirectory)
6466import Obelisk.App (MonadObelisk)
6567import Obelisk.CliApp (
6668 Severity (..),
67− createProcess_,
6869 failWith,
6970 proc,
7071 putLog,
7172 readCreateProcessWithExitCode,
7273 readProcessAndLogStderr,
74+ runProcess_,
7375 setCwd,
7476 setDelegateCtlc,
75− waitForProcess,
7677 withSpinner,
7778 )
7879import Obelisk.Command.Nix
79−import Obelisk.Command.Project (nixShellWithoutPkgs, withProjectRoot, findProjectAssets)
80+import Obelisk.Command.Project (nixShellWithoutPkgs, withProjectRoot, findProjectAssets, bashEscape)
8081import Obelisk.Command.Thunk (attrCacheFileName)
8182import Obelisk.Command.Utils (findExePath, ghcidExePath)
8283
@@ -93,9 +94,11 @@ data CabalPackageInfo = CabalPackageInfo
9394 -- ^ List of globally set languages of the library component
9495 , _cabalPackageInfo_compilerOptions :: [(CompilerFlavor, [String])]
9596 -- ^ List of compiler-specific options (e.g., the "ghc-options" field of the cabal file)
97+ , _cabalPackageInfo_cppOptions :: [String]
98+ -- ^ List of CPP (C Preprocessor) options (e.g. the "cpp-options" field of the cabal file)
9699 }
97100
98−-- | 'Bool' with a better name for it's purpose.
101+-- | 'Bool' with a better name for its purpose.
99102data Interpret = Interpret_Interpret | Interpret_NoInterpret deriving (Eq, Ord, Show)
100103
101104textInterpret :: Interpret -> Text
@@ -109,9 +112,6 @@ data PathTree a = PathTree_Node
109112 (Map FilePath (PathTree a)) -- Branches to deeper leaves
110113 deriving (Eq, Ord, Show, Functor, Foldable, Traversable)
111114
112−emptyPathTree :: PathTree a
113−emptyPathTree = PathTree_Node Nothing mempty
114−
115115-- | 2D ASCII drawing of a 'PathTree'. Adapted from Data.Tree.draw.
116116drawPathTree :: (a -> Text) -> PathTree a -> Text
117117drawPathTree showA (PathTree_Node _ ts0) = T.intercalate "\n" $ goForest (Map.toList ts0)
@@ -151,7 +151,7 @@ profile profileBasePattern rtsFlags = withProjectRoot "." $ \root -> do
151151 liftIO $ createDirectoryIfMissing True $ takeDirectory $ root </> profileBaseName
152152 putLog Debug $ "Storing profiled data under base name of " <> T.pack (root </> profileBaseName)
153153 freePort <- getFreePort
154− (_, _, _, ph) <- createProcess_ "runProfExe" $ setCwd (Just root) $ setDelegateCtlc True $ proc (outPath </> "bin" </> "ob-run") $
154+ runProcess_ $ setCwd (Just root) $ setDelegateCtlc True $ proc (outPath </> "bin" </> "ob-run") $
155155 [ show freePort
156156 , T.unpack assets
157157 , profileBaseName
@@ -159,17 +159,16 @@ profile profileBasePattern rtsFlags = withProjectRoot "." $ \root -> do
159159 , "-po" <> profileBaseName
160160 ] <> rtsFlags
161161 <> [ "-RTS" ]
162− void $ waitForProcess ph
163162
164163run :: MonadObelisk m => FilePath -> PathTree Interpret -> m ()
165164run root interpretPaths = do
166165 pkgs <- getParsedLocalPkgs root interpretPaths
167− withGhciScript pkgs $ \dotGhciPath -> do
168− assets <- findProjectAssets root
169− putLog Debug $ "Assets impurely loaded from: " <> assets
170− ghciArgs <- getGhciSessionSettings pkgs root True
171− freePort <- getFreePort
172− runGhcid root True (ghciArgs <> mkGhciScriptArg dotGhciPath) pkgs $ Just $ unwords
166+ assets <- findProjectAssets root
167+ putLog Debug $ "Assets impurely loaded from: " <> assets
168+ ghciArgs <- getGhciSessionSettings pkgs root True
169+ freePort <- getFreePort
170+ withGhciScriptArgs pkgs $ \dotGhciArgs -> do
171+ runGhcid root True (ghciArgs <> dotGhciArgs) pkgs $ Just $ unwords
173172 [ "Obelisk.Run.run"
174173 , show freePort
175174 , "(Obelisk.Run.runServeAsset " ++ show assets ++ ")"
@@ -181,15 +180,15 @@ runRepl :: MonadObelisk m => FilePath -> PathTree Interpret -> m ()
181180runRepl root interpretPaths = do
182181 pkgs <- getParsedLocalPkgs root interpretPaths
183182 ghciArgs <- getGhciSessionSettings pkgs "." True
184− withGhciScript pkgs $ \dotGhciPath ->
185− runGhciRepl root pkgs (ghciArgs <> mkGhciScriptArg dotGhciPath)
183+ withGhciScriptArgs pkgs $ \dotGhciArgs ->
184+ runGhciRepl root pkgs (ghciArgs <> dotGhciArgs)
186185
187186runWatch :: MonadObelisk m => FilePath -> PathTree Interpret -> m ()
188187runWatch root interpretPaths = do
189188 pkgs <- getParsedLocalPkgs root interpretPaths
190189 ghciArgs <- getGhciSessionSettings pkgs root True
191− withGhciScript pkgs $ \dotGhciPath ->
192− runGhcid root True (ghciArgs <> mkGhciScriptArg dotGhciPath) pkgs Nothing
190+ withGhciScriptArgs pkgs $ \dotGhciArgs ->
191+ runGhcid root True (ghciArgs <> dotGhciArgs) pkgs Nothing
193192
194193exportGhciConfig :: MonadObelisk m => Bool -> FilePath -> PathTree Interpret -> m [String]
195194exportGhciConfig useRelativePaths root interpretPaths = do
@@ -353,6 +352,7 @@ parseCabalPackage' pkg = runExceptT $ do
353352 , _cabalPackageInfo_defaultLanguage =
354353 defaultLanguage $ libBuildInfo lib
355354 , _cabalPackageInfo_compilerOptions = options $ libBuildInfo lib
355+ , _cabalPackageInfo_cppOptions = cppOptions $ libBuildInfo lib
356356 }
357357 Right Nothing -> throwError "Haskell package has no library component"
358358 Left (_, errors) ->
@@ -396,13 +396,29 @@ parsePackagesOrFail dirs' = do
396396packageInfoToNamePathMap :: Foldable f => f CabalPackageInfo -> Map Text FilePath
397397packageInfoToNamePathMap = Map.fromList . map (_cabalPackageInfo_packageName &&& _cabalPackageInfo_packageRoot) . toList
398398
399+-- Like 'withGhciScript' but provides the precise ghci arguments to add to a ghci session
400+withGhciScriptArgs
401+ :: (MonadObelisk m, Foldable f)
402+ => f CabalPackageInfo -- ^ List of packages to load into ghci
403+ -> ([String] -> m ()) -- ^ Action to run with the extra ghci arguments
404+ -> m ()
405+withGhciScriptArgs packageInfos f = withGhciScript loadPreludeManually packageInfos $ \fp -> f ["-XNoImplicitPrelude", "-ghci-script", fp]
406+ where
407+ -- These lines must be first and allow the session to support a custom Prelude when @-XNoImplicitPrelude@
408+ -- is passed to the ghci session.
409+ loadPreludeManually =
410+ [ ":add Prelude" -- @:add@ is used because it's less noisy when there is no custom Prelude
411+ , ":set -XImplicitPrelude" -- Turn the default setting on
412+ ]
413+
399414-- | Create ghci configuration to load the given packages
400415withGhciScript
401416 :: (MonadObelisk m, Foldable f)
402− => f CabalPackageInfo -- ^ List of packages to load into ghci
417+ => [String] -- ^ Commands to prefix to file
418+ -> f CabalPackageInfo -- ^ List of packages to load into ghci
403419 -> (FilePath -> m ()) -- ^ Action to run with the path to generated temporary .ghci
404420 -> m ()
405−withGhciScript (toList -> packageInfos) f =
421+withGhciScript preCommands (toList -> packageInfos) f =
406422 withSystemTempDirectory "ob-ghci" $ \fp -> do
407423 let dotGhciPath = fp </> ".ghci"
408424 liftIO $ writeFile dotGhciPath dotGhci
@@ -414,7 +430,8 @@ withGhciScript (toList -> packageInfos) f =
414430 , [ "Backend" | "backend" `Set.member` packageNames ]
415431 , [ "Frontend" | "frontend" `Set.member` packageNames ]
416432 ]
417− dotGhci = unlines
433+ dotGhci = unlines $
434+ preCommands <>
418435 [ if null modulesToLoad then "" else ":load " <> unwords modulesToLoad
419436 , "import qualified Obelisk.Run"
420437 , "import qualified Frontend"
@@ -467,7 +484,7 @@ runGhciRepl root (toList -> packages) ghciArgs =
467484 -- NOTE: We do *not* want to use $(staticWhich "ghci") here because we need the
468485 -- ghc that is provided by the shell in the user's project.
469486 nixShellWithoutPkgs root True False (packageInfoToNamePathMap packages) "ghc" $
470− Just $ unwords $ "ghci" : ghciArgs -- TODO: Shell escape
487+ Just $ unwords $ fmap bashEscape $ "ghci" : ghciArgs
471488
472489-- | Run ghcid
473490runGhcid
@@ -480,32 +497,28 @@ runGhcid
480497 -> m ()
481498runGhcid root chdirToRoot ghciArgs (toList -> packages) mcmd =
482499 nixShellWithoutPkgs root True chdirToRoot (packageInfoToNamePathMap packages) "ghc" $
483− Just $ unwords $ ghcidExePath : opts -- TODO: Shell escape
500+ Just $ unwords $ fmap bashEscape $ ghcidExePath : opts
484501 where
485− opts =
486− [ "-W"
487− , "--outputfile=ghcid-output.txt"
488− ] <> map (\x -> "--reload='" <> x <> "'") reloadFiles
489− <> map (\x -> "--restart='" <> x <> "'") restartFiles
490− <> testCmd
491− <> ["--command='" <> unwords ("ghci" : ghciArgs) <> "'"] -- TODO: Shell escape
492− testCmd = maybeToList (flip fmap mcmd $ \cmd -> "--test='" <> cmd <> "'") -- TODO: Shell escape
493−
502+ opts = concat
503+ [ ["-W"]
504+ , ["--outputfile=ghcid-output.txt"]
505+ , map (\x -> "--reload=" <> x) reloadFiles
506+ , map (\x -> "--restart=" <> x) restartFiles
507+ , maybe [] (\cmd -> ["--test=" <> cmd]) mcmd
508+ , ["--command=" <> unwords ("ghci" : ghciArgs)]
509+ ]
494510 adjustRoot x = if chdirToRoot then makeRelative root x else x
495511 reloadFiles = map adjustRoot [root </> "config"]
496512 restartFiles = map (adjustRoot . _cabalPackageInfo_packageFile) packages
497513
498−mkGhciScriptArg :: FilePath -> [String]
499−mkGhciScriptArg dotGhci = ["-ghci-script", dotGhci]
500−
501−getFreePort :: MonadIO m => m PortNumber
502−getFreePort = liftIO $ withSocketsDo $ do
503− addr:_ <- getAddrInfo (Just defaultHints) (Just "127.0.0.1") (Just "0")
504− bracket (open addr) close socketPort
514+getFreePort :: MonadIO m => m Socket.PortNumber
515+getFreePort = liftIO $ Socket.withSocketsDo $ do
516+ addr:_ <- Socket.getAddrInfo (Just Socket.defaultHints) (Just "127.0.0.1") (Just "0")
517+ bracket (open addr) Socket.close Socket.socketPort
505518 where
506519 open addr = do
507− sock <- socket (addrFamily addr) (addrSocketType addr) (addrProtocol addr)
508− bind sock (addrAddress addr)
520+ sock <- Socket.socket (Socket.addrFamily addr) (Socket.addrSocketType addr) (Socket.addrProtocol addr)
521+ Socket.bind sock (Socket.addrAddress addr)
509522 return sock
510523
511524
lib/command/src/Obelisk/Command/Thunk.hs+3−3
@@ -56,7 +56,7 @@ import System.Exit
5656import System.FilePath
5757import System.IO.Error
5858import System.IO.Temp
59−import System.Posix (getSymbolicLinkStatus, modificationTime)
59+import System.PosixCompat.Files (getSymbolicLinkStatus, modificationTime)
6060import qualified Text.URI as URI
6161
6262import Obelisk.App (MonadObelisk)
@@ -178,14 +178,14 @@ getNixSha256ForUriUnpacked
178178getNixSha256ForUriUnpacked uri =
179179 withExitFailMessage ("nix-prefetch-url: Failed to determine sha256 hash of URL " <> gitUriToText uri) $ do
180180 [hash] <- fmap T.lines $ readProcessAndLogOutput (Debug, Debug) $
181− proc "nix-prefetch-url" ["--unpack", "--type", "sha256", T.unpack $ gitUriToText uri]
181+ proc nixPrefetchUrlPath ["--unpack", "--type", "sha256", T.unpack $ gitUriToText uri]
182182 pure hash
183183
184184nixPrefetchGit :: MonadObelisk m => GitUri -> Text -> Bool -> m NixSha256
185185nixPrefetchGit uri rev fetchSubmodules =
186186 withExitFailMessage ("nix-prefetch-git: Failed to determine sha256 hash of Git repo " <> gitUriToText uri <> " at " <> rev) $ do
187187 out <- readProcessAndLogStderr Debug $
188− proc "nix-prefetch-git" $ filter (/="")
188+ proc nixPrefetchGitPath $ filter (/="")
189189 [ "--url", T.unpack $ gitUriToText uri
190190 , "--rev", T.unpack rev
191191 , if fetchSubmodules then "--fetch-submodules" else ""
lib/command/src/Obelisk/Command/Utils.hs+34−2
@@ -54,6 +54,38 @@ nixBuildExePath = $(staticWhich "nix-build")
5454jreKeyToolPath :: FilePath
5555jreKeyToolPath = $(staticWhich "keytool")
5656
57+nixPrefetchGitPath :: FilePath
58+nixPrefetchGitPath = $(staticWhich "nix-prefetch-git")
59+
60+nixPrefetchUrlPath :: FilePath
61+nixPrefetchUrlPath = $(staticWhich "nix-prefetch-url")
62+
63+nixShellPath :: FilePath
64+nixShellPath = $(staticWhich "nix-shell")
65+
66+rsyncPath :: FilePath
67+rsyncPath = $(staticWhich "rsync")
68+
69+sshPath :: FilePath
70+sshPath = $(staticWhich "ssh")
71+
72+gitPath :: FilePath
73+gitPath = $(staticWhich "git")
74+
75+whichPath :: FilePath
76+whichPath = $(staticWhich "which")
77+
78+sshKeygenPath :: FilePath
79+sshKeygenPath = $(staticWhich "ssh-keygen")
80+
81+-- $(staticWhich "docker") was intentionally omitted, at least for now
82+-- One concern is that I don't know how particular docker is about having the
83+-- CLI exe match the version of the docker daemon, which is largely outside of
84+-- the control of obelisk-command.
85+-- TODO: Investigate the tradeoffs associated with this choice
86+dockerPath :: FilePath
87+dockerPath = "docker"
88+
5789-- | Nix syntax requires relative paths to be prefixed by @./@ or
5890-- @../@. This will make a 'FilePath' that can be embedded in a Nix
5991-- expression.
@@ -91,7 +123,7 @@ initGit repo = do
91123 git ["commit", "-m", "Initial commit."]
92124
93125gitProcNoRepo :: [String] -> ProcessSpec
94−gitProcNoRepo args = setEnvOverride (M.singleton "GIT_TERMINAL_PROMPT" "0" <>) $ proc "git" args
126+gitProcNoRepo args = setEnvOverride (M.singleton "GIT_TERMINAL_PROMPT" "0" <>) $ proc gitPath args
95127
96128gitProc :: FilePath -> [String] -> ProcessSpec
97129gitProc repo = gitProcNoRepo . runGitInDir
@@ -108,7 +140,7 @@ isolateGitProc = setEnvOverride (overrides <>)
108140 , ("GIT_CONFIG_NOSYSTEM", "1")
109141 , ("GIT_TERMINAL_PROMPT", "0") -- git 2.3+
110142 , ("GIT_ASKPASS", "echo") -- pre git 2.3 to just use empty password
111− , ("GIT_SSH_COMMAND", "ssh -o PreferredAuthentications password -o PubkeyAuthentication no -o GSSAPIAuthentication no")
143+ , ("GIT_SSH_COMMAND", "ssh -o PreferredAuthentications=password -o PubkeyAuthentication=no -o GSSAPIAuthentication=no")
112144 ]
113145
114146-- | Recursively copy a directory using `cp -a` -- TODO: Should use -rT instead of -a
lib/command/src/Obelisk/Command/VmBuilder.hs+8−8
@@ -21,7 +21,7 @@ import qualified System.Info
2121
2222import Obelisk.App (MonadObelisk, getObeliskUserStateDir)
2323import Obelisk.CliApp
24−import Obelisk.Command.Utils (rmPath)
24+import Obelisk.Command.Utils (rmPath, whichPath, sshKeygenPath, nixBuildExePath, dockerPath)
2525
2626-- | Generate the `--builders` argument string to enable the VM builder after ensuring it is available.
2727getNixBuildersArg :: MonadObelisk m => m String
@@ -35,7 +35,7 @@ getNixBuildersArg = do
3535
3636checkForNixDarwin :: MonadObelisk m => String -> m ()
3737checkForNixDarwin sshIdFile = do
38− (exitCode, _, _) <- readCreateProcessWithExitCode $ proc "which" ["darwin-rebuild"]
38+ (exitCode, _, _) <- readCreateProcessWithExitCode $ proc whichPath ["darwin-rebuild"]
3939 unless (exitCode == ExitSuccess) $ failWith $ T.intercalate "\n"
4040 [ "Deployments from macOS require nix-darwin to be installed."
4141 , "Follow the installation instructions here: https://github.com/LnL7/nix-darwin"
@@ -67,7 +67,7 @@ containerExists :: MonadObelisk m => FilePath -> m Bool
6767containerExists stateDir = handle (\(_ :: IOError) -> failWith needDockerMsg) $ do
6868 containerNames <- fmap (map T.strip . T.lines) $
6969 readProcessAndLogStderr Error $
70− proc "docker" ["container", "list", "--all", "--format", "{{.Names}}"]
70+ proc dockerPath ["container", "list", "--all", "--format", "{{.Names}}"]
7171 let exists = containerName `elem` containerNames
7272 when exists $ testLinuxBuild stateDir
7373 pure exists
@@ -85,7 +85,7 @@ containerSshPort = 2222
8585startContainer :: MonadObelisk m => m ()
8686startContainer = withSpinner "Starting VM builder" $
8787 callProcessAndLogOutput (Debug, Debug) $
88− proc "docker" ["start", containerName]
88+ proc dockerPath ["start", containerName]
8989
9090-- | Creates the Docker container; assumes it does not exist.
9191setupNixDocker :: MonadObelisk m => FilePath -> m ()
@@ -98,12 +98,12 @@ setupNixDocker stateDir = withSpinner ("Creating Docker container named " <> con
9898 callProcessAndLogOutput (Debug, Error) $
9999 proc rmPath ["-f", stateDir </> sshKeyFileName, stateDir </> sshKeyFileName <.> "pub"]
100100 callProcessAndLogOutput (Debug, Error) $
101− proc "ssh-keygen" ["-t", "ed25519", "-f", stateDir </> sshKeyFileName, "-P", ""]
101+ proc sshKeygenPath ["-t", "ed25519", "-f", stateDir </> sshKeyFileName, "-P", ""]
102102
103103 -- Build the docker container (which uses the SSH keys in the 'ssh' folder)
104104 containerId <- fmap T.strip $ readProcessAndLogStderr Error $
105− proc "docker" ["build", stateDir, "--quiet"]
106− callProcessAndLogOutput (Debug, Error) $ proc "docker"
105+ proc dockerPath ["build", stateDir, "--quiet"]
106+ callProcessAndLogOutput (Debug, Error) $ proc dockerPath
107107 [ "run"
108108 , "--restart", "always"
109109 , "--detach"
@@ -155,7 +155,7 @@ testLinuxBuild :: MonadObelisk m => FilePath -> m ()
155155testLinuxBuild stateDir
156156 | System.Info.os == "linux" = failWith "Using the docker builder is not necessary on linux."
157157 | otherwise = do
158− (exitCode, _stdout, stderr) <- readCreateProcessWithExitCode $ proc "nix-build"
158+ (exitCode, _stdout, stderr) <- readCreateProcessWithExitCode $ proc nixBuildExePath
159159 [ "--no-out-link"
160160 , "-E", "(import <nixpkgs> { system = \"x86_64-linux\"; }).writeText \"test\" builtins.currentTime"
161161 , "--builders", nixBuildersArgString stateDir
lib/executable-config/default.nix+13−2
@@ -25,8 +25,19 @@ let
2525in
2626
2727{
28− haskellOverlay = self: super: {
29− obelisk-executable-config-lookup = self.callCabal2nix "obelisk-executable-config-lookup" (obeliskCleanSource ./lookup) {};
28+ haskellOverlay = self: super:
29+ let
30+ pkgs = self.callPackage ({pkgs}: pkgs) {};
31+ in {
32+ obelisk-executable-config-lookup = pkgs.haskell.lib.overrideCabal
33+ (self.callCabal2nix "obelisk-executable-config-lookup" (obeliskCleanSource ./lookup) {})
34+ (drv: {
35+ # Hack until https://github.com/NixOS/cabal2nix/pull/432 lands
36+ libraryHaskellDepends = (drv.libraryHaskellDepends or [])
37+ ++ pkgs.stdenv.lib.optionals (with pkgs.stdenv.hostPlatform; isAndroid && is32bit) [
38+ self.android-activity
39+ ];
40+ });
3041 };
3142
3243 platforms = {
lib/executable-config/inject/obelisk-executable-config-inject.cabal+1−1
@@ -15,4 +15,4 @@ library
1515 text
1616
1717 exposed-modules: Obelisk.ExecutableConfig.Inject
18− ghc-options: -Wall
18+ ghc-options: -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
lib/executable-config/lookup/obelisk-executable-config-lookup.cabal+10−7
@@ -31,15 +31,18 @@ library
3131 base64-bytestring,
3232 bytestring,
3333 containers,
34+ exceptions,
3435 filepath,
35− text,
36− transformers,
37− transformers-base,
38− ref-tf,
39− primitive,
36+ jsaddle,
37+ mmorph,
4038 monad-control,
39+ mtl,
40+ primitive,
41+ ref-tf,
42+ reflex-dom-core,
4143 reflex,
42− reflex-dom,
43− jsaddle
44+ text,
45+ transformers-base,
46+ transformers
4447
4548 ghc-options: -Wall
lib/executable-config/lookup/src/Obelisk/Configs.hs+31−12
@@ -18,24 +18,38 @@ module Obelisk.Configs
1818 , getTextConfig
1919 ) where
2020
21−import Control.Applicative
22−import Control.Monad
23−import Control.Monad.Base
24−import Control.Monad.Fix
25−import Control.Monad.Primitive
26−import Control.Monad.Ref
27−import Control.Monad.IO.Class
28−import Control.Monad.Trans.Class
29−import Control.Monad.Trans.Control
30−import Control.Monad.Trans.Reader
21+import Control.Applicative (Alternative)
22+import Control.Monad (MonadPlus)
23+import Control.Monad.Base (MonadBase)
24+import Control.Monad.Catch (MonadThrow)
25+import Control.Monad.Fail (MonadFail)
26+import Control.Monad.Fix (MonadFix)
27+import Control.Monad.IO.Class (MonadIO)
28+import Control.Monad.Morph (MFunctor)
29+import Control.Monad.Primitive (PrimMonad, PrimState, primitive)
30+import Control.Monad.Ref (MonadRef)
31+import Control.Monad.Trans (MonadTrans, lift)
32+import Control.Monad.Trans.Control (MonadBaseControl)
33+import Control.Monad.Trans.Reader (ReaderT (..), ask, mapReaderT)
34+import Control.Monad.Trans.State (StateT)
35+import qualified Control.Monad.Trans.State.Strict as Strict
3136import Data.ByteString (ByteString)
3237import Data.Map (Map)
3338import qualified Data.Map as Map
3439import Data.Text (Text)
3540import qualified Data.Text.Encoding as T
3641import Reflex
37−import Reflex.Host.Class
38−import Reflex.Dom
42+import Reflex.Host.Class (MonadReflexCreateTrigger)
43+import Reflex.Dom.Core
44+ ( DomBuilder
45+ , DomRenderHook
46+ , HasDocument
47+ , HasJS
48+ , HasJSContext
49+ , Prerender (Client)
50+ , StaticDomBuilderT
51+ , prerender
52+ )
3953#ifndef ghcjs_HOST_OS
4054import Language.Javascript.JSaddle (MonadJSM)
4155#endif
@@ -62,6 +76,8 @@ instance HasConfigs m => HasConfigs (PostBuildT t m)
6276instance HasConfigs m => HasConfigs (QueryT t q m)
6377instance HasConfigs m => HasConfigs (ReaderT r m)
6478instance HasConfigs m => HasConfigs (RequesterT t request response m)
79+instance HasConfigs m => HasConfigs (StateT w m)
80+instance HasConfigs m => HasConfigs (Strict.StateT w m)
6581instance HasConfigs m => HasConfigs (StaticDomBuilderT t m)
6682instance HasConfigs m => HasConfigs (TriggerEventT t m)
6783
@@ -72,12 +88,15 @@ newtype ConfigsT m a = ConfigsT { unConfigsT :: ReaderT (Map Text ByteString) m
7288 , Monad
7389 , MonadPlus
7490 , Alternative
91+ , MonadFail
7592 , MonadFix
93+ , MonadThrow
7694 , MonadIO
7795 , MonadBase m'
7896 , MonadBaseControl m'
7997 , MonadRef
8098 , MonadTrans
99+ , MFunctor
81100 , DomBuilder t
82101 , MonadHold t
83102 , MonadReflexCreateTrigger t
lib/frontend/obelisk-frontend.cabal+1−1
@@ -26,4 +26,4 @@ library
2626 exposed-modules:
2727 Obelisk.Frontend
2828 Obelisk.Frontend.Cookie
29− ghc-options: -Wall
29+ ghc-options: -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
lib/frontend/src/Obelisk/Frontend.hs+1−1
@@ -182,7 +182,7 @@ runFrontendWithConfigsAndCurrentRoute
182182 -> Frontend (R frontendRoute)
183183 -> JSM ()
184184runFrontendWithConfigsAndCurrentRoute mode configs validFullEncoder frontend = do
185− let ve = validFullEncoder . hoistParse errorLeft (prismEncoder (rPrism $ _FullRoute_Frontend . _ObeliskRoute_App))
185+ let ve = validFullEncoder . hoistParse errorLeft (reviewEncoder (rPrism $ _FullRoute_Frontend . _ObeliskRoute_App))
186186 errorLeft = \case
187187 Left _ -> error "runFrontend: Unexpected non-app ObeliskRoute reached the frontend. This shouldn't happen."
188188 Right x -> Identity x
lib/route/README.mdnew file+6
@@ -0,0 +1,6 @@
1+# obelisk-route
2+
3+[![Haskell Programming Language](https://img.shields.io/badge/language-Haskell-blue.svg)](http://www.haskell.org)
4+[![BSD3 License](http://img.shields.io/badge/license-BSD3-brightgreen.svg)](https://github.com/obsidiansystems/obelisk/blob/master/LICENSE)
5+
6+Robust URL management for single-page apps.
lib/route/obelisk-route.cabal+2−1
@@ -20,6 +20,7 @@ library
2020 http-types,
2121 jsaddle,
2222 lens,
23+ mmorph,
2324 monad-control,
2425 mtl,
2526 network-uri,
@@ -38,4 +39,4 @@ library
3839 exposed-modules: Obelisk.Route
3940 Obelisk.Route.TH
4041 Obelisk.Route.Frontend
41− ghc-options: -Wall -fwarn-redundant-constraints
42+ ghc-options: -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
lib/route/src/Obelisk/Route.hs+89−46
@@ -1,3 +1,4 @@
1+{-# LANGUAGE CPP #-}
12{-# LANGUAGE ApplicativeDo #-}
23{-# LANGUAGE ConstraintKinds #-}
34{-# LANGUAGE EmptyCase #-}
@@ -5,7 +6,6 @@
56{-# LANGUAGE FlexibleContexts #-}
67{-# LANGUAGE FlexibleInstances #-}
78{-# LANGUAGE GADTs #-}
8−{-# LANGUAGE KindSignatures #-}
99{-# LANGUAGE LambdaCase #-}
1010{-# LANGUAGE MultiParamTypeClasses #-}
1111{-# LANGUAGE OverloadedStrings #-}
@@ -61,6 +61,7 @@ module Obelisk.Route
6161 , justEncoder
6262 , nothingEncoder
6363 , isoEncoder
64+ , viewEncoder
6465 , wrappedEncoder
6566 , unwrappedEncoder
6667 , listToNonEmptyEncoder
@@ -69,6 +70,7 @@ module Obelisk.Route
6970 , toListMapEncoder
7071 , shadowEncoder
7172 , prismEncoder
73+ , reviewEncoder
7274 , rPrism
7375 , _R
7476 , obeliskRouteEncoder
@@ -133,20 +135,24 @@ import Control.Lens
133135 , Prism'
134136 , prism'
135137 , re
138+ , review
136139 , view
137140 , Wrapped (..)
138141 )
139142import Control.Monad.Except
140−import Control.Monad.Writer (execWriter, tell)
141143import qualified Control.Monad.State.Strict as State
142144import Control.Monad.Trans (lift)
145+import Control.Monad.Writer (execWriter, tell)
146+import Data.Aeson (FromJSON, ToJSON)
147+import qualified Data.Aeson as Aeson
143148import qualified Data.ByteString as BS
144149import qualified Data.ByteString.Lazy as BSL
145−import Data.Dependent.Sum (DSum (..))
146150import Data.Dependent.Map (DMap)
147151import qualified Data.Dependent.Map as DMap
152+import Data.Dependent.Sum (DSum (..))
148153import Data.Either.Validation (Validation (..))
149154import Data.Foldable
155+import Data.Functor (($>))
150156import Data.Functor.Sum
151157import Data.GADT.Compare
152158import Data.GADT.Compare.TH
@@ -159,19 +165,17 @@ import Data.Monoid ((<>))
159165import Data.Set (Set)
160166import qualified Data.Set as Set
161167import Data.Some (Some(Some))
168+import Data.Tabulation
162169import Data.Text (Text)
163−import Data.Text.Lens (IsText, packed, unpacked)
164170import qualified Data.Text as T
165171import qualified Data.Text.Encoding as T
172+import Data.Text.Lens (IsText, packed, unpacked)
166173import Data.Universe
167174import Data.Universe.Some
168175import Network.HTTP.Types.URI
169176import qualified Numeric.Lens
170177import Obelisk.Route.TH
171178import Text.Read (readMaybe)
172−import Data.Tabulation
173−import qualified Data.Aeson as Aeson
174−import Data.Aeson (FromJSON, ToJSON)
175179
176180-- Design goals:
177181-- No start-up time on the frontend (not yet met)
@@ -221,7 +225,19 @@ hoistR f (x :=> Identity y) = f x :/ y
221225infixr 5 :.
222226type (:.) = (,)
223227
228+#ifdef __GLASGOW_HASKELL__
229+#if __GLASGOW_HASKELL__ >= 810
224230{-# COMPLETE (:.) #-}
231+#else
232+{-# WARNING (:.)
233+ [ "Use of this pattern in GHC < 8.10 will result in spurious non-exhaustive warnings at every use site."
234+ , "We cannot provide a COMPLETE pragma to silence these due to a GHC bug: https://gitlab.haskell.org/ghc/ghc/issues/17729."
235+ , "The bug hides incompleteness warnings for all two tuples when the COMPLETE pattern is in scope."
236+ , "Instead, you should use (,) directly until you can switch to GHC >= 8.10, where the COMPLETE pragma is reinstated."
237+ ]
238+ #-}
239+#endif
240+#endif
225241pattern (:.) :: a -> b -> a :. b
226242pattern a :. b = (a, b)
227243
@@ -287,13 +303,13 @@ decode e x = runIdentity (tryDecode e x)
287303-- | Once an 'Encoder' has been checked, so that its check monad has become 'Identity', even if the same is not true of the
288304-- parse monad, we may still attempt to decode with it in its parse monad.
289305tryDecode :: Encoder Identity parse decoded encoded -> encoded -> parse decoded
290−tryDecode (Encoder (Identity impl)) x = _encoderImpl_decode impl x
306+tryDecode (Encoder (Identity impl)) = _encoderImpl_decode impl
291307
292308-- | Similar to 'decode', once an encoder has been checked so that its check monad is Identity, it
293309-- can be used to actually encode by using this. Note that while there's no constraint on the parse monad here,
294310-- one should usually be applying decode and encode to the same 'Encoder'
295311encode :: Encoder Identity parse decoded encoded -> decoded -> encoded
296−encode (Encoder (Identity impl)) x = _encoderImpl_encode impl x
312+encode (Encoder (Identity impl)) = _encoderImpl_encode impl
297313
298314-- | This is a primitive used to build encoders which can't fail to check. It should not be used unless one is
299315-- reasonably certain that the law given for 'EncoderImpl' above holds.
@@ -340,7 +356,7 @@ instance Monad parse => Bifunctor (,) (EncoderImpl parse) (EncoderImpl parse) (E
340356 }
341357
342358instance (Monad parse, Applicative check) => Braided (Encoder check parse) (,) where
343− braid = isoEncoder (iso swap swap)
359+ braid = viewEncoder (iso swap swap)
344360
345361
346362instance (Applicative check, Monad parse) => PFunctor (,) (Encoder check parse) (Encoder check parse) where
@@ -376,11 +392,11 @@ instance (Monad parse, Applicative check) => Bifunctor Either (Encoder check par
376392 bimap f g = Encoder $ liftA2 bimap (unEncoder f) (unEncoder g)
377393
378394instance (Applicative check, Monad parse) => Associative (Encoder check parse) Either where
379− associate = isoEncoder (iso (associate @(->) @Either) disassociate)
380− disassociate = isoEncoder (iso disassociate associate)
395+ associate = viewEncoder (iso (associate @(->) @Either) disassociate)
396+ disassociate = viewEncoder (iso disassociate associate)
381397
382398instance (Monad parse, Applicative check) => Braided (Encoder check parse) Either where
383− braid = isoEncoder (iso swap swap)
399+ braid = viewEncoder (iso swap swap)
384400
385401
386402
@@ -434,17 +450,17 @@ instance (Applicative check, Monad parse) => Monoidal (Encoder check parse) (,)
434450--------------------------------------------------------------------------------
435451
436452-- | Given a valid 'Iso' from lens, construct an 'Encoder'
437−isoEncoder :: (Applicative check, Applicative parse) => Iso' a b -> Encoder check parse a b
438−isoEncoder f = unsafeMkEncoder $ EncoderImpl
453+viewEncoder :: (Applicative check, Applicative parse) => Iso' a b -> Encoder check parse a b
454+viewEncoder f = unsafeMkEncoder $ EncoderImpl
439455 { _encoderImpl_encode = view f
440456 , _encoderImpl_decode = pure . view (from f)
441457 }
442458
443459wrappedEncoder :: (Wrapped a, Applicative check, Applicative parse) => Encoder check parse (Unwrapped a) a
444−wrappedEncoder = isoEncoder $ from _Wrapped'
460+wrappedEncoder = viewEncoder $ from _Wrapped'
445461
446462unwrappedEncoder :: (Wrapped a, Applicative check, Applicative parse) => Encoder check parse a (Unwrapped a)
447−unwrappedEncoder = isoEncoder _Wrapped'
463+unwrappedEncoder = viewEncoder $ _Wrapped'
448464
449465maybeToEitherEncoder :: (Applicative check, Applicative parse) => Encoder check parse (Maybe a) (Either () a)
450466maybeToEitherEncoder = unsafeMkEncoder $ EncoderImpl
@@ -469,11 +485,11 @@ maybeEncoder f g = shadowEncoder f g . maybeToEitherEncoder
469485
470486-- | Encode a value by simply applying 'Just'
471487justEncoder :: (Applicative check, MonadError Text parse) => Encoder check parse a (Maybe a)
472−justEncoder = prismEncoder _Just
488+justEncoder = reviewEncoder _Just
473489
474490-- | Encode () to 'Nothing'.
475491nothingEncoder :: (Applicative check, MonadError Text parse) => Encoder check parse () (Maybe a)
476−nothingEncoder = prismEncoder _Nothing
492+nothingEncoder = reviewEncoder _Nothing
477493
478494someConstEncoder :: (Applicative check, Applicative parse) => Encoder check parse (Some (Const a)) a
479495someConstEncoder = unsafeMkEncoder $ EncoderImpl
@@ -538,11 +554,11 @@ pathComponentEncoder f = Encoder $ do
538554 unEncoder (pathComponentEncoderImpl (enum1Encoder (extractPathSegment . f)) f')
539555
540556pathComponentEncoderImpl :: forall check parse p. (Monad check, Monad parse)
541− => (Encoder check parse (Some p) (Maybe Text))
557+ => Encoder check parse (Some p) (Maybe Text)
542558 -> (forall a. p a -> Encoder Identity parse a PageName)
543559 -> Encoder check parse (R p) PageName
544−pathComponentEncoderImpl this rest =
545− chainEncoder (lensEncoder (\(_, b) a -> (a, b)) Prelude.fst consEncoder) this rest
560+pathComponentEncoderImpl =
561+ chainEncoder (lensEncoder (\(_, b) a -> (a, b)) Prelude.fst consEncoder)
546562
547563--NOTE: Naming convention in this module is to always talk about things in the *encoding* direction, never in the *decoding* direction
548564
@@ -798,7 +814,7 @@ rPrism
798814 :: forall f f'
799815 . (forall a. Prism' (f a) (f' a))
800816 -> Prism' (R f) (R f')
801−rPrism p = dSumPrism p
817+rPrism = dSumPrism
802818
803819dSumPrism'
804820 :: forall f g a
@@ -810,7 +826,7 @@ dSumGEqPrism
810826 :: GEq f
811827 => f a
812828 -> Prism' (DSum f g) (g a)
813−dSumGEqPrism variant = dSumPrism' $ prism' (\Refl -> variant) (\x -> geq variant x)
829+dSumGEqPrism variant = dSumPrism' $ prism' (\Refl -> variant) (geq variant)
814830
815831-- | Given a 'tag :: f a', make a prism for 'R f'. This generalizes the usual
816832-- prisms for a sum type (the ones that 'mkPrisms' would make), just as 'R'
@@ -827,12 +843,19 @@ _R variant = dSumGEqPrism variant . iso runIdentity Identity
827843
828844-- | An encoder that only works on the items available via the prism. An error will be thrown in the parse monad
829845-- if the prism doesn't match.
830−prismEncoder :: (Applicative check, MonadError Text parse) => Prism' b a -> Encoder check parse a b
831−prismEncoder p = unsafeMkEncoder $ EncoderImpl
832− { _encoderImpl_encode = (^. re p)
846+--
847+-- Note that a 'Prism' from @a@ to @b@ will produce an 'Encoder' from @b@ to @a@
848+-- (i.e. 'reviewEncoder' is a contravariant functor from the category of prisms to the category of encoders),
849+-- just like 'review' produces a function @b -> a@. This is because 'Prism's extract values, in a way that might
850+-- fail, in their forward direction and inject values, in a way that cannot fail, in their reverse direction;
851+-- whereas 'Encoder's encode, which cannot fail, in their forward direction, and decode, which can fail, in their
852+-- reverse direction. In short @reviewEncoder (f . g) = reviewEncoder g . reviewEncoder f@.
853+reviewEncoder :: (Applicative check, MonadError Text parse) => Prism' b a -> Encoder check parse a b
854+reviewEncoder p = unsafeMkEncoder $ EncoderImpl
855+ { _encoderImpl_encode = review p
833856 , _encoderImpl_decode = \r -> case r ^? p of
834857 Just a -> pure a
835− Nothing -> throwError "prismEncoder: value is not present in the prism"
858+ Nothing -> throwError "reviewEncoder: value is not present in the prism"
836859 }
837860
838861-- | A URL path and query string, in which trailing slashes don't matter in the path
@@ -970,9 +993,9 @@ obeliskRouteSegment r appRouteSegment = case r of
970993-- be combined with other such segment encoders before 'pathComponentEncoder' turns it into a proper 'Encoder'.
971994resourceRouteSegment :: (MonadError Text check, MonadError Text parse) => ResourceRoute a -> SegmentResult check parse a
972995resourceRouteSegment = \case
973− ResourceRoute_Static -> PathSegment "static" $ pathOnlyEncoderIgnoringQuery
974− ResourceRoute_Ghcjs -> PathSegment "ghcjs" $ pathOnlyEncoder
975− ResourceRoute_JSaddleWarp -> PathSegment "jsaddle" $ jsaddleWarpRouteEncoder
996+ ResourceRoute_Static -> PathSegment "static" pathOnlyEncoderIgnoringQuery
997+ ResourceRoute_Ghcjs -> PathSegment "ghcjs" pathOnlyEncoder
998+ ResourceRoute_JSaddleWarp -> PathSegment "jsaddle" jsaddleWarpRouteEncoder
976999 ResourceRoute_Version -> PathSegment "version" $ unitEncoder mempty
9771000
9781001data JSaddleWarpRoute :: * -> * where
@@ -984,7 +1007,7 @@ jsaddleWarpRouteEncoder :: (MonadError Text check, MonadError Text parse) => Enc
9841007jsaddleWarpRouteEncoder = pathComponentEncoder $ \case
9851008 JSaddleWarpRoute_JavaScript -> PathSegment "jsaddle.js" $ unitEncoder mempty
9861009 JSaddleWarpRoute_WebSocket -> PathEnd $ unitEncoder mempty
987− JSaddleWarpRoute_Sync -> PathSegment "sync" $ pathOnlyEncoder
1010+ JSaddleWarpRoute_Sync -> PathSegment "sync" pathOnlyEncoder
9881011
9891012instance GShow appRoute => GShow (ObeliskRoute appRoute) where
9901013 gshowsPrec prec = \case
@@ -1028,17 +1051,6 @@ void1Encoder = Encoder $ pure $ EncoderImpl
10281051instance GShow Void1 where
10291052 gshowsPrec _ = \case {}
10301053
1031−concat <$> mapM deriveRouteComponent
1032− [ ''ResourceRoute
1033− , ''JSaddleWarpRoute
1034− , ''IndexOnlyRoute
1035− ]
1036−
1037−makePrisms ''ObeliskRoute
1038−makePrisms ''FullRoute
1039−deriveGEq ''Void1
1040−deriveGCompare ''Void1
1041−
10421054-- | Given a backend route and a checked route encoder, render the route (path
10431055-- and query string). See 'checkEncoder' for how to produce a checked encoder.
10441056renderBackendRoute
@@ -1071,11 +1083,11 @@ readShowEncoder :: (MonadError Text parse, Read a, Show a, Applicative check) =>
10711083readShowEncoder = singlePathSegmentEncoder . unsafeTshowEncoder
10721084
10731085integralEncoder :: (MonadError Text parse, Applicative check, Integral a) => Encoder check parse a Integer
1074−integralEncoder = prismEncoder (Numeric.Lens.integral)
1086+integralEncoder = reviewEncoder Numeric.Lens.integral
10751087
10761088pathSegmentEncoder :: (MonadError Text parse, Applicative check, Cons as as a a) =>
10771089 Encoder check parse (a, (as, b)) (as, b)
1078−pathSegmentEncoder = first (prismEncoder _Cons) . disassociate
1090+pathSegmentEncoder = first (reviewEncoder _Cons) . disassociate
10791091
10801092newtype Decoder check parse b a = Decoder { toEncoder :: Encoder check parse a b }
10811093
@@ -1146,7 +1158,7 @@ pathFieldEncoder fieldEncoder = unsafeEncoder $ do
11461158 fieldEncoderPure f = toEncoder (DMap.findWithDefault (error "bad") f fieldEncoderPureMap)
11471159 pure $ EncoderImpl
11481160 { _encoderImpl_encode = \(x, rest) -> execWriter $ do
1149− _ <- traverseWithField (\f x_i -> tell (pure $ encode (fieldEncoderPure f) x_i) *> pure x_i) x
1161+ _ <- traverseWithField (\f x_i -> tell (pure $ encode (fieldEncoderPure f) x_i) $> x_i) x
11501162 tell rest
11511163 , _encoderImpl_decode = State.runStateT $ tabulateFieldsA $ \f -> State.get >>= \case
11521164 [] -> throwError $ T.pack "not enough path components"
@@ -1182,3 +1194,34 @@ byteStringsToPageName p q =
11821194 in decode pageNameEncoder' (T.unpack (T.decodeUtf8 p), T.unpack (T.decodeUtf8 q))
11831195
11841196--TODO: decodeURIComponent as appropriate
1197+
1198+
1199+{-# DEPRECATED isoEncoder "Instead of 'isoEncoder f', use 'viewEncoder f'" #-}
1200+-- | Given a valid 'Iso' from lens, construct an 'Encoder'
1201+isoEncoder :: (Applicative check, Applicative parse) => Iso' a b -> Encoder check parse a b
1202+isoEncoder = viewEncoder
1203+
1204+{-# DEPRECATED prismEncoder "Instead of 'prismEncoder f', use 'reviewEncoder f'" #-}
1205+-- | An encoder that only works on the items available via the prism. An error will be thrown in the parse monad
1206+-- if the prism doesn't match.
1207+--
1208+-- Note that a 'Prism' from @a@ to @b@ will produce an 'Encoder' from @b@ to @a@
1209+-- (i.e. 'prismEncoder' is a contravariant functor from the category of prisms to the category of encoders),
1210+-- just like 'review' produces a function @b -> a@. This is because 'Prism's extract values, in a way that might
1211+-- fail, in their forward direction and inject values, in a way that cannot fail, in their reverse direction;
1212+-- whereas 'Encoder's encode, which cannot fail, in their forward direction, and decode, which can fail, in their
1213+-- reverse direction. In short @prismEncoder (f . g) = prismEncoder g . prismEncoder f@.
1214+prismEncoder :: (Applicative check, MonadError Text parse) => Prism' b a -> Encoder check parse a b
1215+prismEncoder = reviewEncoder
1216+
1217+
1218+concat <$> mapM deriveRouteComponent
1219+ [ ''ResourceRoute
1220+ , ''JSaddleWarpRoute
1221+ , ''IndexOnlyRoute
1222+ ]
1223+
1224+makePrisms ''ObeliskRoute
1225+makePrisms ''FullRoute
1226+deriveGEq ''Void1
1227+deriveGCompare ''Void1
lib/route/src/Obelisk/Route/Frontend.hs+41−28
@@ -1,24 +1,24 @@
1−{-# LANGUAGE ApplicativeDo #-}
21{-# LANGUAGE CPP #-}
3−{-# LANGUAGE RecursiveDo #-}
4−{-# LANGUAGE StandaloneDeriving #-}
2+{-# LANGUAGE ApplicativeDo #-}
53{-# LANGUAGE ConstraintKinds #-}
4+{-# LANGUAGE DataKinds #-}
65{-# LANGUAGE DefaultSignatures #-}
76{-# LANGUAGE FlexibleContexts #-}
87{-# LANGUAGE FlexibleInstances #-}
8+{-# LANGUAGE FunctionalDependencies #-}
99{-# LANGUAGE GADTs #-}
10+{-# LANGUAGE GeneralizedNewtypeDeriving #-}
1011{-# LANGUAGE LambdaCase #-}
1112{-# LANGUAGE OverloadedStrings #-}
1213{-# LANGUAGE PatternSynonyms #-}
1314{-# LANGUAGE RankNTypes #-}
15+{-# LANGUAGE RecursiveDo #-}
1416{-# LANGUAGE ScopedTypeVariables #-}
17+{-# LANGUAGE StandaloneDeriving #-}
1518{-# LANGUAGE TypeFamilies #-}
1619{-# LANGUAGE TypeOperators #-}
17−{-# LANGUAGE ViewPatterns #-}
18−{-# LANGUAGE GeneralizedNewtypeDeriving #-}
1920{-# LANGUAGE UndecidableInstances #-}
20−{-# LANGUAGE DataKinds #-}
21−{-# LANGUAGE FunctionalDependencies #-}
21+{-# LANGUAGE ViewPatterns #-}
2222
2323module Obelisk.Route.Frontend
2424 ( module Obelisk.Route
@@ -57,49 +57,42 @@ module Obelisk.Route.Frontend
5757
5858import Prelude hiding ((.), id)
5959
60−import Obelisk.Route
61−
6260import Control.Category (Category (..), (.))
6361import Control.Category.Cartesian ((&&&))
6462import Control.Lens hiding (Bifunctor, bimap, universe, element)
6563import Control.Monad ((<=<))
6664import Control.Monad.Fix
65+import Control.Monad.Morph
6766import Control.Monad.Primitive
6867import Control.Monad.Reader
6968import Control.Monad.Ref
7069import Control.Monad.Trans.Control
7170import Data.Coerce
7271import Data.Dependent.Sum (DSum (..))
72+import Data.Functor.Compose
73+import Data.Functor.Misc
7374import Data.GADT.Compare
75+import qualified Data.List as L
7476import Data.Map (Map)
77+import Data.Maybe (fromMaybe)
7578import Data.Monoid
7679import Data.Proxy
7780import Data.Text (Text)
7881import qualified Data.Text as T
79−import Data.Functor.Compose
80−import Data.Functor.Misc
81−import Reflex.Class
82−import Reflex.Host.Class
83−import Reflex.PostBuild.Class
84−import Reflex.TriggerEvent.Class
85−import Reflex.PerformEvent.Class
86−import Reflex.EventWriter.Class
87−import Reflex.EventWriter.Base
88−import Reflex.Dynamic
89−import Reflex.Dom.Builder.Class
9082import Data.Type.Coercion
91−import Language.Javascript.JSaddle --TODO: Get rid of this - other platforms can also be routed
92−import Reflex.Dom.Core
9383import qualified GHCJS.DOM as DOM
9484import qualified GHCJS.DOM.Types as DOM
9585import qualified GHCJS.DOM.Window as Window
86+import Language.Javascript.JSaddle (MonadJSM, jsNull, liftJSM) --TODO: Get rid of this - other platforms can also be routed
9687import Network.URI
97−import Data.Maybe (fromMaybe)
98−import qualified Data.List as L
99−
88+import Reflex.Class
89+import Reflex.Dom.Builder.Class
90+import Reflex.Dom.Core
91+import Reflex.Host.Class
10092import Unsafe.Coerce
10193
10294import Obelisk.Configs
95+import Obelisk.Route
10396
10497infixr 5 :~
10598pattern (:~) :: Reflex t => f a -> Dynamic t a -> DSum f (Compose (Dynamic t) Identity)
@@ -116,7 +109,23 @@ instance Monad m => Routed t r (RoutedT t r m) where
116109instance (Monad m, Routed t r m) => Routed t r (ReaderT r' m)
117110
118111newtype RoutedT t r m a = RoutedT { unRoutedT :: ReaderT (Dynamic t r) m a }
119− deriving (Functor, Applicative, Monad, MonadFix, MonadTrans, NotReady t, MonadHold t, MonadSample t, PostBuild t, TriggerEvent t, MonadIO, MonadReflexCreateTrigger t, HasDocument, DomRenderHook t)
112+ deriving
113+ ( Functor
114+ , Applicative
115+ , Monad
116+ , MonadFix
117+ , MonadTrans
118+ , MFunctor
119+ , NotReady t
120+ , MonadHold t
121+ , MonadSample t
122+ , PostBuild t
123+ , TriggerEvent t
124+ , MonadIO
125+ , MonadReflexCreateTrigger t
126+ , HasDocument
127+ , DomRenderHook t
128+ )
120129
121130instance MonadReader r' m => MonadReader r' (RoutedT t r m) where
122131 ask = lift ask
@@ -192,6 +201,10 @@ instance (Monad m, RouteToUrl r m) => RouteToUrl r (EventWriterT t w m)
192201
193202instance (Monad m, SetRoute t r m) => SetRoute t r (EventWriterT t w m)
194203
204+instance (Monad m, RouteToUrl r m) => RouteToUrl r (DynamicWriterT t w m)
205+
206+instance (Monad m, SetRoute t r m) => SetRoute t r (DynamicWriterT t w m)
207+
195208runRoutedT :: RoutedT t r m a -> Dynamic t r -> m a
196209runRoutedT = runReaderT . unRoutedT
197210
@@ -256,7 +269,7 @@ dynamicIdentityCoercion = unsafeCoerce (Coercion :: Coercion (Identity ()) ()) -
256269factorRouted :: (Reflex t, MonadFix m, MonadHold t m, GEq f) => RoutedT t (DSum f (Dynamic t)) m a -> RoutedT t (DSum f Identity) m a
257270factorRouted r = RoutedT $ ReaderT $ \d -> do
258271 d' <- factorDyn d
259− runRoutedT r $ (coerceWith (dynamicCoercion $ dsumValueCoercion dynamicIdentityCoercion) d')
272+ runRoutedT r $ coerceWith (dynamicCoercion $ dsumValueCoercion dynamicIdentityCoercion) d'
260273
261274maybeRouted :: (Reflex t, MonadFix m, MonadHold t m) => RoutedT t (Maybe (Dynamic t a)) m b -> RoutedT t (Maybe a) m b
262275maybeRouted r = RoutedT $ ReaderT $ \d -> do
@@ -464,7 +477,7 @@ runRouteViewT
464477 , MonadJSM (Performable m)
465478 , MonadFix m
466479 )
467− => (Encoder Identity Identity r PageName)
480+ => Encoder Identity Identity r PageName
468481 --TODO: Get rid of the switchover and useHash arguments
469482 -- useHash can probably be baked into the encoder
470483 -> Event t () -- ^ Switchover event, nothing is done until this event fires. Used to prevent incorrect DOM expectations at hydration switchover time
lib/run/obelisk-run.cabal+2−2
@@ -33,7 +33,7 @@ library
3333 , process
3434 , ref-tf
3535 , reflex
36− , reflex-dom
36+ , reflex-dom-core
3737 , snap-core
3838 , streaming-commons
3939 , text
@@ -47,7 +47,7 @@ library
4747 , websockets
4848 exposed-modules:
4949 Obelisk.Run
50− ghc-options: -Wall -fwarn-redundant-constraints
50+ ghc-options: -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
5151 if os(linux)
5252 cpp-options: -DIPROUTE_SUPPORTED
5353 build-depends: which
lib/selftest/src/Obelisk/SelfTest.hs+24
@@ -19,6 +19,7 @@ import Data.Bool (bool)
1919import qualified Data.ByteString.Lazy as LBS
2020import Data.Foldable (for_)
2121import Data.Function (fix)
22+import Data.List (isInfixOf)
2223import qualified Data.Map as Map
2324import Data.Semigroup ((<>))
2425import qualified Data.Set as Set
@@ -205,6 +206,22 @@ main' isVerbose httpManager obeliskRepoReadOnly = withInitCache $ \initCache ->
205206 it "works in root directory" $ inTmpObInit $ \_ -> testObRunInDir' Nothing httpManager
206207 it "works in sub directory" $ inTmpObInit $ \_ -> testObRunInDir' (Just "frontend") httpManager
207208
209+ describe "ob repl" $ do
210+ it "accepts stdin commands" $ inTmpObInit $ \_ -> do
211+ setStdin "print 3\n:q"
212+ output <- runOb ["repl"]
213+ liftIO $ assertBool "" $
214+ [ "*Obelisk.Run Obelisk.Run Frontend Backend> 3"
215+ , "*Obelisk.Run Obelisk.Run Frontend Backend> Leaving GHCi."
216+ ] `isInfixOf` T.lines (T.strip output)
217+ it "works with custom Prelude" $ inTmpObInit $ \_ -> do
218+ writefile "common/src/Prelude.hs"
219+ "{-# LANGUAGE PackageImports #-} module Prelude (module X) where import \"base\" Prelude as X"
220+ setStdin ":q"
221+ output <- runOb ["repl"]
222+ liftIO $ assertBool "" $
223+ "*Obelisk.Run Obelisk.Run Frontend Backend> Leaving GHCi." `T.isInfixOf` output
224+
208225 describe "obelisk project" $ parallel $ do
209226 it "can build obelisk command" $ inTmpObInit $ \_ -> nixBuild ["-A", "command" , toTextIgnore obeliskRepoReadOnly]
210227 it "can build obelisk skeleton" $ inTmpObInit $ \_ -> nixBuild ["-A", "skeleton", toTextIgnore obeliskRepoReadOnly]
@@ -243,6 +260,8 @@ main' isVerbose httpManager obeliskRepoReadOnly = withInitCache $ \initCache ->
243260 uu <- update
244261 assertRevEQ u uu
245262
263+ it "can run 'ob doc'" $ inTmpObInit $ \_ -> runOb_ ["doc", "reflex"]
264+
246265 describe "ob thunk pack/unpack" $ parallel $ do
247266 it "has thunk pack and unpack inverses" $ inTmpObInitWithImplCopy $ \_ -> do
248267
@@ -304,6 +323,11 @@ main' isVerbose httpManager obeliskRepoReadOnly = withInitCache $ \initCache ->
304323 void $ errExit False $ runOb ["thunk", "update", toTextIgnore dir, "--branch", "dumble-palooza"]
305324 checkDir dir >>= liftIO . assertEqual "" startingContents
306325
326+ describe "ob shell" $ parallel $ do
327+ it "works with --" $ inTmpObInit $ \_ -> do
328+ output <- runOb ["shell", "--", "ghc-pkg", "list"]
329+ liftIO $ assertBool "Unexpected output from ob shell" $ ("Cabal-" `T.isInfixOf` output) && ("ghc-" `T.isInfixOf` output)
330+
307331 describe "ob hoogle" $ {- NOT parallel -} do
308332 it "starts a hoogle server on the given port" $ inTmpObInit $ \_ -> do
309333 [p0] <- liftIO $ getFreePorts 1
lib/snap-extras/obelisk-snap-extras.cabal+1−2
@@ -12,10 +12,9 @@ library
1212 , base
1313 , bytestring
1414 , snap-core
15− , unix
1615 , directory
1716 , filepath
1817 , text
1918 exposed-modules:
2019 Obelisk.Snap.Extras
21− ghc-options: -Wall
20+ ghc-options: -Wall -Werror -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
scripts/ghcid-this-libdeleted−4
@@ -1,4 +0,0 @@
1−#!/usr/bin/env bash
2−set -euo pipefail
3−
4−nix-shell -E "with (import ../.. {}); reflex-platform.workOn haskellPackageSets.ghc haskellPackageSets.ghc.obelisk-$(basename $PWD)" --run "ghcid -c 'cabal new-repl'"
skeleton/.gitignore+12−6
@@ -1,9 +1,15 @@
1−dist-newstyle
2−result
3−result-*
4−result-android
5−result-ios
6−result-exe
71.attr-cache
2+.cabal-sandbox
3+*.hi
4+*.o
5+cabal.project.local
6+cabal.sandbox.config
7+ctags
8+dist-newstyle/
9+dist/
810ghcid-output.txt
911profile/
12+result
13+result-*
14+tags
15+TAGS
skeleton/backend/backend.cabal+2−1
@@ -14,11 +14,12 @@ library
1414 , obelisk-route
1515 exposed-modules:
1616 Backend
17− ghc-options: -Wall
17+ ghc-options: -Wall -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
1818
1919executable backend
2020 main-is: main.hs
2121 hs-source-dirs: src-bin
22+ ghc-options: -Wall -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O -threaded
2223 if impl(ghcjs)
2324 buildable: False
2425 build-depends: base
skeleton/cabal.project+1
@@ -1,2 +1,3 @@
11optional-packages:
22 *
3+write-ghc-environment-files: never
skeleton/common/common.cabal+1−1
@@ -12,4 +12,4 @@ library
1212 exposed-modules:
1313 Common.Api
1414 Common.Route
15− ghc-options: -Wall
15+ ghc-options: -Wall -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
skeleton/default.nix+3−2
@@ -1,5 +1,6 @@
1−{ obelisk ? import ./.obelisk/impl {
2− system = builtins.currentSystem;
1+{ system ? builtins.currentSystem
2+, obelisk ? import ./.obelisk/impl {
3+ inherit system;
34 iosSdkVersion = "10.2";
45
56 # You must accept the Android Software Development Kit License Agreement at
skeleton/frontend/frontend.cabal+6−4
@@ -16,7 +16,7 @@ library
1616 , text
1717 exposed-modules:
1818 Frontend
19− ghc-options: -Wall
19+ ghc-options: -Wall -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates -O
2020
2121executable frontend
2222 main-is: main.hs
@@ -28,7 +28,9 @@ executable frontend
2828 , reflex-dom
2929 , obelisk-generated-static
3030 , frontend
31− --TODO: Make these ghc-options optional
32− ghc-options: -threaded
31+ ghc-options: -threaded -O -Wall -Wredundant-constraints -Wincomplete-uni-patterns -Wincomplete-record-updates
32+ if impl(ghcjs)
33+ ghc-options: -dedupe
34+ cpp-options: -DGHCJS_BROWSER
3335 if os(darwin)
34− ghc-options: -dynamic
36+ ghc-options: -dynamic
skeleton/shell.nixdeleted−1
@@ -1 +0,0 @@
1−(import ./. {}).shells.ghc