@@ -1,6 +1,16 @@
1+{-# LANGUAGE DataKinds #-}
2+{-# LANGUAGE LambdaCase #-}
3+{-# LANGUAGE OverloadedStrings #-}
4+{-# LANGUAGE QuasiQuotes #-}
5+{-# LANGUAGE RecordWildCards #-}
6+{-# LANGUAGE RoleAnnotations #-}
7+{-# LANGUAGE TemplateHaskellQuotes #-}
8+{-# LANGUAGE TypeFamilies #-}
9+{-# LANGUAGE UndecidableInstances #-}
2-- Module : Network.HTTP.Req
12-- Module : Network.HTTP.Req
3−-- Copyright : © 2016–2017 Mark Karpov
13+-- Copyright : © 2016–present Mark Karpov
4-- License : BSD 3 clause
14-- License : BSD 3 clause
6-- Maintainer : Mark Karpov <markkarpov92@gmail.com>
16-- Maintainer : Mark Karpov <markkarpov92@gmail.com>
@@ -9,61 +19,40 @@
10-- The documentation below is structured in such a way that the most
20-- The documentation below is structured in such a way that the most
11-- important information is presented first: you learn how to do HTTP
21-- important information is presented first: you learn how to do HTTP
12−-- requests, how to embed them in any monad you have, and then it gives you
22+-- requests, how to embed them in the monad you have, and then it gives you
13-- details about less-common things you may want to know about. The
23-- details about less-common things you may want to know about. The
14-- documentation is written with sufficient coverage of details and
24-- documentation is written with sufficient coverage of details and
15-- examples, and it's designed to be a complete tutorial on its own.
25-- examples, and it's designed to be a complete tutorial on its own.
17−-- /(A modest intro goes here, click on 'req' to start making requests.)/
19-- === About the library
27-- === About the library
21−-- Req is an easy-to-use, type-safe, expandable, high-level HTTP library
29+-- Req is an HTTP client library that attempts to be easy-to-use, type-safe,
22−-- that just works without any fooling around.
30+-- and expandable.
24−-- What does the phrase “easy-to-use” mean? It means that the library is
32+-- “Easy-to-use” means that the library is designed to be beginner-friendly
25−-- designed to be beginner-friendly so it's simple to add to your monad
33+-- so it's simple to add to your monad stack, intuitive to work with,
26−-- stack, intuitive to work with, well-documented, and does not get in your
34+-- well-documented, and does not get in your way. Doing HTTP requests is a
27−-- way. Doing HTTP requests is a common task and a Haskell library for this
35+-- common task and a Haskell library for this should be approachable and
28−-- should be very approachable and clear to beginners, thus certain
29−-- compromises were made. For example, one cannot currently modify
36+-- clear to beginners, thus certain compromises were made. For example, one
30−-- 'L.ManagerSettings' of the default manager because the library always
37+-- cannot currently modify 'L.ManagerSettings' of the default manager
31−-- uses the same implicit global manager for simplicity and maximal
38+-- because the library always uses the same implicit global manager for
32−-- connection sharing. There is a way to use your own manager with different
39+-- simplicity and maximal connection sharing. There is a way to use your own
33−-- settings, but it requires a bit more typing.
40+-- manager with different settings, but it requires more typing.
35−-- “Type-safe” means that the library is protective and eliminates certain
42+-- “Type-safe” means that the library tries to eliminate certain classes of
36−-- classes of errors. For example, we have correct-by-construction 'Url's,
43+-- errors. For example, we have correct-by-construction URLs; it is
37−-- it's guaranteed that the user does not send the request body when using
44+-- guaranteed that the user does not send the request body when using
38−-- methods like 'GET' or 'OPTIONS', and the amount of implicit assumptions
45+-- methods like GET or OPTIONS, and the amount of implicit assumptions is
39−-- is minimized by making the user specify his\/her intentions in an
46+-- minimized by making the user specify their intentions in an explicit
40−-- explicit form (for example, it's not possible to avoid specifying the
47+-- form. For example, it's not possible to avoid specifying the body or the
41−-- body or method of a request). Authentication methods that assume HTTPS
48+-- method of a request. Authentication methods that assume HTTPS force the
42−-- force the user to use HTTPS at the type level. The library also carefully
49+-- user to use HTTPS at the type level.
43−-- hides underlying types from the lower-level @http-client@ package because
44−-- those types are not safe enough (for example 'L.Request' is an instance
45−-- of 'Data.String.IsString' and, if it's malformed, it will blow up at
48−-- “Expandable” refers to the ability of the library to be expanded without
51+-- “Expandable” refers to the ability to create new components without
49−-- having to resort to ugly hacking. For example, it's possible to define
52+-- having to resort to hacking. For example, it's possible to define your
50−-- your own HTTP methods, create new ways to construct the body of a
53+-- own HTTP methods, create new ways to construct the body of a request,
51−-- request, create new authorization options, perform a request in a
54+-- create new authorization options, perform a request in a different way,
52−-- different way, and create your own methods to parse and represent a
55+-- and create your own methods to parse a response.
53−-- response. As a user extends the library to satisfy his\/her special
54−-- needs, the new solutions will work just like the built-ins. However, all
55−-- of the common cases are also covered by the library out-of-the-box.
57−-- “High-level” means that there are less details to worry about. The
58−-- library is a result of my experiences as a Haskell consultant. Working
59−-- for several clients, who had very different projects, showed me that the
60−-- library should adapt easily to any particular style of writing Haskell
61−-- applications. For example, some people prefer throwing exceptions, while
62−-- others are concerned with purity. Just define 'handleHttpException'
63−-- accordingly when making your monad instance of 'MonadHttp' and it will
64−-- play together seamlessly. Finally, the library cuts boilerplate down
65−-- considerably, and helps you write concise, easy to read, and maintainable
68-- === Using with other libraries
57-- === Using with other libraries
@@ -87,179 +76,207 @@
87-- the whole Haskell ecosystem uses, there is no risk in using @req@. The
76-- the whole Haskell ecosystem uses, there is no risk in using @req@. The
88-- machinery for performing requests is the same as with @http-conduit@ and
77-- machinery for performing requests is the same as with @http-conduit@ and
89-- @wreq@. The only difference is the API.
78-- @wreq@. The only difference is the API.
92−{-# LANGUAGE DataKinds #-}
93−{-# LANGUAGE DeriveDataTypeable #-}
94−{-# LANGUAGE DeriveGeneric #-}
95−{-# LANGUAGE FlexibleInstances #-}
96−{-# LANGUAGE GeneralizedNewtypeDeriving #-}
97−{-# LANGUAGE KindSignatures #-}
98−{-# LANGUAGE OverloadedStrings #-}
99−{-# LANGUAGE RankNTypes #-}
100−{-# LANGUAGE RecordWildCards #-}
101−{-# LANGUAGE ScopedTypeVariables #-}
102−{-# LANGUAGE TypeFamilies #-}
104−#if MIN_VERSION_base(4,9,0)
105−{-# LANGUAGE UndecidableInstances #-}
108−#if __GLASGOW_HASKELL__ < 710
109−{-# LANGUAGE ConstraintKinds #-}
112−#if __GLASGOW_HASKELL__ >= 800
113−{-# OPTIONS_GHC -fno-warn-redundant-constraints #-}
116module Network.HTTP.Req
79module Network.HTTP.Req
117 ( -- * Making a request
80 ( -- * Making a request
118 -- $making-a-request
81 -- $making-a-request
121− , withReqManager
86+ withReqManager,
122− -- * Embedding requests into your monad
88+ -- * Embedding requests in your monad
123 -- $embedding-requests
89 -- $embedding-requests
124− , MonadHttp (..)
90+ MonadHttp (..),
125− , HttpConfig (..)
91+ HttpConfig (..),
126 -- * Request
96 -- * Request
127 -- ** Method
98 -- ** Method
128 -- $method
99 -- $method
129− , GET (..)
100+ GET (..),
130− , POST (..)
101+ POST (..),
131− , HEAD (..)
102+ HEAD (..),
132− , PUT (..)
103+ PUT (..),
133− , DELETE (..)
104+ DELETE (..),
134− , TRACE (..)
105+ TRACE (..),
135− , CONNECT (..)
106+ CONNECT (..),
136− , OPTIONS (..)
107+ OPTIONS (..),
137− , PATCH (..)
108+ PATCH (..),
138− , HttpMethod (..)
109+ HttpMethod (..),
139 -- ** URL
111 -- ** URL
146− , parseUrlHttp
118+ useHttpURI,
147− , parseUrlHttps
119+ useHttpsURI,
148 -- ** Body
124 -- ** Body
150− , NoReqBody (..)
126+ NoReqBody (..),
151− , ReqBodyJson (..)
127+ ReqBodyJson (..),
152− , ReqBodyFile (..)
128+ ReqBodyFile (..),
153− , ReqBodyBs (..)
129+ ReqBodyBs (..),
154− , ReqBodyLbs (..)
130+ ReqBodyLbs (..),
155− , ReqBodyUrlEnc (..)
131+ ReqBodyUrlEnc (..),
156− , FormUrlEncodedParam
132+ FormUrlEncodedParam,
157− , ReqBodyMultipart
133+ ReqBodyMultipart,
158− , reqBodyMultipart
134+ reqBodyMultipart,
159− , HttpBody (..)
135+ HttpBody (..),
160− , ProvidesBody
136+ ProvidesBody,
161− , HttpBodyAllowed
137+ HttpBodyAllowed,
162 -- ** Optional parameters
139 -- ** Optional parameters
163 -- $optional-parameters
140 -- $optional-parameters
164− , Option
141+ Option,
165 -- *** Query parameters
143 -- *** Query parameters
166 -- $query-parameters
144 -- $query-parameters
168− , queryFlag
146+ queryFlag,
169− , QueryParam (..)
148+ QueryParam (..),
170 -- *** Headers
150 -- *** Headers
171− , header
151+ header,
172 -- *** Cookies
155 -- *** Cookies
173 -- $cookies
156 -- $cookies
174− , cookieJar
157+ cookieJar,
175 -- *** Authentication
159 -- *** Authentication
176 -- $authentication
160 -- $authentication
177− , basicAuth
161+ basicAuth,
178− , oAuth1
164+ oAuth1,
179− , oAuth2Bearer
165+ oAuth2Bearer,
180− , oAuth2Token
166+ oAuth2Token,
181 -- *** Other
169 -- *** Other
183− , decompress
171+ decompress,
184− , responseTimeout
172+ responseTimeout,
185− , httpVersion
173+ httpVersion,
186 -- * Response
175 -- * Response
187 -- ** Response interpretations
177 -- ** Response interpretations
188− , IgnoreResponse
178+ IgnoreResponse,
189− , ignoreResponse
179+ ignoreResponse,
190− , JsonResponse
180+ JsonResponse,
191− , jsonResponse
181+ jsonResponse,
192− , BsResponse
182+ BsResponse,
193− , bsResponse
183+ bsResponse,
194− , LbsResponse
184+ LbsResponse,
195− , lbsResponse
185+ lbsResponse,
196 -- ** Inspecting a response
187 -- ** Inspecting a response
197− , responseBody
188+ responseBody,
198− , responseStatusCode
189+ responseStatusCode,
199− , responseStatusMessage
190+ responseStatusMessage,
200− , responseHeader
191+ responseHeader,
201− , responseCookieJar
192+ responseCookieJar,
202 -- ** Defining your own interpretation
194 -- ** Defining your own interpretation
203 -- $new-response-interpretation
195 -- $new-response-interpretation
204− , HttpResponse (..)
196+ HttpResponse (..),
205 -- * Other
198 -- * Other
206− , HttpException (..)
199+ HttpException (..),
200+ isStatusCodeException,
207− , CanHaveBody (..)
201+ CanHaveBody (..),
208− , Scheme (..) )
202+ Scheme (..),
206+import Blaze.ByteString.Builder qualified as BB
211import Control.Applicative
207import Control.Applicative
212import Control.Arrow (first, second)
208import Control.Arrow (first, second)
213−import Control.Exception (Exception, try, handle, throwIO)
209+import Control.Exception hiding (Handler (..), TypeError)
210+import Control.Monad (guard, void, (>=>))
214−import Control.Monad
211+import Control.Monad.Base
212+import Control.Monad.Catch (Handler (..), MonadCatch, MonadMask, MonadThrow)
215import Control.Monad.IO.Class
213import Control.Monad.IO.Class
214+import Control.Monad.IO.Unlift
215+import Control.Monad.Reader (ReaderT (ReaderT), ask, lift, runReaderT)
216+import Control.Monad.Trans.Accum (AccumT)
217+import Control.Monad.Trans.Cont (ContT)
218+import Control.Monad.Trans.Control
219+import Control.Monad.Trans.Except (ExceptT)
220+import Control.Monad.Trans.Identity (IdentityT)
221+import Control.Monad.Trans.Maybe (MaybeT)
222+import Control.Monad.Trans.RWS.CPS qualified as RWS.CPS
223+import Control.Monad.Trans.RWS.Lazy qualified as RWS.Lazy
224+import Control.Monad.Trans.RWS.Strict qualified as RWS.Strict
225+import Control.Monad.Trans.Select (SelectT)
226+import Control.Monad.Trans.State.Lazy qualified as State.Lazy
227+import Control.Monad.Trans.State.Strict qualified as State.Strict
228+import Control.Monad.Trans.Writer.CPS qualified as Writer.CPS
229+import Control.Monad.Trans.Writer.Lazy qualified as Writer.Lazy
230+import Control.Monad.Trans.Writer.Strict qualified as Writer.Strict
216import Control.Retry
231import Control.Retry
217−import Data.Aeson (ToJSON (..), FromJSON (..))
232+import Data.Aeson (FromJSON (..), ToJSON (..))
233+import Data.Aeson qualified as A
218import Data.ByteString (ByteString)
234import Data.ByteString (ByteString)
235+import Data.ByteString qualified as B
236+import Data.ByteString.Lazy qualified as BL
237+import Data.CaseInsensitive qualified as CI
219import Data.Data (Data)
238import Data.Data (Data)
220−import Data.Default.Class
239+import Data.Default.Class (def)
221import Data.Function (on)
240import Data.Function (on)
222import Data.IORef
241import Data.IORef
223−import Data.List (nubBy)
242+import Data.Kind (Constraint, Type)
243+import Data.List (foldl', nubBy)
224import Data.List.NonEmpty (NonEmpty (..))
244import Data.List.NonEmpty (NonEmpty (..))
245+import Data.List.NonEmpty qualified as NE
225import Data.Maybe (fromMaybe)
246import Data.Maybe (fromMaybe)
226import Data.Proxy
247import Data.Proxy
227−import Data.Semigroup hiding (Option, option)
248+import Data.Semigroup (Endo (..))
249+import Data.Set qualified as S
228import Data.Text (Text)
250import Data.Text (Text)
251+import Data.Text qualified as T
252+import Data.Text.Encoding qualified as T
229−import Data.Typeable (Typeable)
253+import Data.Typeable (Typeable, cast)
230import GHC.Generics
254import GHC.Generics
231import GHC.TypeLits
255import GHC.TypeLits
256+import Language.Haskell.TH qualified as TH
257+import Language.Haskell.TH.Quote qualified as TH
258+import Language.Haskell.TH.Syntax qualified as TH
259+import Network.Connection qualified as NC
260+import Network.HTTP.Client qualified as L
261+import Network.HTTP.Client.Internal qualified as LI
262+import Network.HTTP.Client.MultipartFormData qualified as LM
263+import Network.HTTP.Client.TLS qualified as L
264+import Network.HTTP.Types qualified as Y
232import System.IO.Unsafe (unsafePerformIO)
265import System.IO.Unsafe (unsafePerformIO)
266+import Text.URI (URI)
267+import Text.URI qualified as URI
268+import Text.URI.QQ qualified as QQ
269+import Web.Authenticate.OAuth qualified as OAuth
270+import Web.FormUrlEncoded (FromForm (..), ToForm (..))
271+import Web.FormUrlEncoded qualified as Form
233import Web.HttpApiData (ToHttpApiData (..))
272import Web.HttpApiData (ToHttpApiData (..))
234−import qualified Blaze.ByteString.Builder as BB
235−import qualified Data.Aeson as A
236−import qualified Data.ByteString as B
237−import qualified Data.ByteString.Lazy as BL
238−import qualified Data.CaseInsensitive as CI
239−import qualified Data.List.NonEmpty as NE
240−import qualified Data.Text as T
241−import qualified Data.Text.Encoding as T
242−import qualified Data.Text.Read as TR
243−import qualified Network.Connection as NC
244−import qualified Network.HTTP.Client as L
245−import qualified Network.HTTP.Client.Internal as LI
246−import qualified Network.HTTP.Client.MultipartFormData as LM
247−import qualified Network.HTTP.Client.TLS as L
248−import qualified Network.HTTP.Types as Y
249−import qualified Web.Authenticate.OAuth as OAuth
251−#if MIN_VERSION_base(4,9,0)
252−import Data.Kind (Constraint)
254−import GHC.Exts (Constraint)
257----------------------------------------------------------------------------
274----------------------------------------------------------------------------
258-- Making a request
275-- Making a request
260-- $making-a-request
277-- $making-a-request
262−-- To make an HTTP request you need only one function: 'req'.
279+-- To make an HTTP request you normally need only one function: 'req'.
264-- | Make an HTTP request. The function takes 5 arguments, 4 of which
281-- | Make an HTTP request. The function takes 5 arguments, 4 of which
265-- specify required parameters and the final 'Option' argument is a
282-- specify required parameters and the final 'Option' argument is a
@@ -276,7 +293,7 @@ import GHC.Exts (Constraint)
277-- @body@ is a body option such as 'NoReqBody' or 'ReqBodyJson'. The
294-- @body@ is a body option such as 'NoReqBody' or 'ReqBodyJson'. The
278-- tutorial has a section about HTTP bodies, but usage is very
295-- tutorial has a section about HTTP bodies, but usage is very
279−-- straightforward and should be clear from the examples below.
296+-- straightforward and should be clear from the examples.
281-- @response@ is a type hint how to make and interpret response of an HTTP
298-- @response@ is a type hint how to make and interpret response of an HTTP
282-- request. Out-of-the-box it can be the following:
299-- request. Out-of-the-box it can be the following:
@@ -302,12 +319,13 @@ import GHC.Exts (Constraint)
302-- First, this is a piece of boilerplate that should be in place before you
319-- First, this is a piece of boilerplate that should be in place before you
303-- try the examples:
320-- try the examples:
322+-- > {-# LANGUAGE DeriveGeneric #-}
305-- > {-# LANGUAGE OverloadedStrings #-}
323-- > {-# LANGUAGE OverloadedStrings #-}
307-- > module Main (main) where
325-- > module Main (main) where
309−-- > import Control.Exception (throwIO)
310-- > import Control.Monad
327-- > import Control.Monad
328+-- > import Control.Monad.IO.Class
311-- > import Data.Aeson
329-- > import Data.Aeson
312-- > import Data.Maybe (fromJust)
330-- > import Data.Maybe (fromJust)
313-- > import Data.Monoid ((<>))
331-- > import Data.Monoid ((<>))
@@ -315,32 +333,30 @@ import GHC.Exts (Constraint)
315-- > import GHC.Generics
333-- > import GHC.Generics
316-- > import Network.HTTP.Req
334-- > import Network.HTTP.Req
317-- > import qualified Data.ByteString.Char8 as B
335-- > import qualified Data.ByteString.Char8 as B
318−-- >
336+-- > import qualified Text.URI as URI
319−-- > instance MonadHttp IO where
320−-- > handleHttpException = throwIO
322-- We will be making requests against the <https://httpbin.org> service.
338-- We will be making requests against the <https://httpbin.org> service.
324-- Make a GET request, grab 5 random bytes:
340-- Make a GET request, grab 5 random bytes:
326-- > main :: IO ()
342-- > main :: IO ()
327−-- > main = do
343+-- > main = runReq defaultHttpConfig $ do
328-- > let n :: Int
344-- > let n :: Int
329-- > n = 5
345-- > n = 5
330-- > bs <- req GET (https "httpbin.org" /: "bytes" /~ n) NoReqBody bsResponse mempty
346-- > bs <- req GET (https "httpbin.org" /: "bytes" /~ n) NoReqBody bsResponse mempty
331−-- > B.putStrLn (responseBody bs)
347+-- > liftIO $ B.putStrLn (responseBody bs)
333-- The same, but now we use a query parameter named @\"seed\"@ to control
349-- The same, but now we use a query parameter named @\"seed\"@ to control
334-- seed of the generator:
350-- seed of the generator:
336-- > main :: IO ()
352-- > main :: IO ()
337−-- > main = do
353+-- > main = runReq defaultHttpConfig $ do
338-- > let n, seed :: Int
354-- > let n, seed :: Int
339-- > n = 5
355-- > n = 5
340-- > seed = 100
356-- > seed = 100
341-- > bs <- req GET (https "httpbin.org" /: "bytes" /~ n) NoReqBody bsResponse $
357-- > bs <- req GET (https "httpbin.org" /: "bytes" /~ n) NoReqBody bsResponse $
342-- > "seed" =: seed
358-- > "seed" =: seed
343−-- > B.putStrLn (responseBody bs)
359+-- > liftIO $ B.putStrLn (responseBody bs)
345-- POST JSON data and get some info about the POST request:
361-- POST JSON data and get some info about the POST request:
@@ -353,108 +369,231 @@ import GHC.Exts (Constraint)
353-- > instance FromJSON MyData
369-- > instance FromJSON MyData
355-- > main :: IO ()
371-- > main :: IO ()
356−-- > main = do
372+-- > main = runReq defaultHttpConfig $ do
357-- > let myData = MyData
373-- > let myData = MyData
358-- > { size = 6
374-- > { size = 6
359-- > , color = "Green" }
375-- > , color = "Green" }
360-- > v <- req POST (https "httpbin.org" /: "post") (ReqBodyJson myData) jsonResponse mempty
376-- > v <- req POST (https "httpbin.org" /: "post") (ReqBodyJson myData) jsonResponse mempty
361−-- > print (responseBody v :: Value)
377+-- > liftIO $ print (responseBody v :: Value)
363-- Sending URL-encoded body:
379-- Sending URL-encoded body:
365-- > main :: IO ()
381-- > main :: IO ()
366−-- > main = do
382+-- > main = runReq defaultHttpConfig $ do
367-- > let params =
383-- > let params =
368-- > "foo" =: ("bar" :: Text) <>
384-- > "foo" =: ("bar" :: Text) <>
369-- > queryFlag "baz"
385-- > queryFlag "baz"
370-- > response <- req POST (https "httpbin.org" /: "post") (ReqBodyUrlEnc params) jsonResponse mempty
386-- > response <- req POST (https "httpbin.org" /: "post") (ReqBodyUrlEnc params) jsonResponse mempty
371−-- > print (responseBody response :: Value)
387+-- > liftIO $ print (responseBody response :: Value)
373-- Using various optional parameters and URL that is not known in advance:
389-- Using various optional parameters and URL that is not known in advance:
375-- > main :: IO ()
391-- > main :: IO ()
376−-- > main = do
392+-- > main = runReq defaultHttpConfig $ do
377-- > -- This is an example of what to do when URL is given dynamically. Of
393-- > -- This is an example of what to do when URL is given dynamically. Of
378-- > -- course in a real application you may not want to use 'fromJust'.
394-- > -- course in a real application you may not want to use 'fromJust'.
379−-- > let (url, options) = fromJust (parseUrlHttps "https://httpbin.org/get?foo=bar")
395+-- > uri <- URI.mkURI "https://httpbin.org/get?foo=bar"
396+-- > let (url, options) = fromJust (useHttpsURI uri)
380-- > response <- req GET url NoReqBody jsonResponse $
397-- > response <- req GET url NoReqBody jsonResponse $
381-- > "from" =: (15 :: Int) <>
398-- > "from" =: (15 :: Int) <>
382-- > "to" =: (67 :: Int) <>
399-- > "to" =: (67 :: Int) <>
383-- > basicAuth "username" "password" <>
400-- > basicAuth "username" "password" <>
384-- > options <> -- contains the ?foo=bar part
401-- > options <> -- contains the ?foo=bar part
385-- > port 443 -- here you can put any port of course
402-- > port 443 -- here you can put any port of course
386−-- > print (responseBody response :: Value)
403+-- > liftIO $ print (responseBody response :: Value)
389− :: ( MonadHttp m
405+ ( MonadHttp m,
390− , HttpMethod method
406+ HttpMethod method,
391− , HttpBody body
407+ HttpBody body,
392− , HttpResponse response
408+ HttpResponse response,
393− , HttpBodyAllowed (AllowsBody method) (ProvidesBody body) )
409+ HttpBodyAllowed (AllowsBody method) (ProvidesBody body)
394− => method -- ^ HTTP method
411+ -- | HTTP method
395− -> Url scheme -- ^ 'Url'—location of resource
413+ -- | 'Url'—location of resource
396− -> body -- ^ Body of the request
415+ -- | Body of the request
397− -> Proxy response -- ^ A hint how to interpret response
417+ -- | A hint how to interpret response
398− -> Option scheme -- ^ Collection of optional parameters
419+ -- | Collection of optional parameters
399− -> m response -- ^ Response
421+ -- | Response
400−req method url body Proxy options = req' method url body options $ \request manager -> do
423+req method url body responseProxy options =
424+ reqCb method url body responseProxy options pure
426+-- | A version of 'req' that does not use one of the predefined instances of
427+-- 'HttpResponse' but instead allows the user to consume @'L.Response'
428+-- 'L.BodyReader'@ manually, in a custom way.
435+ HttpBodyAllowed (AllowsBody method) (ProvidesBody body)
439+ -- | 'Url'—location of resource
441+ -- | Body of the request
443+ -- | Collection of optional parameters
445+ -- | How to consume response
446+ (L.Response L.BodyReader -> IO a) ->
449+reqBr method url body options consume =
450+ req' method url body options (reqHandler consume)
452+-- | A version of 'req' that takes a callback to modify the 'L.Request', but
453+-- otherwise performs the request identically.
460+ HttpResponse response,
461+ HttpBodyAllowed (AllowsBody method) (ProvidesBody body)
465+ -- | 'Url'—location of resource
467+ -- | Body of the request
469+ -- | A hint how to interpret response
471+ -- | Collection of optional parameters
473+ -- | Callback to modify the request
474+ (L.Request -> m L.Request) ->
477+reqCb method url body responseProxy options adjustRequest =
478+ req' method url body (options <> extraOptions) $ \request manager -> do
479+ request' <- adjustRequest request
480+ reqHandler getHttpResponse request' manager
483+ case acceptHeader responseProxy of
485+ Just accept -> header "Accept" accept
487+-- | The default handler function that the higher-level request functions
488+-- pass to 'req''. Internal function.
493+ -- | How to get final result from a 'L.Response'
494+ (L.Response L.BodyReader -> IO b) ->
495+ -- | 'L.Request' to perform
497+ -- | 'L.Manager' to use
500+reqHandler consume request manager = do
401− HttpConfig {..} <- getHttpConfig
501+ HttpConfig {..} <- getHttpConfig
402− let wrappingVanilla = handle (throwIO . VanillaHttpException)
502+ let wrapVanilla = handle (throwIO . VanillaHttpException)
403− wrapExc = handle (throwIO . LI.toHttpException request)
503+ wrapExc = handle (throwIO . LI.toHttpException request)
507+ (readIORef >=> mapM_ L.responseClose)
404− (liftIO . try . wrappingVanilla . wrapExc) (do
508+ (liftIO . try . wrapVanilla . wrapExc)
405− response <- retrying httpConfigRetryPolicy httpConfigRetryJudge
509+ ( withRRef $ \rref -> do
406− (const $ getHttpResponse request manager)
510+ let openResponse = mask_ $ do
512+ mapM_ L.responseClose r
513+ r' <- L.responseOpen request manager
514+ writeIORef rref (Just r')
516+ exceptionRetryPolicies =
518+ ++ [ \retryStatus -> Handler $ \e ->
519+ return $ httpConfigRetryJudgeException retryStatus e
523+ httpConfigRetryPolicy
524+ (\retryStatus r -> return $ httpConfigRetryJudge retryStatus r)
527+ httpConfigRetryPolicy
528+ exceptionRetryPolicies
529+ (const openResponse)
532+ (preview, r') <- grabPreview httpConfigBodyPreviewLength r
407− httpConfigCheckResponse request response
533+ mapM_ LI.throwHttp (httpConfigCheckResponse request r' preview)
408− return response)
534+ consume r'
409 >>= either handleHttpException return
536 >>= either handleHttpException return
411-- | Mostly like 'req' with respect to its arguments, but accepts a callback
538-- | Mostly like 'req' with respect to its arguments, but accepts a callback
412-- that allows to perform a request in arbitrary fashion.
539-- that allows to perform a request in arbitrary fashion.
414-- This function /does not/ perform handling\/wrapping exceptions, checking
541-- This function /does not/ perform handling\/wrapping exceptions, checking
415−-- response, and retrying. It only prepares 'L.Request' and allows you to
542+-- response (with 'httpConfigCheckResponse'), and retrying. It only prepares
416−-- use it.
543+-- 'L.Request' and allows you to use it.
418-- @since 0.3.0
545-- @since 0.3.0
421− :: forall m method body scheme a.
547+ forall m method body scheme a.
422− ( MonadHttp m
548+ ( MonadHttp m,
423− , HttpMethod method
549+ HttpMethod method,
424− , HttpBody body
550+ HttpBody body,
425− , HttpBodyAllowed (AllowsBody method) (ProvidesBody body) )
551+ HttpBodyAllowed (AllowsBody method) (ProvidesBody body)
426− => method -- ^ HTTP method
553+ -- | HTTP method
427− -> Url scheme -- ^ 'Url'—location of resource
555+ -- | 'Url'—location of resource
428− -> body -- ^ Body of the request
557+ -- | Body of the request
429− -> Option scheme -- ^ Collection of optional parameters
559+ -- | Collection of optional parameters
430− -> (L.Request -> L.Manager -> m a) -- ^ How to perform request
561+ -- | How to perform request
562+ (L.Request -> L.Manager -> m a) ->
432req' method url body options m = do
565req' method url body options m = do
433− config@HttpConfig {..} <- getHttpConfig
566+ config <- getHttpConfig
434− manager <- liftIO (readIORef globalManager)
435 let -- NOTE First appearance of any given header wins. This allows to
567 let -- NOTE First appearance of any given header wins. This allows to
436 -- “overwrite” headers when we construct a request by cons-ing.
568 -- “overwrite” headers when we construct a request by cons-ing.
437 nubHeaders = Endo $ \x ->
569 nubHeaders = Endo $ \x ->
438− x { L.requestHeaders = nubBy ((==) `on` fst) (L.requestHeaders x) }
570+ x {L.requestHeaders = nubBy ((==) `on` fst) (L.requestHeaders x)}
439− request' = flip appEndo L.defaultRequest $
572+ flip appEndo L.defaultRequest $
440− -- NOTE The order of 'mappend's matters, here method is overwritten
573+ -- NOTE The order of 'mappend's matters, here method is overwritten
441− -- first and 'options' take effect last. In particular, this means
574+ -- first and 'options' take effect last. In particular, this means
442− -- that 'options' can overwrite things set by other request
575+ -- that 'options' can overwrite things set by other request
443− -- components, which is useful for setting port number,
576+ -- components, which is useful for setting port number,
444− -- "Content-Type" header, etc.
577+ -- "Content-Type" header, etc.
445− nubHeaders <>
578+ nubHeaders
446− getRequestMod options <>
579+ <> getRequestMod options
447− getRequestMod config <>
580+ <> getRequestMod config
448− getRequestMod (Womb body :: Womb "body" body) <>
581+ <> getRequestMod (Tagged body :: Tagged "body" body)
449− getRequestMod url <>
582+ <> getRequestMod url
450− getRequestMod (Womb method :: Womb "method" method)
583+ <> getRequestMod (Tagged method :: Tagged "method" method)
451 request <- finalizeRequest options request'
584 request <- finalizeRequest options request'
452− m request manager
585+ withReqManager (m request)
587+-- | Perform an action using the global implicit 'L.Manager' that the rest
588+-- of the library uses. This allows us to reuse connections that the
589+-- 'L.Manager' controls.
590+withReqManager :: (MonadIO m) => (L.Manager -> m a) -> m a
591+withReqManager m = m globalManager
454−-- | Global 'L.Manager' that 'req' uses. Here we just go with the default
593+-- | The global 'L.Manager' that 'req' uses. Here we just go with the
455−-- settings, so users don't need to deal with this manager stuff at all, but
594+-- default settings, so users don't need to deal with this manager stuff at
456−-- when we create a request, instance 'HttpConfig' can affect the default
595+-- all, but when we create a request, instance 'HttpConfig' can affect the
457−-- settings via 'getHttpConfig'.
596+-- default settings via 'getHttpConfig'.
459-- A note about safety, in case 'unsafePerformIO' looks suspicious to you.
598-- A note about safety, in case 'unsafePerformIO' looks suspicious to you.
460-- The value of 'globalManager' is named and lives on top level. This means
599-- The value of 'globalManager' is named and lives on top level. This means
@@ -462,24 +601,20 @@ req' method url body options m = do
462-- manager. From that moment on the 'IORef' will be just reused—exactly the
601-- manager. From that moment on the 'IORef' will be just reused—exactly the
463-- behavior we want here in order to maximize connection sharing. GHC could
602-- behavior we want here in order to maximize connection sharing. GHC could
464-- spoil the plan by inlining the definition, hence the @NOINLINE@ pragma.
603-- spoil the plan by inlining the definition, hence the @NOINLINE@ pragma.
466−globalManager :: IORef L.Manager
604+globalManager :: L.Manager
467globalManager = unsafePerformIO $ do
605globalManager = unsafePerformIO $ do
468 context <- NC.initConnectionContext
606 context <- NC.initConnectionContext
469− let settings = L.mkManagerSettingsContext (Just context) def Nothing
608+ L.mkManagerSettingsContext
470 manager <- L.newManager settings
612 manager <- L.newManager settings
471− newIORef manager
613+ return manager
472{-# NOINLINE globalManager #-}
614{-# NOINLINE globalManager #-}
474−-- | Perform an action using global implicit 'L.Manager' that the rest of
475−-- the library uses. This allows to reuse connections that the 'L.Manager'
478−withReqManager :: MonadIO m => (L.Manager -> m a) -> m a
479−withReqManager m = liftIO (readIORef globalManager) >>= m
481----------------------------------------------------------------------------
616----------------------------------------------------------------------------
482−-- Embedding requests into your monad
617+-- Embedding requests in your monad
484-- $embedding-requests
619-- $embedding-requests
@@ -488,98 +623,267 @@ withReqManager m = liftIO (readIORef globalManager) >>= m
489-- When writing a library, keep your API polymorphic in terms of
624-- When writing a library, keep your API polymorphic in terms of
490-- 'MonadHttp', only define instance of 'MonadHttp' in final application.
625-- 'MonadHttp', only define instance of 'MonadHttp' in final application.
491−-- Another option is to use @newtype@ wrapped monad stack and define
626+-- Another option is to use a @newtype@-wrapped monad stack and define
492−-- 'MonadHttp' for it.
627+-- 'MonadHttp' for it. As of the version /0.4.0/, the 'Req' monad that
628+-- follows this strategy is provided out-of-the-box (see below).
494-- | A type class for monads that support performing HTTP requests.
630-- | A type class for monads that support performing HTTP requests.
495-- Typically, you only need to define the 'handleHttpException' method
631-- Typically, you only need to define the 'handleHttpException' method
496-- unless you want to tweak 'HttpConfig'.
632-- unless you want to tweak 'HttpConfig'.
498−class MonadIO m => MonadHttp m where
633+class (MonadIO m) => MonadHttp m where
500 -- | This method describes how to deal with 'HttpException' that was
634 -- | This method describes how to deal with 'HttpException' that was
501 -- caught by the library. One option is to re-throw it if you are OK with
635 -- caught by the library. One option is to re-throw it if you are OK with
502 -- exceptions, but if you prefer working with something like
636 -- exceptions, but if you prefer working with something like
503 -- 'Control.Monad.Except.MonadError', this is the right place to pass it to
637 -- 'Control.Monad.Except.MonadError', this is the right place to pass it to
504 -- 'Control.Monad.Except.throwError'.
638 -- 'Control.Monad.Except.throwError'.
506 handleHttpException :: HttpException -> m a
639 handleHttpException :: HttpException -> m a
508− -- | Return 'HttpConfig' to be used when performing HTTP requests. Default
641+ -- | Return the 'HttpConfig' to be used when performing HTTP requests.
509− -- implementation returns its 'def' value, which is described in the
642+ -- Default implementation returns its 'def' value, which is described in
510− -- documentation for the type. Common usage pattern with manually defined
643+ -- the documentation for the type. Common usage pattern with manually
511− -- 'getHttpConfig' is to return some hard-coded value, or value extracted
644+ -- defined 'getHttpConfig' is to return some hard-coded value, or a value
512− -- from 'Control.Monad.Reader.MonadReader' if a more flexible approach to
645+ -- extracted from 'Control.Monad.Reader.MonadReader' if a more flexible
513− -- configuration is desirable.
646+ -- approach to configuration is desirable.
515 getHttpConfig :: m HttpConfig
647 getHttpConfig :: m HttpConfig
516− getHttpConfig = return def
648+ getHttpConfig = return defaultHttpConfig
518−-- | 'HttpConfig' contains general and default settings to be used when
519−-- making HTTP requests.
650+-- | 'HttpConfig' contains settings to be used when making HTTP requests.
521data HttpConfig = HttpConfig
651data HttpConfig = HttpConfig
522− { httpConfigProxy :: Maybe L.Proxy
523− -- ^ Proxy to use. By default values of @HTTP_PROXY@ and @HTTPS_PROXY@
652+ { -- | Proxy to use. By default values of @HTTP_PROXY@ and @HTTPS_PROXY@
524 -- environment variables are respected, this setting overwrites them.
653 -- environment variables are respected, this setting overwrites them.
525 -- Default value: 'Nothing'.
654 -- Default value: 'Nothing'.
526− , httpConfigRedirectCount :: Int
655+ httpConfigProxy :: Maybe L.Proxy,
527− -- ^ How many redirects to follow when getting a resource. Default
656+ -- | How many redirects to follow when getting a resource. Default
528 -- value: 10.
657 -- value: 10.
529− , httpConfigAltManager :: Maybe L.Manager
658+ httpConfigRedirectCount :: Int,
530− -- ^ Alternative 'L.Manager' to use. 'Nothing' (default value) means
659+ -- | Alternative 'L.Manager' to use. 'Nothing' (default value) means
531− -- that default implicit manager will be used (that's what you want in
660+ -- that the default implicit manager will be used (that's what you want
532− -- 99% of cases).
661+ -- in 99% of cases).
533− , httpConfigCheckResponse :: forall r. HttpResponse r => L.Request -> r -> IO ()
662+ httpConfigAltManager :: Maybe L.Manager,
534− -- ^ Function to check the response immediately after receiving the
663+ -- | Function to check the response immediately after receiving the
664+ -- status and headers, before streaming of response body. The third
665+ -- argument is the beginning of response body (typically first 1024
535− -- status and headers. This is used for throwing exceptions on
666+ -- bytes). This is used for throwing exceptions on non-success status
536− -- non-success status codes by default (set to @\\_ _ -> return ()@ if
667+ -- codes by default (set to @\\_ _ _ -> Nothing@ if this behavior is not
537− -- this behavior is not desirable). Throwing is better then just
668+ -- desirable).
670+ -- When the value this function returns is 'Nothing', nothing will
671+ -- happen. When it there is 'L.HttpExceptionContent' inside 'Just', it
538− -- returning a request with non-2xx status code because in that case
674+ -- Throwing is better then just returning a request with non-2xx status
539− -- something is wrong and we need a way to short-cut execution. The
675+ -- code because in that case something is wrong and we need a way to
676+ -- short-cut execution (also remember that Req retries automatically on
677+ -- request timeouts and such, so when your request fails, it's certainly
540− -- thrown exception is caught by the library though and is available in
678+ -- something exceptional). The thrown exception is caught by the library
541− -- 'handleHttpException'.
679+ -- though and is available in 'handleHttpException'.
681+ -- __Note__: signature of this function was changed in the version
543 -- @since 0.3.0
684 -- @since 0.3.0
544− , httpConfigRetryPolicy :: RetryPolicyM IO
685+ httpConfigCheckResponse ::
690+ Maybe L.HttpExceptionContent,
545− -- ^ The retry policy to use for request retrying. By default 'def' is
691+ -- | The retry policy to use for request retrying. By default 'def' is
546 -- used (see 'RetryPolicyM').
692 -- used (see 'RetryPolicyM').
694+ -- __Note__: signature of this function was changed to disallow 'IO' in
695+ -- version /1.0.0/ and then changed back to its current form in /3.1.0/.
548 -- @since 0.3.0
697 -- @since 0.3.0
549− , httpConfigRetryJudge :: forall r. HttpResponse r => RetryStatus -> r -> IO Bool
698+ httpConfigRetryPolicy :: RetryPolicyM IO,
550− -- ^ The function is used to decide whether to retry a request. 'True'
699+ -- | The function is used to decide whether to retry a request. 'True'
551 -- means that the request should be retried.
700 -- means that the request should be retried.
702+ -- __Note__: signature of this function was changed in the version
553 -- @since 0.3.0
705 -- @since 0.3.0
554− } deriving Typeable
706+ httpConfigRetryJudge :: forall b. RetryStatus -> L.Response b -> Bool,
555−
707+ -- | Similar to 'httpConfigRetryJudge', but is used to decide when to
556−instance Default HttpConfig where
708+ -- retry requests that resulted in an exception. By default it retries
709+ -- on response timeout and connection timeout (changed in version
713+ httpConfigRetryJudgeException :: RetryStatus -> SomeException -> Bool,
714+ -- | Max length of preview fragment of response body.
717+ httpConfigBodyPreviewLength :: forall a. (Num a) => a
720+-- | The default value of 'HttpConfig'.
723+defaultHttpConfig :: HttpConfig
557− def = HttpConfig
725+ HttpConfig
558− { httpConfigProxy = Nothing
726+ { httpConfigProxy = Nothing,
559− , httpConfigRedirectCount = 10
727+ httpConfigRedirectCount = 10,
560− , httpConfigAltManager = Nothing
728+ httpConfigAltManager = Nothing,
561− , httpConfigCheckResponse = \_ response ->
729+ httpConfigCheckResponse = \_ response preview ->
562− let statusCode = responseStatusCode response in
730+ let scode = statusCode response
563− unless (200 <= statusCode && statusCode < 300) $ do
731+ in if 200 <= scode && scode < 300
564− chunk <- makeResponseBodyPreview response
732+ then Nothing
565− let vresponse = toVanillaResponse response
566− LI.throwHttp (L.StatusCodeException (void vresponse) chunk)
733+ else Just (L.StatusCodeException (void response) preview),
567− , httpConfigRetryPolicy = def
734+ httpConfigRetryPolicy = retryPolicyDefault,
568− , httpConfigRetryJudge = \_ r -> return $
735+ httpConfigRetryJudge = \_ response ->
569− responseStatusCode r `elem`
736+ statusCode response
570− [ 408 -- Request timeout
737+ `elem` [ 408, -- Request timeout
571− , 504 -- Gateway timeout
738+ 504, -- Gateway timeout
572− , 524 -- A timeout occurred
739+ 524, -- A timeout occurred
573− , 598 -- (Informal convention) Network read timeout error
740+ 598, -- (Informal convention) Network read timeout error
574− , 599 -- (Informal convention) Network connect timeout error
741+ 599 -- (Informal convention) Network connect timeout error
743+ httpConfigRetryJudgeException = \_ e ->
744+ case fromException e of
745+ Just (L.HttpExceptionRequest _ c) ->
747+ L.ResponseTimeout -> True
748+ L.ConnectionTimeout -> True
751+ httpConfigBodyPreviewLength = 1024
754+ statusCode = Y.statusCode . L.responseStatus
578instance RequestComponent HttpConfig where
756instance RequestComponent HttpConfig where
579 getRequestMod HttpConfig {..} = Endo $ \x ->
757 getRequestMod HttpConfig {..} = Endo $ \x ->
580− x { L.proxy = httpConfigProxy
759+ { L.proxy = httpConfigProxy,
581− , L.redirectCount = httpConfigRedirectCount
760+ L.redirectCount = httpConfigRedirectCount,
582− , LI.requestManagerOverride = httpConfigAltManager }
761+ LI.requestManagerOverride = httpConfigAltManager
764+-- | A monad that allows us to run 'req' in any 'IO'-enabled monad without
765+-- having to define new instances.
768+newtype Req a = Req (ReaderT HttpConfig IO a)
778+deriving instance MonadThrow Req
781+deriving instance MonadCatch Req
784+deriving instance MonadMask Req
786+instance MonadBase IO Req where
789+instance MonadBaseControl IO Req where
791+ liftBaseWith f = Req . ReaderT $ \r -> f (runReq r)
792+ {-# INLINEABLE liftBaseWith #-}
793+ restoreM = Req . ReaderT . const . return
794+ {-# INLINEABLE restoreM #-}
796+instance MonadHttp Req where
797+ handleHttpException = Req . lift . throwIO
798+ getHttpConfig = Req ask
801+instance (MonadHttp m, Monoid w) => MonadHttp (AccumT w m) where
802+ handleHttpException = lift . handleHttpException
803+ getHttpConfig = lift getHttpConfig
806+instance (MonadHttp m) => MonadHttp (ContT r m) where
807+ handleHttpException = lift . handleHttpException
808+ getHttpConfig = lift getHttpConfig
811+instance (MonadHttp m) => MonadHttp (ExceptT e m) where
812+ handleHttpException = lift . handleHttpException
813+ getHttpConfig = lift getHttpConfig
816+instance (MonadHttp m) => MonadHttp (IdentityT m) where
817+ handleHttpException = lift . handleHttpException
818+ getHttpConfig = lift getHttpConfig
821+instance (MonadHttp m) => MonadHttp (MaybeT m) where
822+ handleHttpException = lift . handleHttpException
823+ getHttpConfig = lift getHttpConfig
826+instance (MonadHttp m) => MonadHttp (ReaderT r m) where
827+ handleHttpException = lift . handleHttpException
828+ getHttpConfig = lift getHttpConfig
831+instance (MonadHttp m, Monoid w) => MonadHttp (RWS.CPS.RWST r w s m) where
832+ handleHttpException = lift . handleHttpException
833+ getHttpConfig = lift getHttpConfig
836+instance (MonadHttp m, Monoid w) => MonadHttp (RWS.Lazy.RWST r w s m) where
837+ handleHttpException = lift . handleHttpException
838+ getHttpConfig = lift getHttpConfig
841+instance (MonadHttp m, Monoid w) => MonadHttp (RWS.Strict.RWST r w s m) where
842+ handleHttpException = lift . handleHttpException
843+ getHttpConfig = lift getHttpConfig
846+instance (MonadHttp m) => MonadHttp (SelectT r m) where
847+ handleHttpException = lift . handleHttpException
848+ getHttpConfig = lift getHttpConfig
851+instance (MonadHttp m) => MonadHttp (State.Lazy.StateT s m) where
852+ handleHttpException = lift . handleHttpException
853+ getHttpConfig = lift getHttpConfig
856+instance (MonadHttp m) => MonadHttp (State.Strict.StateT s m) where
857+ handleHttpException = lift . handleHttpException
858+ getHttpConfig = lift getHttpConfig
861+instance (MonadHttp m, Monoid w) => MonadHttp (Writer.CPS.WriterT w m) where
862+ handleHttpException = lift . handleHttpException
863+ getHttpConfig = lift getHttpConfig
866+instance (MonadHttp m, Monoid w) => MonadHttp (Writer.Lazy.WriterT w m) where
867+ handleHttpException = lift . handleHttpException
868+ getHttpConfig = lift getHttpConfig
871+instance (MonadHttp m, Monoid w) => MonadHttp (Writer.Strict.WriterT w m) where
872+ handleHttpException = lift . handleHttpException
873+ getHttpConfig = lift getHttpConfig
875+-- | Run a computation in the 'Req' monad with the given 'HttpConfig'. In
876+-- the case of an exceptional situation an 'HttpException' will be thrown.
881+ -- | 'HttpConfig' to use
883+ -- | Computation to run
886+runReq config (Req m) = liftIO (runReaderT m config)
584----------------------------------------------------------------------------
888----------------------------------------------------------------------------
585-- Request—Method
889-- Request—Method
@@ -594,7 +898,6 @@ instance RequestComponent HttpConfig where
594-- define a new method that will works seamlessly, see 'HttpMethod'.
898-- define a new method that will works seamlessly, see 'HttpMethod'.
596-- | 'GET' method.
900-- | 'GET' method.
598data GET = GET
901data GET = GET
600instance HttpMethod GET where
903instance HttpMethod GET where
@@ -602,7 +905,6 @@ instance HttpMethod GET where
602 httpMethodName Proxy = Y.methodGet
905 httpMethodName Proxy = Y.methodGet
604-- | 'POST' method.
907-- | 'POST' method.
606data POST = POST
908data POST = POST
608instance HttpMethod POST where
910instance HttpMethod POST where
@@ -610,7 +912,6 @@ instance HttpMethod POST where
610 httpMethodName Proxy = Y.methodPost
912 httpMethodName Proxy = Y.methodPost
612-- | 'HEAD' method.
914-- | 'HEAD' method.
614data HEAD = HEAD
915data HEAD = HEAD
616instance HttpMethod HEAD where
917instance HttpMethod HEAD where
@@ -618,26 +919,24 @@ instance HttpMethod HEAD where
618 httpMethodName Proxy = Y.methodHead
919 httpMethodName Proxy = Y.methodHead
620-- | 'PUT' method.
921-- | 'PUT' method.
622data PUT = PUT
922data PUT = PUT
624instance HttpMethod PUT where
924instance HttpMethod PUT where
625 type AllowsBody PUT = 'CanHaveBody
925 type AllowsBody PUT = 'CanHaveBody
626 httpMethodName Proxy = Y.methodPut
926 httpMethodName Proxy = Y.methodPut
628−-- | 'DELETE' method. This data type does not allow having request body with
928+-- | 'DELETE' method. RFC 7231 allows a payload in DELETE but without
629−-- 'DELETE' requests, as it should be. However some APIs may expect 'DELETE'
929+-- semantics.
630−-- requests to have bodies, in that case define your own variation of
930+--
631−-- 'DELETE' method and allow it to have a body.
931+-- __Note__: before version /3.4.0/ this method did not allow request
633data DELETE = DELETE
933data DELETE = DELETE
635instance HttpMethod DELETE where
935instance HttpMethod DELETE where
636− type AllowsBody DELETE = 'NoBody
936+ type AllowsBody DELETE = 'CanHaveBody
637 httpMethodName Proxy = Y.methodDelete
937 httpMethodName Proxy = Y.methodDelete
639-- | 'TRACE' method.
939-- | 'TRACE' method.
641data TRACE = TRACE
940data TRACE = TRACE
643instance HttpMethod TRACE where
942instance HttpMethod TRACE where
@@ -645,7 +944,6 @@ instance HttpMethod TRACE where
645 httpMethodName Proxy = Y.methodTrace
944 httpMethodName Proxy = Y.methodTrace
647-- | 'CONNECT' method.
946-- | 'CONNECT' method.
649data CONNECT = CONNECT
947data CONNECT = CONNECT
651instance HttpMethod CONNECT where
949instance HttpMethod CONNECT where
@@ -653,7 +951,6 @@ instance HttpMethod CONNECT where
653 httpMethodName Proxy = Y.methodConnect
951 httpMethodName Proxy = Y.methodConnect
655-- | 'OPTIONS' method.
953-- | 'OPTIONS' method.
657data OPTIONS = OPTIONS
954data OPTIONS = OPTIONS
659instance HttpMethod OPTIONS where
956instance HttpMethod OPTIONS where
@@ -661,7 +958,6 @@ instance HttpMethod OPTIONS where
661 httpMethodName Proxy = Y.methodOptions
958 httpMethodName Proxy = Y.methodOptions
663-- | 'PATCH' method.
960-- | 'PATCH' method.
665data PATCH = PATCH
961data PATCH = PATCH
667instance HttpMethod PATCH where
963instance HttpMethod PATCH where
@@ -669,30 +965,26 @@ instance HttpMethod PATCH where
669 httpMethodName Proxy = Y.methodPatch
965 httpMethodName Proxy = Y.methodPatch
671-- | A type class for types that can be used as an HTTP method. To define a
967-- | A type class for types that can be used as an HTTP method. To define a
672−-- non-standard method, follow this example that defines COPY:
968+-- non-standard method, follow this example that defines @COPY@:
674-- > data COPY = COPY
970-- > data COPY = COPY
676-- > instance HttpMethod COPY where
972-- > instance HttpMethod COPY where
677-- > type AllowsBody COPY = 'CanHaveBody
973-- > type AllowsBody COPY = 'CanHaveBody
678-- > httpMethodName Proxy = "COPY"
974-- > httpMethodName Proxy = "COPY"
680class HttpMethod a where
975class HttpMethod a where
682 -- | Type function 'AllowsBody' returns a type of kind 'CanHaveBody' which
976 -- | Type function 'AllowsBody' returns a type of kind 'CanHaveBody' which
683− -- tells the rest of the library whether the method can have a body or
977+ -- tells the rest of the library whether the method can have body or not.
684− -- not. We use the special type 'CanHaveBody' “lifted” to kind level
978+ -- We use the special type 'CanHaveBody' lifted to the kind level instead
685− -- instead of 'Bool' to get more user-friendly compiler messages.
979+ -- of 'Bool' to get more user-friendly compiler messages.
687 type AllowsBody a :: CanHaveBody
980 type AllowsBody a :: CanHaveBody
689 -- | Return name of the method as a 'ByteString'.
982 -- | Return name of the method as a 'ByteString'.
691 httpMethodName :: Proxy a -> ByteString
983 httpMethodName :: Proxy a -> ByteString
693−instance HttpMethod method => RequestComponent (Womb "method" method) where
985+instance (HttpMethod method) => RequestComponent (Tagged "method" method) where
694 getRequestMod _ = Endo $ \x ->
986 getRequestMod _ = Endo $ \x ->
695− x { L.method = httpMethodName (Proxy :: Proxy method) }
987+ x {L.method = httpMethodName (Proxy :: Proxy method)}
697----------------------------------------------------------------------------
989----------------------------------------------------------------------------
698-- Request—URL
990-- Request—URL
@@ -700,7 +992,7 @@ instance HttpMethod method => RequestComponent (Womb "method" method) where
702-- We use 'Url's which are correct by construction, see 'Url'. To build a
994-- We use 'Url's which are correct by construction, see 'Url'. To build a
703−-- 'Url' from a 'ByteString', use 'parseUrlHttp' or 'parseUrlHttps'.
995+-- 'Url' from a 'URI', use 'useHttpURI', 'useHttpsURI', or generic 'useURI'.
705-- | Request's 'Url'. Start constructing your 'Url' with 'http' or 'https'
997-- | Request's 'Url'. Start constructing your 'Url' with 'http' or 'https'
706-- specifying the scheme and host at the same time. Then use the @('/~')@
998-- specifying the scheme and host at the same time. Then use the @('/~')@
@@ -730,91 +1022,194 @@ instance HttpMethod method => RequestComponent (Womb "method" method) where
731-- > https "юникод.рф"
1023-- > https "юникод.рф"
732-- > -- https://%D1%8E%D0%BD%D0%B8%D0%BA%D0%BE%D0%B4.%D1%80%D1%84
1024-- > -- https://%D1%8E%D0%BD%D0%B8%D0%BA%D0%BE%D0%B4.%D1%80%D1%84
734data Url (scheme :: Scheme) = Url Scheme (NonEmpty Text)
1025data Url (scheme :: Scheme) = Url Scheme (NonEmpty Text)
735 -- NOTE The second value is the path segments in reversed order.
1026 -- NOTE The second value is the path segments in reversed order.
736− deriving (Eq, Ord, Show, Data, Typeable, Generic)
1027+ deriving (Eq, Ord, Show, Data, Generic)
1029+type role Url nominal
1031+-- With template-haskell >=2.15 and text >=1.2.4 Lift can be derived, however
1032+-- the derived lift forgets the type of the scheme.
1033+instance (Typeable scheme) => TH.Lift (Url scheme) where
1035+ TH.dataToExpQ (fmap liftText . cast) url `TH.sigE` case url of
1036+ Url Http _ -> [t|Url 'Http|]
1037+ Url Https _ -> [t|Url 'Https|]
1039+ liftText t = TH.AppE (TH.VarE 'T.pack) <$> TH.lift (T.unpack t)
1040+ liftTyped = TH.Code . TH.unsafeTExpCoerce . TH.lift
738−-- | Given host name, produce a 'Url' which have “http” as its scheme and
1042+-- | Given host name, produce a 'Url' which has “http” as its scheme and
739-- empty path. This also sets port to @80@.
1043-- empty path. This also sets port to @80@.
741http :: Text -> Url 'Http
1044http :: Text -> Url 'Http
742http = Url Http . pure
1045http = Url Http . pure
744−-- | Given host name, produce a 'Url' which have “https” as its scheme and
1047+-- | Given host name, produce a 'Url' which has “https” as its scheme and
745-- empty path. This also sets port to @443@.
1048-- empty path. This also sets port to @443@.
747https :: Text -> Url 'Https
1049https :: Text -> Url 'Https
748https = Url Https . pure
1050https = Url Https . pure
750−-- | Grow given 'Url' appending a single path segment to it. Note that the
1052+-- | Grow a given 'Url' appending a single path segment to it. Note that the
751-- path segment can be of any type that is an instance of 'ToHttpApiData'.
1053-- path segment can be of any type that is an instance of 'ToHttpApiData'.
753infixl 5 /~
1054infixl 5 /~
754−(/~) :: ToHttpApiData a => Url scheme -> a -> Url scheme
755−Url secure path /~ segment = Url secure (NE.cons (toUrlPiece segment) path)
757−-- | Type-constrained version of @('/~')@ to remove ambiguity in the cases
1056+(/~) :: (ToHttpApiData a) => Url scheme -> a -> Url scheme
758−-- when next URL piece is a 'Text' literal.
1057+Url secure path /~ segment = Url secure (NE.cons (toUrlPiece segment) path)
1059+-- | A type-constrained version of @('/~')@ to remove ambiguity in the cases
1060+-- when next URL piece is a 'Data.Text.Text' literal.
760infixl 5 /:
1061infixl 5 /:
761(/:) :: Url scheme -> Text -> Url scheme
1063(/:) :: Url scheme -> Text -> Url scheme
762(/:) = (/~)
1064(/:) = (/~)
1066+-- | Render a 'Url' as 'Text'.
1069+renderUrl :: Url scheme -> Text
1072+ "https://" <> renderParts parts
1074+ "http://" <> renderParts parts
1076+ renderParts parts =
1077+ T.intercalate "/" (reverse $ NE.toList parts)
764−-- | The 'parseUrlHttp' function provides an alternative method to get 'Url'
1079+-- | The 'useHttpURI' function provides an alternative method to get 'Url'
765−-- (possibly with some 'Option's) from a 'ByteString'. This is useful when
1080+-- (possibly with some 'Option's) from a 'URI'. This is useful when you are
766−-- you are given a URL to query dynamically and don't know it beforehand.
1081+-- given a URL to query dynamically and don't know it beforehand.
767−-- The function parses 'ByteString' because it's the correct type to
1082+--
768−-- represent a URL, as 'Url' cannot contain characters outside of ASCII
1083+-- This function expects the scheme to be “http” and host to be present.
769−-- range, thus we can consider every character a 'Data.Word.Word8' value.
1084+--
770−--
1085+-- @since 3.0.0
771−-- This function only parses 'Url' (scheme, host, path) and optional query
1086+useHttpURI :: URI -> Maybe (Url 'Http, Option scheme)
772−-- parameters that are returned as 'Option'. It does not parse method name
1087+useHttpURI uri = do
773−-- or authentication info from given 'ByteString'.
1088+ guard (URI.uriScheme uri == Just [QQ.scheme|http|])
774−
1089+ urlHead <- http <$> uriHost uri
775−parseUrlHttp :: ByteString -> Maybe (Url 'Http, Option scheme)
1090+ let url = case URI.uriPath uri of
776−parseUrlHttp url' = do
1091+ Nothing -> urlHead
777− url <- B.stripPrefix "http://" url'
1092+ Just uriPath -> uriPathToUrl uriPath urlHead
778− (host :| path, option) <- parseUrlHelper url
1093+ return (url, uriOptions uri)
779− return (foldl (/:) (http host) path, option)
1094+
781−-- | Just like 'parseUrlHttp', but expects “https” scheme.
1095+-- | Just like 'useHttpURI', but expects the “https” scheme.
783−parseUrlHttps :: ByteString -> Maybe (Url 'Https, Option scheme)
1098+useHttpsURI :: URI -> Maybe (Url 'Https, Option scheme)
784−parseUrlHttps url' = do
1099+useHttpsURI uri = do
785− url <- B.stripPrefix "https://" url'
1100+ guard (URI.uriScheme uri == Just [QQ.scheme|https|])
786− (host :| path, option) <- parseUrlHelper url
1101+ urlHead <- https <$> uriHost uri
787− return (foldl (/:) (https host) path, option)
1102+ let url = case URI.uriPath uri of
788−
1103+ Nothing -> urlHead
789−-- | Get host\/collection of path pieces and possibly query parameters
1104+ Just uriPath -> uriPathToUrl uriPath urlHead
790−-- already converted to 'Option'. This function is not public.
1105+ return (url, uriOptions uri)
792−parseUrlHelper :: ByteString -> Maybe (NonEmpty Text, Option scheme)
1107+-- | Convert URI path to a 'Url'. Internal.
793−parseUrlHelper url = do
1108+--
794− let (path', query') = B.break (== 0x3f) url
1109+-- @since 3.9.0
795− query = mconcat (uncurry queryParam <$> Y.parseQueryText query')
1110+uriPathToUrl ::
796− p' :| ps <- NE.nonEmpty (Y.decodePathSegments path')
1111+ (Bool, NonEmpty (URI.RText 'URI.PathPiece)) ->
797− (p, port') <-
1112+ Url scheme ->
798− case T.break (== ':') p' of
1113+ Url scheme
799− (x, "") -> return (x, mempty)
1114+uriPathToUrl (trailingSlash, xs) urlHead =
800− (x, prt) ->
1115+ if trailingSlash then path /: T.empty else path
801− case TR.decimal (T.drop 1 prt) of
1116+ where
802− Right (prt',"") -> return (x, port prt')
1117+ path = foldl' (/:) urlHead (URI.unRText <$> NE.toList xs)
804− return (p :| ps, query <> port')
1119+-- | A combination of 'useHttpURI' and 'useHttpsURI' for cases when scheme
1120+-- is not known in advance.
1127+ (Url 'Http, Option scheme0)
1128+ (Url 'Https, Option scheme1)
1131+ (Left <$> useHttpURI uri) <|> (Right <$> useHttpsURI uri)
1133+-- | An internal helper function to extract host from a 'URI'.
1134+uriHost :: URI -> Maybe Text
1135+uriHost uri = case URI.uriAuthority uri of
1137+ Right URI.Authority {..} ->
1138+ Just (URI.unRText authHost)
1140+-- | A quasiquoter to build an 'Url' and 'Option' tuple. The type of the
1141+-- generated expression is @('Url' scheme0, 'Option' scheme1)@ with
1142+-- @scheme0@ being either 'Http' or 'Https' depending on the input.
1145+urlQ :: TH.QuasiQuoter
1148+ { quoteExp = \str ->
1149+ case URI.mkURI (T.pack str) of
1150+ Left err -> fail (displayException err)
1151+ Right uri -> case useURI uri of
1152+ Nothing -> fail "Not a HTTP or HTTPS URL"
1155+ [ either (TH.lift . fst) (TH.lift . fst) eurl,
1158+ quotePat = error "This usage is not supported",
1159+ quoteType = error "This usage is not supported",
1160+ quoteDec = error "This usage is not supported"
1163+-- | An internal helper function to extract 'Option's from a 'URI'.
1164+uriOptions :: forall scheme. URI -> Option scheme
1174+ case URI.uriAuthority uri of
1175+ Left _ -> (mempty, mempty)
1176+ Right URI.Authority {..} ->
1177+ let auth0 = case authUserInfo of
1179+ Just URI.UserInfo {..} ->
1180+ let username = T.encodeUtf8 (URI.unRText uiUsername)
1181+ password = maybe "" (T.encodeUtf8 . URI.unRText) uiPassword
1182+ in basicAuthUnsafe username password
1183+ port0 = case authPort of
1185+ Just port'' -> port (fromIntegral port'')
1188+ let liftQueryParam = \case
1189+ URI.QueryFlag t -> queryFlag (URI.unRText t)
1190+ URI.QueryParam k v -> URI.unRText k =: URI.unRText v
1191+ in mconcat (liftQueryParam <$> URI.uriQuery uri)
1193+-- TODO Blocked on upstream: https://github.com/snoyberg/http-client/issues/424
1195+-- case URI.uriFragment uri of
1196+-- Nothing -> mempty
1197+-- Just fragment'' -> fragment (URI.unRText fragment'')
806instance RequestComponent (Url scheme) where
1199instance RequestComponent (Url scheme) where
807 getRequestMod (Url scheme segments) = Endo $ \x ->
1200 getRequestMod (Url scheme segments) = Endo $ \x ->
808− let (host :| path) = NE.reverse segments in
1201+ let (host :| path) = NE.reverse segments
809− x { L.secure = case scheme of
1203+ { L.secure = case scheme of
810− Http -> False
1204+ Http -> False
811− Https -> True
1205+ Https -> True,
812− , L.port = case scheme of
1206+ L.port = case scheme of
813− Http -> 80
1207+ Http -> 80
814− Https -> 443
1208+ Https -> 443,
815− , L.host = Y.urlEncode False (T.encodeUtf8 host)
1209+ L.host = Y.urlEncode False (T.encodeUtf8 host),
816− , L.path =
1210+ L.path =
817− (BL.toStrict . BB.toLazyByteString . Y.encodePathSegments) path }
1211+ (BL.toStrict . BB.toLazyByteString . Y.encodePathSegments) path
819----------------------------------------------------------------------------
1214----------------------------------------------------------------------------
820-- Request—Body
1215-- Request—Body
@@ -823,39 +1218,37 @@ instance RequestComponent (Url scheme) where
824-- A number of options for request bodies are available. The @Content-Type@
1219-- A number of options for request bodies are available. The @Content-Type@
825-- header is set for you automatically according to the body option you use
1220-- header is set for you automatically according to the body option you use
826−-- (it's always specified in documentation for a given body option). To add
1221+-- (it's always specified in the documentation for a given body option). To
827−-- your own way to represent request body, see 'HttpBody'.
1222+-- add your own way to represent request body, define an instance of
829-- | This data type represents empty body of an HTTP request. This is the
1225-- | This data type represents empty body of an HTTP request. This is the
830-- data type to use with 'HttpMethod's that cannot have a body, as it's the
1226-- data type to use with 'HttpMethod's that cannot have a body, as it's the
831-- only type for which 'ProvidesBody' returns 'NoBody'.
1227-- only type for which 'ProvidesBody' returns 'NoBody'.
833-- Using of this body option does not set the @Content-Type@ header.
1229-- Using of this body option does not set the @Content-Type@ header.
835data NoReqBody = NoReqBody
1230data NoReqBody = NoReqBody
837instance HttpBody NoReqBody where
1232instance HttpBody NoReqBody where
838 getRequestBody NoReqBody = L.RequestBodyBS B.empty
1233 getRequestBody NoReqBody = L.RequestBodyBS B.empty
840−-- | This body option allows to use a JSON object as request body—probably
1235+-- | This body option allows us to use a JSON object as the request
841−-- the most popular format right now. Just wrap a data type that is an
1236+-- body—probably the most popular format right now. Just wrap a data type
842−-- instance of 'ToJSON' type class and you are done: it will be converted to
1237+-- that is an instance of 'ToJSON' type class and you are done: it will be
843−-- JSON and inserted as request body.
1238+-- converted to JSON and inserted as request body.
845-- This body option sets the @Content-Type@ header to @\"application/json;
1240-- This body option sets the @Content-Type@ header to @\"application/json;
846-- charset=utf-8\"@ value.
1241-- charset=utf-8\"@ value.
848newtype ReqBodyJson a = ReqBodyJson a
1242newtype ReqBodyJson a = ReqBodyJson a
850−instance ToJSON a => HttpBody (ReqBodyJson a) where
1244+instance (ToJSON a) => HttpBody (ReqBodyJson a) where
851 getRequestBody (ReqBodyJson a) = L.RequestBodyLBS (A.encode a)
1245 getRequestBody (ReqBodyJson a) = L.RequestBodyLBS (A.encode a)
852 getRequestContentType _ = pure "application/json; charset=utf-8"
1246 getRequestContentType _ = pure "application/json; charset=utf-8"
854-- | This body option streams request body from a file. It is expected that
1248-- | This body option streams request body from a file. It is expected that
855−-- the file size does not change during the streaming.
1249+-- the file size does not change during streaming.
857-- Using of this body option does not set the @Content-Type@ header.
1251-- Using of this body option does not set the @Content-Type@ header.
859newtype ReqBodyFile = ReqBodyFile FilePath
1252newtype ReqBodyFile = ReqBodyFile FilePath
861instance HttpBody ReqBodyFile where
1254instance HttpBody ReqBodyFile where
@@ -865,7 +1258,6 @@ instance HttpBody ReqBodyFile where
865-- | HTTP request body represented by a strict 'ByteString'.
1258-- | HTTP request body represented by a strict 'ByteString'.
867-- Using of this body option does not set the @Content-Type@ header.
1260-- Using of this body option does not set the @Content-Type@ header.
869newtype ReqBodyBs = ReqBodyBs ByteString
1261newtype ReqBodyBs = ReqBodyBs ByteString
871instance HttpBody ReqBodyBs where
1263instance HttpBody ReqBodyBs where
@@ -874,22 +1266,19 @@ instance HttpBody ReqBodyBs where
874-- | HTTP request body represented by a lazy 'BL.ByteString'.
1266-- | HTTP request body represented by a lazy 'BL.ByteString'.
876-- Using of this body option does not set the @Content-Type@ header.
1268-- Using of this body option does not set the @Content-Type@ header.
878newtype ReqBodyLbs = ReqBodyLbs BL.ByteString
1269newtype ReqBodyLbs = ReqBodyLbs BL.ByteString
880instance HttpBody ReqBodyLbs where
1271instance HttpBody ReqBodyLbs where
881 getRequestBody (ReqBodyLbs bs) = L.RequestBodyLBS bs
1272 getRequestBody (ReqBodyLbs bs) = L.RequestBodyLBS bs
883−-- | Form URL-encoded body. This can hold a collection of parameters which
1274+-- | URL-encoded body. This can hold a collection of parameters which are
884−-- are encoded similarly to query parameters at the end of query string,
1275+-- encoded similarly to query parameters at the end of query string, with
885−-- with the only difference that they are stored in request body. The
1276+-- the only difference that they are stored in request body. The similarity
886−-- similarity is reflected in the API as well, as you can use the same
1277+-- is reflected in the API as well, as you can use the same combinators you
887−-- combinators you would use to add query parameters: @('=:')@ and
1278+-- would use to add query parameters: @('=:')@ and 'queryFlag'.
890-- This body option sets the @Content-Type@ header to
1280-- This body option sets the @Content-Type@ header to
891−-- @\"application/x-www-from-urlencoded\"@ value.
1281+-- @\"application/x-www-form-urlencoded\"@ value.
893newtype ReqBodyUrlEnc = ReqBodyUrlEnc FormUrlEncodedParam
1282newtype ReqBodyUrlEnc = ReqBodyUrlEnc FormUrlEncodedParam
895instance HttpBody ReqBodyUrlEnc where
1284instance HttpBody ReqBodyUrlEnc where
@@ -899,33 +1288,37 @@ instance HttpBody ReqBodyUrlEnc where
900-- | An opaque monoidal value that allows to collect URL-encoded parameters
1289-- | An opaque monoidal value that allows to collect URL-encoded parameters
901-- to be wrapped in 'ReqBodyUrlEnc'.
1290-- to be wrapped in 'ReqBodyUrlEnc'.
903newtype FormUrlEncodedParam = FormUrlEncodedParam [(Text, Maybe Text)]
1291newtype FormUrlEncodedParam = FormUrlEncodedParam [(Text, Maybe Text)]
904 deriving (Semigroup, Monoid)
1292 deriving (Semigroup, Monoid)
906instance QueryParam FormUrlEncodedParam where
1294instance QueryParam FormUrlEncodedParam where
907 queryParam name mvalue =
1295 queryParam name mvalue =
908 FormUrlEncodedParam [(name, toQueryParam <$> mvalue)]
1296 FormUrlEncodedParam [(name, toQueryParam <$> mvalue)]
1297+ queryParamToList (FormUrlEncodedParam p) = p
1299+-- | Use 'formToQuery'.
1302+instance FromForm FormUrlEncodedParam where
1303+ fromForm = Right . formToQuery
910-- | Multipart form data. Please consult the
1305-- | Multipart form data. Please consult the
911-- "Network.HTTP.Client.MultipartFormData" module for how to construct
1306-- "Network.HTTP.Client.MultipartFormData" module for how to construct
912-- parts, then use 'reqBodyMultipart' to create actual request body from the
1307-- parts, then use 'reqBodyMultipart' to create actual request body from the
913−-- parts. 'reqBodyMultipart' is the only way to get a value of type
1308+-- parts. 'reqBodyMultipart' is the only way to get a value of the type
914-- 'ReqBodyMultipart', as its constructor is not exported on purpose.
1309-- 'ReqBodyMultipart', as its constructor is not exported on purpose.
916-- @since 0.2.0
1311-- @since 0.2.0
918−-- ==== __Example__
1313+-- ==== __Examples__
920−-- > import Control.Exception (throwIO)
1315+-- > import Control.Monad.IO.Class
921−-- > import qualified Network.HTTP.Client.MultipartFormData as LM
1316+-- > import Data.Default.Class
922-- > import Network.HTTP.Req
1317-- > import Network.HTTP.Req
923−-- >
1318+-- > import qualified Network.HTTP.Client.MultipartFormData as LM
924−-- > instance MonadHttp IO where
925−-- > handleHttpException = throwIO
927-- > main :: IO ()
1320-- > main :: IO ()
928−-- > main = do
1321+-- > main = runReq def $ do
929-- > body <-
1322-- > body <-
930-- > reqBodyMultipart
1323-- > reqBodyMultipart
931-- > [ LM.partBS "title" "My Image"
1324-- > [ LM.partBS "title" "My Image"
@@ -936,8 +1329,7 @@ instance QueryParam FormUrlEncodedParam where
936-- > body
1329-- > body
937-- > bsResponse
1330-- > bsResponse
938-- > mempty
1331-- > mempty
939−-- > print $ responseBody response
1332+-- > liftIO $ print (responseBody response)
941data ReqBodyMultipart = ReqBodyMultipart ByteString LI.RequestBody
1333data ReqBodyMultipart = ReqBodyMultipart ByteString LI.RequestBody
943instance HttpBody ReqBodyMultipart where
1335instance HttpBody ReqBodyMultipart where
@@ -948,126 +1340,117 @@ instance HttpBody ReqBodyMultipart where
948-- | Create 'ReqBodyMultipart' request body from a collection of 'LM.Part's.
1340-- | Create 'ReqBodyMultipart' request body from a collection of 'LM.Part's.
950-- @since 0.2.0
1342-- @since 0.2.0
952−reqBodyMultipart :: MonadIO m => [LM.Part] -> m ReqBodyMultipart
1343+reqBodyMultipart :: (MonadIO m) => [LM.Part] -> m ReqBodyMultipart
953reqBodyMultipart parts = liftIO $ do
1344reqBodyMultipart parts = liftIO $ do
954 boundary <- LM.webkitBoundary
1345 boundary <- LM.webkitBoundary
955− body <- LM.renderParts boundary parts
1346+ body <- LM.renderParts boundary parts
956 return (ReqBodyMultipart boundary body)
1347 return (ReqBodyMultipart boundary body)
958-- | A type class for things that can be interpreted as an HTTP
1349-- | A type class for things that can be interpreted as an HTTP
959-- 'L.RequestBody'.
1350-- 'L.RequestBody'.
961class HttpBody body where
1351class HttpBody body where
963− {-# MINIMAL getRequestBody #-}
965 -- | How to get actual 'L.RequestBody'.
1352 -- | How to get actual 'L.RequestBody'.
967 getRequestBody :: body -> L.RequestBody
1353 getRequestBody :: body -> L.RequestBody
969− -- | This method allows to optionally specify value of @Content-Type@
1355+ -- | This method allows us to optionally specify the value of
970− -- header that should be used with particular body option. By default it
1356+ -- @Content-Type@ header that should be used with particular body option.
971− -- returns 'Nothing' and so @Content-Type@ is not set.
1357+ -- By default it returns 'Nothing' and so @Content-Type@ is not set.
973 getRequestContentType :: body -> Maybe ByteString
1358 getRequestContentType :: body -> Maybe ByteString
974 getRequestContentType = const Nothing
1359 getRequestContentType = const Nothing
976-- | The type function recognizes 'NoReqBody' as having 'NoBody', while any
1361-- | The type function recognizes 'NoReqBody' as having 'NoBody', while any
977−-- other body option 'CanHaveBody'. This forces user to use 'NoReqBody' with
1362+-- other body option 'CanHaveBody'. This forces the user to use 'NoReqBody'
978−-- 'GET' method and other methods that should not send a body.
1363+-- with 'GET' method and other methods that should not have body.
980type family ProvidesBody body :: CanHaveBody where
1364type family ProvidesBody body :: CanHaveBody where
981 ProvidesBody NoReqBody = 'NoBody
1365 ProvidesBody NoReqBody = 'NoBody
982− ProvidesBody body = 'CanHaveBody
1366+ ProvidesBody body = 'CanHaveBody
984-- | This type function allows any HTTP body if method says it
1368-- | This type function allows any HTTP body if method says it
985-- 'CanHaveBody'. When the method says it should have 'NoBody', the only
1369-- 'CanHaveBody'. When the method says it should have 'NoBody', the only
986-- body option to use is 'NoReqBody'.
1370-- body option to use is 'NoReqBody'.
988−-- __Note__: users of GHC 8.0.1 and later will see a slightly more friendly
989−-- error message when method does not allow a body and body is provided.
991−type family HttpBodyAllowed
1371+type family
992− (allowsBody :: CanHaveBody)
1373+ (allowsBody :: CanHaveBody)
993− (providesBody :: CanHaveBody) :: Constraint where
1374+ (providesBody :: CanHaveBody) ::
994− HttpBodyAllowed 'NoBody 'NoBody = ()
1377+ HttpBodyAllowed 'NoBody 'NoBody = ()
995− HttpBodyAllowed 'CanHaveBody body = ()
1378+ HttpBodyAllowed 'CanHaveBody body = ()
996−#if MIN_VERSION_base(4,9,0)
997− HttpBodyAllowed 'NoBody 'CanHaveBody = TypeError
1379+ HttpBodyAllowed 'NoBody 'CanHaveBody =
998− ('Text "This HTTP method does not allow attaching a request body.")
1381+ ('Text "This HTTP method does not allow attaching a request body.")
1001−instance HttpBody body => RequestComponent (Womb "body" body) where
1383+instance (HttpBody body) => RequestComponent (Tagged "body" body) where
1002− getRequestMod (Womb body) = Endo $ \x ->
1384+ getRequestMod (Tagged body) = Endo $ \x ->
1003− x { L.requestBody = getRequestBody body
1386+ { L.requestBody = getRequestBody body,
1004− , L.requestHeaders =
1387+ L.requestHeaders =
1005− let old = L.requestHeaders x in
1388+ let old = L.requestHeaders x
1006− case getRequestContentType body of
1389+ in case getRequestContentType body of
1007− Nothing -> old
1390+ Nothing -> old
1008− Just contentType ->
1391+ Just contentType ->
1009− (Y.hContentType, contentType) : old }
1392+ (Y.hContentType, contentType) : old
1011----------------------------------------------------------------------------
1395----------------------------------------------------------------------------
1012-- Request—Optional parameters
1396-- Request—Optional parameters
1014-- $optional-parameters
1398-- $optional-parameters
1016−-- Optional parameters to a request include things like query parameters,
1400+-- Optional parameters of request include things like query parameters,
1017-- headers, port number, etc. All optional parameters have the type
1401-- headers, port number, etc. All optional parameters have the type
1018-- 'Option', which is a 'Monoid'. This means that you can use 'mempty' as
1402-- 'Option', which is a 'Monoid'. This means that you can use 'mempty' as
1019-- the last argument of 'req' to specify no optional parameters, or combine
1403-- the last argument of 'req' to specify no optional parameters, or combine
1020−-- 'Option's using 'mappend' (or @('<>')@) to have several of them at once.
1404+-- 'Option's using 'mappend' or @('<>')@ to have several of them at once.
1022−-- | Opaque 'Option' type is a 'Monoid' you can use to pack collection of
1406+-- | The opaque 'Option' type is a 'Monoid' you can use to pack collection
1023−-- optional parameters like query parameters and headers. See sections below
1407+-- of optional parameters like query parameters and headers. See sections
1024−-- to learn which 'Option' primitives are available.
1408+-- below to learn which 'Option' primitives are available.
1409+data Option (scheme :: Scheme)
1410+ = Option (Endo (Y.QueryText, L.Request)) (Maybe (L.Request -> IO L.Request))
1026−data Option (scheme :: Scheme) =
1027− Option (Endo (Y.QueryText, L.Request)) (Maybe (L.Request -> IO L.Request))
1028− -- NOTE 'QueryText' is just [(Text, Maybe Text)], we keep it along with
1412+-- NOTE 'QueryText' is just [(Text, Maybe Text)], we keep it along with
1029− -- Request to avoid appending to existing query string in request every
1413+-- Request to avoid appending to an existing query string in request every
1030− -- time new parameter is added. Additional Maybe (L.Request -> IO
1414+-- time new parameter is added. The additional Maybe (L.Request -> IO
1031− -- L.Request) is a finalizer that will be applied after all other
1415+-- L.Request) is a finalizer that will be applied after all other
1032− -- transformations. This is for authentication methods that sign requests
1416+-- transformations. This is for authentication methods that sign requests
1033− -- based on data in Request.
1417+-- based on data in Request.
1035instance Semigroup (Option scheme) where
1419instance Semigroup (Option scheme) where
1036− Option er0 mr0 <> Option er1 mr1 = Option
1420+ Option er0 mr0 <> Option er1 mr1 =
1037− (er0 <> er1) (mr0 <|> mr1)
1422+ (er0 <> er1)
1039instance Monoid (Option scheme) where
1425instance Monoid (Option scheme) where
1040− mempty = Option mempty Nothing
1426+ mempty = Option mempty Nothing
1041 mappend = (<>)
1427 mappend = (<>)
1429+-- | Use 'formToQuery'.
1432+instance FromForm (Option scheme) where
1433+ fromForm = Right . formToQuery
1043-- | A helper to create an 'Option' that modifies only collection of query
1435-- | A helper to create an 'Option' that modifies only collection of query
1044-- parameters. This helper is not a part of the public API.
1436-- parameters. This helper is not a part of the public API.
1046withQueryParams :: (Y.QueryText -> Y.QueryText) -> Option scheme
1437withQueryParams :: (Y.QueryText -> Y.QueryText) -> Option scheme
1047withQueryParams f = Option (Endo (first f)) Nothing
1438withQueryParams f = Option (Endo (first f)) Nothing
1049-- | A helper to create an 'Option' that modifies only 'L.Request'. This
1440-- | A helper to create an 'Option' that modifies only 'L.Request'. This
1050-- helper is not a part of public API.
1441-- helper is not a part of public API.
1052withRequest :: (L.Request -> L.Request) -> Option scheme
1442withRequest :: (L.Request -> L.Request) -> Option scheme
1053withRequest f = Option (Endo (second f)) Nothing
1443withRequest f = Option (Endo (second f)) Nothing
1055−-- | A helper to create an 'Option' that adds a finalizer (request
1056−-- transformation that is applied after all other modifications).
1058−asFinalizer :: (L.Request -> IO L.Request) -> Option scheme
1059−asFinalizer = Option mempty . pure
1061instance RequestComponent (Option scheme) where
1445instance RequestComponent (Option scheme) where
1062 getRequestMod (Option f _) = Endo $ \x ->
1446 getRequestMod (Option f _) = Endo $ \x ->
1063 let (qparams, x') = appEndo f ([], x)
1447 let (qparams, x') = appEndo f ([], x)
1064− query = Y.renderQuery True (Y.queryTextToQuery qparams)
1448+ query = Y.renderQuery True (Y.queryTextToQuery qparams)
1065− in x' { L.queryString = query }
1449+ in x' {L.queryString = query}
1067-- | Finalize given 'L.Request' by applying a finalizer from the given
1451-- | Finalize given 'L.Request' by applying a finalizer from the given
1068-- 'Option' (if it has any).
1452-- 'Option' (if it has any).
1070−finalizeRequest :: MonadIO m => Option scheme -> L.Request -> m L.Request
1453+finalizeRequest :: (MonadIO m) => Option scheme -> L.Request -> m L.Request
1071finalizeRequest (Option _ mfinalizer) = liftIO . fromMaybe pure mfinalizer
1454finalizeRequest (Option _ mfinalizer) = liftIO . fromMaybe pure mfinalizer
1073----------------------------------------------------------------------------
1456----------------------------------------------------------------------------
@@ -1080,47 +1463,67 @@ finalizeRequest (Option _ mfinalizer) = liftIO . fromMaybe pure mfinalizer
1080-- bodies (of the type 'FormUrlEncodedParam').
1463-- bodies (of the type 'FormUrlEncodedParam').
1082-- | This operator builds a query parameter that will be included in URL of
1465-- | This operator builds a query parameter that will be included in URL of
1083−-- your request after question sign @?@. This is the same syntax you use
1466+-- your request after the question sign @?@. This is the same syntax you use
1084-- with form URL encoded request bodies.
1467-- with form URL encoded request bodies.
1086-- This operator is defined in terms of 'queryParam':
1469-- This operator is defined in terms of 'queryParam':
1088-- > name =: value = queryParam name (pure value)
1471-- > name =: value = queryParam name (pure value)
1090infix 7 =:
1472infix 7 =:
1091(=:) :: (QueryParam param, ToHttpApiData a) => Text -> a -> param
1474(=:) :: (QueryParam param, ToHttpApiData a) => Text -> a -> param
1092name =: value = queryParam name (pure value)
1475name =: value = queryParam name (pure value)
1094−-- | Construct a flag, that is, valueless query parameter. For example, in
1477+-- | Construct a flag, that is, a valueless query parameter. For example, in
1095−-- the following URL @a@ is a flag, while @b@ is a query parameter with a
1478+-- the following URL @\"a\"@ is a flag, while @\"b\"@ is a query parameter
1096−-- value:
1479+-- with a value:
1098-- > https://httpbin.org/foo/bar?a&b=10
1481-- > https://httpbin.org/foo/bar?a&b=10
1100-- This operator is defined in terms of 'queryParam':
1483-- This operator is defined in terms of 'queryParam':
1102-- > queryFlag name = queryParam name (Nothing :: Maybe ())
1485-- > queryFlag name = queryParam name (Nothing :: Maybe ())
1104−queryFlag :: QueryParam param => Text -> param
1486+queryFlag :: (QueryParam param) => Text -> param
1105queryFlag name = queryParam name (Nothing :: Maybe ())
1487queryFlag name = queryParam name (Nothing :: Maybe ())
1489+-- | Construct query parameters from a 'ToForm' instance. This function
1490+-- produces the same query params as 'Form.urlEncodeAsFormStable'.
1492+-- Note that 'Form.Form' doesn't have the concept of parameters with the
1493+-- empty value (i.e. what you can get by @key =: ""@). If the value is
1494+-- empty, it will be encoded as a valueless parameter (i.e. what you can get
1495+-- by @queryFlag key@).
1498+formToQuery :: (QueryParam param, Monoid param, ToForm f) => f -> param
1499+formToQuery f = mconcat . fmap toParam . Form.toListStable $ toForm f
1501+ toParam (key, val) =
1107-- | A type class for query-parameter-like things. The reason to have an
1507-- | A type class for query-parameter-like things. The reason to have an
1108-- overloaded 'queryParam' is to be able to use it as an 'Option' and as a
1508-- overloaded 'queryParam' is to be able to use it as an 'Option' and as a
1109-- 'FormUrlEncodedParam' when constructing form URL encoded request bodies.
1509-- 'FormUrlEncodedParam' when constructing form URL encoded request bodies.
1110-- Having the same syntax for these cases seems natural and user-friendly.
1510-- Having the same syntax for these cases seems natural and user-friendly.
1112class QueryParam param where
1511class QueryParam param where
1114 -- | Create a query parameter with given name and value. If value is
1512 -- | Create a query parameter with given name and value. If value is
1115 -- 'Nothing', it won't be included at all (i.e. you create a flag this
1513 -- 'Nothing', it won't be included at all (i.e. you create a flag this
1116 -- way). It's recommended to use @('=:')@ and 'queryFlag' instead of this
1514 -- way). It's recommended to use @('=:')@ and 'queryFlag' instead of this
1117 -- method, because they are easier to read.
1515 -- method, because they are easier to read.
1516+ queryParam :: (ToHttpApiData a) => Text -> Maybe a -> param
1119− queryParam :: ToHttpApiData a => Text -> Maybe a -> param
1518+ -- | Get the query parameter names and values set by 'queryParam'.
1521+ queryParamToList :: param -> [(Text, Maybe Text)]
1121instance QueryParam (Option scheme) where
1523instance QueryParam (Option scheme) where
1122 queryParam name mvalue =
1524 queryParam name mvalue =
1123 withQueryParams ((:) (name, toQueryParam <$> mvalue))
1525 withQueryParams ((:) (name, toQueryParam <$> mvalue))
1526+ queryParamToList (Option f _) = fst $ appEndo f ([], L.defaultRequest)
1125----------------------------------------------------------------------------
1528----------------------------------------------------------------------------
1126-- Request—Optional parameters—Headers
1529-- Request—Optional parameters—Headers
@@ -1129,19 +1532,28 @@ instance QueryParam (Option scheme) where
1129-- headers with the same names the leftmost header will win. This means, in
1532-- headers with the same names the leftmost header will win. This means, in
1130-- particular, that you cannot create a request with several headers of the
1533-- particular, that you cannot create a request with several headers of the
1131-- same name.
1534-- same name.
1133−header
1535+header ::
1134− :: ByteString -- ^ Header name
1536+ -- | Header name
1135− -> ByteString -- ^ Header value
1538+ -- | Header value
1136− -> Option scheme
1540+ Option scheme
1137header name value = withRequest (attachHeader name value)
1541header name value = withRequest (attachHeader name value)
1139−-- | A non-public helper that attaches a header with given name and content
1543+-- | Attach a header with given name and content to a 'L.Request'.
1140−-- to a 'L.Request'.
1544+--
1141−
1545+-- @since 1.1.0
1142attachHeader :: ByteString -> ByteString -> L.Request -> L.Request
1546attachHeader :: ByteString -> ByteString -> L.Request -> L.Request
1143attachHeader name value x =
1547attachHeader name value x =
1144− x { L.requestHeaders = (CI.mk name, value) : L.requestHeaders x }
1548+ x {L.requestHeaders = (CI.mk name, value) : L.requestHeaders x}
1550+-- | Same as 'header', but with redacted values on print.
1553+headerRedacted :: ByteString -> ByteString -> Option scheme
1554+headerRedacted name value = withRequest $ \x ->
1555+ let y = attachHeader name value x
1556+ in y {L.redactHeaders = CI.mk name `S.insert` L.redactHeaders y}
1146----------------------------------------------------------------------------
1558----------------------------------------------------------------------------
1147-- Request—Optional parameters—Cookies
1559-- Request—Optional parameters—Cookies
@@ -1154,10 +1566,9 @@ attachHeader name value x =
1155-- | Use the given 'L.CookieJar'. A 'L.CookieJar' can be obtained from a
1567-- | Use the given 'L.CookieJar'. A 'L.CookieJar' can be obtained from a
1156-- 'L.Response' record.
1568-- 'L.Response' record.
1158cookieJar :: L.CookieJar -> Option scheme
1569cookieJar :: L.CookieJar -> Option scheme
1159cookieJar jar = withRequest $ \x ->
1570cookieJar jar = withRequest $ \x ->
1160− x { L.cookieJar = Just jar }
1571+ x {L.cookieJar = Just jar}
1162----------------------------------------------------------------------------
1573----------------------------------------------------------------------------
1163-- Request—Optional parameters—Authentication
1574-- Request—Optional parameters—Authentication
@@ -1175,30 +1586,66 @@ cookieJar jar = withRequest $ \x ->
1175-- | The 'Option' adds basic authentication.
1586-- | The 'Option' adds basic authentication.
1177-- See also: <https://en.wikipedia.org/wiki/Basic_access_authentication>.
1588-- See also: <https://en.wikipedia.org/wiki/Basic_access_authentication>.
1179−basicAuth
1589+basicAuth ::
1180− :: ByteString -- ^ Username
1590+ -- | Username
1181− -> ByteString -- ^ Password
1592+ -- | Password
1182− -> Option 'Https -- ^ Auth 'Option'
1595+ Option 'Https
1596+basicAuth = basicAuthUnsafe
1598+-- | An alternative to 'basicAuth' which works for any scheme. Note that
1599+-- using basic access authentication without SSL\/TLS is vulnerable to
1600+-- attacks. Use 'basicAuth' instead unless you know what you are doing.
1183−basicAuth username password = asFinalizer
1610+basicAuthUnsafe username password =
1184− (pure . L.applyBasicAuth username password)
1612+ (pure . L.applyBasicAuth username password)
1614+-- | The 'Option' set basic proxy authentication header.
1624+basicProxyAuth username password =
1625+ withRequest (L.applyBasicProxyAuth username password)
1186-- | The 'Option' adds OAuth1 authentication.
1627-- | The 'Option' adds OAuth1 authentication.
1188-- @since 0.2.0
1629-- @since 0.2.0
1190−oAuth1
1630+oAuth1 ::
1191− :: ByteString -- ^ Consumer token
1631+ -- | Consumer token
1192− -> ByteString -- ^ Consumer secret
1633+ -- | Consumer secret
1193− -> ByteString -- ^ OAuth token
1634+ ByteString ->
1194− -> ByteString -- ^ OAuth token secret
1637+ -- | OAuth token secret
1195− -> Option scheme -- ^ Auth 'Option'
1639+ -- | Auth 'Option'
1196oAuth1 consumerToken consumerSecret token tokenSecret =
1641oAuth1 consumerToken consumerSecret token tokenSecret =
1197− asFinalizer (OAuth.signOAuth app creds)
1642+ customAuth (OAuth.signOAuth app creds)
1199− app = OAuth.newOAuth
1645+ OAuth.newOAuth
1200− { OAuth.oauthConsumerKey = consumerToken
1646+ { OAuth.oauthConsumerKey = consumerToken,
1201− , OAuth.oauthConsumerSecret = consumerSecret }
1647+ OAuth.oauthConsumerSecret = consumerSecret
1202 creds = OAuth.newCredential token tokenSecret
1649 creds = OAuth.newCredential token tokenSecret
1204-- | The 'Option' adds an OAuth2 bearer token. This is treated by many
1651-- | The 'Option' adds an OAuth2 bearer token. This is treated by many
@@ -1209,12 +1656,14 @@ oAuth1 consumerToken consumerSecret token tokenSecret =
1209-- > oAuth2Bearer token = header "Authorization" ("Bearer " <> token)
1656-- > oAuth2Bearer token = header "Authorization" ("Bearer " <> token)
1211-- See also: <https://en.wikipedia.org/wiki/OAuth>.
1658-- See also: <https://en.wikipedia.org/wiki/OAuth>.
1213−oAuth2Bearer
1659+oAuth2Bearer ::
1214− :: ByteString -- ^ Token
1660+ -- | Token
1215− -> Option 'Https -- ^ Auth 'Option'
1662+ -- | Auth 'Option'
1216−oAuth2Bearer token = asFinalizer
1664+oAuth2Bearer token =
1217− (pure . attachHeader "Authorization" ("Bearer " <> token))
1666+ (pure . attachHeader "Authorization" ("Bearer " <> token))
1219-- | The 'Option' adds a not-quite-standard OAuth2 bearer token (that seems
1668-- | The 'Option' adds a not-quite-standard OAuth2 bearer token (that seems
1220-- to be used only by GitHub). This will be treated by whatever services
1669-- to be used only by GitHub). This will be treated by whatever services
@@ -1225,26 +1674,35 @@ oAuth2Bearer token = asFinalizer
1225-- > oAuth2Token token = header "Authorization" ("token" <> token)
1674-- > oAuth2Token token = header "Authorization" ("token" <> token)
1227-- See also: <https://developer.github.com/v3/oauth#3-use-the-access-token-to-access-the-api>.
1676-- See also: <https://developer.github.com/v3/oauth#3-use-the-access-token-to-access-the-api>.
1229−oAuth2Token
1677+oAuth2Token ::
1230− :: ByteString -- ^ Token
1678+ -- | Token
1231− -> Option 'Https -- ^ Auth 'Option'
1680+ -- | Auth 'Option'
1232−oAuth2Token token = asFinalizer
1682+oAuth2Token token =
1233− (pure . attachHeader "Authorization" ("token " <> token))
1684+ (pure . attachHeader "Authorization" ("token " <> token))
1686+-- | A helper to create custom authentication 'Option's. The given
1687+-- 'IO'-enabled request transformation is applied after all other
1688+-- modifications when constructing a request. Use wisely.
1691+customAuth :: (L.Request -> IO L.Request) -> Option scheme
1692+customAuth = Option mempty . pure
1235----------------------------------------------------------------------------
1694----------------------------------------------------------------------------
1236-- Request—Optional parameters—Other
1695-- Request—Optional parameters—Other
1238-- | Specify the port to connect to explicitly. Normally, 'Url' you use
1697-- | Specify the port to connect to explicitly. Normally, 'Url' you use
1239-- determines the default port: @80@ for HTTP and @443@ for HTTPS. This
1698-- determines the default port: @80@ for HTTP and @443@ for HTTPS. This
1240−-- 'Option' allows to choose arbitrary port overwriting the defaults.
1699+-- 'Option' allows us to choose an arbitrary port overwriting the defaults.
1242port :: Int -> Option scheme
1700port :: Int -> Option scheme
1243port n = withRequest $ \x ->
1701port n = withRequest $ \x ->
1244− x { L.port = n }
1702+ x {L.port = n}
1246-- | This 'Option' controls whether gzipped data should be decompressed on
1704-- | This 'Option' controls whether gzipped data should be decompressed on
1247−-- the fly. By default everything except for @application\/x-tar@ is
1705+-- the fly. By default everything except for @\"application\/x-tar\"@ is
1248-- decompressed, i.e. we have:
1706-- decompressed, i.e. we have:
1250-- > decompress (/= "application/x-tar")
1708-- > decompress (/= "application/x-tar")
@@ -1252,163 +1710,212 @@ port n = withRequest $ \x ->
1252-- You can also choose to decompress everything like this:
1710-- You can also choose to decompress everything like this:
1254-- > decompress (const True)
1712-- > decompress (const True)
1256−decompress
1713+decompress ::
1257− :: (ByteString -> Bool) -- ^ Predicate that is given MIME type, it
1714+ -- | Predicate that is given MIME type, it returns 'True' when content
1258− -- returns 'True' when content should be decompressed on the fly.
1715+ -- should be decompressed on the fly.
1716+ (ByteString -> Bool) ->
1259− -> Option scheme
1717+ Option scheme
1260decompress f = withRequest $ \x ->
1718decompress f = withRequest $ \x ->
1261− x { L.decompress = f }
1719+ x {L.decompress = f}
1263-- | Specify the number of microseconds to wait for response. The default
1721-- | Specify the number of microseconds to wait for response. The default
1264−-- value is 30 seconds.
1722+-- value is 30 seconds (defined in 'L.ManagerSettings' of connection
1265−
1723+-- 'L.Manager').
1266−responseTimeout
1724+responseTimeout ::
1267− :: Int -- ^ Number of microseconds to wait
1725+ -- | Number of microseconds to wait
1268− -> Option scheme
1727+ Option scheme
1269responseTimeout n = withRequest $ \x ->
1728responseTimeout n = withRequest $ \x ->
1270− x { L.responseTimeout = LI.ResponseTimeoutMicro n }
1729+ x {L.responseTimeout = LI.ResponseTimeoutMicro n}
1272-- | HTTP version to send to the server, the default is HTTP 1.1.
1731-- | HTTP version to send to the server, the default is HTTP 1.1.
1274−httpVersion
1732+httpVersion ::
1275− :: Int -- ^ Major version number
1733+ -- | Major version number
1276− -> Int -- ^ Minor version number
1735+ -- | Minor version number
1277− -> Option scheme
1737+ Option scheme
1278httpVersion major minor = withRequest $ \x ->
1738httpVersion major minor = withRequest $ \x ->
1279− x { L.requestVersion = Y.HttpVersion major minor }
1739+ x {L.requestVersion = Y.HttpVersion major minor}
1281----------------------------------------------------------------------------
1741----------------------------------------------------------------------------
1282-- Response interpretations
1742-- Response interpretations
1284−-- | Make a request and ignore body of response.
1744+-- | Make a request and ignore the body of the response.
1286−data IgnoreResponse = IgnoreResponse (L.Response ())
1745+newtype IgnoreResponse = IgnoreResponse (L.Response ())
1288instance HttpResponse IgnoreResponse where
1748instance HttpResponse IgnoreResponse where
1289 type HttpResponseBody IgnoreResponse = ()
1749 type HttpResponseBody IgnoreResponse = ()
1290− toVanillaResponse (IgnoreResponse response) = response
1750+ toVanillaResponse (IgnoreResponse r) = r
1291− getHttpResponse request manager =
1751+ getHttpResponse r = return $ IgnoreResponse (void r)
1292− IgnoreResponse <$> liftIO (L.httpNoBody request manager)
1293− makeResponseBodyPreview _ = return "<ignored response>"
1295-- | Use this as the fourth argument of 'req' to specify that you want it to
1753-- | Use this as the fourth argument of 'req' to specify that you want it to
1296−-- return the 'IgnoreResponse' interpretation.
1754+-- ignore the response body.
1298ignoreResponse :: Proxy IgnoreResponse
1755ignoreResponse :: Proxy IgnoreResponse
1299ignoreResponse = Proxy
1756ignoreResponse = Proxy
1301−-- | Make a request and interpret body of response as JSON. The
1758+-- | Make a request and interpret the body of the response as JSON. The
1302-- 'handleHttpException' method of 'MonadHttp' instance corresponding to
1759-- 'handleHttpException' method of 'MonadHttp' instance corresponding to
1303-- monad in which you use 'req' will determine what to do in the case when
1760-- monad in which you use 'req' will determine what to do in the case when
1304-- parsing fails (the 'JsonHttpException' constructor will be used).
1761-- parsing fails (the 'JsonHttpException' constructor will be used).
1762+newtype JsonResponse a = JsonResponse (L.Response a)
1306−data JsonResponse a = JsonResponse (L.Response a) ByteString
1308−instance FromJSON a => HttpResponse (JsonResponse a) where
1765+instance (FromJSON a) => HttpResponse (JsonResponse a) where
1309 type HttpResponseBody (JsonResponse a) = a
1766 type HttpResponseBody (JsonResponse a) = a
1310− toVanillaResponse (JsonResponse response _) = response
1767+ toVanillaResponse (JsonResponse r) = r
1311− getHttpResponse request manager = do
1768+ getHttpResponse r = do
1312− response <- L.httpLbs request manager
1769+ chunks <- L.brConsume (L.responseBody r)
1313− case A.eitherDecode (L.responseBody response) of
1770+ case A.eitherDecode (BL.fromChunks chunks) of
1314 Left e -> throwIO (JsonHttpException e)
1771 Left e -> throwIO (JsonHttpException e)
1318− . BL.take bodyPreviewLength
1321− return $ JsonResponse response { L.responseBody = x } preview
1772+ Right x -> return $ JsonResponse (x <$ r)
1322− makeResponseBodyPreview (JsonResponse _ preview) = return preview
1773+ acceptHeader Proxy = Just "application/json"
1324−-- | Use this as the forth argument of 'req' to specify that you want it to
1325−-- return the 'JsonResponse' interpretation.
1775+-- | Use this as the fourth argument of 'req' to specify that you want it to
1776+-- return the 'JsonResponse' interpretation.
1327jsonResponse :: Proxy (JsonResponse a)
1777jsonResponse :: Proxy (JsonResponse a)
1328jsonResponse = Proxy
1778jsonResponse = Proxy
1330−-- | Make a request and interpret body of response as a strict 'ByteString'.
1780+-- | Make a request and interpret the body of the response as a strict
1331−
1781+-- 'ByteString'.
1332newtype BsResponse = BsResponse (L.Response ByteString)
1782newtype BsResponse = BsResponse (L.Response ByteString)
1334instance HttpResponse BsResponse where
1785instance HttpResponse BsResponse where
1335 type HttpResponseBody BsResponse = ByteString
1786 type HttpResponseBody BsResponse = ByteString
1336− toVanillaResponse (BsResponse response) = response
1787+ toVanillaResponse (BsResponse r) = r
1337− getHttpResponse request manager =
1788+ getHttpResponse r = do
1338− L.withResponse request manager $ \response -> do
1339− chunks <- L.brConsume (L.responseBody response)
1789+ chunks <- L.brConsume (L.responseBody r)
1340− return $ BsResponse response { L.responseBody = B.concat chunks }
1790+ return $ BsResponse (B.concat chunks <$ r)
1341− makeResponseBodyPreview = return . B.take bodyPreviewLength . responseBody
1343−-- | Use this as the forth argument of 'req' to specify that you want to
1344−-- interpret response body as a strict 'ByteString'.
1792+-- | Use this as the fourth argument of 'req' to specify that you want to
1793+-- interpret the response body as a strict 'ByteString'.
1346bsResponse :: Proxy BsResponse
1794bsResponse :: Proxy BsResponse
1347bsResponse = Proxy
1795bsResponse = Proxy
1349−-- | Make a request and interpret body of response as a lazy
1797+-- | Make a request and interpret the body of the response as a lazy
1350-- 'BL.ByteString'.
1798-- 'BL.ByteString'.
1352newtype LbsResponse = LbsResponse (L.Response BL.ByteString)
1799newtype LbsResponse = LbsResponse (L.Response BL.ByteString)
1354instance HttpResponse LbsResponse where
1802instance HttpResponse LbsResponse where
1355 type HttpResponseBody LbsResponse = BL.ByteString
1803 type HttpResponseBody LbsResponse = BL.ByteString
1356− toVanillaResponse (LbsResponse response) = response
1804+ toVanillaResponse (LbsResponse r) = r
1357− getHttpResponse request manager =
1805+ getHttpResponse r = do
1358− LbsResponse <$> L.httpLbs request manager
1806+ chunks <- L.brConsume (L.responseBody r)
1359− makeResponseBodyPreview = return . BL.toStrict . BL.take 1027 . responseBody
1807+ return $ LbsResponse (BL.fromChunks chunks <$ r)
1361−-- | Use this as the forth argument of 'req' to specify that you want to
1362−-- interpret response body as a lazy 'BL.ByteString'.
1809+-- | Use this as the fourth argument of 'req' to specify that you want to
1810+-- interpret the response body as a lazy 'BL.ByteString'.
1364lbsResponse :: Proxy LbsResponse
1811lbsResponse :: Proxy LbsResponse
1365lbsResponse = Proxy
1812lbsResponse = Proxy
1814+----------------------------------------------------------------------------
1815+-- Helpers for response interpretations
1817+-- | Fetch beginning of the response and return it together with a new
1818+-- @'L.Response' 'L.BodyReader'@ that can be passed to 'getHttpResponse' and
1821+ -- | How many bytes to fetch
1823+ -- | Response with body reader inside
1824+ L.Response L.BodyReader ->
1825+ -- | Preview 'ByteString' and new response with body reader inside
1826+ IO (ByteString, L.Response L.BodyReader)
1827+grabPreview nbytes r = do
1828+ let br = L.responseBody r
1829+ (target, leftover, done) <- brReadN br nbytes
1830+ nref <- newIORef (0 :: Int)
1832+ n <- readIORef nref
1833+ let incn = modifyIORef' nref (+ 1)
1844+ else return leftover
1847+ then return B.empty
1849+ return (target, r {L.responseBody = br'})
1851+-- | Consume N bytes from 'L.BodyReader', return the target chunk, the
1852+-- leftover (may be empty), and whether we're done consuming the body.
1854+ -- | Body reader to stream from
1856+ -- | How many bytes to consume
1858+ -- | Target chunk, the leftover, whether we're done
1859+ IO (ByteString, ByteString, Bool)
1860+brReadN br n = go 0 id id
1865+ then return (r t, r l, True)
1867+ let (target, leftover) = B.splitAt (n - tlen) chunk
1868+ tlen' = B.length target
1869+ t' = t . (target :)
1870+ l' = l . (leftover :)
1871+ if tlen + tlen' < n
1872+ then go (tlen + tlen') t' l'
1873+ else return (r t', r l', False)
1874+ r f = B.concat (f [])
1367----------------------------------------------------------------------------
1876----------------------------------------------------------------------------
1368-- Inspecting a response
1877-- Inspecting a response
1370-- | Get the response body.
1879-- | Get the response body.
1372−responseBody
1880+responseBody ::
1373− :: HttpResponse response
1881+ (HttpResponse response) =>
1374− => response
1882+ response ->
1375− -> HttpResponseBody response
1883+ HttpResponseBody response
1376responseBody = L.responseBody . toVanillaResponse
1884responseBody = L.responseBody . toVanillaResponse
1378-- | Get the response status code.
1886-- | Get the response status code.
1380−responseStatusCode
1887+responseStatusCode ::
1381− :: HttpResponse response
1888+ (HttpResponse response) =>
1382− => response
1889+ response ->
1384responseStatusCode =
1891responseStatusCode =
1385 Y.statusCode . L.responseStatus . toVanillaResponse
1892 Y.statusCode . L.responseStatus . toVanillaResponse
1387-- | Get the response status message.
1894-- | Get the response status message.
1389−responseStatusMessage
1895+responseStatusMessage ::
1390− :: HttpResponse response
1896+ (HttpResponse response) =>
1391− => response
1897+ response ->
1392− -> ByteString
1898+ ByteString
1393responseStatusMessage =
1899responseStatusMessage =
1394 Y.statusMessage . L.responseStatus . toVanillaResponse
1900 Y.statusMessage . L.responseStatus . toVanillaResponse
1396-- | Lookup a particular header from a response.
1902-- | Lookup a particular header from a response.
1398−responseHeader
1903+responseHeader ::
1399− :: HttpResponse response
1904+ (HttpResponse response) =>
1400− => response -- ^ Response interpretation
1905+ -- | Response interpretation
1401− -> ByteString -- ^ Header to lookup
1907+ -- | Header to lookup
1402− -> Maybe ByteString -- ^ Header value if found
1909+ -- | Header value if found
1403responseHeader r h =
1911responseHeader r h =
1404 (lookup (CI.mk h) . L.responseHeaders . toVanillaResponse) r
1912 (lookup (CI.mk h) . L.responseHeaders . toVanillaResponse) r
1406-- | Get the response 'L.CookieJar'.
1914-- | Get the response 'L.CookieJar'.
1408−responseCookieJar
1915+responseCookieJar ::
1409− :: HttpResponse response
1916+ (HttpResponse response) =>
1410− => response
1917+ response ->
1411− -> L.CookieJar
1918+ L.CookieJar
1412responseCookieJar = L.responseCookieJar . toVanillaResponse
1919responseCookieJar = L.responseCookieJar . toVanillaResponse
1414----------------------------------------------------------------------------
1921----------------------------------------------------------------------------
@@ -1417,34 +1924,58 @@ responseCookieJar = L.responseCookieJar . toVanillaResponse
1417-- $new-response-interpretation
1924-- $new-response-interpretation
1419-- To create a new response interpretation you just need to make your data
1926-- To create a new response interpretation you just need to make your data
1420−-- type an instance of 'HttpResponse' type class.
1927+-- type an instance of the 'HttpResponse' type class.
1422−-- | A type class for response interpretations. It allows to fully control
1423−-- how request is made and how its body is parsed.
1929+-- | A type class for response interpretations. It allows us to describe how
1930+-- to consume the response from a @'L.Response' 'L.BodyReader'@ and produce
1931+-- the final result that is to be returned to the user.
1425class HttpResponse response where
1932class HttpResponse response where
1427 -- | The associated type is the type of body that can be extracted from an
1933 -- | The associated type is the type of body that can be extracted from an
1428 -- instance of 'HttpResponse'.
1934 -- instance of 'HttpResponse'.
1430− type HttpResponseBody response :: *
1935+ type HttpResponseBody response :: Type
1432 -- | The method describes how to get the underlying 'L.Response' record.
1937 -- | The method describes how to get the underlying 'L.Response' record.
1434 toVanillaResponse :: response -> L.Response (HttpResponseBody response)
1938 toVanillaResponse :: response -> L.Response (HttpResponseBody response)
1436− -- | This method describes how to make an HTTP request given 'L.Request'
1940+ -- | This method describes how to consume response body and, more
1437− -- (prepared by the library) and 'L.Manager'.
1941+ -- generally, obtain @response@ value from @'L.Response' 'L.BodyReader'@.
1943+ -- __Note__: 'L.BodyReader' is nothing but @'IO' 'ByteString'@. You should
1944+ -- call this action repeatedly until it yields the empty 'ByteString'. In
1945+ -- that case streaming of response is finished (which apparently leads to
1946+ -- closing of the connection, so don't call the reader after it has
1947+ -- returned the empty 'ByteString' once) and you can concatenate the
1948+ -- chunks to obtain the final result. (Of course you could as well stream
1949+ -- the contents to a file or do whatever you want.)
1951+ -- __Note__: signature of this function was changed in the version
1439− getHttpResponse :: L.Request -> L.Manager -> IO response
1953+ getHttpResponse ::
1440−
1954+ -- | Response with body reader inside
1441− -- | Construct a “preview” of response body. It is recommend to limit the
1955+ L.Response L.BodyReader ->
1442− -- length to 1024 bytes. This is mainly useful for inclusion of response
1956+ -- | The final result
1443− -- body fragments in exceptions.
1957+ IO response
1959+ -- | The value of @\"Accept\"@ header. This is useful, for example, if a
1960+ -- website supports both @XML@ and @JSON@ responses, and decides what to
1961+ -- reply with based on what @Accept@ headers you have sent.
1963+ -- __Note__: manually specified 'Options' that set the @\"Accept\"@ header
1964+ -- will take precedence.
1445− -- @since 0.3.0
1966+ -- @since 2.1.0
1967+ acceptHeader :: Proxy response -> Maybe ByteString
1968+ acceptHeader Proxy = Nothing
1447− makeResponseBodyPreview :: response -> IO ByteString
1970+-- | This instance has been added to make it easier to inspect 'L.Response'
1971+-- using Req's functions like 'responseStatusCode', 'responseStatusMessage',
1975+instance HttpResponse (L.Response ()) where
1976+ type HttpResponseBody (L.Response ()) = ()
1977+ toVanillaResponse = id
1978+ getHttpResponse = return . void
1449----------------------------------------------------------------------------
1980----------------------------------------------------------------------------
@@ -1454,15 +1985,14 @@ class HttpResponse response where
1454-- 'RequestComponent' changing\/overwriting something in it. 'Endo' is a
1985-- 'RequestComponent' changing\/overwriting something in it. 'Endo' is a
1455-- monoid of endomorphisms under composition, it's used to chain different
1986-- monoid of endomorphisms under composition, it's used to chain different
1456-- request components easier using @('<>')@.
1987-- request components easier using @('<>')@.
1989+-- __Note__: this type class is not a part of the public API.
1458class RequestComponent a where
1990class RequestComponent a where
1460 -- | Get a function that takes a 'L.Request' and changes it somehow
1991 -- | Get a function that takes a 'L.Request' and changes it somehow
1461− -- returning another 'L.Request'. For example HTTP method instance of
1992+ -- returning another 'L.Request'. For example, the 'HttpMethod' instance
1462− -- 'RequestComponent' just overwrites method. The function is wrapped in
1993+ -- of 'RequestComponent' just overwrites method. The function is wrapped
1463− -- 'Endo' so it's easier to chain such “modifying applications” together
1994+ -- in 'Endo' so it's easier to chain such “modifying applications”
1464− -- building bigger and bigger 'RequestComponent's.
1995+ -- together building bigger and bigger 'RequestComponent's.
1466 getRequestMod :: a -> Endo L.Request
1996 getRequestMod :: a -> Endo L.Request
1468-- | This wrapper is only used to attach a type-level tag to a given type.
1998-- | This wrapper is only used to attach a type-level tag to a given type.
@@ -1472,42 +2002,50 @@ class RequestComponent a where
1472-- method@ and @'HttpBody' body => 'RequestComponent' body@ when it decides
2002-- method@ and @'HttpBody' body => 'RequestComponent' body@ when it decides
1473-- which instance to use (i.e. the constraints are taken into account later,
2003-- which instance to use (i.e. the constraints are taken into account later,
1474-- when instance is already chosen).
2004-- when instance is already chosen).
1476−newtype Womb (tag :: Symbol) a = Womb a
2005+newtype Tagged (tag :: Symbol) a = Tagged a
1478-- | Exceptions that this library throws.
2007-- | Exceptions that this library throws.
1480data HttpException
2008data HttpException
1481− = VanillaHttpException L.HttpException
1482− -- ^ A wrapper with an 'L.HttpException' from "Network.HTTP.Client"
2009+ = -- | A wrapper with an 'L.HttpException' from "Network.HTTP.Client"
1483− | JsonHttpException String
2010+ VanillaHttpException L.HttpException
1484− -- ^ A wrapper with Aeson-produced 'String' describing why decoding failed
2011+ | -- | A wrapper with Aeson-produced 'String' describing why decoding
2013+ JsonHttpException String
1485− deriving (Show, Typeable, Generic)
2014+ deriving (Show, Generic)
1487instance Exception HttpException
2016instance Exception HttpException
1489−-- | A simple 'Bool'-like type we only have for better error messages. We
2018+-- | Return 'Just' if the given 'HttpException' is wrapping a http-client's
1490−-- use it as a kind and its data constructors as type-level tags.
2019+-- 'L.StatusCodeException'. Otherwise, return 'Nothing'.
1492−-- See also: 'HttpMethod' and 'HttpBody'.
2021+-- @since 3.12.0
2022+isStatusCodeException :: HttpException -> Maybe (L.Response ())
2023+isStatusCodeException
2024+ ( VanillaHttpException
2025+ ( L.HttpExceptionRequest
2027+ (L.StatusCodeException r _)
2030+isStatusCodeException _ = Nothing
2032+-- | A simple type isomorphic to 'Bool' that we only have for better error
2033+-- messages. We use it as a kind and its data constructors as type-level
2036+-- See also: 'HttpMethod' and 'HttpBody'.
1494data CanHaveBody
2037data CanHaveBody
1495− = CanHaveBody -- ^ Indeed can have a body
2038+ = -- | Indeed can have a body
1496− | NoBody -- ^ Should not have a body
2040+ | -- | Should not have a body
1498-- | A type-level tag that specifies URL scheme used (and thus if HTTPS is
2043-- | A type-level tag that specifies URL scheme used (and thus if HTTPS is
1499-- enabled). This is used to force TLS requirement for some authentication
2044-- enabled). This is used to force TLS requirement for some authentication
1500-- 'Option's.
2045-- 'Option's.
1502data Scheme
2046data Scheme
1503− = Http -- ^ HTTP
2048+ Http
1504− | Https -- ^ HTTPS
2050+ Https
1505− deriving (Eq, Ord, Show, Data, Typeable, Generic)
2051+ deriving (Eq, Ord, Show, Data, Generic, TH.Lift)
1507−----------------------------------------------------------------------------
1510−-- | Max length of preview fragment of response body.
1512−bodyPreviewLength :: Num a => a
1513−bodyPreviewLength = 1024