streamly/streamly.cabal

564 lines
21 KiB
Plaintext
Raw Normal View History

cabal-version: 2.2
name: streamly
version: 0.7.2
2017-10-20 07:06:00 +03:00
synopsis: Beautiful Streaming, Concurrent and Reactive Composition
2017-12-02 18:39:06 +03:00
description:
Streamly is a framework for writing programs in a high level, declarative
data flow programming paradigm. It provides a simple API, very close to
standard Haskell lists. A program is expressed as a composition of data
processing pipes, generally known as streams. Streams can be generated,
merged, chained, mapped, zipped, and consumed concurrently enabling a high
level, declarative yet concurrent composition of programs. Programs can be
concurrent or non-concurrent without any significant change. Concurrency is
auto scaled based on consumption rate. Programmers do not have to be aware
of threads, locking or synchronization to write scalable concurrent programs.
Streamly provides C like performance, orders of magnitude better compared to
existing streaming libraries.
2017-10-20 07:06:00 +03:00
.
Streamly is designed to express the full spectrum of programs with highest
performance. Do not think that if you are writing a small and simple program
it may not be for you. It expresses a small "hello world" program with the
same efficiency, simplicity and elegance as a large scale concurrent
application. It unifies many different aspects of special purpose libraries
into a single yet simple framework.
.
Streamly covers the functionality provided by Haskell lists as well as the
functionality provided by streaming libraries like
2018-06-14 23:38:06 +03:00
<https://hackage.haskell.org/package/streaming streaming>,
<https://hackage.haskell.org/package/pipes pipes>, and
<https://hackage.haskell.org/package/conduit conduit> with a simpler API and
better performance. Streamly provides
2019-05-12 23:35:22 +03:00
advanced stream composition including various ways of appending, merging,
zipping, splitting, grouping, distributing, partitioning and unzipping of
streams with true streaming and with concurrency. Streamly subsumes the
2018-06-14 23:38:06 +03:00
functionality of list transformer libraries like @pipes@ or
<https://hackage.haskell.org/package/list-t list-t> and also the logic
programming library <https://hackage.haskell.org/package/logict logict>.
The grouping, splitting and windowing combinators in streamly can be compared
to the window operators in <https://flink.apache.org/ Apache Flink>.
However, compared to Flink streamly has a pure functional, succinct and
expressive API.
.
The concurrency capabilities of streamly are much more advanced and powerful
compared to the basic concurrency functionality provided by the
<https://hackage.haskell.org/package/async async> package. Streamly is a
first class reactive programming library. If you are familiar with
<http://reactivex.io/ Reactive Extensions> you will find that it is very
similar. For most RxJs combinators you can find or write corresponding ones
in streamly. Streamly can be used as an alternative to
<https://hackage.haskell.org/package/Yampa Yampa> or
<https://hackage.haskell.org/package/reflex reflex> as well.
.
Streamly focuses on practical engineering with high performance. From well
written streamly programs one can expect performance competitive to C. High
performance streaming eliminates the need for string and text libraries like
2019-05-12 23:35:22 +03:00
<https://hackage.haskell.org/package/bytestring bytestring>,
<https://hackage.haskell.org/package/text text> and their lazy and strict
flavors. The confusion and cognitive overhead arising from different
string types is eliminated. The two fundamental types in streamly are arrays
for storage and streams for processing. Strings and text are simply streams
or arrays of 'Char' as they should be. Arrays in streamly have performance
at par with the vector library.
.
Where to find more information:
.
2020-01-02 09:06:11 +03:00
* /Quick Overview/: <#readme README file> in the package
* /Building/: <src/docs/Build.md Build guide> for optimal performance
* /Detailed Tutorial/: "Streamly.Tutorial" module in the haddock documentation
* /Interoperation/: "Streamly.Tutorial" module for interop with other
streaming libraries
* /Reference Documentation/: Haddock documentation for the respective modules
* /Examples/: <https://github.com/composewell/streamly-examples Streamly Examples>
* /Guides/: <src/docs docs directory> in the package, for documentation on
advanced topics, limitations, semantics of the library or on specific use
cases.
2018-10-26 21:34:55 +03:00
* <https://github.com/composewell/streaming-benchmarks Streaming Benchmarks>
* <https://github.com/composewell/concurrency-benchmarks Concurrency Benchmarks>
.
2017-12-02 18:39:06 +03:00
2017-12-05 18:40:43 +03:00
homepage: https://github.com/composewell/streamly
bug-reports: https://github.com/composewell/streamly/issues
license: BSD-3-Clause
license-file: LICENSE
2020-08-11 15:20:41 +03:00
tested-with: GHC==8.0.2
2018-12-30 22:17:49 +03:00
, GHC==8.4.4
, GHC==8.6.5
, GHC==8.8.1
, GHC==8.10.1
author: Composewell Technologies
maintainer: streamly@composewell.com
copyright: 2017 Composewell Technologies
2017-09-06 06:29:43 +03:00
category: Control, Concurrency, Streaming, Reactivity
stability: Experimental
build-type: Configure
2017-12-04 13:39:36 +03:00
extra-source-files:
.circleci/config.yml
2021-01-16 13:51:58 +03:00
.ghci
.github/workflows/haskell.yml
.gitignore
.hlint.ignore
.hlint.yaml
.travis.yml
2020-06-06 23:07:55 +03:00
CONTRIBUTING.md
Changelog.md
INSTALL.md
MAINTAINING.md
README.md
appveyor.yml
2020-06-06 23:07:55 +03:00
benchmark/*.hs
benchmark/README.md
benchmark/Streamly/Benchmark/Data/*.hs
benchmark/Streamly/Benchmark/Data/Parser/*.hs
benchmark/Streamly/Benchmark/Data/Stream/*.hs
benchmark/Streamly/Benchmark/FileSystem/*.hs
benchmark/Streamly/Benchmark/FileSystem/Handle/*.hs
2020-06-06 23:07:55 +03:00
benchmark/Streamly/Benchmark/Prelude/*.hs
benchmark/Streamly/Benchmark/Prelude/Serial/*.hs
benchmark/Streamly/Benchmark/Unicode/*.hs
2020-06-06 23:07:55 +03:00
benchmark/lib/Streamly/Benchmark/*.hs
benchmark/lib/Streamly/Benchmark/Common/*.hs
2020-06-06 23:07:55 +03:00
benchmark/streamly-benchmarks.cabal
2020-12-19 16:05:59 +03:00
bin/bench.sh
bin/bench-exec-one.sh
bin/build-lib.sh
bin/mk-hscope.sh
bin/mk-tags.sh
bin/targets.sh
bin/test.sh
2020-12-05 17:30:59 +03:00
cabal.project
cabal.project.ci
charts-0/streamly-vs-list-time.svg
2020-06-06 23:07:55 +03:00
configure
configure.ac
2019-01-21 07:36:50 +03:00
credits/*.md
2020-06-06 23:07:55 +03:00
credits/Yampa-0.10.6.2.txt
2019-11-15 02:14:20 +03:00
credits/base-4.12.0.0.txt
credits/bjoern-2008-2009.txt
2019-01-21 07:36:50 +03:00
credits/clock-0.7.2.txt
credits/foldl-1.4.5.txt
credits/fsnotify-0.3.0.1.txt
credits/hfsevents-0.1.6.txt
2019-01-21 07:36:50 +03:00
credits/pipes-concurrency-2.0.8.txt
2020-06-06 23:07:55 +03:00
credits/primitive-0.7.0.0.txt
2019-01-21 07:36:50 +03:00
credits/transient-0.5.5.txt
credits/vector-0.12.0.2.txt
2020-10-12 01:24:21 +03:00
default.nix
design/*.md
design/*.png
design/*.rst
2020-06-06 23:07:55 +03:00
docs/Build.md
docs/streamly-vs-async.md
docs/streamly-vs-lists.md
docs/transformers.md
examples/README.md
src/Streamly/Internal/Data/Stream/Instances.hs
src/Streamly/Internal/Data/Time/config-clock.h
src/Streamly/Internal/Data/Array/PrimInclude.hs
src/Streamly/Internal/Data/Array/Prim/TypesInclude.hs
src/Streamly/Internal/Data/Array/Prim/MutTypesInclude.hs
2020-08-07 14:05:28 +03:00
src/Streamly/Internal/FileSystem/Event/Darwin.h
src/config.h.in
2020-06-06 23:07:55 +03:00
src/inline.hs
test/README.md
test/Streamly/Test/Common/Array.hs
test/Streamly/Test/Data/*.hs
test/Streamly/Test/Data/Array/Prim.hs
test/Streamly/Test/Data/Array/Prim/Pinned.hs
test/Streamly/Test/Data/Array/Storable/Foreign.hs
test/Streamly/Test/Data/Parser/ParserD.hs
test/Streamly/Test/FileSystem/Event.hs
test/Streamly/Test/FileSystem/Handle.hs
test/Streamly/Test/Network/Socket.hs
test/Streamly/Test/Network/Inet/TCP.hs
test/Streamly/Test/Prelude.hs
test/Streamly/Test/Prelude/*.hs
test/Streamly/Test/Unicode/Stream.hs
test/lib/Streamly/Test/Common.hs
test/lib/Streamly/Test/Prelude/Common.hs
test/streamly-tests.cabal
test/version-bounds.hs
2020-06-06 23:07:55 +03:00
stack.yaml
extra-tmp-files:
config.log
config.status
autom4te.cache
src/config.h
2017-12-04 13:39:36 +03:00
2017-10-18 09:21:38 +03:00
source-repository head
type: git
2017-12-05 18:40:43 +03:00
location: https://github.com/composewell/streamly
2017-10-18 09:21:38 +03:00
flag fusion-plugin
2020-02-20 12:38:12 +03:00
description: Use fusion plugin for benchmarks and executables
manual: True
default: False
flag inspection
description: Enable inspection testing
manual: True
default: False
2019-11-08 19:44:07 +03:00
flag debug
description: Debug build with asserts enabled
manual: True
default: False
2017-09-14 06:10:50 +03:00
flag dev
description: Development build
2017-09-14 06:10:50 +03:00
manual: True
default: False
flag has-llvm
2020-02-20 12:38:12 +03:00
description: Use llvm backend for code generation
manual: True
default: False
2018-06-24 20:26:40 +03:00
flag no-fusion
2020-02-20 12:38:12 +03:00
description: Disable rewrite rules for stream fusion
2018-06-24 20:26:40 +03:00
manual: True
default: False
flag streamk
description: Use CPS style streams when possible
manual: True
default: False
flag use-c-malloc
description: Use C malloc instead of GHC malloc
manual: True
default: False
flag opt
description: off=GHC default, on=-O2
manual: True
default: True
-------------------------------------------------------------------------------
-- Common stanzas
-------------------------------------------------------------------------------
common compile-options
default-language: Haskell2010
if os(darwin)
cpp-options: -DCABAL_OS_DARWIN
if os(linux)
cpp-options: -DCABAL_OS_LINUX
2020-09-06 14:41:15 +03:00
if os(windows)
cpp-options: -DCABAL_OS_WINDOWS
2020-09-06 14:41:15 +03:00
if flag(streamk)
cpp-options: -DUSE_STREAMK_ONLY
if flag(no-fusion)
cpp-options: -DDISABLE_FUSION
if flag(dev)
cpp-options: -DDEVBUILD
if flag(inspection)
cpp-options: -DINSPECTION
if flag(use-c-malloc)
cpp-options: -DUSE_C_MALLOC
ghc-options: -Wall
2020-08-11 15:20:41 +03:00
-Wcompat
-Wunrecognised-warning-flags
-Widentities
-Wincomplete-record-updates
-Wincomplete-uni-patterns
-Wredundant-constraints
-Wnoncanonical-monad-instances
-Rghc-timing
if flag(has-llvm)
ghc-options: -fllvm
if flag(dev)
ghc-options: -Wmissed-specialisations
-Wall-missed-specialisations
2019-11-08 19:44:07 +03:00
if flag(dev) || flag(debug)
ghc-options: -fno-ignore-asserts
2020-07-06 05:40:04 +03:00
common default-extensions
default-extensions:
BangPatterns
CApiFFI
CPP
ConstraintKinds
DeriveDataTypeable
DeriveGeneric
DeriveTraversable
ExistentialQuantification
FlexibleContexts
FlexibleInstances
GeneralizedNewtypeDeriving
InstanceSigs
KindSignatures
LambdaCase
MagicHash
MultiParamTypeClasses
PatternSynonyms
RankNTypes
RecordWildCards
ScopedTypeVariables
TupleSections
TypeFamilies
2020-07-06 05:40:04 +03:00
ViewPatterns
-- MonoLocalBinds, enabled by TypeFamilies, causes performance
-- regressions. Disable it. This must come after TypeFamilies,
-- otherwise TypeFamilies will enable it again.
NoMonoLocalBinds
2020-07-06 05:40:04 +03:00
-- UndecidableInstances -- Does not show any perf impact
-- UnboxedTuples -- interferes with (#.)
common optimization-options
if flag(opt)
ghc-options: -O2
-fdicts-strict
-fspec-constr-recursive=16
-fmax-worker-args=16
common threading-options
ghc-options: -threaded
-with-rtsopts=-N
-- We need optimization options here to optimize internal (non-inlined)
-- versions of functions. Also, we have some benchmarking inspection tests
-- part of the library when built with --benchmarks flag. Thos tests fail
-- if we do not use optimization options here. It was observed that due to
-- -O2 here some concurrent/nested benchmarks improved and others regressed.
-- We can investigate a bit more here why the regression occurred.
common lib-options
2020-07-06 05:40:04 +03:00
import: compile-options, optimization-options, default-extensions
-------------------------------------------------------------------------------
-- Library
-------------------------------------------------------------------------------
library
import: lib-options
if impl(ghc >= 8.1)
default-extensions: TypeApplications
if impl(ghc >= 8.6)
default-extensions: QuantifiedConstraints
js-sources: jsbits/clock.js
include-dirs: src
if os(windows)
c-sources: src/Streamly/Internal/Data/Time/Windows.c
2020-09-06 14:41:15 +03:00
exposed-modules: Streamly.Internal.FileSystem.Event.Windows
build-depends: Win32 >= 2.6 && < 2.10
2020-08-07 14:05:28 +03:00
if os(darwin)
2020-08-07 14:05:28 +03:00
frameworks: Cocoa
include-dirs: src/Streamly/Internal
c-sources: src/Streamly/Internal/Data/Time/Darwin.c
, src/Streamly/Internal/FileSystem/Event/Darwin.m
2020-08-07 14:05:28 +03:00
exposed-modules:
Streamly.Internal.FileSystem.Event.Darwin
if os(linux)
exposed-modules: Streamly.Internal.FileSystem.Event.Linux
hs-source-dirs: src
other-modules:
Streamly.Data.Array
2020-08-11 15:20:41 +03:00
, Streamly.Data.Prim.Array
, Streamly.Data.SmallArray
-- Memory storage
, Streamly.Memory.Ring
, Streamly.FileSystem.IOVec
, Streamly.FileSystem.FDIO
, Streamly.FileSystem.FD
exposed-modules:
Streamly.Prelude
2019-11-04 19:11:49 +03:00
, Streamly.Data.Unfold
, Streamly.Data.Fold
, Streamly.Data.Array.Storable.Foreign
-- Text Processing
, Streamly.Unicode.Stream
-- Filesystem/IO
, Streamly.FileSystem.Handle
-- Network/IO
, Streamly.Network.Socket
, Streamly.Network.Inet.TCP
-- documentation
, Streamly.Tutorial
2019-09-24 13:02:02 +03:00
-- Deprecated
, Streamly
, Streamly.Data.Unicode.Stream
, Streamly.Memory.Array
-- Internal modules, listed roughly in dependency order
-- streamly-base
2020-02-18 21:25:28 +03:00
, Streamly.Internal.BaseCompat
, Streamly.Internal.Control.Exception
, Streamly.Internal.Control.Monad
2020-08-11 22:22:14 +03:00
, Streamly.Internal.Data.Cont
, Streamly.Internal.Data.Tuple.Strict
, Streamly.Internal.Data.Maybe.Strict
, Streamly.Internal.Data.Either.Strict
, Streamly.Internal.Foreign.Malloc
2019-09-24 22:49:19 +03:00
, Streamly.Internal.Data.Atomics
, Streamly.Internal.Data.IOFinalizer
, Streamly.Internal.Data.Time
2020-06-28 20:20:46 +03:00
, Streamly.Internal.Data.Time.TimeSpec
, Streamly.Internal.Data.Time.Units
, Streamly.Internal.Data.Time.Clock
-- streamly-core-stream
, Streamly.Internal.Data.SVar
, Streamly.Internal.Data.Stream.StreamK.Type
, Streamly.Internal.Data.Fold.Types
, Streamly.Internal.Data.Stream.StreamD.Step
, Streamly.Internal.Data.Stream.StreamD.Type
, Streamly.Internal.Data.Stream.StreamDK.Type
, Streamly.Internal.Data.Unfold.Types
2019-09-25 14:10:16 +03:00
, Streamly.Internal.Data.Sink.Types
, Streamly.Internal.Data.Parser.ParserK.Types
, Streamly.Internal.Data.Parser.ParserD.Types
, Streamly.Internal.Data.Pipe.Types
-- Unboxed IORef
, Streamly.Internal.Data.IORef.Prim
-- streamly-core-array
-- May depend on streamly-core-stream
, Streamly.Internal.Data.Array.Storable.Foreign.Mut.Types
, Streamly.Internal.Data.Array.Storable.Foreign.Types
, Streamly.Internal.Data.Array.Prim.Mut.Types
, Streamly.Internal.Data.Array.Prim.Types
, Streamly.Internal.Data.Array.Prim.Pinned.Mut.Types
, Streamly.Internal.Data.Array.Prim.Pinned.Types
, Streamly.Internal.Data.SmallArray.Types
-- streamly-base-streams
, Streamly.Internal.Data.Stream.StreamK
-- StreamD depends on streamly-core-array
, Streamly.Internal.Data.Stream.StreamD.Generate
, Streamly.Internal.Data.Stream.StreamD.Eliminate
, Streamly.Internal.Data.Stream.StreamD.Nesting
, Streamly.Internal.Data.Stream.StreamD.Transform
, Streamly.Internal.Data.Stream.StreamD.Exception
, Streamly.Internal.Data.Stream.StreamD.Lift
, Streamly.Internal.Data.Stream.StreamD
, Streamly.Internal.Data.Stream.StreamDK
, Streamly.Internal.Data.Stream.Prelude
, Streamly.Internal.Data.Parser.ParserD.Tee
, Streamly.Internal.Data.Parser.ParserD
-- streamly-core
, Streamly.Internal.Data.Unfold
2021-01-22 04:52:15 +03:00
, Streamly.Internal.Data.Fold.Tee
, Streamly.Internal.Data.Fold
, Streamly.Internal.Data.Sink
, Streamly.Internal.Data.Parser
, Streamly.Internal.Data.Pipe
, Streamly.Internal.Data.Stream.SVar
, Streamly.Internal.Data.Stream.Serial
, Streamly.Internal.Data.Stream.Async
, Streamly.Internal.Data.Stream.Parallel
, Streamly.Internal.Data.Stream.Ahead
, Streamly.Internal.Data.Stream.Zip
, Streamly.Internal.Data.Stream.IsStream.Combinators
, Streamly.Internal.Data.Stream.IsStream.Common
, Streamly.Internal.Data.Stream.IsStream.Types
, Streamly.Internal.Data.Stream.IsStream.Enumeration
, Streamly.Internal.Data.Stream.IsStream.Generate
, Streamly.Internal.Data.Stream.IsStream.Eliminate
, Streamly.Internal.Data.Stream.IsStream.Transform
, Streamly.Internal.Data.Stream.IsStream.Nesting
, Streamly.Internal.Data.Stream.IsStream.Exception
, Streamly.Internal.Data.Stream.IsStream.Lift
, Streamly.Internal.Data.Stream.IsStream
, Streamly.Internal.Data.List
-- streamly-arrays
-- May depend on streamly-core
, Streamly.Internal.Data.Array
, Streamly.Internal.Data.Array.Storable.Foreign
, Streamly.Internal.Data.Array.Prim
, Streamly.Internal.Data.Array.Prim.Pinned
, Streamly.Internal.Data.SmallArray
, Streamly.Internal.Data.Array.Stream.Mut.Foreign
, Streamly.Internal.Memory.ArrayStream
-- streamly-unicode
, Streamly.Internal.Unicode.Stream
, Streamly.Internal.Unicode.Char
, Streamly.Internal.Unicode.Array.Char
, Streamly.Internal.Unicode.Array.Prim.Pinned
2019-12-27 18:29:17 +03:00
-- streamly-serde
, Streamly.Internal.Data.Binary.Decode
-- streamly-filesystem
, Streamly.Internal.FileSystem.Handle
, Streamly.Internal.FileSystem.Dir
, Streamly.Internal.FileSystem.File
-- streamly-network
2019-09-30 20:55:43 +03:00
, Streamly.Internal.Network.Socket
, Streamly.Internal.Network.Inet.TCP
build-depends:
-- Core libraries shipped with ghc, the min and max
-- constraints of these libraries should match with
-- the GHC versions we support
2020-08-11 15:20:41 +03:00
base >= 4.9 && < 5
, containers >= 0.5 && < 0.7
, deepseq >= 1.4.1 && < 1.5
, directory >= 1.2.2 && < 1.4
, exceptions >= 0.8 && < 0.11
, ghc-prim >= 0.2 && < 0.7
, mtl >= 2.2 && < 3
, primitive >= 0.5.4 && < 0.8
, transformers >= 0.4 && < 0.6
, heaps >= 0.3 && < 0.4
-- concurrency
, atomic-primops >= 0.8 && < 0.9
, lockfree-queue >= 0.2.3 && < 0.3
-- transfomers
2017-08-31 03:41:46 +03:00
, monad-control >= 1.0 && < 2
, transformers-base >= 0.4 && < 0.5
, fusion-plugin-types >= 0.1 && < 0.2
2020-01-24 13:57:17 +03:00
2020-12-23 09:23:37 +03:00
-- Network
, network >= 2.6 && < 4
if flag(inspection)
build-depends: template-haskell >= 2.14 && < 2.17
, inspection-testing >= 0.4 && < 0.5
-- Array uses a Storable constraint in dev build making several inspection
-- tests fail
if flag(dev) && flag(inspection)
build-depends: inspection-and-dev-flags-cannot-be-used-together