1
1
mirror of https://github.com/wader/fq.git synced 2024-11-28 11:42:50 +03:00
Commit Graph

779 Commits

Author SHA1 Message Date
Mattias Wadman
bf7a483f87 interp: Fix handling of group decode error from stdin
null input to open means stdin but it as also erroneously also used as object key
to store the error.
2022-01-23 12:41:31 +01:00
Mattias Wadman
6c519ea890
Merge pull request #94 from wader/zip-assert-not-validate
zip: Assert signature not validate
2022-01-22 16:31:58 +01:00
Mattias Wadman
778a1a4178 zip: Assert signature not validate 2022-01-22 16:26:03 +01:00
Mattias Wadman
b700194ac7
Merge pull request #93 from wader/id3v2-assert-magic
id3v2: Should assert not validate magic
2022-01-22 16:22:21 +01:00
Mattias Wadman
85371173b5 id3v2: Should assert not validate magic
Fixes issue with mp3 frame that happens to have a 2,3 or 4 at byte 3 being seen as id3v2 header
2022-01-22 16:16:29 +01:00
Mattias Wadman
49c90f89b2 doc: Add macOS security notes and move supported format up a bit 2022-01-22 11:49:31 +01:00
Mattias Wadman
47c978e424 goreleaser: Use zip for macos 2022-01-21 16:30:35 +01:00
Mattias Wadman
04dd153c2f goreleaser: Fix yml and description 2022-01-21 15:19:55 +01:00
Mattias Wadman
8b30504bb8 goreleaser: Skip homebrew upload for -rc 2022-01-21 14:10:16 +01:00
Mattias Wadman
aa7adb681d fq: Update version to 0.0.4 2022-01-21 13:54:07 +01:00
Mattias Wadman
8d10423d06 make: Fix quote issue in release script 2022-01-21 12:16:34 +01:00
Mattias Wadman
34a09c40a7
Merge pull request #90 from wader/decode-stable-sort
decode: Use stable sort for values to not change order or values with…
2022-01-20 16:34:47 +01:00
Mattias Wadman
3201314415
Merge pull request #91 from wader/decode-array-root-buf
decode: Add FieldArrayRootBitBufFn for completeness
2022-01-20 16:33:09 +01:00
Mattias Wadman
9198e18c10 decode: Add FieldArrayRootBitBufFn for completeness
Should rethink these, not very nice api
2022-01-20 16:27:52 +01:00
Mattias Wadman
cd025f80df
Merge pull request #89 from wader/fuzz-skip-other-tests
fuzz: Skip other tests when fuzzing
2022-01-20 16:22:21 +01:00
Mattias Wadman
cf8a50c150 decode: Use stable sort for values to not change order or values with same range start
Some decoders might relay on values added with same start to be kept in same order.
2022-01-20 16:21:50 +01:00
Mattias Wadman
7461264e40 fuzz: Skip other tests when fuzzing 2022-01-20 16:13:02 +01:00
Xentripetal
6fc1efd902 Add test case with all data types 2022-01-19 23:53:33 -06:00
Xentripetal
ee184075b7 Parse header using avro decoders. Still not certain this is the best idea. Will get opinions before finalizing. 2022-01-19 21:00:44 -06:00
Xentripetal
16849c8f35 Update linting 2022-01-19 19:44:42 -06:00
Xentripetal
6e1f338ac3 Pull latest from wader 2022-01-19 19:39:12 -06:00
Xentripetal
de64a99e72 cleanup some docs, change enum to mapper, error zigzag on more than 8 bytes 2022-01-19 19:35:50 -06:00
Xentripetal
06085a26f6 Undo change to doc/file.mp4. I have no idea how this got changed in the first place? Maybe some macos shenanigans. 2022-01-19 19:07:08 -06:00
Mattias Wadman
2173d9e1f9
Merge pull request #88 from wader/fq-version-in-source
fq: Embed version in source
2022-01-19 21:38:22 +01:00
Mattias Wadman
78c0775e63 fq: Embed version in source
Related to #68
2022-01-19 20:45:08 +01:00
Mattias Wadman
059e287227 todo: Cleanup add some known issues and deoder ideas 2022-01-18 17:52:51 +01:00
Mattias Wadman
ae167bbfb4
Merge pull request #87 from wader/tar-allow-more-than-2-zero-block-at-end
tar: Allow more than 2 zero end blocks at end
2022-01-18 13:01:08 +01:00
Mattias Wadman
ba1edef793 tar: Allow more than 2 zero end blocks at end 2022-01-18 12:54:50 +01:00
Mattias Wadman
39d4d846d7
Merge pull request #86 from wader/tar-dont-assume-endmarker
tar: Don't assume there is a end marker
2022-01-18 12:20:59 +01:00
Mattias Wadman
6181128c65
Merge pull request #85 from wader/decode-error-number-neg-nbits
decode: Error on negative number of bits when reading numbers
2022-01-18 12:14:36 +01:00
Mattias Wadman
5921d76bf0 tar: Don't assume there is a end marker
GNU tar docs says:
At the end of the archive file there are two 512-byte blocks filled with binary zeros as an
end-of-file marker. A reasonable system should write such end-of-file marker at the end of
an archive, but must not assume that such a block exists when reading an archive.
In particular GNU tar always issues a warning if it does not encounter it.

Also clean up API usage a bit
2022-01-18 12:12:34 +01:00
Mattias Wadman
51f958278e
Merge pull request #84 from wader/flac-dont-allow-zero-samplesize
flac: Don't allow zero subframe sample size
2022-01-18 12:03:54 +01:00
Mattias Wadman
ff5c0b8195 decode: Error on negative number of bits when reading numbers
Maybe should even give error on zero bits? maybe only allow for zero bit for unsigned ints?
2022-01-18 12:01:04 +01:00
Mattias Wadman
263f1aeb66 flac: Don't allow zero subframe sample size
Spec says sample size can be 4-32 but that is probably before correcting for waste bits
2022-01-18 11:58:57 +01:00
Mattias Wadman
b1b42b46b0
Merge pull request #83 from wader/readline-update
readline: Update to verison with less deps
2022-01-18 00:45:14 +01:00
Mattias Wadman
36d28913ae readline: Update to verison with less deps
Should make it easier to package for debian etc
2022-01-18 00:40:12 +01:00
Mattias Wadman
4a25f9d120
Merge pull request #82 from wader/mp4-improved-sample-decode
mp4: Refactor sample decode into something more sane
2022-01-17 21:50:00 +01:00
Mattias Wadman
61bf2ce644 mp4: Refactor sample decode into something more sane
Also fatal error instead of silent ignore if index goes outside stsc or stco tables.
2022-01-17 13:38:11 +01:00
Mattias Wadman
7d08a75cd3
Merge pull request #81 from wader/decode-nil
decode,interp: Finish up nil value support
2022-01-17 10:59:49 +01:00
Mattias Wadman
548a065388 decode,interp: Finish up nil value support
Update msgpack, bson and cbor to use it.
2022-01-17 10:49:46 +01:00
Mattias Wadman
cc79735817
Merge pull request #80 from wader/doc-formats-graph
doc: Improve formats graph a bit
2022-01-16 21:17:50 +01:00
Mattias Wadman
6ca4767e24 doc: Improve formats graph a bit
Force all dep edges to go from east to north
2022-01-16 20:12:40 +01:00
Mattias Wadman
8e9700d0bd doc: Improve readme a bit and add torepr example 2022-01-15 19:26:58 +01:00
Mattias Wadman
63160bf52e
Merge pull request #79 from wader/bigint
Add arbitrary large integer support (BigInt)
2022-01-15 19:08:50 +01:00
Mattias Wadman
edad481878 num,mathextra: Rename num package to mathextra
Think it makes more sense
2022-01-15 19:00:42 +01:00
Mattias Wadman
1383b411ae decode,interp: Add arbitrary large integer support (BigInt)
Was already handled in fq in various places as gojq uses them

Update msgpack to support negative integers that can't represented as int64
Rename read try* number functions to make them more explicit
2022-01-15 19:00:42 +01:00
Mattias Wadman
3411f8900c
Merge pull request #78 from wader/mp4-improved-stsz
mp4: Improved stsz handling
2022-01-15 17:55:09 +01:00
Mattias Wadman
4a1e8590fa mp4: Improved stsz handling
Track size/count instead of just sizes which should decrease memory usage
making count sanity check unnecessary.

Fixes issue with huge mp4 files (80gb+) with lots of samples.
2022-01-15 17:51:10 +01:00
Xentripetal
251053ef3c Initial pass on logical types 2022-01-13 23:32:19 -06:00
Xentripetal
788fd0258f Pull latest from wader 2022-01-13 20:59:56 -06:00