1
1
mirror of https://github.com/wader/fq.git synced 2024-08-16 15:30:36 +03:00
Commit Graph

1997 Commits

Author SHA1 Message Date
Mattias Wadman
9c1c3c3fce pdf: Add decoder 2023-05-17 18:38:47 +02:00
Mattias Wadman
a7d54ff190
Merge pull request #677 from wader/binary-bits-format
interp: Make binary also respect bits_format
2023-05-17 18:12:40 +02:00
Mattias Wadman
b2c0e5fcd8 interp: Make binary also respect bits_format 2023-05-17 15:10:32 +02:00
Mattias Wadman
fa5a89c79f
Merge pull request #676 from wader/mp4-udta-len-lang-probe-empty-value
mp4: udta: Improve length/lang box probe and support empty value
2023-05-17 12:06:25 +02:00
Mattias Wadman
1da8069190 mp4: udta: Improve length/lang box probe and support empty value 2023-05-17 11:55:13 +02:00
Mattias Wadman
4335c30075
Merge pull request #675 from wader/release-0.6.0
fq: Release 0.6.0
2023-05-16 16:00:47 +02:00
Mattias Wadman
2388ccdbb8 fq: Release 0.6.0 2023-05-16 14:25:55 +02:00
Mattias Wadman
66e11ea9e9
Merge pull request #674 from wader/mp4-correct-quicktime-epoch
mp4: Use correct epoch for quicktime timestamps
2023-05-16 13:30:03 +02:00
Mattias Wadman
493848a7e5 mp4: Use correct epoch for quicktime timestamps
Somehow was 1904-01-04 should be 1904-01-01
2023-05-16 13:10:56 +02:00
Mattias Wadman
aec2635ea6
Merge pull request #672 from Rogach/pr/fix-tohex
fix to_hex function handling of non-ascii characters
2023-05-16 11:02:03 +02:00
Platon Pronko
b0e4da28de fix non-ascii characters handling in to_hex and to_base64 functions
to_hex and to_base64 functions were expecting `string` as an input type,
which caused the value to be CastFn'ed to string,
which in turn resulted in raw bytes being cast to []rune (in makeDecodeValueOut).
This operation replaces invalid UTF-8 bytes with 0xFFFD, which then were
passed on to the hex/base64 encoders, resulting in incorrect output.

This patch fixes it by expecting `any` as an input type,
which allows the function to correctly read raw bytes of the input data.
2023-05-16 09:44:35 +08:00
Mattias Wadman
93423d0da6
Merge pull request #673 from wader/bit-format-hex
interp: Add hex bits format
2023-05-15 17:49:15 +02:00
Mattias Wadman
8a468f45df interp: Add hex bits format
$ cat random.bin.gz | fq -rV -o bits_format=hex .uncompressed
f6f2074cf77d449d

Also made unknown bit formats an error.
2023-05-15 17:31:38 +02:00
Mattias Wadman
aa6723603e
Merge pull request #671 from Rogach/pr/bitcoin-tx-witness-items
bitcoin: fix witness item structs
2023-05-15 15:17:47 +02:00
Platon Pronko
a3361e70ba bitcoin: fix witness item structs
This commit fixes witness item decoding such that they are represented
as structs with `item_size` and `item` fields, instead of a flat list
of raw bytes.
2023-05-15 18:36:26 +08:00
Mattias Wadman
7eaddb8be5
Merge pull request #670 from kianmeng/fix-typos
doc: fix typos
2023-05-14 16:15:50 +02:00
Kian-Meng Ang
dd4fa26867 doc: fix typos
Found via `codespell -S format -L bu,ue,trys,nd,tbe,te,trun,actuall`
2023-05-14 21:45:15 +08:00
Mattias Wadman
070d5f43ab
Merge pull request #668 from wader/trim-multiline
interp: trim: Add multi-line support
2023-05-12 00:35:04 +02:00
Mattias Wadman
d5ae11659f interp: trim: Add multi-line support 2023-05-12 00:22:04 +02:00
Mattias Wadman
91db201447
Merge pull request #667 from wader/html-probe
html: Add to probe group
2023-05-11 19:20:17 +02:00
Mattias Wadman
e2eb667091 html: Add to probe group
As decoder now can know they are decoding as part of probing we can now
use some heuristics to see if we should decode as html.
The reason heuristics is needed is that x/html parser will alwaus succeed.

Add lazyre package to help delay compile of RE and make it concurrency safe.
2023-05-11 19:07:18 +02:00
Mattias Wadman
f254b16cfc
Merge pull request #666 from wader/bits-bytes-binary
bits,bytes: Behave as binary instead of raw decode value
2023-05-11 18:54:21 +02:00
Mattias Wadman
222cd88b77 bits,bytes: Behave as binary instead of raw decode value
I think this is closer to what one would expect.
With this fq -d bytes 'scan("...")' will match as a binary and also return binaries,
before as raw decode value one would have to use tobytes to get the binary.
2023-05-11 18:45:16 +02:00
Mattias Wadman
dc91e5e899
Merge pull request #665 from wader/interp-explicit-display-no-binary
interp: Don't output raw binary if display is called explicitly
2023-05-11 14:30:04 +02:00
Mattias Wadman
033498b289 interp: Don't output raw binary if display is called explicitly
So raw binay is only outputted if stdout is not a terminal and "... | d" is not used..
fq -n '[1,2,3] | tobytes' | cat > binary
fq -n '[1,2,3] | tobytes | d' | cat > hexdump
2023-05-11 14:15:00 +02:00
Mattias Wadman
1cbc2535c8
Merge pull request #664 from wader/bump-gomod-golang-x-net-0.10.0
Update gomod-golang-x-net to 0.10.0 from 0.9.0
2023-05-09 18:16:33 +02:00
Mattias Wadman
5c7779ba1f
Merge pull request #663 from wader/bump-gomod-golang-x-crypto-0.9.0
Update gomod-golang-x-crypto to 0.9.0 from 0.8.0
2023-05-09 18:16:09 +02:00
bump
ed0cd6d292 Update gomod-golang-x-net to 0.10.0 from 0.9.0
Tags https://github.com/golang/net/tags
2023-05-09 16:04:02 +00:00
bump
c405afd4d4 Update gomod-golang-x-crypto to 0.9.0 from 0.8.0
Tags https://github.com/golang/crypto/tags
2023-05-09 16:03:59 +00:00
Mattias Wadman
37708583fd
Merge pull request #662 from wader/ansisvg-regenerate
doc: Hopefully fix svg fixed font issue
2023-05-09 16:23:36 +02:00
Mattias Wadman
88be3a7f9f doc: Hopefully fix svg fixed font issue
Regenerate with new ansisvg that uses Courier with monospace as fallback

Related to #655
2023-05-08 15:27:00 +02:00
Mattias Wadman
be0bbfbc37
Merge pull request #661 from wader/markdown-nicer-to-text
help,markdown: Rewrote and made text rendering nicer
2023-05-08 09:48:59 +02:00
Mattias Wadman
2c505feec8 help,markdown: Rewrote and made text rendering nicer
Plan is to use it for man page etc and also some ansi renderer
2023-05-08 00:07:56 +02:00
Mattias Wadman
a200d3eee0
Merge pull request #415 from pnsafonov/postgres
Postgres
2023-05-06 09:07:13 +02:00
Pavel Safonov
e6a9cdbecf postgres: doc 2023-05-06 08:54:56 +03:00
Pavel Safonov
c9350de352 postgres: use bit stream instead of masks to get flags 2023-05-06 08:42:16 +03:00
Pavel Safonov
e839191679 postgres: btree refactored by Mattias Wadman 2023-05-05 11:28:38 +03:00
Pavel Safonov
c23bc4216f postgres: fix line endings in error messages, simplify code, add comments 2023-05-04 09:16:55 +03:00
Pavel Safonov
08c535239b postgres: refactoring 2023-05-04 08:45:42 +03:00
Pavel Safonov
7a89234b13 postgres: update doc 2023-05-04 08:34:32 +03:00
Mattias Wadman
1cbfebb56d
Merge pull request #660 from wader/bump-github-go-version-1.20.4
Update github-go-version to 1.20.4 from 1.20.3
2023-05-03 18:50:10 +02:00
Mattias Wadman
70d07d5572
Merge pull request #659 from wader/bump-docker-golang-1.20.4
Update docker-golang to 1.20.4 from 1.20.3
2023-05-03 18:49:58 +02:00
bump
2a5927b5db Update github-go-version to 1.20.4 from 1.20.3 2023-05-03 16:04:01 +00:00
bump
c9d3b8fb49 Update docker-golang to 1.20.4 from 1.20.3 2023-05-03 16:03:56 +00:00
Pavel Safonov
f6f8d5c037 postgres: refactoring 2023-05-03 15:40:32 +03:00
Pavel Safonov
9508a209ea postgres: fix lint 2023-05-03 15:28:29 +03:00
Mattias Wadman
4f9c43ffa1
Merge pull request #658 from wader/decode-group-arg
interp,decode: Support decode group argument
2023-05-03 10:20:40 +02:00
Mattias Wadman
684a083813 interp,decode: Support decode group argument
Will be used for probing via -d <string> and filename
2023-05-03 10:01:13 +02:00
Pavel Safonov
e5f15c5fed postgres: fix compilation, fix tests 2023-05-03 10:10:03 +03:00
Pavel Safonov
bb2659d442 Merge remote-tracking branch 'master' into postgres_merge_master_0 2023-05-03 09:44:02 +03:00