wader/fq
1
1
Fork 0
mirror of https://github.com/wader/fq.git synced 2024-12-25 22:34:14 +03:00
Code Issues Projects Releases Wiki Activity
2c4862c9fb
fq/pkg/interp/testdata/decode.fqtest

112 lines
6.6 KiB
Plaintext
Raw Normal View History

fqtest: Cleanup path usage Make cwd for a test script the directory where the script is. Use relative paths
2022-05-21 20:33:52 +03:00
$ fq -i -d mp3 . test.mp3
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
mp3> decode
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: (mp3)
0x000|49 44 33 04 00 00 00 00 00 23 54 53 53 45 00 00|ID3......#TSSE..| headers[0:1]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
* |until 0x2c.7 (45) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
0x020| ff fb 40| ..@| frames[0:3]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
0x030|c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00|................|
* |until 0x283.7 (end) (599) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
| | | footers[0:0]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
mp3> decode("mp3")
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: (mp3)
0x000|49 44 33 04 00 00 00 00 00 23 54 53 53 45 00 00|ID3......#TSSE..| headers[0:1]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
* |until 0x2c.7 (45) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
0x020| ff fb 40| ..@| frames[0:3]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
0x030|c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00|................|
* |until 0x283.7 (end) (599) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
| | | footers[0:0]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
mp3> decode("mp3"; {})
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: (mp3)
0x000|49 44 33 04 00 00 00 00 00 23 54 53 53 45 00 00|ID3......#TSSE..| headers[0:1]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
* |until 0x2c.7 (45) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
0x020| ff fb 40| ..@| frames[0:3]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
0x030|c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00|................|
* |until 0x283.7 (end) (599) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
| | | footers[0:0]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
mp3> probe
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: (mp3)
0x000|49 44 33 04 00 00 00 00 00 23 54 53 53 45 00 00|ID3......#TSSE..| headers[0:1]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
* |until 0x2c.7 (45) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
0x020| ff fb 40| ..@| frames[0:3]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
0x030|c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00|................|
* |until 0x283.7 (end) (599) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
| | | footers[0:0]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
mp3> probe({})
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: (mp3)
0x000|49 44 33 04 00 00 00 00 00 23 54 53 53 45 00 00|ID3......#TSSE..| headers[0:1]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
* |until 0x2c.7 (45) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
0x020| ff fb 40| ..@| frames[0:3]:
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
0x030|c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00|................|
* |until 0x283.7 (end) (599) | |
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
| | | footers[0:0]:
interp: Implement format/0 in jq
2021-11-03 12:58:33 +03:00
mp3> format
"mp3"
mp3> null | format
null
gojq: Rebase fq fork. Fixes JQValue path tracking when iterating Add some decode value path and assign tests
2022-04-19 19:59:24 +03:00
mp3> path(.[])
[
"headers"
]
[
"frames"
]
[
"footers"
]
mp3> .[] = 1
{
"footers": 1,
"frames": 1,
"headers": 1
}
mp3> walk(tovalue) | .headers[0].magic
"ID3"
fq: Generate decode alises code
2021-09-04 13:54:26 +03:00
mp3> ^D
raw,bits,bytes: Replace raw format with bits and bytes format that decode to a binary raw format was a hack to skip decoding to be able to get a binary using tobyte etc. Now you can do fq -d bytes ... instead of fq -d raw 'tobytes | ...'
2022-11-20 21:22:16 +03:00
$ fq -d bytes 'png | d' test.mp3
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: (png)
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
| | | error: png: RawLen(signature): failed at position 8 (read size 0 seek pos 0): failed to validate raw
decode,interp: Rename unknown gap fields from "unknown#" to "gap#" Think it makes it clearer and also less likely to collide with a field name a deocder wants to use.
2022-12-01 22:37:40 +03:00
0x000|49 44 33 04 00 00 00 00 00 23 54 53 53 45 00 00|ID3......#TSSE..| gap0: raw bits
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
* |until 0x283.7 (end) (644) | |
raw,bits,bytes: Replace raw format with bits and bytes format that decode to a binary raw format was a hack to skip decoding to be able to get a binary using tobyte etc. Now you can do fq -d bytes ... instead of fq -d raw 'tobytes | ...'
2022-11-20 21:22:16 +03:00
$ fq -d bytes '.[0:1] | png | d' test.mp3
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: (png)
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
| | | error: png: RawLen(signature): failed at position 0 (read size 0 seek pos 0): outside buffer
decode,interp: Rename unknown gap fields from "unknown#" to "gap#" Think it makes it clearer and also less likely to collide with a field name a deocder wants to use.
2022-12-01 22:37:40 +03:00
0x0|49 |I | gap0: raw bits
fqtest: Cleanup path usage Make cwd for a test script the directory where the script is. Use relative paths
2022-05-21 20:33:52 +03:00
$ fq -o force=true -d png d test.mp3
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: test.mp3 (png)
interp: Support force decode as -o force=true
2022-02-05 19:16:10 +03:00
| | | error: png: BitBufRange: failed at position 0 (read size 2315363 seek pos 0): outside buffer
0x000|49 44 33 04 00 00 00 00 |ID3..... | signature: raw bits (invalid)
| | | chunks[0:1]:
interp: dump: Show field name for compound values in arrays mp3: Remove one level of struct for granales dump: Makes it a bit easier to understand array of arrays/structs. avro_ocf: Rename ocf.go -> avro_ocr.go to have same name of source file as format pcap,pcapng: Rename tcp flow struct to tcp_connection, makes more sense i think mp4: Add ISOBMFF to format description
2022-04-21 18:31:34 +03:00
| | | [0]{}: chunk
interp: Support force decode as -o force=true
2022-02-05 19:16:10 +03:00
0x000| 00 23 54 53 | .#TS | length: 2315347
0x000| 53 45 00 00| SE..| type: "SE\x00\x00"
0x000| 53 | S | ancillary: true
0x000| 45 | E | private: false
0x000| 00 | . | reserved: false
0x000| 00| .| safe_to_copy: false
decode,interp: Rename unknown gap fields from "unknown#" to "gap#" Think it makes it clearer and also less likely to collide with a field name a deocder wants to use.
2022-12-01 22:37:40 +03:00
0x010|00 0f 00 00 03 4c 61 76 66 35 38 2e 34 35 2e 31|.....Lavf58.45.1| gap0: raw bits
interp: Support force decode as -o force=true
2022-02-05 19:16:10 +03:00
* |until 0x283.7 (end) (628) | |
raw,bits,bytes: Replace raw format with bits and bytes format that decode to a binary raw format was a hack to skip decoding to be able to get a binary using tobyte etc. Now you can do fq -d bytes ... instead of fq -d raw 'tobytes | ...'
2022-11-20 21:22:16 +03:00
$ fq -d bytes '.[0:1] | try probe catch . | type' test.mp3
decode,interp: Add RecoverableErrorer interface instead of enumerate
2021-11-01 19:35:37 +03:00
"array"
raw,bits,bytes: Replace raw format with bits and bytes format that decode to a binary raw format was a hack to skip decoding to be able to get a binary using tobyte etc. Now you can do fq -d bytes ... instead of fq -d raw 'tobytes | ...'
2022-11-20 21:22:16 +03:00
$ fq -d bytes 'png({force: true}) | d' test.mp3
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: (png)
interp,decode: Add force option to ignore asserts
2021-11-16 15:03:45 +03:00
| | | error: png: BitBufRange: failed at position 0 (read size 2315363 seek pos 0): outside buffer
0x000|49 44 33 04 00 00 00 00 |ID3..... | signature: raw bits (invalid)
interp: dump: Indicate arrays using jq-syntax Related to #16
2021-12-08 18:20:37 +03:00
| | | chunks[0:1]:
interp: dump: Show field name for compound values in arrays mp3: Remove one level of struct for granales dump: Makes it a bit easier to understand array of arrays/structs. avro_ocf: Rename ocf.go -> avro_ocr.go to have same name of source file as format pcap,pcapng: Rename tcp flow struct to tcp_connection, makes more sense i think mp4: Add ISOBMFF to format description
2022-04-21 18:31:34 +03:00
| | | [0]{}: chunk
interp,decode: Add force option to ignore asserts
2021-11-16 15:03:45 +03:00
0x000| 00 23 54 53 | .#TS | length: 2315347
0x000| 53 45 00 00| SE..| type: "SE\x00\x00"
0x000| 53 | S | ancillary: true
0x000| 45 | E | private: false
0x000| 00 | . | reserved: false
0x000| 00| .| safe_to_copy: false
decode,interp: Rename unknown gap fields from "unknown#" to "gap#" Think it makes it clearer and also less likely to collide with a field name a deocder wants to use.
2022-12-01 22:37:40 +03:00
0x010|00 0f 00 00 03 4c 61 76 66 35 38 2e 34 35 2e 31|.....Lavf58.45.1| gap0: raw bits
interp,decode: Add force option to ignore asserts
2021-11-16 15:03:45 +03:00
* |until 0x283.7 (end) (628) | |
fqtest: Cleanup path usage Make cwd for a test script the directory where the script is. Use relative paths
2022-05-21 20:33:52 +03:00
$ fq -d bbb . test.mp3
interp: Better error if format/group is not found
2021-11-22 15:28:18 +03:00
exitcode: 4
stderr:
fqtest: Cleanup path usage Make cwd for a test script the directory where the script is. Use relative paths
2022-05-21 20:33:52 +03:00
error: test.mp3: bbb: format group not found
interp: Better error if format/group is not found
2021-11-22 15:28:18 +03:00
$ fq -n '"aaa" | decode("aaa")'
exitcode: 5
stderr:
error: format group not found
Reference in New Issue Copy Permalink