1
1
mirror of https://github.com/wader/fq.git synced 2024-11-26 21:55:57 +03:00
Commit Graph

924 Commits

Author SHA1 Message Date
Mattias Wadman
f4480c6fe5 decode,interp: Support for format specific options
interp: Refactor format help and also include options
interp: Add -o name=@path to load file content as value (not documented yet, might change)
interp,decode: Expose decode out value as _out (might change)
interp: Refactor foramts.jq into format_{decode,func,include}.jq
interp: Refactor torepr into _format_func for generic format function overloading
interp: Refactor -o options parsing to be more generic and collect unknowns options to be used as format options
decode of decode alises
func for format overloaded functions
include for format specific jq functions (also _help, torepr etc)
flac_frame: Add bits_per_sample option
mp3: Add max_unique_header_config and max_sync_seek options
mp4: Add decode_samples and allow_truncate options
avc_au: Has length_size option
hevc_au: Has length_size option
aac_frame: Has object_typee option
doc: Rewrite format doc generation, less hack more jq
2022-05-01 17:08:30 +02:00
Mattias Wadman
411c970093
Merge pull request #238 from wader/macho-sections-data
macho: Add section and encryption_info raw data fields
2022-04-25 20:33:39 +02:00
Mattias Wadman
d6c31dac2b macho: Add section and encryption_info raw data fields 2022-04-25 20:26:35 +02:00
Mattias Wadman
43d78340d6
Merge pull request #237 from wader/bump-gomod-mapstructure-1.5.0
Update gomod-mapstructure from 1.4.3 to 1.5.0
2022-04-21 18:21:43 +02:00
bump
d9195ac48a Update gomod-mapstructure from 1.4.3 to 1.5.0
CHANGELOG https://github.com/mitchellh/mapstructure/blob/master/CHANGELOG.md
2022-04-21 16:08:54 +00:00
Mattias Wadman
20193d046f
Merge pull request #236 from wader/dump-array-in-array-name-cleanup
interp: dump: Show field name for compound values in arrays
2022-04-21 17:55:41 +02:00
Mattias Wadman
21ad628add interp: dump: Show field name for compound values in arrays
mp3: Remove one level of struct for granales
dump: Makes it a bit easier to understand array of arrays/structs.
avro_ocf: Rename ocf.go -> avro_ocr.go to have same name of source file as format
pcap,pcapng: Rename tcp flow struct to tcp_connection, makes more sense i think
mp4: Add ISOBMFF to format description
2022-04-21 17:47:15 +02:00
Mattias Wadman
8dc2fdea34
Merge pull request #235 from wader/gojq-rebase
gojq: Rebase fq fork. Fixes JQValue path tracking when iterating
2022-04-19 19:06:57 +02:00
Mattias Wadman
afd724bf9c gojq: Rebase fq fork. Fixes JQValue path tracking when iterating
Add some decode value path and assign tests
2022-04-19 19:00:37 +02:00
Mattias Wadman
6b4dbbf415
Merge pull request #234 from wader/field-truncate2
interp: Don't truncate last display column
2022-04-19 18:30:17 +02:00
Mattias Wadman
8f1b2bceca
Merge pull request #233 from wader/interp-decode-tobinary-simplier
interp: Simpler and more efficient hexdump
2022-04-19 18:21:39 +02:00
Mattias Wadman
607202bb67 interp: Don't truncate last display column
Wrapping lines might be annoying but not seeing things even worse i think.
Hopefully once column config is in jq it could be an option.
2022-04-19 18:19:42 +02:00
Mattias Wadman
087d12419e interp: Simpler and more efficient hexdump
Should not need to copy bits, just use existing bitreader
2022-04-19 18:12:58 +02:00
Mattias Wadman
16dc8b417a
Merge pull request #232 from wader/gojq-rebase2
gojq: Rebase fq fork
2022-04-17 19:54:12 +02:00
Mattias Wadman
02a97fa39a gojq: Rebase fq fork
debug code conflict and removed some unused code
2022-04-17 19:45:58 +02:00
Mattias Wadman
9d2f176ba4
Merge pull request #231 from wader/field-truncate2
interp: Proper display column truncate
2022-04-16 18:56:54 +02:00
Mattias Wadman
dabad85080 interp: Proper display column truncate
Also speed up by using less string allocs
2022-04-16 18:48:21 +02:00
Mattias Wadman
7bdb3d815a
Merge pull request #230 from wader/bump-github-go-version-1.18.1
Update github-go-version from 1.18.0, 1.18.0, 1.18.0 to 1.18.1
2022-04-16 18:41:51 +02:00
bump
fdfc5c5b75 Update github-go-version from 1.18.0, 1.18.0, 1.18.0 to 1.18.1 2022-04-16 16:04:07 +00:00
Mattias Wadman
c4acbd51d3
Merge pull request #229 from wader/bump-docker-golang-1.18.1
Update docker-golang from 1.18.0 to 1.18.1
2022-04-13 18:17:49 +02:00
bump
05096f501b Update docker-golang from 1.18.0 to 1.18.1 2022-04-13 16:08:57 +00:00
Mattias Wadman
c79db1e925
Merge pull request #227 from wader/decode-format-try-or-raw
decode,format: Add d.FieldFormatOrRaw(Len)
2022-04-11 23:20:47 +02:00
Mattias Wadman
b35b1804be decode,format: Add d.FieldFormatOrRaw(Len) 2022-04-11 23:01:45 +02:00
Mattias Wadman
9a053f0a3d
Merge pull request #226 from wader/macho-cleanup
macho: Cleanup syms and remove redundant fat_arch struct
2022-04-11 22:17:46 +02:00
Mattias Wadman
5424eed703 macho: Cleanup syms and remove redundant fat_arch struct 2022-04-11 22:09:51 +02:00
Mattias Wadman
960cd00026
Merge pull request #225 from wader/mpeg-pes-mpeg1-cleanup
mpeg_pes: Support mpeg1 and some cleanup
2022-04-11 21:53:12 +02:00
Mattias Wadman
39ba5c4da6 mpeg_pes: Support mpeg1 and some cleanup 2022-04-11 21:48:34 +02:00
Mattias Wadman
74279159f4
Merge pull request #224 from wader/gojq-fq3
gojq: Rebase fq fork
2022-04-11 19:31:24 +02:00
Mattias Wadman
518f6af4a8 gojq: Rebase fq fork
Upstream changes:
Many performance improvements
Error message improvments
Lots of refactoring

Most of the JQValue interface changes in gojq fork had to be reworked but
resultet in a much nicer and cleaner changeset.

fq changes:
Assignment to JQValue (like a decode value) now shallowly converts the value into
a jq value before assigning. Was a bit hacky as it was and this makes JQValue
behave more like real jq values. This also fixes some advanced indexing issues.

Actual custom path updates will be something for the future.
2022-04-11 19:23:15 +02:00
Mattias Wadman
963a7af0d0
Merge pull request #222 from wader/display-path-root-array-incorrect
interp: Paths with a array as root was missing start dot
2022-04-08 19:03:10 +02:00
Mattias Wadman
bfe60c0303
Merge pull request #223 from wader/tcp-has-start-end
tcp,udp: Refactor and make port matching better
2022-04-08 19:02:49 +02:00
Mattias Wadman
5d25bbc2e1 tcp,udp: Refactor and make port matching better
rtmp: check port based on tcp direction
dns,rtmp: refactor to use tcp and udp port match helpers
flow: add has start/end to tcp to know if stream has missing bytes
2022-04-08 17:44:39 +02:00
Mattias Wadman
6f03471d15 interp: Paths with a array as root was missing start dot 2022-04-08 16:47:40 +02:00
Mattias Wadman
a763840833
Merge pull request #221 from wader/heif-more-boxes-add-scalar-desc-mapper
mp4: Add more HEIF boxes
2022-04-07 19:19:24 +02:00
Mattias Wadman
f8fd6b7f48 mp4: Add more HEIF boxes
Add scalar.*ToDesceription mapper and refactor to use it
2022-04-07 19:11:49 +02:00
Mattias Wadman
66252bd47c
Merge pull request #220 from wader/matroska-sym-cleanup
matroska: More sym cleanup
2022-04-06 20:01:10 +02:00
Mattias Wadman
f8d79a5777 matroska: More sym cleanup 2022-04-06 19:48:26 +02:00
Mattias Wadman
716083e087
Merge pull request #219 from wader/id3v20-pic
id3v2: Add 2.0 PIC support
2022-04-06 13:25:41 +02:00
Mattias Wadman
09385c612e id3v2: Add 2.0 PIC support 2022-04-06 13:21:28 +02:00
Mattias Wadman
dc9663d380
Merge pull request #218 from wader/sym-field-cleanup
formats: Sym and field name cleanup to be more jq friendly
2022-04-05 14:06:34 +02:00
Mattias Wadman
5ff67e4cfe formats: Sym and field name cleanup to be more jq friendly 2022-04-05 13:59:57 +02:00
Mattias Wadman
ee0f431af3
Merge pull request #217 from wader/amf0-strings
amf0: Decode strings in more detail
2022-04-05 11:06:38 +02:00
Mattias Wadman
34cbe48753 amf0: Decode strings in more detail 2022-04-05 11:01:59 +02:00
Mattias Wadman
788b0ac197 rtmp,amf0: Improve decoders, aac asc, chunk stream interrupt, fix amf0 ecma arrays
rtmp: Handle chunk streams that have been interrupted (capture terminated in middle of stream etc)
rtmp: Decode AAC ASC
rtmp: Add ffmpeg client/server stream test
rtmp: Decode user control messages
rtmo: Decode all data messages
amf0: Fix ecma array decoding
2022-04-04 14:42:16 +02:00
Mattias Wadman
78a7265f4c
Merge pull request #216 from wader/ipv6
ipv6,icmpv6: Add decoder
2022-04-03 17:49:02 +02:00
Mattias Wadman
e8dc7112b6 ipv6,icmpv6: Add decoder
Refactor to use groups between network layers to make them less coupled and reusable:
link_frame (ethernet etc)
inet_packet (ipv4,ipv6 etc)
ip_packet (tcp packet (not stream), udp segment etc)

Rename data to payload as i think it makes more sense for network data
2022-04-03 17:43:51 +02:00
Mattias Wadman
2a8104de90
Merge pull request #214 from wader/rtmp
rtmp,amf0: Add decoders
2022-04-01 13:20:19 +02:00
Mattias Wadman
d8aaf30345 rtmp,amf0: Add decoders
Basic RTMP support, used via tcp_stream group (pcap etc) or manually.
Basic AMF0 support, mostly what is used in RTMP.
2022-04-01 13:07:20 +02:00
Mattias Wadman
8f85b436d1
Merge pull request #213 from wader/bump-gojq
gojq: Rebase fq fork (speedup and fix range with JQValue)
2022-03-28 22:59:39 +02:00
Mattias Wadman
dd0d97eabc gojq: Rebase fq fork (speedup and fix range with JQValue)
Include upstream speedups to:
flatten
join
ltrimstr
rtrimstr
startswith
endswith
min_by
max_by
min
max
sort
2022-03-28 22:51:23 +02:00