David McDonald
4aad2fdeea
doc: remake
2022-12-05 22:03:26 -06:00
David McDonald
34c560c2f5
Merge branch 'master' of https://github.com/wader/fq into macos_bookmark
2022-12-05 22:01:44 -06:00
Mattias Wadman
2fc16ae22a
doc: Add some padding margin to formats table to make it less likely to cause git conflicts
2022-12-05 12:25:00 +01:00
Mattias Wadman
2c4862c9fb
Merge pull request #498 from bitbears-dev/master
...
support tzif (time zone information format)
2022-12-04 13:21:19 +01:00
@0xb17bea125
c4e7fc7919
tzif: moved document to tzif.md
2022-12-04 21:04:13 +09:00
@0xb17bea125
2ee6360b97
support tzif (time zone information format)
2022-12-04 21:02:39 +09:00
Mattias Wadman
42debe5871
dev,doc,make: Cleanup makefile and have proper targets for *.md and *.svg
...
Update format dev docs to only generate README.md and doc/foramts.md to not
cause formats.svg conflicts.
2022-12-04 12:37:10 +01:00
David McDonald
b872b1a337
doc: remake
2022-12-03 17:36:56 -06:00
Mattias Wadman
6fc84a885c
doc,dev: Add more usage and dev tips
2022-12-03 19:00:47 +01:00
David McDonald
f5e25fca26
updated docs
2022-12-01 23:31:57 -06:00
David McDonald
44c91d8296
tweaks apple_bookmark markdown documentation
2022-12-01 23:31:57 -06:00
David McDonald
4a28e44f44
changes decoder package name from bookmark to apple_bookmark
2022-12-01 23:31:57 -06:00
David McDonald
0a72635a78
remade documentation
2022-12-01 23:31:57 -06:00
David McDonald
34db9d7fea
regenerated docs, added tests, fixed torepr
2022-12-01 23:31:57 -06:00
Mattias Wadman
e77f776999
decode,interp: Rename unknown gap fields from "unknown#" to "gap#"
...
Think it makes it clearer and also less likely to collide with a field
name a deocder wants to use.
2022-12-01 20:43:30 +01:00
Mattias Wadman
8d69f1fb23
interp: Change default bits_format=string
...
I think this is more intuitive but might in some case cause very large JSON output
but maybe that less common or expected. In does cases i think you either want to
use some other bits_format (md5, truncate, etc) or you delete/transform the jq value
before turn it into JSON.
Strings in gojq are binary safe so you can use to hold raw bytes. But note that
convert the binary into JSON is lossy, same as the JSON standard.
Add bits_format option documentation.
2022-12-01 17:49:34 +01:00
Mattias Wadman
ef2d5232ba
mp4: Add png mapping
...
Also support samples decode for tracks without hdlr box
2022-11-25 19:49:18 +01:00
Mattias Wadman
c93301fc70
raw,bits,bytes: Replace raw format with bits and bytes format that decode to a binary
...
raw format was a hack to skip decoding to be able to get a binary using tobyte etc.
Now you can do fq -d bytes ... instead of fq -d raw 'tobytes | ...'
2022-11-20 19:51:12 +01:00
Mattias Wadman
0cf46e1196
wav,avi,avc_au: Add avi decoder and refactor wav decoder
...
avi and wav now share common riff decode code
avc_au decoder can now handle annexb format
2022-11-19 13:11:27 +01:00
Mattias Wadman
7b6492eed0
Improve README.md a bit, one more demo and move up usage
2022-11-17 11:10:08 +01:00
Mattias Wadman
c3a0686c9e
mp3_frame_tags: Refactor and rename xing format to mp3_frame_tags
...
Make more sense to use a more general name when there is both info and xing
and possibly vbri in the future. Also both xing and info seems to have extension
fields
Remove some old tests that are not really needed anymore.
2022-11-16 17:32:03 +01:00
Mattias Wadman
4bfd9d8119
doc: Add link to nttw6 presentation video and slides
...
Also clarify install instructions a bit
2022-10-30 13:28:46 +01:00
Mattias Wadman
2a86d323b4
doc,rtmp,pcap,markdown: Add more examples
2022-10-09 19:18:14 +02:00
Mattias Wadman
09ea08f3aa
Merge pull request #427 from dgmcdona/bplist
...
Adds support for Apple Binary Plist, version 00
2022-10-04 14:25:53 +02:00
Mattias Wadman
0fdc03a4f1
doc: Fix some incorrect example prompts
2022-09-27 13:42:31 +02:00
Mattias Wadman
00ee10a1a1
interp: Make to{actual,sym} behave similar to tovalue
...
Before if you did toactual it behaved differently and even gave error for
a scalar that only had actual value set. Now both to{actal,sym} works
similar to tovalue but will force if actual or sym value should be used.
2022-09-25 17:53:12 +02:00
David McDonald
bcccde2358
Fixes and embeds documentation
2022-09-24 12:57:11 -05:00
David McDonald
5f61994087
adds function for decoding fixed sized arrays
2022-09-23 20:50:41 -05:00
David McDonald
a77cec921f
Added documentation and tests, fixed bad date parsing
2022-09-23 20:23:23 -05:00
Mattias Wadman
a7a101ca67
doc,help: Nicer format help and move help tests into each format
...
Also add authors to avro and macho decoders
Generated with:
for i in $(go run . -r -n '_registry | [([([.files[][].name | split(".")[0]] | unique[]), (.formats[].name)] | count[] | select(.[1] == 2)[0]), (.formats[] | select(.decode_in_arg).name)] | unique[]'); do DIR=$(dirname $(find format -name $i.go)); echo "$ fq -h $i" > "$DIR/testdata/help_$i.fqtest" ; done
2022-09-22 23:07:58 +02:00
Mattias Wadman
725ab1b17b
doc,html,xml: Add more documentation and examples
2022-09-20 17:35:27 +02:00
Mattias Wadman
fe64530e11
csv: Add tsv and header example
...
Also fix string esacpe in fuzz options parser
2022-09-15 01:16:45 +02:00
Mattias Wadman
1385b5d0ba
wasm: Add some documentation
2022-09-12 11:53:48 +02:00
Mattias Wadman
abd19ed89b
doc: Fix format sections a bit
2022-09-11 09:55:56 +02:00
Mattias Wadman
87b2c6c10c
help,doc: Use markdown for format documentation again
...
Markdown is used as is in online documentation and in cli the markdown decoder
is used to decode and the some jq code massages it into something cli friendly.
Was just too much of a mess to have doc in jq.
2022-09-11 00:53:29 +02:00
Mattias Wadman
095e1161b7
xml: Switch from "-" to "@" as attribute prefix and make it an option
...
Seems to be more common.
2022-08-25 17:15:23 +02:00
Mattias Wadman
8fc43533a9
prores_frame: Add basic container and frame header decoder
2022-08-24 19:33:35 +02:00
bitbears-dev
89cb0d8e91
Merge branch 'wader:master' into wasm-support
2022-08-22 21:01:19 +09:00
@0xb17bea125
ce43887298
wasm: make doc
2022-08-20 14:58:05 +09:00
Mattias Wadman
394717cae8
gopacket: Switch/update to new fork, remove SLL2 hack
...
SLL2 support merged upstream https://github.com/gopacket/gopacket/pull/1
This also cuts down a bit on some indirect deps
2022-08-20 01:25:03 +02:00
Mattias Wadman
701c67c136
jsonl: Add decoder, also tojsonl encoder
2022-08-15 19:43:59 +02:00
Mattias Wadman
46dca8cdc5
dns: Don't use dns (udp) format for tcp also
...
Fixes issue with TCP streams being probed as dns over TCP
2022-08-09 18:15:34 +02:00
Mattias Wadman
f4e0137244
xml,html: Always include attrs and children in array mode
...
Was hard to use when you dont know what indexes things will have. They are sill optioal for toxml
2022-08-04 11:44:59 +02:00
Mattias Wadman
725c8e83ab
macho: Split into macho/macho_fat, fix offset issue and add string decoding
...
Split fat macho into own decoder macho_fat. This also fixes issue with section
offset etc not being correct as they are from the start of each embedded file.
Make all address and offset field be in hex.
Decode __cstring, __ustring and __cfstring sections.
Fix LC_ENCRYPTION_INFO_64 missing pading issue.
Skip ranging for __bss and __common as they dont have any data in the file.
Simplifed magic handling a bit and add symbols.
Simplified state struct field, had redudant struct.
2022-08-02 14:36:53 +02:00
Mattias Wadman
ed4247836c
doc,interp: Update and add more examples
2022-07-30 20:21:35 +02:00
Mattias Wadman
f247edb592
doc: Update README demo a bit with new features
2022-07-29 16:34:27 +02:00
Mattias Wadman
10cc551871
doc: Improve and cleanup text formats
...
Hopefully will get time to revamp how docs work
2022-07-24 11:55:50 +02:00
Mattias Wadman
cae288e6be
format,intepr: Refactor json, yaml, etc into formats also move out related functions
...
json, yaml, toml, xml, html, csv are now normal formats and most of them also particiate
in probing (not html and csv).
Also fixes a bunch of bugs in to/fromxml, to/fromjq etc.
2022-07-23 21:48:45 +02:00
Mattias Wadman
7aff654a43
doc: Clarify decode, slurp and spew args
2022-07-21 20:56:19 +02:00
Mattias Wadman
342612eb7e
dev: Cleanup linters and fix some unused args
2022-07-19 18:33:50 +02:00
