1
1
mirror of https://github.com/wader/fq.git synced 2024-10-04 15:38:17 +03:00
jq for binary formats
Go to file
2021-12-07 17:33:57 +01:00
.github/workflows Update github-go-version from 1.17.3, 1.17.3 to 1.17.4 2021-12-03 18:24:40 +01:00
.vscode vscode: Use tabsize 2 for jq files 2021-12-04 17:23:34 +01:00
dev snippet: Add mp4_matrix_structure_rotation 2021-11-19 15:59:41 +01:00
doc interp: match: Fix issue with regexp meta characters when matching using a buffer 2021-12-04 17:24:43 +01:00
format matroska,ebml: Use scalar and require sane tag size 2021-12-07 15:51:46 +01:00
internal interp,gojqextra: Make buffers values even more lazy and error early on non-scalar calls 2021-11-29 14:51:00 +01:00
pkg deocde: Cleanup some io panic(err) 2021-12-07 17:33:57 +01:00
.gitignore format: Add vorbis-comment-picture test, add .gitignore and cleanup 2021-11-21 19:32:52 +01:00
.golangci.yml lint: Enable errcheck adnd revive 2021-09-27 11:01:14 +02:00
.goreleaser.yml goreleaser: Cleanup 2021-10-05 12:27:24 +02:00
Bumpfile Update gomod-mapstructure from 1.4.2 to 1.4.3 2021-12-02 18:11:39 +01:00
Dockerfile docker: Fix broken build, copy fq.go 2021-12-06 19:05:04 +01:00
fq.go fq: Rename main.go to fq.go 2021-12-03 10:35:52 +01:00
go.mod Update gomod-mapstructure from 1.4.2 to 1.4.3 2021-12-02 18:11:39 +01:00
go.sum Update gomod-mapstructure from 1.4.2 to 1.4.3 2021-12-02 18:11:39 +01:00
LICENSE Add to/bytes/bits[range] 2021-10-17 14:43:37 +02:00
Makefile decode,interp: Make fuzzing work again and cleanup fatal/error code 2021-11-16 17:11:26 +01:00
README.md doc: Improve readme text a bit 2021-12-06 21:08:40 +01:00

fq

Tool, language and decoders for inspecting binary data.

fq demo

In most cases fq works the same way as jq but instead of reading JSON it reads binary data. The result is a JSON compatbile structures where each value has a bit range, symbolic interpretations and know how to be presented in a useful way.

NOTE: fq is early in development and many things are missing, broken or do not make sense. That also means there is a great opportunity to help out.

Goals

  • Make binary formats accessible and queryable.
  • Nested formats and bit-oriented decoding.
  • Quick and comfortable CLI tool.
  • Bit and byte transformations and conversions.
  • Programmer's calculator.

Usage

Basic usage is: fq . file.

For details see usage.md

Install

Download archive from releases page for your platform, unarchive it and move the executable to PATH etc.

Homebrew

# install latest release
brew install wader/tap/fq

Build from source

Make sure you have go 1.17 or later installed.

To install directly from git repository do:

# build and install latest release
go install github.com/wader/fq@latest

# or build and install latest master
go install github.com/wader/fq@master

# copy binary to $PATH if needed
cp "$(go env GOPATH)/bin/fq" /usr/local/bin

To build and run tests from source directory:

make test fq
# copy binary to $PATH if needed
cp fq /usr/local/bin

Supported formats

aac_frame, adts, adts_frame, apev2, av1_ccr, av1_frame, av1_obu, avc_annexb, avc_au, avc_dcr, avc_nalu, avc_pps, avc_sei, avc_sps, bzip2, dns, dns_tcp, elf, ether8023_frame, exif, flac, flac_frame, flac_metadatablock, flac_metadatablocks, flac_picture, flac_streaminfo, gif, gzip, hevc_annexb, hevc_au, hevc_dcr, hevc_nalu, icc_profile, icmp, id3v1, id3v11, id3v2, ipv4_packet, jpeg, json, matroska, mp3, mp3_frame, mp4, mpeg_asc, mpeg_es, mpeg_pes, mpeg_pes_packet, mpeg_spu, mpeg_ts, ogg, ogg_page, opus_packet, pcap, pcapng, png, protobuf, protobuf_widevine, pssh_playready, raw, sll2_packet, sll_packet, tar, tcp_segment, tiff, udp_datagram, vorbis_comment, vorbis_packet, vp8_frame, vp9_cfm, vp9_frame, vpx_ccr, wav, webp, xing, zip

For details see formats.md

TODO and ideas

See TODO.md

Development

See dev.md

This project would not have been possible without itchyny's jq implementation gojq. I also want to thank HexFiend for inspiration and ideas and stedolan for inventing the jq language.

Similar projects: