wader/fq
1
1
Fork 0
mirror of https://github.com/wader/fq.git synced 2024-12-24 13:52:02 +03:00
Code Issues Projects Releases Wiki Activity
7f7bf1e125
fq/format/all/all.fqtest

148 lines
5.2 KiB
Plaintext
Raw Normal View History

format,interp: Use MustGroup and add probe order test
2021-09-28 14:08:22 +03:00
$ fq -n _registry.groups.probe
[
"adts",
elf,ar: Add ar decoder, improved elf decoder Add x86, 386, arm64, arm v6, arm v7 linux elf test files
2021-12-06 21:33:17 +03:00
"ar",
wav,avi,avc_au: Add avi decoder and refactor wav decoder avi and wav now share common riff decode code avc_au decoder can now handle annexb format
2022-10-29 20:23:50 +03:00
"avi",
Hook into registry, add codecs
2021-12-28 22:05:10 +03:00
"avro_ocf",
bitcoin: Add blkdat, block, transcation and script decoder
2022-04-17 11:33:01 +03:00
"bitcoin_blkdat",
Added documentation and tests, fixed bad date parsing
2022-09-18 00:03:51 +03:00
"bplist",
format,interp: Use MustGroup and add probe order test
2021-09-28 14:08:22 +03:00
"bzip2",
"elf",
"flac",
"gif",
"gzip",
"jpeg",
macho: barebones decoder impl
2022-01-04 01:12:15 +03:00
"macho",
macho: Split into macho/macho_fat, fix offset issue and add string decoding Split fat macho into own decoder macho_fat. This also fixes issue with section offset etc not being correct as they are from the start of each embedded file. Make all address and offset field be in hex. Decode __cstring, __ustring and __cfstring sections. Fix LC_ENCRYPTION_INFO_64 missing pading issue. Skip ranging for __bss and __common as they dont have any data in the file. Simplifed magic handling a bit and add symbols. Simplified state struct field, had redudant struct.
2022-08-01 19:42:24 +03:00
"macho_fat",
format,interp: Use MustGroup and add probe order test
2021-09-28 14:08:22 +03:00
"matroska",
"mp4",
"ogg",
pcap: Add pcap, pcapng, ether8023, ipv4, udp, udp
2021-11-23 00:08:36 +03:00
"pcap",
"pcapng",
format,interp: Use MustGroup and add probe order test
2021-09-28 14:08:22 +03:00
"png",
"tar",
"tiff",
wasm: add wasm to probe list
2022-08-23 15:19:07 +03:00
"wasm",
format,interp: Use MustGroup and add probe order test
2021-09-28 14:08:22 +03:00
"webp",
zip: Add format decoder
2021-11-01 15:08:52 +03:00
"zip",
format,intepr: Refactor json, yaml, etc into formats also move out related functions json, yaml, toml, xml, html, csv are now normal formats and most of them also particiate in probing (not html and csv). Also fixes a bunch of bugs in to/fromxml, to/fromjq etc.
2022-06-01 17:55:55 +03:00
"mp3",
format,interp: Use MustGroup and add probe order test
2021-09-28 14:08:22 +03:00
"mpeg_ts",
"wav",
format,intepr: Refactor json, yaml, etc into formats also move out related functions json, yaml, toml, xml, html, csv are now normal formats and most of them also particiate in probing (not html and csv). Also fixes a bunch of bugs in to/fromxml, to/fromjq etc.
2022-06-01 17:55:55 +03:00
"json",
jsonl: Add decoder, also tojsonl encoder
2022-08-15 13:57:02 +03:00
"jsonl",
format,intepr: Refactor json, yaml, etc into formats also move out related functions json, yaml, toml, xml, html, csv are now normal formats and most of them also particiate in probing (not html and csv). Also fixes a bunch of bugs in to/fromxml, to/fromjq etc.
2022-06-01 17:55:55 +03:00
"toml",
"xml",
"yaml"
format,interp: Use MustGroup and add probe order test
2021-09-28 14:08:22 +03:00
]
doc,help: Nicer format help and move help tests into each format Also add authors to avro and macho decoders Generated with: for i in $(go run . -r -n '_registry | [([([.files[][].name | split(".")[0]] | unique[]), (.formats[].name)] | count[] | select(.[1] == 2)[0]), (.formats[] | select(.decode_in_arg).name)] | unique[]'); do DIR=$(dirname $(find format -name $i.go)); echo "$ fq -h $i" > "$DIR/testdata/help_$i.fqtest" ; done
2022-09-22 19:32:13 +03:00
$ fq --help formats
aac_frame Advanced Audio Coding frame
adts Audio Data Transport Stream
adts_frame Audio Data Transport Stream frame
amf0 Action Message Format 0
apev2 APEv2 metadata tag
ar Unix archive
asn1_ber ASN1 BER (basic encoding rules, also CER and DER)
av1_ccr AV1 Codec Configuration Record
av1_frame AV1 frame
av1_obu AV1 Open Bitstream Unit
avc_annexb H.264/AVC Annex B
avc_au H.264/AVC Access Unit
avc_dcr H.264/AVC Decoder Configuration Record
avc_nalu H.264/AVC Network Access Layer Unit
avc_pps H.264/AVC Picture Parameter Set
avc_sei H.264/AVC Supplemental Enhancement Information
avc_sps H.264/AVC Sequence Parameter Set
wav,avi,avc_au: Add avi decoder and refactor wav decoder avi and wav now share common riff decode code avc_au decoder can now handle annexb format
2022-10-29 20:23:50 +03:00
avi Audio Video Interleaved
doc,help: Nicer format help and move help tests into each format Also add authors to avro and macho decoders Generated with: for i in $(go run . -r -n '_registry | [([([.files[][].name | split(".")[0]] | unique[]), (.formats[].name)] | count[] | select(.[1] == 2)[0]), (.formats[] | select(.decode_in_arg).name)] | unique[]'); do DIR=$(dirname $(find format -name $i.go)); echo "$ fq -h $i" > "$DIR/testdata/help_$i.fqtest" ; done
2022-09-22 19:32:13 +03:00
avro_ocf Avro object container file
bencode BitTorrent bencoding
bitcoin_blkdat Bitcoin blk.dat
bitcoin_block Bitcoin block
bitcoin_script Bitcoin script
bitcoin_transaction Bitcoin transaction
raw,bits,bytes: Replace raw format with bits and bytes format that decode to a binary raw format was a hack to skip decoding to be able to get a binary using tobyte etc. Now you can do fq -d bytes ... instead of fq -d raw 'tobytes | ...'
2022-11-20 21:22:16 +03:00
bits Raw bits
bplist: Fix unknown field for singletons and add torepr tests
2022-10-04 15:24:32 +03:00
bplist Apple Binary Property List
doc,help: Nicer format help and move help tests into each format Also add authors to avro and macho decoders Generated with: for i in $(go run . -r -n '_registry | [([([.files[][].name | split(".")[0]] | unique[]), (.formats[].name)] | count[] | select(.[1] == 2)[0]), (.formats[] | select(.decode_in_arg).name)] | unique[]'); do DIR=$(dirname $(find format -name $i.go)); echo "$ fq -h $i" > "$DIR/testdata/help_$i.fqtest" ; done
2022-09-22 19:32:13 +03:00
bsd_loopback_frame BSD loopback frame
bson Binary JSON
raw,bits,bytes: Replace raw format with bits and bytes format that decode to a binary raw format was a hack to skip decoding to be able to get a binary using tobyte etc. Now you can do fq -d bytes ... instead of fq -d raw 'tobytes | ...'
2022-11-20 21:22:16 +03:00
bytes Raw bytes
doc,help: Nicer format help and move help tests into each format Also add authors to avro and macho decoders Generated with: for i in $(go run . -r -n '_registry | [([([.files[][].name | split(".")[0]] | unique[]), (.formats[].name)] | count[] | select(.[1] == 2)[0]), (.formats[] | select(.decode_in_arg).name)] | unique[]'); do DIR=$(dirname $(find format -name $i.go)); echo "$ fq -h $i" > "$DIR/testdata/help_$i.fqtest" ; done
2022-09-22 19:32:13 +03:00
bzip2 bzip2 compression
cbor Concise Binary Object Representation
csv Comma separated values
dns DNS packet
dns_tcp DNS packet (TCP)
elf Executable and Linkable Format
ether8023_frame Ethernet 802.3 frame
exif Exchangeable Image File Format
fairplay_spc FairPlay Server Playback Context
flac Free Lossless Audio Codec file
flac_frame FLAC frame
flac_metadatablock FLAC metadatablock
flac_metadatablocks FLAC metadatablocks
flac_picture FLAC metadatablock picture
flac_streaminfo FLAC streaminfo
gif Graphics Interchange Format
gzip gzip compression
hevc_annexb H.265/HEVC Annex B
hevc_au H.265/HEVC Access Unit
hevc_dcr H.265/HEVC Decoder Configuration Record
hevc_nalu H.265/HEVC Network Access Layer Unit
hevc_pps H.265/HEVC Picture Parameter Set
hevc_sps H.265/HEVC Sequence Parameter Set
hevc_vps H.265/HEVC Video Parameter Set
html HyperText Markup Language
icc_profile International Color Consortium profile
icmp Internet Control Message Protocol
icmpv6 Internet Control Message Protocol v6
id3v1 ID3v1 metadata
id3v11 ID3v1.1 metadata
id3v2 ID3v2 metadata
ipv4_packet Internet protocol v4 packet
ipv6_packet Internet protocol v6 packet
jpeg Joint Photographic Experts Group file
json JavaScript Object Notation
jsonl JavaScript Object Notation Lines
macho Mach-O macOS executable
macho_fat Fat Mach-O macOS executable (multi-architecture)
markdown Markdown
matroska Matroska file
mp3 MP3 file
mp3_frame MPEG audio layer 3 frame
mp3_frame_tags: Refactor and rename xing format to mp3_frame_tags Make more sense to use a more general name when there is both info and xing and possibly vbri in the future. Also both xing and info seems to have extension fields Remove some old tests that are not really needed anymore.
2022-11-16 15:04:16 +03:00
mp3_frame_tags MP3 frame info/xing tags
doc,help: Nicer format help and move help tests into each format Also add authors to avro and macho decoders Generated with: for i in $(go run . -r -n '_registry | [([([.files[][].name | split(".")[0]] | unique[]), (.formats[].name)] | count[] | select(.[1] == 2)[0]), (.formats[] | select(.decode_in_arg).name)] | unique[]'); do DIR=$(dirname $(find format -name $i.go)); echo "$ fq -h $i" > "$DIR/testdata/help_$i.fqtest" ; done
2022-09-22 19:32:13 +03:00
mp4 ISOBMFF, QuickTime and similar
mpeg_asc MPEG-4 Audio Specific Config
mpeg_es MPEG Elementary Stream
mpeg_pes MPEG Packetized elementary stream
mpeg_pes_packet MPEG Packetized elementary stream packet
mpeg_spu Sub Picture Unit (DVD subtitle)
mpeg_ts MPEG Transport Stream
msgpack MessagePack
ogg OGG file
ogg_page OGG page
opus_packet Opus packet
pcap PCAP packet capture
pcapng PCAPNG packet capture
png Portable Network Graphics file
prores_frame Apple ProRes frame
protobuf Protobuf
protobuf_widevine Widevine protobuf
pssh_playready PlayReady PSSH
rtmp Real-Time Messaging Protocol
sll2_packet Linux cooked capture encapsulation v2
sll_packet Linux cooked capture encapsulation
tar Tar archive
tcp_segment Transmission control protocol segment
tiff Tag Image File Format
toml Tom's Obvious, Minimal Language
udp_datagram User datagram protocol
vorbis_comment Vorbis comment
vorbis_packet Vorbis packet
vp8_frame VP8 frame
vp9_cfm VP9 Codec Feature Metadata
vp9_frame VP9 frame
vpx_ccr VPX Codec Configuration Record
wasm WebAssembly Binary Format
wav WAV file
webp WebP image
xml Extensible Markup Language
yaml YAML Ain't Markup Language
zip ZIP archive
Reference in New Issue Copy Permalink