wader/fq
1
1
Fork 0
mirror of https://github.com/wader/fq.git synced 2024-11-23 00:57:15 +03:00
Code Issues Projects Releases Wiki Activity
2,291 Commits 33 Branches 23 Tags 59 MiB
78a3e94bd7
Commit Graph

91 Commits

Author SHA1 Message Date
Michael B.
b05aa997ab leveldb: address PR comments 2023-12-05 11:31:30 +01:00
Michael B.
fb910bd44b ldb: first draft 
Example:
go run . -d ldb d format/ldb/testdata/000005.ldb
 2023-12-04 12:05:06 +01:00
Mattias Wadman
d703321a7a avi: Add extended chunks support and option 
This is used for >1gb files. Disable decode will speed up
deocde a lot but will probably also produce some gaps as same
part of the movi chunks will not be reference by the indx index.
 2023-10-20 15:55:19 +02:00
fiatjaf
5e7c01a013
opentimestamps: address comments and improve things. 2023-09-26 12:35:18 -03:00
fiatjaf
cef5faa85d
opentimestamps: add parser. 2023-09-25 22:52:41 -03:00
Ronsor
092662ec85 moc3: initial implementation 2023-08-17 20:07:55 -07:00
Ronsor
da41a8d311 caff: initial implementation 2023-08-17 13:17:01 -07:00
Babz
1afdf8b1cf luajit: initial support 2023-06-20 18:24:49 +02:00
Mattias Wadman
a200d3eee0
Merge pull request #415 from pnsafonov/postgres 
Postgres
 2023-05-06 09:07:13 +02:00
Pavel Safonov
08c535239b postgres: refactoring 2023-05-04 08:45:42 +03:00
Pavel Safonov
f6f8d5c037 postgres: refactoring 2023-05-03 15:40:32 +03:00
Mattias Wadman
684a083813 interp,decode: Support decode group argument 
Will be used for probing via -d <string> and filename
 2023-05-03 10:01:13 +02:00
Pavel Safonov
e5f15c5fed postgres: fix compilation, fix tests 2023-05-03 10:10:03 +03:00
Pavel Safonov
bb2659d442 Merge remote-tracking branch 'master' into postgres_merge_master_0 2023-05-03 09:44:02 +03:00
Mattias Wadman
a4a332bf4e formats: Clenaup naming a bit 2023-05-01 13:19:04 +02:00
Mattias Wadman
b08ef00dd1 decode,interp: Refactor format groups into a proper struct 
Replaces []Format with a Group type.
A bit more type safe.
Breaking change for RegisterFormat, now takes a first argument that is a "single" format group.
Lots of naming cleanup.

This is also preparation for decode group argument which will enable doing intresting
probing, ex a format decoder could know it's decode as part of probe group  (html could
be probed possibly), or have "arg probe" group for decoder who inspect args to know
if they should probe (-d /path/to/schema etc) to enable nice CLI-ergonomics.
 2023-04-29 20:02:34 +02:00
Mattias Wadman
0b6ef2a9d8 golangci-lint: Disable revive unused-parameter and update for new default config 
unused-parameter disabled as i prefer to see the names
new default revive config seems to not warn about capital names
 2023-03-18 22:56:58 +01:00
Mattias Wadman
dc4a82eeed aiff: Add basic decoder 2023-03-09 15:16:52 +01:00
Mattias Wadman
9852f56b74 tls: Add TLS 1.0, 1.1, 1.2 decode and decryption 
What it can do:
- Decodes records and most standard messages and extensions.
- Decryptes records and reassemples application data stream if a keylog is provided
  and the cipher suite is supported.
- Supports most recommended and used ciphers and a bunch of older ones.

What it can't do:
- SSL v3 maybe supported, is similar to TLS 1.0, not tested.
- Decryption and renegotiation/cipher change.
- Record defragmentation not supported, seems rare over TCP.
- TLS 1.3
- SSL v2 but v2 compat header is supported.
- Some key exchange messages not decoded yet

Decryption code is heavly based on golang crypto/tls and zmap/zcrypto.

Will be base for decoding http2 and other TLS based on protocols.

Fixes #587
 2023-03-05 13:52:12 +01:00
Mattias Wadman
b60aceca9e matroska: Add decode_samples option 
Also change the option help a bit, maybe medid and support is confusing, we
might evetually decode non-audio/video things.
 2023-02-08 11:31:41 +01:00
Mattias Wadman
2d82c05f64 mp3: Add max_unknown option to fail decode if too much unknown bits 
Hopefully help fix even more miss-detections
 2023-01-25 15:27:31 +01:00
Pavel Safonov
97bbc22a1d postgres: add page arg in pg_btree, change args names in pg_heap 2022-12-22 11:22:02 +03:00
Mattias Wadman
9e5a072e50 mp3_frame_tags: Covert to decode group and split to mp3_frame_{xing,vbri} decoders 2022-12-15 12:10:06 +01:00
David McDonald
34c560c2f5 Merge branch 'master' of https://github.com/wader/fq into macos_bookmark 2022-12-05 22:01:44 -06:00
@0xb17bea125
2ee6360b97 support tzif (time zone information format) 2022-12-04 21:02:39 +09:00
David McDonald
4a28e44f44 changes decoder package name from bookmark to apple_bookmark 2022-12-01 23:31:57 -06:00
David McDonald
34db9d7fea regenerated docs, added tests, fixed torepr 2022-12-01 23:31:57 -06:00
David McDonald
71b17d0382 apple bookmarkdata decoder initial commit 2022-12-01 23:31:56 -06:00
Pavel Safonov
6fe61cd634 Merge branch 'wader_master' into postgres_wal_removed 2022-11-23 13:57:50 +03:00
Pavel Safonov
60709e5a00 postgres: remove pg_wal. Failed to implement. 2022-11-23 13:55:07 +03:00
Mattias Wadman
c93301fc70 raw,bits,bytes: Replace raw format with bits and bytes format that decode to a binary 
raw format was a hack to skip decoding to be able to get a binary using tobyte etc.
Now you can do fq -d bytes ... instead of fq -d raw 'tobytes | ...'
 2022-11-20 19:51:12 +01:00
Mattias Wadman
0cf46e1196 wav,avi,avc_au: Add avi decoder and refactor wav decoder 
avi and wav now share  common riff decode code
avc_au decoder can now handle annexb format
 2022-11-19 13:11:27 +01:00
Mattias Wadman
c3a0686c9e mp3_frame_tags: Refactor and rename xing format to mp3_frame_tags 
Make more sense to use a more general name when there is both info and xing
and possibly vbri in the future. Also both xing and info seems to have extension
fields

Remove some old tests that are not really needed anymore.
 2022-11-16 17:32:03 +01:00
Pavel Safonov
5bb8654423 postgres: remove lsn parameter in pg_wal 2022-11-07 12:05:33 +03:00
Pavel Safonov
4676590624 postgres: add argument to calc page's check sum correctly 2022-10-07 12:58:36 +03:00
Pavel Safonov
6588e1dd88 Merge branch 'wader_master' into postgres 2022-10-05 19:39:35 +03:00
David McDonald
d784db69bc Adds support for Apple Binary Plist, version 00 2022-09-23 20:21:32 -05:00
Pavel Safonov
de3ecf1636 postgres: generate docs by embedded md 2022-09-23 13:50:54 +03:00
Pavel Safonov
dd84d3218c postgres: pg_btree begin impl 2022-09-19 15:45:54 +03:00
Pavel Safonov
f122f72373 Merge branch 'wader_master' into postgres 2022-09-16 17:18:30 +03:00
Mattias Wadman
00a50662ea markdown: Add decoder 2022-09-10 18:26:45 +02:00
Pavel Safonov
1d9ef300b9 postgres: first correct read of WAL file 2022-09-09 15:16:48 +03:00
Pavel Safonov
08eb303435 postgres: add postgres format docs, refactoing postgres flavours 2022-09-02 16:14:24 +03:00
Pavel Safonov
b4c4de26ca Merge remote-tracking branch 'github/master' 2022-08-31 12:17:14 +03:00
Mattias Wadman
004406de65 bitcoin_blkdat,bitcoin_block: Make sure there is a header if blkdat 
Makes bitcoin_blkdat fails fast as it is part of probe group.
Speeds up reading a big JSON file etc.
 2022-08-26 12:07:53 +02:00
Mattias Wadman
095e1161b7 xml: Switch from "-" to "@" as attribute prefix and make it an option 
Seems to be more common.
 2022-08-25 17:15:23 +02:00
Pavel Safonov
e4ba72f42f Merge remote-tracking branch 'github/master' 2022-08-25 09:55:48 +03:00
Mattias Wadman
8fc43533a9 prores_frame: Add basic container and frame header decoder 2022-08-24 19:33:35 +02:00
Takashi Oguma
934ed9a809
wasm: initial version 2022-08-18 21:40:30 +09:00
Mattias Wadman
701c67c136 jsonl: Add decoder, also tojsonl encoder 2022-08-15 19:43:59 +02:00