1
1
mirror of https://github.com/wader/fq.git synced 2024-10-04 07:27:08 +03:00
Commit Graph

321 Commits

Author SHA1 Message Date
fiatjaf
e3c7b1a34b negentropy: another test from a different source, another doc entry, comments on source of test samples. 2024-09-19 21:47:09 -03:00
fiatjaf
49bd7c27fd negentropy: add format. 2024-09-18 16:39:40 -03:00
Mattias Wadman
be9a9164ad doc: Update formats.svg 2024-09-08 17:40:00 +02:00
twystd
36b776ef5d Merge branch 'master' into midi 2024-08-25 20:47:56 -07:00
twystd
2f2070eca2 midi: fixed lint warnings 2024-08-25 17:09:12 -07:00
Michael R. Cook
b27017cc7d tzx: add readme instructions for bits_format=byte_array 2024-08-21 22:02:34 +02:00
Mattias Wadman
fc74f6857c intepr: Revert binary value each
Is a bad idea, behaves confusingly with .. etc. Maybe can be
done in the future via some option to make all raw bits behave
as arrays are instroduced.
2024-08-21 16:33:20 +02:00
Mattias Wadman
3f3183a5c5 intepr: Support each for binary values
Makes it possible to output all bytes or bits as integers in a binary value.
Ex: [1,2,3] | [tobytes[]] -> [1,2,3]
2024-08-21 16:17:19 +02:00
Mattias Wadman
7bf112917b interp: Add bits_format=byte_array support
Represent binary values into an array of bytes when turn values into JSON
2024-08-20 08:43:22 +02:00
Mattias Wadman
db0dfb14b6 doc: Update formats.svg 2024-08-08 10:24:05 +02:00
Michael R. Cook
66345fec29 doc: regenerat formats.md for tzx/tap updates 2024-08-02 12:24:47 +02:00
Michael R. Cook
81b23041af tzx: Add suport for ZX Spectrum TZX and TAP files 2024-08-01 11:57:51 +02:00
Mattias Wadman
6f2b59944d doc: Include format description per format 2024-05-24 12:08:07 +02:00
Mattias Wadman
b818923c26 doc: Fix function indent 2024-05-23 18:33:37 +02:00
Mattias Wadman
40f38a5558 doc: Reorganize and cleanup function descriptions 2024-05-23 18:20:10 +02:00
Mattias Wadman
ebf063d1c0 doc: Cleanup and improve texts a bit 2024-04-30 14:16:13 +02:00
Mattias Wadman
6db6a54d13 build,test: Ignore some files to make ./... work 2024-04-21 09:50:02 +02:00
Mattias Wadman
63f7d79c32 jp2c: Support probe 2024-04-10 21:44:14 +02:00
Mattias Wadman
ebffb3be7b jp2c: Add jpeg2000 codestream format 2024-04-10 16:24:14 +02:00
Mattias Wadman
c8f9cdc9d7 interp: Add string_truncate option
Was hardcoded to 50, now confiugurable also used affected by dd, dv etc
2024-04-08 17:45:10 +02:00
Mattias Wadman
36e8287c2b doc: Regenerate after nes and new ansisvg 2024-03-17 13:45:38 +01:00
Mattias Wadman
76307e4d33 fit: Formatted date/time description for timestamp fields 2024-02-11 00:43:00 +01:00
Mattias Wadman
55470deb99 doc: Update docs to include fit format
Also new version of ansisvg
2024-02-10 01:36:05 +01:00
Mattias Wadman
217660005e interp: Support ~/.config/fq as fallback on macOS
Got fed up with ~/Library/Application Support/fq
2024-02-09 16:10:38 +01:00
Mattias Wadman
e5fd1eb427 doc: Generate svgs with new ansisvg 2024-01-08 13:27:54 +01:00
Mattias Wadman
41226f48d8 readline: Switch to ergochat/readline
All fq changes merged.
2023-12-24 20:35:15 +01:00
Mattias Wadman
b05c7ec54f
Merge pull request #824 from mikez/leveldb
leveldb: Add LevelDB support
2023-12-09 16:47:43 +01:00
Michael B.
2f5f183106 leveldb: decode unfragmented .log files further; fix UTF8 decoding
decode unfragmented .log files:

 - break leveldb_log.go into leveldb_log_blocks.go and leveldb_log.go;
   the former is used by both .MANIFEST (descriptor) and .LOG.
 - in leveldb_log, introduce readBatch that decodes further

 fix UTF8 decoding:

 - introduce fieldUTF8ReturnBytes and stringify to handle multi-byte
   UTF8-encodings correctly.
2023-12-09 14:13:33 +01:00
Mattias Wadman
c47756dcd2 doc: Update svgs after ansisvg update
Now generates svg:s with better select support
2023-12-08 10:39:12 +01:00
Michael B.
3a396e156e leveldb: improve log documentation 2023-12-07 14:36:47 +01:00
Michael B.
cc0d5a8b9b leveldb: update docs 2023-12-07 13:02:55 +01:00
Mattias Wadman
7906f33d51 test: Support to more common -update flag 2023-12-06 11:47:38 +01:00
Michael B.
b05aa997ab leveldb: address PR comments 2023-12-05 11:31:30 +01:00
Mattias Wadman
5abf151f9b doc: Remove spurious backtick 2023-11-10 14:35:22 +01:00
Mattias Wadman
9e58067f4b webp: Refactor to use riff code and decode VP8X, EXIF, ICCP and XMP chunks 2023-11-01 18:58:09 +01:00
Mattias Wadman
a83cac6021 zip: Fix incorrect time/date, add extended timestamp and refactor
MSDOS time/date was read in wrong order and also did not take into account
that the bit ranges in the shortis are in little-endian.

Remodel modification_time/date to be one struct with fat_time, fat_date LE shorts
and then synthetic values for day, hours, minute etc and also a unix field with the
timestamp as unix time.

Also refactor and clenaup extra fields/extended code a bit.

Fixes #792
2023-10-23 11:11:27 +02:00
Mattias Wadman
d703321a7a avi: Add extended chunks support and option
This is used for >1gb files. Disable decode will speed up
deocde a lot but will probably also produce some gaps as same
part of the movi chunks will not be reference by the indx index.
2023-10-20 15:55:19 +02:00
Mattias Wadman
051a70bd4b interp: Change bit ranges to use exclusive end
All other ranges and slicing uses exclusive end so i think it make sense
to make it consistent.

Update docs and add additional example for non-byte-aligned field.

Also fixes issue showing zero bit ranges as start-NA.
2023-10-20 15:37:26 +02:00
fiatjaf
976a7564c7
opentimestamps: one last make doc. 2023-09-26 15:42:02 -03:00
fiatjaf
5e7c01a013
opentimestamps: address comments and improve things. 2023-09-26 12:35:18 -03:00
Mattias Wadman
406f3926e9 doc: Move up and update differences jq section a bit 2023-08-22 13:20:50 +02:00
Mattias Wadman
f15f9bc1a4 doc,moc3,caff: Add author and regenerate docs 2023-08-21 10:04:37 +02:00
Ronsor
cc58c4b81d caff: update doc/formats.md 2023-08-18 11:04:57 -07:00
Mattias Wadman
d5345f0b8a cli: Rename --null/nul-output to --raw-output0
Remove -0 short arg, now it means the expression "-0".
This is to be in sync with jq 1.7 https://github.com/jqlang/jq/pull/2684

Correct and clarify that NUL and new lines are outputted after and not between each output.

Still missing is to abort on output containing zero when using --raw-output0
2023-08-08 16:33:39 +02:00
Mattias Wadman
44f0060205 dev,jq: Reformat jq code to look more the same 2023-07-27 13:21:04 +02:00
Mattias Wadman
23b9eeab1f luajit: make doc 2023-06-22 23:54:49 +02:00
Mattias Wadman
93423d0da6
Merge pull request #673 from wader/bit-format-hex
interp: Add hex bits format
2023-05-15 17:49:15 +02:00
Mattias Wadman
8a468f45df interp: Add hex bits format
$ cat random.bin.gz | fq -rV -o bits_format=hex .uncompressed
f6f2074cf77d449d

Also made unknown bit formats an error.
2023-05-15 17:31:38 +02:00
Kian-Meng Ang
dd4fa26867 doc: fix typos
Found via `codespell -S format -L bu,ue,trys,nd,tbe,te,trun,actuall`
2023-05-14 21:45:15 +08:00
Mattias Wadman
e2eb667091 html: Add to probe group
As decoder now can know they are decoding as part of probing we can now
use some heuristics to see if we should decode as html.
The reason heuristics is needed is that x/html parser will alwaus succeed.

Add lazyre package to help delay compile of RE and make it concurrency safe.
2023-05-11 19:07:18 +02:00