1
1
mirror of https://github.com/wader/fq.git synced 2024-12-29 00:22:38 +03:00
Commit Graph

1152 Commits

Author SHA1 Message Date
bump
198305ecfc Update github-golangci-lint from 1.47.3 to 1.48.0
Release notes https://github.com/golangci/golangci-lint/releases/tag/v1.48.0
2022-08-04 22:04:21 +00:00
Mattias Wadman
b135701ccd
Merge pull request #359 from wader/zip-skip-header-check
zip: Skip header assert as there are zip files with other things appe…
2022-08-04 12:53:09 +02:00
Mattias Wadman
c683b66769
Merge pull request #358 from wader/decode-scalar-max-error
decode,scalar: Map empty string also else sym might ends up nil
2022-08-04 12:38:41 +02:00
Mattias Wadman
19b70899ca zip: Skip header assert as there are zip files with other things appended 2022-08-04 12:33:33 +02:00
Mattias Wadman
5d9ffead52 decode,scalar: Map empty string also else sym might ends up nil
Later mappers should be able to rely on sym being a value of a certain type.
In this crash case tar.go  had this:
d.FieldUTF8NullFixedLen("mtime", 12, scalar.SymUParseUint(8), scalar.DescriptionSymUUnixTime)
If mtime was empty string SymUParseUint was not even called so did not bail out running
all mappers.
2022-08-04 12:23:31 +02:00
Mattias Wadman
7d1316244f
Merge pull request #357 from wader/xml-html-array-attrs-null
xml,html: Always include attrs and children in array mode
2022-08-04 12:05:16 +02:00
Mattias Wadman
f4e0137244 xml,html: Always include attrs and children in array mode
Was hard to use when you dont know what indexes things will have. They are sill optioal for toxml
2022-08-04 11:44:59 +02:00
Mattias Wadman
37de35dd5a
Merge pull request #353 from wader/bump-docker-golang-1.18.5
Update docker-golang from 1.18.4 to 1.18.5
2022-08-02 18:10:39 +02:00
Mattias Wadman
1353aea791
Merge pull request #354 from wader/bump-github-go-version-1.18.5
Update github-go-version from 1.18.4, 1.18.4, 1.18.4 to 1.18.5
2022-08-02 18:10:32 +02:00
bump
7b8d95bf9f Update github-go-version from 1.18.4, 1.18.4, 1.18.4 to 1.18.5 2022-08-02 16:03:50 +00:00
bump
25061acab2 Update docker-golang from 1.18.4 to 1.18.5 2022-08-02 16:03:47 +00:00
Mattias Wadman
5e7d5bbdcf
Merge pull request #352 from wader/macho-refactor-strings
macho: Split into macho/macho_fat, fix offset issue and add string de…
2022-08-02 16:49:09 +02:00
Mattias Wadman
725c8e83ab macho: Split into macho/macho_fat, fix offset issue and add string decoding
Split fat macho into own decoder macho_fat. This also fixes issue with section
offset etc not being correct as they are from the start of each embedded file.

Make all address and offset field be in hex.

Decode __cstring, __ustring and __cfstring sections.

Fix LC_ENCRYPTION_INFO_64 missing pading issue.

Skip ranging for __bss and __common as they dont have any data in the file.

Simplifed magic handling a bit and add symbols.

Simplified state struct field, had redudant struct.
2022-08-02 14:36:53 +02:00
Mattias Wadman
888a471245
Merge pull request #350 from wader/bump-github-golangci-lint-1.47.3
Update github-golangci-lint from 1.47.2 to 1.47.3
2022-08-01 18:54:35 +02:00
Mattias Wadman
bc6cffde61 lint,decode,fuzz:: Fix nilerr warnings, one real one should be ignored for now 2022-08-01 18:47:24 +02:00
Mattias Wadman
a8dd13851a
Merge pull request #349 from wader/bump-make-golangci-lint-1.47.3
Update make-golangci-lint from 1.47.2 to 1.47.3
2022-08-01 18:40:47 +02:00
Mattias Wadman
691b150e3f
Merge pull request #348 from wader/decode-simplify-array-struct-sort
decode: Simplify compound range sort behaviour
2022-08-01 18:40:39 +02:00
bump
4255b87aba Update github-golangci-lint from 1.47.2 to 1.47.3
Release notes https://github.com/golangci/golangci-lint/releases/tag/v1.47.3
2022-08-01 16:04:00 +00:00
bump
f579e9c327 Update make-golangci-lint from 1.47.2 to 1.47.3
Release notes https://github.com/golangci/golangci-lint/releases/tag/v1.47.3
2022-08-01 16:03:57 +00:00
Mattias Wadman
840292ba6e decode: Simplify compound range sort behaviour
Doing it thru a propery in the decode fn feels a bit hidden and will
also not get set on failed decoding.

Now array is not range sorted, logic is you care about index number and ordering.
Struct is range sorted as you will prefer to fields by name.
2022-08-01 17:17:54 +02:00
Mattias Wadman
c1f7a80ac6
Merge pull request #347 from wader/doc-update-demo-and-help
doc,interp: Update and add more examples
2022-07-30 20:30:41 +02:00
Mattias Wadman
ed4247836c doc,interp: Update and add more examples 2022-07-30 20:21:35 +02:00
Mattias Wadman
efa196ba2b
Merge pull request #346 from wader/doc-help-raw-slurp
interp,doc: Add -R raw string slurp hint to -s help
2022-07-29 16:43:46 +02:00
Mattias Wadman
8767bdc731
Merge pull request #345 from wader/readme-demo-update
doc: Update README demo a bit with new features
2022-07-29 16:43:38 +02:00
Mattias Wadman
4eae7ffd99 interp,doc: Add -R raw string slurp hint to -s help 2022-07-29 16:37:42 +02:00
Mattias Wadman
f247edb592 doc: Update README demo a bit with new features 2022-07-29 16:34:27 +02:00
Mattias Wadman
75a6873508
Merge pull request #344 from wader/elf-remove-redundant-program-header-struct
elf: Remove redundant program_header struct
2022-07-29 13:48:57 +02:00
Mattias Wadman
3613b6d4dd elf: Remove redundant program_header struct 2022-07-29 13:41:21 +02:00
Mattias Wadman
960ad46c6e
Merge pull request #342 from wader/remove-format-files
interp: Use RegisterFS instead of format files
2022-07-27 13:44:49 +02:00
Mattias Wadman
9e447c9af1 interp: Use RegisterFS instead of format files 2022-07-27 13:22:59 +02:00
Mattias Wadman
b224e948d1
Merge pull request #341 from wader/normalize-to-string-jqvalue
xml,csv,interp: Handle JQValue when string normalizing
2022-07-26 18:00:37 +02:00
Mattias Wadman
fa20c74c22 xml,csv,interp: Handle JQValue when string normalizing
Otherwise nested array/object JQValue:s could end up being JSON marshalled
2022-07-26 17:43:59 +02:00
Mattias Wadman
9e34754fca
Merge pull request #340 from wader/gojq-update-to-value-order
gojq: Preserve keys order for to_entries when used with JQValue
2022-07-26 16:05:47 +02:00
Mattias Wadman
af35b2848d gojq: Preserve keys order for to_entries when used with JQValue
Feels like what one would expect when doing to_entries on a decode value struct etc,
that is get the pairs in same order as decoder wants.

Quite sure this used to the case but was change to sorted key order when
to_entries was move from bein implemented in jq to be internal for performance
reasons. Now internal gojq to_entries has a special case for JQValue objects.

Also use new gojq.JQType* constants for type strings and switch binary type
to look more like strings. Can still use _exttype to get "binary".
2022-07-26 15:55:58 +02:00
Mattias Wadman
055b029b65
Merge pull request #339 from wader/asn1-xml-lf
asn1_ber,goreleaser: Convert CRLF to LF in asn1 xml tests, hopefully …
2022-07-24 12:48:44 +02:00
Mattias Wadman
0326eeb697 asn1_ber,goreleaser: Convert CRLF to LF in asn1 xml tests, hopefully fixes goreleaer workspace dirty error 2022-07-24 12:38:24 +02:00
Mattias Wadman
1d369bcfab
Merge pull request #319 from wader/release-0.0.8
Release 0.0.8
2022-07-24 12:22:52 +02:00
Mattias Wadman
db70fcca4e fq: Release 0.0.8 2022-07-24 12:15:08 +02:00
Mattias Wadman
2cf8575bb3
Merge pull request #338 from wader/doc-formats-cleanup
doc: Improve and cleanup text formats
2022-07-24 12:02:16 +02:00
Mattias Wadman
10cc551871 doc: Improve and cleanup text formats
Hopefully will get time to revamp how docs work
2022-07-24 11:55:50 +02:00
Mattias Wadman
e843e31b20
Merge pull request #336 from wader/avro-fix-missing-schema-crash
avro_ocf: Fix panic on missing meta schema
2022-07-24 11:24:51 +02:00
Mattias Wadman
2426ef0622
Merge pull request #337 from wader/doc-readme-update
doc: Update and shorten README.md a bit
2022-07-23 23:02:02 +02:00
Mattias Wadman
c27646a689 doc: Update and shorten README.md a bit 2022-07-23 22:50:33 +02:00
Mattias Wadman
5d67df47e2 avro_ocf: Fix panic on missing meta schema 2022-07-23 22:20:03 +02:00
Mattias Wadman
e464454583
Merge pull request #335 from wader/format-text2
format,intepr: Refactor json, yaml, etc into formats also move out re…
2022-07-23 22:02:16 +02:00
Mattias Wadman
cae288e6be format,intepr: Refactor json, yaml, etc into formats also move out related functions
json, yaml, toml, xml, html, csv are now normal formats and most of them also particiate
in probing (not html and csv).

Also fixes a bunch of bugs in to/fromxml, to/fromjq etc.
2022-07-23 21:48:45 +02:00
Mattias Wadman
8b5cc89641
Merge pull request #334 from wader/hevc_vps-max-vps-layers
hevc_vps,fuzz: Error on too many vps layers
2022-07-22 22:56:31 +02:00
Mattias Wadman
fd302093e1 hevc_vps,fuzz: Error on too many vps layers 2022-07-22 22:48:25 +02:00
Mattias Wadman
e0a391de56
Merge pull request #332 from wader/elf-error-on-large-strtab
elf,fuzz: Error on too large string table
2022-07-22 22:47:33 +02:00
Mattias Wadman
375e7a7bea
Merge pull request #333 from wader/asn1-nested-range-panic-test
asn1: Add regression test for range decode fix ##330
2022-07-22 22:40:00 +02:00