wader/fq
1
1
Fork 0
mirror of https://github.com/wader/fq.git synced 2024-12-02 04:05:35 +03:00
Code Issues Projects Releases Wiki Activity
88dc847441
fq/pkg/decode/types.json

224 lines
12 KiB
JSON
Raw Normal View History

decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
{
"types": {
scalar: Add Require* and Require/Validate/AssertRange*
2021-12-07 17:46:42 +03:00
"Str": {"go_type": "string", "zero": "\"\"", "compare": "a == b", "range": "a >= start && a <= end"},
"U": {"go_type": "uint64", "zero": "0", "compare": "a == b", "range": "a >= start && a <= end"},
"S": {"go_type": "int64", "zero": "0", "compare": "a == b", "range": "a >= start && a <= end"},
"F": {"go_type": "float64", "map_from": false, "zero": "0", "compare": "a == b", "range": "a >= start && a <= end"},
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
"Bool": {"go_type": "bool", "zero": "false", "compare": "a == b"},
bitio,decode: Refactor bitio usage and make buffer slicing more correct Remove bitio.Buffer layer. bitio.Buffer was a kitchen sink layer with helpers now it's just a buffer and most functions have been moved to decode instead. bitio package now only have primitive types and functions simialar to standard library io and bytes packages. Make nearly eveything internally use bitio.Bit* interfaces so that slicing work correctly this will also make it possible to start experimenting with more complicated silcing helpers, ex things like: breplace(.header.bitrate; 123) to get a new buffer with bitrate changed.
2022-01-24 23:21:48 +03:00
"BitBuf": {"go_type": "bitio.ReaderAtSeeker", "zero": "nil", "map_from": false, "map_to": false},
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
"BigInt": {"go_type": "*big.Int", "zero": "nil", "map_from": false, "map_to": false, "compare": "a.Cmp(b) == 0", "range": "a.Cmp(start) >= 0 && a.Cmp(end) <= 0"}
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
"readers": [
{
"name": "Raw",
"type": "BitBuf",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"variants": [ {"name": "Len", "args": "nBits", "params": "nBits int64", "call": "d.tryBitBuf(nBits)", "doc": "nBits raw bits"} ]
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
{
"name": "Bool",
"type": "Bool",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"variants": [ {"name": "", "args": "", "params": "", "call": "d.tryBool()", "doc": "1 bit boolean"} ]
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
{
"name": "U",
"type": "U",
"variants": [
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{"name": "", "args": "nBits", "params": "nBits int", "call": "d.tryUEndian(nBits, d.Endian)", "doc": "nBits bits unsigned integer in current endian"},
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
{
"name": "E",
"args": "nBits, endian",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"params": "nBits int, endian Endian",
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
"call": "d.tryUEndian(nBits, endian)",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"doc": "nBits unsigned integer in specified endian"
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{ "name": "$n", "range": [1, 64], "args": "", "params": "", "call": "d.tryUEndian($n, d.Endian)", "doc": "$n bit unsigned integer in current endian" },
{ "name": "$nLE", "range": [8, 64], "args": "", "params": "", "call": "d.tryUEndian($n, LittleEndian)", "doc": "$n bit unsigned integer in little-endian" },
{ "name": "$nBE", "range": [8, 64], "args": "", "params": "", "call": "d.tryUEndian($n, BigEndian)", "doc": "$n bit unsigned integer in big-endian" }
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
]
},
{
"name": "S",
"type": "S",
"variants": [
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{"name": "", "args": "nBits", "params": "nBits int", "call": "d.trySEndian(nBits, d.Endian)", "doc": "nBits bits signed integer in current endian"},
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
{
"name": "E",
"args": "nBits, endian",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"params": "nBits int, endian Endian",
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
"call": "d.trySEndian(nBits, endian)",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"doc": "nBits signed integer in specified endian"
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{ "name": "$n", "range": [1, 64], "args": "", "params": "", "call": "d.trySEndian($n, d.Endian)", "doc": "$n bit signed integer in current endian" },
{ "name": "$nLE", "range": [8, 64], "args": "", "params": "", "call": "d.trySEndian($n, LittleEndian)", "doc": "$n bit signed integer in little-endian" },
{ "name": "$nBE", "range": [8, 64], "args": "", "params": "", "call": "d.trySEndian($n, BigEndian)", "doc": "$n bit signed integer in big-endian" }
]
},
{
"name": "UBigInt",
"type": "BigInt",
"variants": [
bitio,decode: Refactor bitio usage and make buffer slicing more correct Remove bitio.Buffer layer. bitio.Buffer was a kitchen sink layer with helpers now it's just a buffer and most functions have been moved to decode instead. bitio package now only have primitive types and functions simialar to standard library io and bytes packages. Make nearly eveything internally use bitio.Bit* interfaces so that slicing work correctly this will also make it possible to start experimenting with more complicated silcing helpers, ex things like: breplace(.header.bitrate; 123) to get a new buffer with bitrate changed.
2022-01-24 23:21:48 +03:00
{
"name": "",
"args": "nBits",
"params": "nBits int",
"call": "d.tryBigIntEndianSign(nBits, d.Endian, false)",
"doc": "nBits bits signed integer in current endian"
},
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{
"name": "E",
"args": "nBits, endian",
"params": "nBits int, endian Endian",
"call": "d.tryBigIntEndianSign(nBits, endian, false)",
"doc": "nBits signed integer in specified endian"
},
bitio,decode: Refactor bitio usage and make buffer slicing more correct Remove bitio.Buffer layer. bitio.Buffer was a kitchen sink layer with helpers now it's just a buffer and most functions have been moved to decode instead. bitio package now only have primitive types and functions simialar to standard library io and bytes packages. Make nearly eveything internally use bitio.Bit* interfaces so that slicing work correctly this will also make it possible to start experimenting with more complicated silcing helpers, ex things like: breplace(.header.bitrate; 123) to get a new buffer with bitrate changed.
2022-01-24 23:21:48 +03:00
{
"name": "LE",
"args": "nBits",
"params": "nBits int",
"call": "d.tryBigIntEndianSign(nBits, LittleEndian, false)",
"doc": "nBits bit signed integer in little-endian"
},
{
"name": "BE",
"args": "nBits",
"params": "nBits int",
"call": "d.tryBigIntEndianSign(nBits, BigEndian, false)",
"doc": "nBits bit signed integer in big-endian"
}
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
]
},
{
"name": "SBigInt",
"type": "BigInt",
"variants": [
bitio,decode: Refactor bitio usage and make buffer slicing more correct Remove bitio.Buffer layer. bitio.Buffer was a kitchen sink layer with helpers now it's just a buffer and most functions have been moved to decode instead. bitio package now only have primitive types and functions simialar to standard library io and bytes packages. Make nearly eveything internally use bitio.Bit* interfaces so that slicing work correctly this will also make it possible to start experimenting with more complicated silcing helpers, ex things like: breplace(.header.bitrate; 123) to get a new buffer with bitrate changed.
2022-01-24 23:21:48 +03:00
{
"name": "",
"args": "nBits",
"params": "nBits int",
"call": "d.tryBigIntEndianSign(nBits, d.Endian, true)",
"doc": "nBits bits signed integer in current endian"
},
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{
"name": "E",
"args": "nBits, endian",
"params": "nBits int, endian Endian",
"call": "d.tryBigIntEndianSign(nBits, endian, true)",
"doc": "nBits signed integer in specified endian"
},
bitio,decode: Refactor bitio usage and make buffer slicing more correct Remove bitio.Buffer layer. bitio.Buffer was a kitchen sink layer with helpers now it's just a buffer and most functions have been moved to decode instead. bitio package now only have primitive types and functions simialar to standard library io and bytes packages. Make nearly eveything internally use bitio.Bit* interfaces so that slicing work correctly this will also make it possible to start experimenting with more complicated silcing helpers, ex things like: breplace(.header.bitrate; 123) to get a new buffer with bitrate changed.
2022-01-24 23:21:48 +03:00
{
"name": "LE",
"args": "nBits",
"params": "nBits int",
"call": "d.tryBigIntEndianSign(nBits, LittleEndian, true)",
"doc": "nBits bit signed integer in little-endian"
},
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{"name": "BE", "args": "nBits", "params": "nBits int", "call": "d.tryBigIntEndianSign(nBits, BigEndian, true)", "doc": "nBits bit signed integer in big-endian"}
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
]
},
{
"name": "F",
"type": "F",
"variants": [
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{"name": "", "args": "nBits", "params": "nBits int", "call": "d.tryFEndian(nBits, d.Endian)", "doc": "nBit IEEE 754 float in current endian"},
bitio,decode: Refactor bitio usage and make buffer slicing more correct Remove bitio.Buffer layer. bitio.Buffer was a kitchen sink layer with helpers now it's just a buffer and most functions have been moved to decode instead. bitio package now only have primitive types and functions simialar to standard library io and bytes packages. Make nearly eveything internally use bitio.Bit* interfaces so that slicing work correctly this will also make it possible to start experimenting with more complicated silcing helpers, ex things like: breplace(.header.bitrate; 123) to get a new buffer with bitrate changed.
2022-01-24 23:21:48 +03:00
{
"name": "E",
"args": "nBits, endian",
"params": "nBits int, endian Endian",
"call": "d.tryFEndian(nBits, endian)",
"doc": "nBit IEEE 754 float in specified endian"
},
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{"name": "16", "args": "", "params": "", "call": "d.tryFEndian(16, d.Endian)", "doc": "16 bit IEEE 754 float in current endian"},
{"name": "32", "args": "", "params": "", "call": "d.tryFEndian(32, d.Endian)", "doc": "32 bit IEEE 754 float in current endian"},
{"name": "64", "args": "", "params": "", "call": "d.tryFEndian(64, d.Endian)", "doc": "64 bit IEEE 754 float in current endian"},
{"name": "16LE", "args": "", "params": "", "call": "d.tryFEndian(16, LittleEndian)", "doc": "16 bit IEEE 754 float in little-endian"},
{"name": "32LE", "args": "", "params": "", "call": "d.tryFEndian(32, LittleEndian)", "doc": "32 bit IEEE 754 float in little-endian"},
{"name": "64LE", "args": "", "params": "", "call": "d.tryFEndian(64, LittleEndian)", "doc": "64 bit IEEE 754 float in little-endian"},
{"name": "16BE", "args": "", "params": "", "call": "d.tryFEndian(16, BigEndian)", "doc": "16 bit IEEE 754 float in big-endian"},
{"name": "32BE", "args": "", "params": "", "call": "d.tryFEndian(32, BigEndian)", "doc": "32 bit IEEE 754 float in big-endian"},
{"name": "64BE", "args": "", "params": "", "call": "d.tryFEndian(64, BigEndian)", "doc": "64 bit IEEE 754 float in big-endian"}
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
]
},
{
"name": "FP",
"type": "F",
"variants": [
{
"name": "",
"args": "nBits, fBits",
mp4: Add tapt, prof, enof and clap boxes
2021-11-19 17:24:53 +03:00
"params": "nBits int, fBits int",
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
"call": "d.tryFPEndian(nBits, fBits, d.Endian)",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"doc": "nBits fixed-point number in current endian"
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
{
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"name": "E",
"args": "nBits, fBits, endian",
mp4: Add tapt, prof, enof and clap boxes
2021-11-19 17:24:53 +03:00
"params": "nBits int, fBits int, endian Endian",
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
"call": "d.tryFPEndian(nBits, fBits, endian)",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"doc": "nBits fixed-point number in specified endian"
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
decode,interp: Add arbitrary large integer support (BigInt) Was already handled in fq in various places as gojq uses them Update msgpack to support negative integers that can't represented as int64 Rename read try* number functions to make them more explicit
2022-01-14 03:58:42 +03:00
{"name": "16", "args": "", "params": "", "call": "d.tryFPEndian(16, 8, d.Endian)", "doc": "16 bit fixed-point number in current endian"},
{"name": "32", "args": "", "params": "", "call": "d.tryFPEndian(32, 16, d.Endian)", "doc": "32 bit fixed-point number in current endian"},
{"name": "64", "args": "", "params": "", "call": "d.tryFPEndian(64, 32, d.Endian)", "doc": "64 bit fixed-point number in current endian"},
{"name": "16LE", "args": "", "params": "", "call": "d.tryFPEndian(16, 8, LittleEndian)", "doc": "16 bit fixed-point number in little-endian"},
{"name": "32LE", "args": "", "params": "", "call": "d.tryFPEndian(32, 16, LittleEndian)", "doc": "32 bit fixed-point number in little-endian"},
{"name": "64LE", "args": "", "params": "", "call": "d.tryFPEndian(64, 32, LittleEndian)", "doc": "64 bit fixed-point number in little-endian"},
{"name": "16BE", "args": "", "params": "", "call": "d.tryFPEndian(16, 8, BigEndian)", "doc": "16 bit fixed-point number in big-endian"},
{"name": "32BE", "args": "", "params": "", "call": "d.tryFPEndian(32, 16, BigEndian)", "doc": "32 bit fixed-point number in big-endian"},
{"name": "64BE", "args": "", "params": "", "call": "d.tryFPEndian(64, 32, BigEndian)", "doc": "64 bit fixed-point number in big-endian"}
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
]
},
{
"name": "Unary",
"type": "U",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"variants": [ {"name": "", "args": "ov", "params": "ov uint64", "call": "d.tryUnary(ov)", "doc": "unary integer using ov as \"one\" value"} ]
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
{
"type": "Str",
"name": "UTF",
"variants": [
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
{"name": "8", "args": "nBytes", "params": "nBytes int", "call": "d.tryText(nBytes, UTF8BOM)", "doc": "nBytes bytes UTF8 string"},
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
{
"name": "16",
"args": "nBytes",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"params": "nBytes int",
"call": "d.tryText(nBytes, UTF16BOM)",
"doc": "nBytes bytes UTF16 string, default big-endian and accepts BOM"
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
{"name": "16LE", "args": "nBytes", "params": "nBytes int", "call": "d.tryText(nBytes, UTF16LE)", "doc": "nBytes bytes UTF16 little-endian string"},
{"name": "16BE", "args": "nBytes", "params": "nBytes int", "call": "d.tryText(nBytes, UTF16BE)", "doc": "nBytes bytes UTF16 big-endian string"}
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
]
},
{
"name": "UTF8ShortString",
"type": "Str",
"variants": [
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
{"name": "", "args": "", "params": "", "call": "d.tryTextLenPrefixed(8, -1, UTF8BOM)", "doc": "one byte length fixed UTF8 string"},
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
{
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"name": "FixedLen",
"args": "fixedBytes",
"params": "fixedBytes int",
"call": "d.tryTextLenPrefixed(8, fixedBytes, UTF8BOM)",
"doc": "fixedBytes bytes long one byte length prefixed UTF8 string"
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
}
]
},
{
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"name": "UTF8Null",
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
"type": "Str",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"variants": [ {"name": "", "args": "", "params": "", "call": "d.tryTextNull(1, UTF8BOM)", "doc": "null terminated UTF8 string"} ]
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
},
{
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"name": "UTF8NullFixedLen",
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
"type": "Str",
"variants": [
{
"name": "",
"args": "fixedBytes",
decode: Nicer scalar template and add doc
2021-11-17 18:13:10 +03:00
"params": "fixedBytes int",
"call": "d.tryTextNullLen(fixedBytes, UTF8BOM)",
"doc": "fixedBytes bytes long null terminated UTF8 string"
decode: Major decode API refactor Generate more code More generic and comfortable API Improve and Update format decoder to new API Add some more format tests
2021-11-05 17:04:26 +03:00
}
]
}
]
}
Reference in New Issue Copy Permalink