Pavel Safonov
e66baa75f3
postgres: add wal checks
2022-09-12 13:40:59 +03:00
Pavel Safonov
e311434b8f
postgres: wal decoding implement
2022-09-12 13:19:32 +03:00
Pavel Safonov
8e27e30f89
Merge branch 'wader_master' into postgres
2022-09-09 17:30:33 +03:00
Pavel Safonov
dc6ed54437
Merge branch 'master' into postgres
2022-09-09 17:18:20 +03:00
Pavel Safonov
8f57ebf00b
Merge remote-tracking branch 'github/master'
2022-09-09 17:18:09 +03:00
Pavel Safonov
6281b50ddd
postgres: exclude wal tests for now
2022-09-09 17:14:30 +03:00
Mattias Wadman
e98adfaa03
Merge pull request #421 from wader/elf-notes
...
elf: Basic program header notes decoding
2022-09-09 14:48:02 +02:00
Mattias Wadman
5382d46a9a
elf: Basic program header notes decoding
...
Used in coredump to record various statees but also used in executables.
Next step would be to decode the note descriptions, like register info, file mappings etc.
Maybe a bit tricky as it is os/abi specific.
2022-09-09 14:35:35 +02:00
Pavel Safonov
1d9ef300b9
postgres: first correct read of WAL file
2022-09-09 15:16:48 +03:00
Mattias Wadman
2a5a53447c
Merge pull request #420 from piggynl/patch-1
...
test: Skip go test with -race by default
2022-09-09 09:40:38 +02:00
Piggy NL
808202fa34
test: Skip go test with -race by default
2022-09-09 15:15:18 +08:00
Pavel Safonov
586c803fa5
postgres: try to implement wal
2022-09-09 07:55:36 +03:00
Mattias Wadman
ee6691728f
Merge pull request #419 from wader/bump-github-go-version-1.19.1
...
Update github-go-version from 1.19.0, 1.19.0, 1.19.0 to 1.19.1
2022-09-07 18:15:01 +02:00
Mattias Wadman
4096de99bd
Merge pull request #418 from wader/bump-docker-golang-1.19.1
...
Update docker-golang from 1.19.0 to 1.19.1
2022-09-07 18:11:40 +02:00
bump
c47c3866c4
Update github-go-version from 1.19.0, 1.19.0, 1.19.0 to 1.19.1
2022-09-07 16:03:48 +00:00
bump
84ca1010e3
Update docker-golang from 1.19.0 to 1.19.1
2022-09-07 16:03:45 +00:00
Pavel Safonov
c2591ac80a
postgres: add test data with specific values
2022-09-07 14:14:11 +03:00
Pavel Safonov
85c042289d
postgres: fix linter
2022-09-06 12:55:15 +03:00
Mattias Wadman
f617f39a9a
Merge pull request #417 from wader/elf-more-robust
...
elf: Treat missing string tables as empty to be more robust
2022-09-06 11:40:38 +02:00
Mattias Wadman
12105d8c1d
elf: Treat missing string tables as empty to be more robust
...
Makes it possible to decode shellcode snippets etc:
$ fq -n '"f0VMRgIBAQAAAAAAAAAAAAIAPgABAAAAeABAAAAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAEAAOAABAAAAAAAAAAEAAAAFAAAAAAAAAAAAAAAAAEAAAAAAAAAAQAAAAAAAAAAAAAEAAAAAAAAAAQAAAAAAIAAAAAAAsDxmvwYADwU=" | frombase64 | elf | d'
|00 01 02 03 04 05 06 07 08 09 0a 0b 0c 0d 0e 0f|0123456789abcdef|.{}: (elf)
| | | error: elf: BitBufRange: failed at position 0 (read size 4294967296 seek pos 0): outside buffer
| | | header{}:
| | | ident{}:
0x00|7f 45 4c 46 |.ELF | magic: raw bits (valid)
0x00| 02 | . | class: 64 (2)
0x00| 01 | . | data: "little_endian" (1)
0x00| 01 | . | version: 1
0x00| 00 | . | os_abi: "sysv" (0)
0x00| 00 | . | abi_version: 0
0x00| 00 00 00 00 00 00 00| .......| pad: raw bits (all zero)
0x10|02 00 |.. | type: "exec" (0x2)
0x10| 3e 00 | >. | machine: "x86_64" (0x3e) (AMD x86-64)
0x10| 01 00 00 00 | .... | version: 1
0x10| 78 00 40 00 00 00 00 00| x.@.....| entry: 4194424
0x20|40 00 00 00 00 00 00 00 |@....... | phoff: 64
0x20| 00 00 00 00 00 00 00 00| ........| shoff: 0
0x30|00 00 00 00 |.... | flags: 0
0x30| 40 00 | @. | ehsize: 64
0x30| 38 00 | 8. | phentsize: 56
0x30| 01 00 | .. | phnum: 1
0x30| 00 00 | .. | shentsize: 0
0x30| 00 00 | .. | shnum: 0
0x30| 00 00| ..| shstrndx: 0
| | | program_headers[0:1]:
| | | [0]{}: program_header
0x40|01 00 00 00 |.... | type: "load" (1) (Loadable segment)
| | | flags{}:
0x40| 05 | . | unused0: 0
0x40| 05 | . | r: true
0x40| 05 | . | w: false
0x40| 05 | . | x: true
0x40| 00 00 00 | ... | unused1: 0
0x40| 00 00 00 00 00 00 00 00| ........| offset: 0x0
0x50|00 00 40 00 00 00 00 00 |..@..... | vaddr: 0x400000
0x50| 00 00 40 00 00 00 00 00| ..@.....| paddr: 0x400000
0x60|00 00 00 00 01 00 00 00 |........ | filesz: 4294967296
0x60| 00 00 00 00 01 00 00 00| ........| memsz: 4294967296
0x70|00 00 20 00 00 00 00 00 |.. ..... | align: 2097152
0x70| b0 3c 66 bf 06 00 0f 05| .<f.....| unknown0: raw bits
$ fq -n '"f0VMRgIBAQAAAAAAAAAAAAIAPgABAAAAeABAAAAAAABAAAAAAAAAAAAAAAAAAAAAAAAAAEAAOAABAAAAAAAAAAEAAAAFAAAAAAAAAAAAAAAAAEAAAAAAAAAAQAAAAAAAAAAAAAEAAAAAAAAAAQAAAAAAIAAAAAAAsDxmvwYADwU=" | frombase64 | . as $b | elf | $b[.header.entry-.program_headers[0].vaddr:]' | ndisasm -b 64 -
00000000 B03C mov al,0x3c
00000002 66BF0600 mov di,0x6
00000006 0F05 syscall
2022-09-06 11:31:48 +02:00
Pavel Safonov
f224ed000e
postgres: refactoring
2022-09-06 10:23:08 +03:00
Pavel Safonov
ff4b6fdf14
postgres: refactoring - remove GetHeapD
2022-09-06 10:19:52 +03:00
Pavel Safonov
5eea605f12
postgres: remove duplicate tests
2022-09-06 09:27:40 +03:00
Pavel Safonov
1e24d70e45
postgres: move SeekAbs(0) to Probe
2022-09-06 09:27:04 +03:00
Pavel Safonov
ccf2edb526
postgres: better versions probing in pg_control, fix holes, better tests
2022-09-06 09:20:10 +03:00
Pavel Safonov
3e09f9f12d
postgres: change tuple struct in heap
2022-09-05 15:01:59 +03:00
Pavel Safonov
ba8b90ba81
postgres: fill gap alignment in heap tuple
2022-09-05 14:54:42 +03:00
Pavel Safonov
666bbfba29
postgres: fix some unknown, chanche tests tovalue -> dv
2022-09-05 12:50:59 +03:00
Pavel Safonov
4db1284f06
postgres: add tests
2022-09-02 16:21:27 +03:00
Pavel Safonov
d58860580a
Merge branch 'master' of github.com:pnsafonov/fq into postgres
2022-09-02 16:16:19 +03:00
Pavel Safonov
08eb303435
postgres: add postgres format docs, refactoing postgres flavours
2022-09-02 16:14:24 +03:00
Pavel Safonov
9f5036a311
postgres: made root an array
2022-09-02 11:53:35 +03:00
Pavel Safonov
2ee01f79c2
allow to change FillGaps in decoder
2022-09-02 09:03:08 +03:00
Mattias Wadman
0f853bda22
Merge pull request #414 from wader/html-array-doctype-etc
...
html: Handle html with leading doctype etc
2022-09-01 23:09:34 +02:00
Mattias Wadman
8016352b3b
html: Handle html with leading doctype etc
2022-09-01 22:58:48 +02:00
Mattias Wadman
df1a81ed26
Merge pull request #413 from wader/decode-remove-rangesort
...
decode: Remove RangeSorted flag as we can decide on array/struct instead
2022-09-01 17:55:25 +02:00
Mattias Wadman
a6429ffe7a
decode: Remove RangeSorted flag as we can decide on array/struct instead
2022-09-01 17:45:28 +02:00
Mattias Wadman
a1cade5390
Merge pull request #412 from wader/interp-decode-struct-byname
...
interp,decode: For struct use map to lookup field
2022-09-01 11:44:02 +02:00
Mattias Wadman
768df3012c
interp,decode: For struct use map to lookup field
...
Will make it faster for struct with logs of fields and seems to
not cuase any significant difference for small structs.
All this really needs a rewrite somehow, maybe refactor into interfaces somehow? getting messy.
2022-09-01 11:35:19 +02:00
Mattias Wadman
16ebdc1f39
Merge pull request #411 from pnsafonov/perf2
...
perfomance: increase performance by map usage
2022-09-01 09:47:51 +02:00
Pavel Safonov
7cd43b4919
perfomance: increase performance by map usage
2022-09-01 09:36:50 +03:00
Pavel Safonov
b4c4de26ca
Merge remote-tracking branch 'github/master'
2022-08-31 12:17:14 +03:00
Mattias Wadman
6748b4dccf
Merge pull request #407 from wader/more-golang-x-exp
...
generics: Use more from x/exp
2022-08-31 11:03:30 +02:00
Mattias Wadman
226a9a3e08
generics: Use more from x/exp
2022-08-31 10:50:56 +02:00
Pavel Safonov
f56c72d353
add postgres tests for mem, cpu profiling
2022-08-31 11:20:50 +03:00
Mattias Wadman
e14cb49ba9
Merge pull request #406 from wader/range-sort-speedup
...
range,decode: Use own range sort impl to speed up a bit
2022-08-30 19:49:09 +02:00
Mattias Wadman
6a6fec54f5
range,decode: Use own range sort impl to speed up a bit
2022-08-30 15:24:19 +02:00
Mattias Wadman
a87616763e
Merge pull request #405 from wader/sort-refactor
...
sortex: Package with type safe sort helpers
2022-08-30 11:11:10 +02:00
Mattias Wadman
7d86534348
sortex: Package with type safe sort helpers
2022-08-30 11:02:57 +02:00
Mattias Wadman
e0bd489668
Merge pull request #404 from wader/matroska-lacing
...
matroska: Add proper lacing support
2022-08-28 21:13:50 +02:00
