Commit Graph

190 Commits

Author SHA1 Message Date
Sami
c90b897eba
list-dsl flag to list json output keys which can be further used with matchers / filters (#768)
* flag list-dsl

* variable name update

* used reflect to dnymically access DSL variables

* aligned with the changes in dev branch

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-09-19 22:50:40 +05:30
Ice3man
674b792770
Fixed connection pooling with cancelable timeout (#763) 2022-09-15 22:57:26 +05:30
Ice3man
9b4a2ecb0f
Added tlsx integration for probing and grabbing (#767)
* Added tlsx integration for probing and grabbing

* Added additional TLS required fields
2022-09-15 20:33:51 +05:30
Sami
d491201eff
Issue 735+issue 739 (#757)
* adding strings.ToLower to headers

* added validation logic for flags

* validated silent flag with incompatible flags

* silent flag bug fix

* added test case

* updated test case to include multiple headers
2022-09-13 16:46:38 +05:30
forgedhallpass
c48909f64f
Minor fixes and improvements (#726)
* Added .idea to .gitignore

* Updated the README

* Added more verbose information on preset extractors

* removing deprecated ioutil

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-08-17 03:16:06 +04:00
Mzack9999
21ca2621bd
Fixing and improving custom ports handling (#714)
* Fixing and improving custom ports

* adding test case from https://github.com/projectdiscovery/httpx/pull/713
2022-07-31 20:54:34 +05:30
Ice3man
90a32dd65f
Added connection pooling for jarm conn + fastdialer (#707)
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2022-07-25 18:40:06 +05:30
Its Hex !
8d0a34f28a
Update go.mod (#689)
* Exposing regex matches to json output (#668)

* Update runner.go

Fix regex json output.

* small refactor

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>

* Update go.mod

* fixing jarm-go reference

* removing redundant declaration

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: Dothelm <49758889+st3rv04ka@users.noreply.github.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-07-11 03:09:43 +05:30
Sami
89cf7396b7
modified error message with invalid ports (#677)
* modified error message with invalid ports

* updated ValidateCustomPorts function
2022-07-07 20:04:31 +05:30
Mzack9999
dfab811ff9
removing redundant regex (#676) 2022-07-05 23:37:08 +05:30
Mzack9999
310294649f
Improving HTML decoding (#673) 2022-06-27 13:36:42 +05:30
M09Ic
cd18edc689
support multi -extract-regex flag and json output (#529)
* Add hashes flag, to support multi body hash type. issue:489 and issue:488

* go mod update

* Add hash type validate for -hash flag

* support multi extract regexps

* support extract regexps matches for json output

* support extract regexp preset

* extract result deduplicate

* small changes

* lint ignore

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-06-13 17:48:00 +05:30
Mzack9999
ee655bbdcd
Adding Client TLS1.0 (#645) 2022-05-31 03:43:31 +05:30
Mzack9999
daf4ad6c5a
Fixing all ips probe with ports (#626)
* Fixing all ips probe with standard ports

* using custom type for targets
2022-05-19 14:59:07 +05:30
mzack
f0430675d8 Fixing SNI for HTTP transport 2022-05-10 19:43:58 +02:00
Miguel Ángel Jimeno
032c535292 httpx: consider CDN check error as non-fatal
Fixes #599
2022-05-03 10:31:41 +02:00
mzack
06f1c2c4c5 Adding support for custom SNI name 2022-04-15 17:41:57 +02:00
Sami
ccf0c9ddc5
Issue 549 jarm algorithm (#567)
* jarm hash

* lint error fix

* remove default jarm value if jarm not calculated

* jarm cli boolean flag

* removed unused hash type

* readme update

* example update

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2022-04-08 18:50:03 +05:30
mzack
987131a20b Adding custom cookies supports in redirects 2022-03-29 19:34:55 +02:00
mzack
ffb2079dfb Adding CSP parsing form HTML meta 2022-03-22 16:47:55 +01:00
LuitelSamikshya
faab923bd4 display first title 2022-03-15 15:28:45 -05:00
Sami
03ded973d8
hash improvement (#528)
* hash improvement

* mmh3 conversion to int32

* misc update

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-03-01 12:05:06 +05:30
M09Ic
e2b0c1683b
Add hash flag, to support multi body hash type. (#517)
* Add hashes flag, to support multi body hash type. issue:489 and issue:488

* go mod update

* Add hash type validate for -hash flag

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-02-15 17:32:33 +05:30
Sandeep Singh
09b278bc86
Merge pull request #499 from projectdiscovery/cdn-name-expose
Expose CDN Name in output and json
2022-02-07 19:18:17 +05:30
mzack
eb3787518f Adding support for euc-kr charset 2022-02-02 07:18:57 +01:00
Ice3man
6c6d3e334f Expose cdnname in output and json 2022-01-15 05:50:41 +05:30
Mzack9999
bee964315c
Add support for favicon hash (#476)
* Add support for favicon hash

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-01-07 17:28:07 +05:30
mzack
96a511ad48 Adding support for custom resolvers 2021-12-28 07:46:42 +01:00
Alexey Zhuchkov
9481594528
Add probe-all-ips feature (#427)
* Add probe-all-ips flag

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2021-12-01 12:40:53 +05:30
LuitelSamikshya
59ebd48e88 bug-fix new line with title flag 2021-11-29 13:15:59 -06:00
mzack
1b89056d8a Adding max recursion level for self-dos on recursive load function 2021-10-16 14:37:54 +02:00
z0ne
9b53795521 Fixing follow-host-redirects option when customizing the host request header 2021-10-15 15:31:08 +08:00
Sandeep Singh
abb8d7d5a6
Merge pull request #404 from sullo/dev
Typo fixes
2021-09-21 00:27:02 +05:30
sullo
306aa2515b Typo fixes 2021-09-20 13:05:39 -04:00
sullo
ad559f308e logger error message updates:
- missing word in runner.go file errors
- various consistency cleanup.
2021-09-14 13:06:35 -04:00
Sandeep Singh
9ff0732c99
Merge pull request #389 from projectdiscovery/388-bugfix-content-length
Fixing content-length calculation
2021-09-06 15:58:02 +05:30
mzack
fc77c54395 Fixing content-length calculation 2021-09-03 15:50:17 +02:00
mzack
0bebb4aec3 Disabling automatic UA if user defines one 2021-08-30 17:13:22 +02:00
Sandeep Singh
2fa91f9e12
Merge pull request #375 from projectdiscovery/373-bugfix-non-rfc-urls
Fixing input URLs handling with non-rfc paths
2021-08-24 22:37:58 +05:30
mzack
6804cda5e4 using new line as split token for data from file 2021-08-23 01:22:56 +02:00
mzack
7a59d6702b Improving cli parsing for Allow/Deny option 2021-08-22 21:07:23 +02:00
mzack
57c1244a16 Fixing input URLs handling with non-rfc paths 2021-08-22 19:26:28 +02:00
mzack
b07da83b5e Adding cli options dedupe for ports 2021-08-17 14:42:14 +02:00
mzack
06bb53bbc8 Merge branch 'dev' into 354-bugfix-custom-ports-with-scheme 2021-08-17 14:37:10 +02:00
Mzack9999
4ca01fe686
Merge pull request #369 from projectdiscovery/348-bugfix-content-length-head
Improving case behavior with methods CLI option
2021-08-17 00:29:11 +02:00
mzack
1e2e2d54e9 Handling edge case with head method and unresponsive server 2021-08-16 19:10:12 +02:00
mzack
5919040a93 Fixing inconsistent behavior for custom ports with schemes 2021-08-16 15:53:28 +02:00
mzack
89f77e50d2 Adding support for maximum redirects number 2021-08-16 14:25:30 +02:00
mzack
ae0c4501de Improving rawhttp timeout handling 2021-08-14 20:19:53 +02:00
Mzack9999
949dab612e
Merge pull request #338 from projectdiscovery/issue-328-exclude-cdn
[Feature] Adding support to scan only ports 80/443 if the ip is part of CDN range
2021-08-07 14:13:09 +02:00