Commit Graph

2236 Commits

Author SHA1 Message Date
Sandeep Singh
ca398ed3ab
Merge pull request #1934 from projectdiscovery/dev
httpx v1.6.9 release prep
2024-10-21 03:56:10 +05:30
sandeep
719aa8be74 readme update 2024-10-21 03:49:03 +05:30
sandeep
5fac22544b version update 2024-10-21 03:46:31 +05:30
Dogan Can Bakir
b8f40c695e
do not store failed reqs (#1954)
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2024-10-21 03:38:11 +05:30
Dogan Can Bakir
2f16a472f5
filter out near duplicate responses (#1951)
* filter out near duplicate responses

* use ACR cache

* lint + msg

* skip asn

* optional asn

* more opt

* Update runner.go

---------

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2024-10-21 03:29:20 +05:30
Dogan Can Bakir
0c9bba73d7
introduce page type classifier (#1924)
* introduce page type classifier

* add more data
2024-10-21 02:30:36 +05:30
Mzack9999
7cfd7147c2
Merge pull request #1937 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/dsl-0.2.5
chore(deps): bump github.com/projectdiscovery/dsl from 0.2.1 to 0.2.5
2024-10-07 19:44:09 +02:00
dependabot[bot]
42e064ada2
Merge pull request #1935 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/rawhttp-0.1.68 2024-10-07 10:48:32 +00:00
dependabot[bot]
2a50a8a4a6
Merge pull request #1941 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/wappalyzergo-0.1.22 2024-10-07 10:47:52 +00:00
dependabot[bot]
b6a324f74b
chore(deps): bump github.com/projectdiscovery/rawhttp
Bumps [github.com/projectdiscovery/rawhttp](https://github.com/projectdiscovery/rawhttp) from 0.1.67 to 0.1.68.
- [Release notes](https://github.com/projectdiscovery/rawhttp/releases)
- [Commits](https://github.com/projectdiscovery/rawhttp/compare/v0.1.67...v0.1.68)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/rawhttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-10-07 10:43:18 +00:00
dependabot[bot]
fa20ee9b24
chore(deps): bump github.com/projectdiscovery/wappalyzergo
Bumps [github.com/projectdiscovery/wappalyzergo](https://github.com/projectdiscovery/wappalyzergo) from 0.1.16 to 0.1.22.
- [Release notes](https://github.com/projectdiscovery/wappalyzergo/releases)
- [Commits](https://github.com/projectdiscovery/wappalyzergo/compare/v0.1.16...v0.1.22)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/wappalyzergo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-10-07 10:43:16 +00:00
dependabot[bot]
ff83cea849
Merge pull request #1940 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/retryablehttp-go-1.0.81 2024-10-07 10:42:23 +00:00
dependabot[bot]
807503d009
chore(deps): bump github.com/projectdiscovery/retryablehttp-go
Bumps [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) from 1.0.79 to 1.0.81.
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.0.79...v1.0.81)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-10-07 10:37:48 +00:00
dependabot[bot]
7bdd88b9bd
chore(deps): bump github.com/projectdiscovery/dsl from 0.2.1 to 0.2.5
Bumps [github.com/projectdiscovery/dsl](https://github.com/projectdiscovery/dsl) from 0.2.1 to 0.2.5.
- [Release notes](https://github.com/projectdiscovery/dsl/releases)
- [Commits](https://github.com/projectdiscovery/dsl/compare/v0.2.1...v0.2.5)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/dsl
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-30 11:00:17 +00:00
dependabot[bot]
c9e3829552
Merge pull request #1926 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/rawhttp-0.1.67 2024-09-23 11:01:32 +00:00
dependabot[bot]
8a6cac96a9
chore(deps): bump github.com/projectdiscovery/rawhttp
Bumps [github.com/projectdiscovery/rawhttp](https://github.com/projectdiscovery/rawhttp) from 0.1.66 to 0.1.67.
- [Release notes](https://github.com/projectdiscovery/rawhttp/releases)
- [Commits](https://github.com/projectdiscovery/rawhttp/compare/v0.1.66...v0.1.67)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/rawhttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-23 10:56:29 +00:00
dependabot[bot]
7e6000a0dc
Merge pull request #1927 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/gologger-1.1.25 2024-09-23 10:55:35 +00:00
dependabot[bot]
3bd1092a81
Merge pull request #1929 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/retryablehttp-go-1.0.79 2024-09-23 10:55:06 +00:00
dependabot[bot]
86d4bb8b70
chore(deps): bump github.com/projectdiscovery/gologger
Bumps [github.com/projectdiscovery/gologger](https://github.com/projectdiscovery/gologger) from 1.1.23 to 1.1.25.
- [Release notes](https://github.com/projectdiscovery/gologger/releases)
- [Commits](https://github.com/projectdiscovery/gologger/compare/v1.1.23...v1.1.25)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/gologger
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-23 10:50:11 +00:00
dependabot[bot]
631ec2af57
chore(deps): bump github.com/projectdiscovery/retryablehttp-go
Bumps [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) from 1.0.78 to 1.0.79.
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.0.78...v1.0.79)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-23 10:50:05 +00:00
dependabot[bot]
e65b298069
Merge pull request #1928 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/clistats-0.1.1 2024-09-23 10:49:16 +00:00
dependabot[bot]
12fa4a0051
Merge pull request #1925 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/utils-0.2.11 2024-09-23 10:48:35 +00:00
dependabot[bot]
283bf7967b
chore(deps): bump github.com/projectdiscovery/clistats
Bumps [github.com/projectdiscovery/clistats](https://github.com/projectdiscovery/clistats) from 0.1.0 to 0.1.1.
- [Release notes](https://github.com/projectdiscovery/clistats/releases)
- [Commits](https://github.com/projectdiscovery/clistats/compare/v0.1.0...v0.1.1)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/clistats
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-23 10:43:30 +00:00
dependabot[bot]
0b2ee56fe2
chore(deps): bump github.com/projectdiscovery/utils
Bumps [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) from 0.2.10 to 0.2.11.
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.2.10...v0.2.11)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/utils
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-23 10:43:14 +00:00
Dogan Can Bakir
a5f8198169
add auth cred file flag (#1912)
* add auth cred file flag

* update readme

* rename
2024-09-16 23:59:37 +05:30
Mzack9999
db72bb2902
Adding trace (#1883)
* adding trace

* using retryablehttp

* syntax error

---------

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2024-09-16 23:56:21 +05:30
Mzack9999
d6082fd505
Merge pull request #1917 from michael2to3/feat/wait-after-screenshot
Added Idle Time Before Screenshot Capture
2024-09-16 19:18:13 +02:00
Mzack9999
2455adc7da Merge branch 'dev' into pr/1917 2024-09-16 19:12:19 +02:00
Mzack9999
8e48bde09c using duration var 2024-09-16 19:11:04 +02:00
dependabot[bot]
230f59eae0
Merge pull request #1921 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/rawhttp-0.1.66 2024-09-16 11:07:48 +00:00
dependabot[bot]
238235563e
chore(deps): bump github.com/projectdiscovery/rawhttp
Bumps [github.com/projectdiscovery/rawhttp](https://github.com/projectdiscovery/rawhttp) from 0.1.63 to 0.1.66.
- [Release notes](https://github.com/projectdiscovery/rawhttp/releases)
- [Commits](https://github.com/projectdiscovery/rawhttp/compare/v0.1.63...v0.1.66)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/rawhttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-16 11:03:08 +00:00
dependabot[bot]
a697a75a58
Merge pull request #1922 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/tlsx-1.1.7 2024-09-16 11:02:12 +00:00
dependabot[bot]
56184e2f81
chore(deps): bump github.com/projectdiscovery/tlsx from 1.1.6 to 1.1.7
Bumps [github.com/projectdiscovery/tlsx](https://github.com/projectdiscovery/tlsx) from 1.1.6 to 1.1.7.
- [Release notes](https://github.com/projectdiscovery/tlsx/releases)
- [Changelog](https://github.com/projectdiscovery/tlsx/blob/main/.goreleaser.yml)
- [Commits](https://github.com/projectdiscovery/tlsx/compare/v1.1.6...v1.1.7)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/tlsx
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-16 10:56:14 +00:00
dependabot[bot]
0a0018b0df
Merge pull request #1919 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/utils-0.2.10 2024-09-16 10:55:26 +00:00
dependabot[bot]
894aea4adb
Merge pull request #1920 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/fastdialer-0.2.9 2024-09-16 10:55:23 +00:00
dependabot[bot]
0926e385a5
chore(deps): bump github.com/projectdiscovery/utils from 0.2.9 to 0.2.10
Bumps [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) from 0.2.9 to 0.2.10.
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.2.9...v0.2.10)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/utils
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-16 10:50:59 +00:00
dependabot[bot]
c741b21837
chore(deps): bump github.com/projectdiscovery/fastdialer
Bumps [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer) from 0.2.7 to 0.2.9.
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases)
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.2.7...v0.2.9)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/fastdialer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-16 10:50:43 +00:00
dependabot[bot]
2208b3f977
Merge pull request #1918 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/retryablehttp-go-1.0.78 2024-09-16 10:49:54 +00:00
dependabot[bot]
b77e16f599
chore(deps): bump github.com/projectdiscovery/retryablehttp-go
Bumps [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) from 1.0.76 to 1.0.78.
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.0.76...v1.0.78)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-16 10:45:14 +00:00
Mikhail Gaile
4e33c0c926
feat: add idle screenshot option 2024-09-15 13:32:06 +03:00
dependabot[bot]
ec694a6e53
Merge pull request #1907 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/utils-0.2.9 2024-09-09 10:39:13 +00:00
dependabot[bot]
58f46ff55c
chore(deps): bump github.com/projectdiscovery/utils from 0.2.7 to 0.2.9
Bumps [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) from 0.2.7 to 0.2.9.
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.2.7...v0.2.9)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/utils
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-09 10:32:56 +00:00
dependabot[bot]
c5ffe7f015
Merge pull request #1910 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/useragent-0.0.69 2024-09-09 10:31:55 +00:00
dependabot[bot]
e051552d01
chore(deps): bump github.com/projectdiscovery/useragent
Bumps [github.com/projectdiscovery/useragent](https://github.com/projectdiscovery/useragent) from 0.0.68 to 0.0.69.
- [Release notes](https://github.com/projectdiscovery/useragent/releases)
- [Commits](https://github.com/projectdiscovery/useragent/compare/v0.0.68...v0.0.69)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/useragent
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-09 10:25:50 +00:00
dependabot[bot]
f563220a48
Merge pull request #1909 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/gologger-1.1.23 2024-09-09 10:25:17 +00:00
dependabot[bot]
f3d196884a
Merge pull request #1908 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/freeport-0.0.7 2024-09-09 10:25:00 +00:00
dependabot[bot]
c86c63590d
Merge pull request #1906 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/ratelimit-0.0.54 2024-09-09 10:24:30 +00:00
dependabot[bot]
9e69a123e4
chore(deps): bump github.com/projectdiscovery/gologger
Bumps [github.com/projectdiscovery/gologger](https://github.com/projectdiscovery/gologger) from 1.1.21 to 1.1.23.
- [Release notes](https://github.com/projectdiscovery/gologger/releases)
- [Commits](https://github.com/projectdiscovery/gologger/compare/v1.1.21...v1.1.23)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/gologger
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-09 10:19:40 +00:00
dependabot[bot]
10320cc683
chore(deps): bump github.com/projectdiscovery/freeport
Bumps [github.com/projectdiscovery/freeport](https://github.com/projectdiscovery/freeport) from 0.0.5 to 0.0.7.
- [Release notes](https://github.com/projectdiscovery/freeport/releases)
- [Commits](https://github.com/projectdiscovery/freeport/compare/v0.0.5...v0.0.7)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/freeport
  dependency-type: indirect
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-09 10:19:36 +00:00
dependabot[bot]
0d65af3620
chore(deps): bump github.com/projectdiscovery/ratelimit
Bumps [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit) from 0.0.49 to 0.0.54.
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases)
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.49...v0.0.54)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/ratelimit
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-09-09 10:19:29 +00:00