Commit Graph

2061 Commits

Author SHA1 Message Date
dependabot[bot]
3fbc7f005c
chore(deps): bump github.com/projectdiscovery/utils from 0.1.4 to 0.1.5
Bumps [github.com/projectdiscovery/utils](https://github.com/projectdiscovery/utils) from 0.1.4 to 0.1.5.
- [Release notes](https://github.com/projectdiscovery/utils/releases)
- [Changelog](https://github.com/projectdiscovery/utils/blob/main/CHANGELOG.md)
- [Commits](https://github.com/projectdiscovery/utils/compare/v0.1.4...v0.1.5)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/utils
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-24 10:20:14 +00:00
sandeep
1ecf09747c version update 2024-06-22 12:51:57 -07:00
Ramana Reddy
9330887a58
Extract body_domains and body_fqdns to jsonl (#1750)
* Extract body-domains and body-fqdns

* remvove port in domains

* Add test for domains extraction

* misc update

* improve domain regex

* fix test

* extract domain inside quotes

* sanitize urls

* fix test

* minor

* do not embed

* remove js variables fp + improve regex

---------

Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2024-06-23 01:01:43 +05:30
dependabot[bot]
72f4c2cef4
Merge pull request #1765 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/retryablehttp-go-1.0.65 2024-06-17 16:50:32 +00:00
dependabot[bot]
ebb1df4175
Merge pull request #1766 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/wappalyzergo-0.1.6 2024-06-17 16:50:10 +00:00
dependabot[bot]
80a7e69c74
chore(deps): bump github.com/projectdiscovery/retryablehttp-go
Bumps [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) from 1.0.64 to 1.0.65.
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.0.64...v1.0.65)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-17 16:39:32 +00:00
dependabot[bot]
647d156c33
chore(deps): bump github.com/projectdiscovery/wappalyzergo
Bumps [github.com/projectdiscovery/wappalyzergo](https://github.com/projectdiscovery/wappalyzergo) from 0.1.4 to 0.1.6.
- [Release notes](https://github.com/projectdiscovery/wappalyzergo/releases)
- [Commits](https://github.com/projectdiscovery/wappalyzergo/compare/v0.1.4...v0.1.6)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/wappalyzergo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-17 16:39:31 +00:00
dependabot[bot]
74c1237eb6
Merge pull request #1764 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/useragent-0.0.56 2024-06-17 16:38:43 +00:00
dependabot[bot]
534ae56420
chore(deps): bump github.com/projectdiscovery/useragent
Bumps [github.com/projectdiscovery/useragent](https://github.com/projectdiscovery/useragent) from 0.0.54 to 0.0.56.
- [Release notes](https://github.com/projectdiscovery/useragent/releases)
- [Commits](https://github.com/projectdiscovery/useragent/compare/v0.0.54...v0.0.56)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/useragent
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-17 16:32:35 +00:00
dependabot[bot]
ac6c4f8ecb
Merge pull request #1767 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/rawhttp-0.1.54 2024-06-17 16:31:36 +00:00
dependabot[bot]
acda5d4823
Merge pull request #1768 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/goflags-0.1.56 2024-06-17 16:31:04 +00:00
dependabot[bot]
2faaeda99d
chore(deps): bump github.com/projectdiscovery/rawhttp
Bumps [github.com/projectdiscovery/rawhttp](https://github.com/projectdiscovery/rawhttp) from 0.1.52 to 0.1.54.
- [Release notes](https://github.com/projectdiscovery/rawhttp/releases)
- [Commits](https://github.com/projectdiscovery/rawhttp/compare/v0.1.52...v0.1.54)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/rawhttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-17 16:26:23 +00:00
dependabot[bot]
0cab380c6d
chore(deps): bump github.com/projectdiscovery/goflags
Bumps [github.com/projectdiscovery/goflags](https://github.com/projectdiscovery/goflags) from 0.1.54 to 0.1.56.
- [Release notes](https://github.com/projectdiscovery/goflags/releases)
- [Commits](https://github.com/projectdiscovery/goflags/compare/v0.1.54...v0.1.56)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/goflags
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-17 16:26:04 +00:00
Ice3man
355814014a
Merge pull request #1769 from projectdiscovery/use-tech-networkpolicy-singletons
feat: use networkpolicy + wappalyzer singletons from library
2024-06-17 21:55:13 +05:30
Ice3man
80d5532b15 misc fixing tests 2024-06-17 19:58:12 +05:30
Ice3man
ca3e696834 feat: use networkpolicy + wappalyzer singletons from library 2024-06-17 18:11:01 +05:30
SAEED
736ed3299c
Added the Functionality of storing raw request response headers (#1671)
* implemented storing header

* Revert "chore(deps): bump github.com/quic-go/quic-go from 0.37.7 to 0.42.0"

This reverts commit a88d85acd6.

* implemented req/resp headers storing feature

* implemented req/resp headers storing feature

* update readme

* commit to last commit

* add `-ob, -omit-body` flag

---------

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: Doğan Can Bakır <dogancanbakir@protonmail.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2024-06-13 02:37:14 +05:30
Mzack9999
e432123e95
Merge pull request #1761 from projectdiscovery/support_multiple_values
Support multiple values
2024-06-12 15:45:18 +02:00
Mzack9999
6811b18e85 removing redundant code + update readme 2024-06-12 15:36:16 +02:00
Mzack9999
8f9bb51b64
Merge pull request #1762 from projectdiscovery/http_based_speed_control
add http based speed control
2024-06-12 15:31:56 +02:00
Mzack9999
1db018b469 adding tests 2024-06-12 15:10:53 +02:00
Mzack9999
746b821388 using std waitgroup for non-changing output 2024-06-12 14:57:04 +02:00
Doğan Can Bakır
dece6fce63 commit to last commit 2024-06-12 14:34:30 +03:00
Doğan Can Bakır
d77348b8da set threads to 2 2024-06-12 14:26:00 +03:00
Doğan Can Bakır
6adf02ea9c minor 2024-06-12 14:15:44 +03:00
Doğan Can Bakır
a91cce13ae add http based speed control 2024-06-12 13:53:07 +03:00
Mzack9999
a636cf0e86
Merge pull request #1759 from projectdiscovery/fix_empty_host
fix empty host
2024-06-11 18:44:29 +02:00
Mzack9999
0729980017 stripping port 2024-06-11 18:39:35 +02:00
Doğan Can Bakır
812d7d892f update README 2024-06-11 12:07:28 +03:00
Doğan Can Bakır
608d6d40d7 support multiple values 2024-06-11 12:04:54 +03:00
Dogan Can Bakir
64ab42a4c8
do not omit status code (#1760) 2024-06-10 21:11:00 +05:30
Doğan Can Bakır
3e0593b81b fix empty host 2024-06-10 16:44:54 +03:00
dependabot[bot]
da34530300
Merge pull request #1757 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/fastdialer-0.1.3 2024-06-10 10:44:37 +00:00
dependabot[bot]
1e91ab5d22
chore(deps): bump github.com/projectdiscovery/fastdialer
Bumps [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer) from 0.1.2 to 0.1.3.
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases)
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.1.2...v0.1.3)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/fastdialer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-10 10:39:45 +00:00
dependabot[bot]
35d5a664fd
Merge pull request #1755 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/hmap-0.0.46 2024-06-10 10:38:20 +00:00
dependabot[bot]
fc17089bc1
Merge pull request #1754 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/retryablehttp-go-1.0.64 2024-06-10 10:38:08 +00:00
dependabot[bot]
54f9065597
Merge pull request #1756 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/dsl-0.1.2 2024-06-10 10:38:03 +00:00
dependabot[bot]
98ba7228a6
Merge pull request #1758 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/wappalyzergo-0.1.4 2024-06-10 10:37:19 +00:00
dependabot[bot]
051ba046bb
chore(deps): bump github.com/projectdiscovery/wappalyzergo
Bumps [github.com/projectdiscovery/wappalyzergo](https://github.com/projectdiscovery/wappalyzergo) from 0.1.3 to 0.1.4.
- [Release notes](https://github.com/projectdiscovery/wappalyzergo/releases)
- [Commits](https://github.com/projectdiscovery/wappalyzergo/compare/v0.1.3...v0.1.4)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/wappalyzergo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-10 10:32:17 +00:00
dependabot[bot]
4b68142601
chore(deps): bump github.com/projectdiscovery/dsl from 0.1.1 to 0.1.2
Bumps [github.com/projectdiscovery/dsl](https://github.com/projectdiscovery/dsl) from 0.1.1 to 0.1.2.
- [Release notes](https://github.com/projectdiscovery/dsl/releases)
- [Commits](https://github.com/projectdiscovery/dsl/compare/v0.1.1...v0.1.2)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/dsl
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-10 10:32:10 +00:00
dependabot[bot]
2560dc6bc7
chore(deps): bump github.com/projectdiscovery/hmap from 0.0.45 to 0.0.46
Bumps [github.com/projectdiscovery/hmap](https://github.com/projectdiscovery/hmap) from 0.0.45 to 0.0.46.
- [Release notes](https://github.com/projectdiscovery/hmap/releases)
- [Commits](https://github.com/projectdiscovery/hmap/compare/v0.0.45...v0.0.46)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/hmap
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-10 10:32:06 +00:00
dependabot[bot]
b6eb961805
chore(deps): bump github.com/projectdiscovery/retryablehttp-go
Bumps [github.com/projectdiscovery/retryablehttp-go](https://github.com/projectdiscovery/retryablehttp-go) from 1.0.63 to 1.0.64.
- [Release notes](https://github.com/projectdiscovery/retryablehttp-go/releases)
- [Commits](https://github.com/projectdiscovery/retryablehttp-go/compare/v1.0.63...v1.0.64)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/retryablehttp-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-10 10:32:03 +00:00
dependabot[bot]
31e5d43dd1
Merge pull request #1745 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/dsl-0.1.1 2024-06-03 14:13:12 +00:00
dependabot[bot]
19acaf27ca
chore(deps): bump github.com/projectdiscovery/dsl from 0.1.0 to 0.1.1
Bumps [github.com/projectdiscovery/dsl](https://github.com/projectdiscovery/dsl) from 0.1.0 to 0.1.1.
- [Release notes](https://github.com/projectdiscovery/dsl/releases)
- [Commits](https://github.com/projectdiscovery/dsl/compare/v0.1.0...v0.1.1)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/dsl
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-03 14:07:40 +00:00
dependabot[bot]
43ebc13d9a
Merge pull request #1746 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/useragent-0.0.54 2024-06-03 14:07:14 +00:00
dependabot[bot]
7f4a62ade8
Merge pull request #1747 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/rawhttp-0.1.52 2024-06-03 14:06:54 +00:00
dependabot[bot]
c10b6266b4
Merge pull request #1743 from projectdiscovery/dependabot/go_modules/dev/github.com/projectdiscovery/fastdialer-0.1.2 2024-06-03 14:05:26 +00:00
dependabot[bot]
26e600b96f
chore(deps): bump github.com/projectdiscovery/rawhttp
Bumps [github.com/projectdiscovery/rawhttp](https://github.com/projectdiscovery/rawhttp) from 0.1.50 to 0.1.52.
- [Release notes](https://github.com/projectdiscovery/rawhttp/releases)
- [Commits](https://github.com/projectdiscovery/rawhttp/compare/v0.1.50...v0.1.52)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/rawhttp
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-03 13:59:52 +00:00
dependabot[bot]
0a475cf5c9
chore(deps): bump github.com/projectdiscovery/useragent
Bumps [github.com/projectdiscovery/useragent](https://github.com/projectdiscovery/useragent) from 0.0.53 to 0.0.54.
- [Release notes](https://github.com/projectdiscovery/useragent/releases)
- [Commits](https://github.com/projectdiscovery/useragent/compare/v0.0.53...v0.0.54)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/useragent
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-03 13:59:46 +00:00
dependabot[bot]
8acc175ff3
chore(deps): bump github.com/projectdiscovery/fastdialer
Bumps [github.com/projectdiscovery/fastdialer](https://github.com/projectdiscovery/fastdialer) from 0.1.0 to 0.1.2.
- [Release notes](https://github.com/projectdiscovery/fastdialer/releases)
- [Commits](https://github.com/projectdiscovery/fastdialer/compare/v0.1.0...v0.1.2)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/fastdialer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-03 13:59:32 +00:00