projectdiscovery/httpx
1
1
Fork 0
mirror of https://github.com/projectdiscovery/httpx.git synced 2024-09-11 17:46:08 +03:00
Code Issues Packages Projects Releases Wiki Activity
2,067 Commits 7 Branches 55 Tags 40 MiB
41109a0c2a
Commit Graph

118 Commits

Author SHA1 Message Date
SAEED
736ed3299c
Added the Functionality of storing raw request response headers (#1671) 
* implemented storing header

* Revert "chore(deps): bump github.com/quic-go/quic-go from 0.37.7 to 0.42.0"

This reverts commit a88d85acd6.

* implemented req/resp headers storing feature

* implemented req/resp headers storing feature

* update readme

* commit to last commit

* add `-ob, -omit-body` flag

---------

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: Doğan Can Bakır <dogancanbakir@protonmail.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2024-06-13 02:37:14 +05:30
Mzack9999
6811b18e85 removing redundant code + update readme 2024-06-12 15:36:16 +02:00
Doğan Can Bakır
812d7d892f update README 2024-06-11 12:07:28 +03:00
sandeep
870a621f2e readme update 2024-05-19 23:16:21 +05:30
Yoshino-s
b57c8c31db
feat(flags): add screenshot-timeout flag (#1516) 
* chore(deps): bump golang.org/x/net from 0.14.0 to 0.17.0 (#1400)

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.14.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.14.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* chore(deps): bump golang.org/x/crypto from 0.14.0 to 0.17.0 (#1493)

Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.14.0 to 0.17.0.
- [Commits](https://github.com/golang/crypto/compare/v0.14.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* feat(flags): add screenshot-timeout flag

* misc update

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
 2024-01-16 04:08:04 +05:30
mzack
8b584f069c updating docs 2024-01-07 21:15:21 +01:00
Doğan Can Bakır
af5909bcac introduce -exclude flag 2024-01-04 15:16:02 +03:00
Brendan O'Leary
c8b1e1b959
Brendan update readme (#1495) 
Update README to match centralized docs

Co-authored-by: Brendan O'Leary <boleary@gitlab.com>
 2023-12-29 22:55:57 +05:30
seeyarh
91139dbc91
Fix chrome unsafe port err by setting explicitly-allowed-ports (#1343) 
* Update headless.go

* adding headless generic option

---------

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
 2023-11-28 18:18:29 +05:30
Cody Cline
7dee9988ca
Feature: optional flag to skip a host if it has a private IP address. (#1408) 
* feat: Implement flag which when enabled, will skip any host with a private ip address instead of timing out.

* fix: Amend private ip check to include loopback and link-local addresses

* fix: Amend debug message to be more concise

* fix: Account for port numbers in skipPrivateHosts feature

* docs: Remove uncessary  debug statement

* readme update

---------

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
 2023-11-02 14:21:22 +05:30
Doğan Can Bakır
0f1b51b6c8 introduce visual recon clusters 2023-09-20 08:31:30 +00:00
Mzack9999
88fa321dc4
Restoring https://github.com/projectdiscovery/httpx/pull/1331 (#1360) 
* Restoring https://github.com/projectdiscovery/httpx/pull/1331

* updating readme
 2023-09-14 17:51:38 +05:30
sandeep
d380f3139b readme update 2023-09-13 23:15:18 +05:30
sandeep
b6793864ee readme updates 2023-09-12 16:30:03 +05:30
JoMar
11fa743dd9
Allow to show response headers in json output without using -irh option (#1326) 
* Show responses headers in JSON output

* Update ident

* Update options name

* Update option & README

* Add missing 's'

* Add missing 's'

* updated headers to header for user facing variable to keep it uniform

* updating doc

---------

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2023-09-12 03:37:54 +05:30
Mzack9999
0f6edb50be refactor hsts implementation 2023-09-11 17:53:26 +02:00
Ramana Reddy
76adadfeb4
Add flag to preview first N characters (#1316) 
* Add flag to preview first N characters

* use dynamic var for body-preview flag

* strip html tags from response

* add stripe option to remove html or xml tags

* typo

* resolve merge conflicts

* add test and update readme

* update readme

* typo

* typo no 2

* small refactor

* include body preview in jsonl output

* minor changes

---------

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2023-09-07 15:26:54 +05:30
JoMar
179678581d
Exclude WAF (#1341) 
* Exclude WAF

* Add missing 's'

* Revert "Add missing 's'"

This reverts commit 467ceca320.
 2023-09-05 19:53:06 +05:30
Mzack9999
b3de0bc9d7
Merge pull request #1245 from dogancanbakir/error_page_classifier 
Error page classifier
 2023-07-19 14:50:16 +02:00
sandeep
1c15cc3595 Update README.md 2023-07-18 01:41:26 +05:30
dependabot[bot]
5ed2fab4e1
chore(deps): bump github.com/projectdiscovery/dsl from 0.0.12 to 0.0.14 (#1286) 
* chore(deps): bump github.com/projectdiscovery/dsl from 0.0.12 to 0.0.14

Bumps [github.com/projectdiscovery/dsl](https://github.com/projectdiscovery/dsl) from 0.0.12 to 0.0.14.
- [Release notes](https://github.com/projectdiscovery/dsl/releases)
- [Commits](https://github.com/projectdiscovery/dsl/compare/v0.0.12...v0.0.14)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/dsl
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

* bump go version

* updating readme

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
 2023-07-17 20:59:12 +05:30
Doğan Can Bakır
e90a4346fa update example 2023-07-17 15:37:43 +03:00
sandeep
366a98493b Merge branch 'dev' into pr/1245 2023-07-17 16:43:04 +05:30
Sandeep Singh
ac5348bcb9
Workflow update (#1290) 
* added auto dep merge

* added release test in build workflow

* workflow update

* Added Disclaimer
 2023-07-17 16:31:08 +05:30
Dogan Can Bakir
c3eb8897e7
Support multiple output format (#1242) 
* support multiple output format

* output plain text when -oA

* separate the conditions

* fail output-all when it's not used with output

* update doc

* remove hashes for plain output when -hash isn't used

* add integration test

* use filepath

* fix no hash std output

* remove json/csv extension for json/csv only output

* add ext when both -csv and -json is used

* fix assertion

* commit to last commit

* print filenames

* no tmpdir

* remove files

* remove prints

* lowercase options

* test update

---------

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
 2023-07-17 16:09:10 +05:30
Doğan Can Bakır
bbcee49994 add doc 2023-07-03 11:39:31 +03:00
Doğan Can Bakır
900f5623e8 add error page classifier 2023-06-20 14:13:48 +03:00
Mzack9999
8ea85e901d
Adding prototype of tls impersonate (#1199) 
* Adding prototype of tls impersonate

* updating docs

* misc update

* dep update

---------

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
 2023-06-17 16:34:19 +05:30
Mzack9999
00d0977963
Adding Screenshot support (#1097) 
* Adding Screenshot support

* adding headless body

* moving example into compilable file

* updating docs

* enabling store response with screenshot

* fixing output dir path

* fixing mod

* using native leakless

* splitting response+screenshot folders

* better handling json output

* readme update

* rel => abs path

* Added chromium into docker

* “Wipe them out. All of them.” – Darth Sidious

* utils bump

* go mod tidy

---------

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
 2023-04-27 01:07:06 +05:30
Mzack9999
1defd0a9b7
Add support to skip decode (#1055) 
add support to skip decode
 2023-03-29 19:06:47 +05:30
Mzack9999
d0d3d2ae3e rephrasing 2023-02-28 11:21:23 +01:00
minispooner
51c4375ee3
clarify README -ms flag to be case insensitive 2023-02-24 12:27:59 -08:00
Mzack9999
db1bc2ebba
Reworking favicon hash calculation (#906) 
* Reworking favicon hash calculation

* removing debug code

* bumping go to 1.19

* removing automatic follow redirect

* more edge cases

* added favicon path info
 2023-01-06 18:28:08 +05:30
xm1k3
88c49b812b
added ztls flag (#896) 
* added ztls to httpx

* adding missing dialtls

* updated readme.md

* add ztls functional test

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
 2022-12-28 23:40:22 +05:30
Sandeep Singh
0b08493e6d
broken link fix (#875) 2022-11-20 17:32:38 +05:30
forgedhallpass
1f409072b4
Readme update (#867) 2022-11-17 02:52:27 +05:30
Shubham Rasal
f06133f03b
Add delay between making httpx requests. (#853) 
* Add delay between making httpx requests.

- sleep before creating goroutine to make http request
- eg.
  ```
  cat urls.txt | httpx -delay 2s
  ```
  ```
  cat urls.txt | httpx -delay 2s -port 80,443,8443
  ```

* Update delay help message

* Use goflags DurationVar to accept delay

* replace string with duration for delay
 2022-11-15 12:23:45 +05:30
sandeep
e7ab403b33 readme + workflow update 2022-10-27 11:52:01 +02:00
Shubham Rasal
bab68a487f
AS input support +asnmap integration (#821) 
* Add asnmap integration

- Use PD's asnmap lib to get asn details

* Add AS input support [WIP]

* Add AS input support

- Add AS Number input support
- Update README.md to add AS input example
- Add test cases to test `targets()` function
- Refactor target function remove if-else with switch case

* Resolve merge conflicts

* Replace - with _ in asnResponse for json

* Replace - with _ in asnResponse for csv
 2022-10-20 17:54:52 +05:30
Sami
12fee4f3ee
include dsl tag for all json keys (#812) 
* include dsl tag for all json keys

* removed dsl tag and built list from json tag

* asn interface changed

* refactoring expression engine

- Using mapstructure for uniform mapping
- Flat key:value in expressions/variables list

* adding fields to ignore

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2022-10-20 13:18:01 +05:30
Shubham S Jagtap
0dac46522d
[docs] Update README.md (#808) 
Update README.md

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
 2022-10-12 12:36:19 +05:30
Sajad
e31c1250a2
add dsl match/filter condtion (#782) 
* add dsl match/filter condtion

* update README

* add test cases
 2022-10-06 17:11:12 +05:30
forgedhallpass
c48909f64f
Minor fixes and improvements (#726) 
* Added .idea to .gitignore

* Updated the README

* Added more verbose information on preset extractors

* removing deprecated ioutil

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
 2022-08-17 03:16:06 +04:00
sandeep
5e6b645a12 readme update 2022-07-11 03:57:11 +05:30
Mzack9999
e4e2aab402
Adding httpx as a library minimal example (#670) 2022-06-28 16:19:46 +05:30
sandeep
08a2be6e5f readme update 2022-06-12 09:50:36 +05:30
sandeep
a0e5b0c169 misc updates 2022-05-06 13:45:09 +05:30
LuitelSamikshya
1cd05e1071 readme updates 2022-04-29 10:48:28 -05:00
LuitelSamikshya
d3c485c3ce match/filter cdn 2022-04-13 13:29:52 -05:00
sandeep
3bb618440e Added ASN readme example 2022-04-08 19:28:22 +05:30