### Install URLFinder using Go

Source: https://github.com/projectdiscovery/urlfinder/blob/dev/README.md

Installs the URLFinder tool using the Go package manager. Requires Go 1.21 or later.

```sh
go install -v github.com/projectdiscovery/urlfinder/cmd/urlfinder@latest
```

--------------------------------

### Example JSONL Output Structure

Source: https://github.com/projectdiscovery/urlfinder/blob/dev/README.md

Demonstrates the structure of individual JSON objects within the JSONL output, detailing the fields provided for each discovered URL.

```json
{"url":"https://shop.tesla.com/product/model-s-plaid","input":"tesla.com","source":"waybackarchive"}
{"url":"https://www.tesla.com/inventory/used/ms","input":"tesla.com","source":"waybackarchive"}
{"url":"https://forums.tesla.com/discussion/101112/model-3-updates","input":"tesla.com","source":"waybackarchive"}
```

--------------------------------

### URLFinder Command-Line Usage and Options

Source: https://github.com/projectdiscovery/urlfinder/blob/dev/README.md

Provides a comprehensive overview of URLFinder's command-line interface, including input, source, scope, filter, rate-limiting, update, output, configuration, debug, and optimization flags.

```yaml
A streamlined tool for discovering associated URLs.

Usage:
  ./urlfinder [flags]

Flags:
INPUT:
   -d, -list string[]  target domain or list of domains

SOURCE:
   -s, -sources string[]           specific sources for discovery (e.g., -s alienvault,commoncrawl)
   -es, -exclude-sources string[]   sources to exclude (e.g., -es alienvault,commoncrawl)
   -all                             use all sources (may be slower)
SCOPE:
   -us, -url-scope string[]       in scope url regex to be followed by urlfinder
   -uos, -url-out-scope string[]  out of scope url regex to be excluded by urlfinder
   -fs, -field-scope string       pre-defined scope field (dn,rdn,fqdn) or custom regex (e.g., '(company-staging.io|company.com)') (default "rdn")
   -ns, -no-scope                 disables host based default scope
   -do, -display-out-scope        display external endpoint from scoped crawling

FILTER:
   -m, -match string[]       URLs or list to match (file or comma-separated)
   -f, -filter string[]      URLs or list to filter (file or comma-separated)

RATE-LIMIT:
   -rl, -rate-limit int      max HTTP requests per second (global)
   -rls, -rate-limits value  per-provider HTTP request limits (e.g., -rls waybackarchive=15/m)

UPDATE:
   -up, -update              update URLFinder to the latest version
   -duc, -disable-update-check  disable automatic update checks

OUTPUT:
   -o, -output string       specify output file
   -j, -jsonl               JSONL output format
   -od, -output-dir string  specify output directory
   -cs, -collect-sources    include all sources in JSON output

CONFIGURATION:
   -config string           config file (default "$CONFIG/urlfinder/config.yaml")
   -pc, -provider-config string  provider config file (default "$CONFIG/urlfinder/provider-config.yaml")
   -proxy string            HTTP proxy

DEBUG:
   -silent                  show only URLs in output
   -version                 display URLFinder version
   -v                       verbose output
   -nc, -no-color           disable colored output
   -ls, -list-sources       list all available sources
   -stats                   display source statistics

OPTIMIZATION:
   -timeout int   timeout in seconds (default 30)
   -max-time int  max time in minutes for enumeration (default 10)

```

--------------------------------

### Basic URL Enumeration

Source: https://github.com/projectdiscovery/urlfinder/blob/dev/README.md

Enumerates all discoverable URLs for a given domain. This is the fundamental usage of the tool.

```console
urlfinder -d tesla.com
```

--------------------------------

### Include URLs Matching Patterns

Source: https://github.com/projectdiscovery/urlfinder/blob/dev/README.md

Filters discovered URLs to include only those that contain specified patterns. Multiple patterns can be provided, separated by commas.

```sh
urlfinder -d tesla.com -m shop,model
```

--------------------------------

### Using Files for Matching and Filtering

Source: https://github.com/projectdiscovery/urlfinder/blob/dev/README.md

Utilizes external text files to define inclusion and exclusion patterns for URL filtering. This is useful for managing large or complex sets of patterns.

```sh
urlfinder -d tesla.com -m include-patterns.txt -f exclude-patterns.txt
```

--------------------------------

### JSONL Output Format

Source: https://github.com/projectdiscovery/urlfinder/blob/dev/README.md

Outputs discovered URLs in JSON Lines (JSONL) format, where each line is a valid JSON object. This format is ideal for machine processing and integration with other tools.

```sh
urlfinder -d tesla.com -j
```

--------------------------------

### Combined Match and Filter

Source: https://github.com/projectdiscovery/urlfinder/blob/dev/README.md

Applies both inclusion and exclusion patterns simultaneously to refine URL discovery results. This allows for precise targeting of desired URLs while excluding unwanted ones.

```sh
urlfinder -d tesla.com -m support -f faq
```

--------------------------------

### Exclude URLs Matching Patterns

Source: https://github.com/projectdiscovery/urlfinder/blob/dev/README.md

Filters discovered URLs to exclude those that contain specified patterns. Multiple patterns can be provided, separated by commas.

```sh
urlfinder -d tesla.com -f privacy,terms
```

=== COMPLETE CONTENT === This response contains all available snippets from this library. No additional content exists. Do not make further requests.