ScrapeOps

https://scrapeops.io/docs/intro/
Admin
ScrapeOps is a web scraping platform that provides proxy aggregation, scraper monitoring,...
Tokens:3,119
Snippets:38
Trust Score:8.8
Update:1 month ago
Show doc for...
Tokens:
Raw
### Query ScrapeOps Data API for Amazon Product

Source: https://scrapeops.io/docs/intro

Use the Data API endpoint to get structured JSON data for a product by passing its ASIN and country. Requires a free API key. The example prints the product title and price from the response.

```python
import requests  
  
response = requests.get(  
    'https://proxy.scrapeops.io/v1/structured-data/amazon/product',  
    params={  
        'api_key': 'YOUR_API_KEY',  
        'asin': 'B0BNLTS1T3',  
        'country': 'us'  
    }  
)  
data = response.json()  
print(data['title'])   # "Apple AirPods Pro (2nd Generation)"  
print(data['price'])   # "$249.00"  
```

--------------------------------

### Send HTML to ScrapeOps Parser API

Source: https://scrapeops.io/docs/intro

Use the Parser API endpoint to send raw HTML from a target page and receive structured JSON. Requires a free API key. The example fetches an Amazon product page and posts the HTML to the parser endpoint.

```python
import requests  
  
# First get the HTML from the target page  
html = requests.get('https://www.amazon.com/dp/B08WM3LMJF').text  
  
# Send HTML to the Parser API  
response = requests.post(  
    'https://parser.scrapeops.io/v2/amazon?api_key=YOUR_API_KEY',  
    data={'html': html}  
)  
print(response.json())  
```

--------------------------------

### Configure MCP Server in IDE

Source: https://scrapeops.io/docs/intro

Add the ScrapeOps MCP server to your IDE configuration file, specifying the command, arguments, and API key.

```json
{
  "mcpServers": {
    "@scrapeops/mcp": {
      "command": "npx",
      "args": ["-y", "@scrapeops/mcp"],
      "env": { "SCRAPEOPS_API_KEY": "YOUR_API_KEY" }
    }
  }
}
```

--------------------------------

### Run ScrapeOps MCP Server with npx

Source: https://scrapeops.io/docs/intro

Execute the MCP server directly using npx, ensuring the SCRAPEOPS_API_KEY environment variable is set.

```bash
env SCRAPEOPS_API_KEY=YOUR_API_KEY npx -y @scrapeops/mcp  
```

--------------------------------

### Make a request with ScrapeOps Proxy API Aggregator

Source: https://scrapeops.io/docs/intro

Use the requests library to send a URL to the ScrapeOps Proxy API endpoint. Requires an API key and the target URL as query parameters.

```python
import requests  
  
response = requests.get(  
    'https://proxy.scrapeops.io/v1/',  
    params={  
        'api_key': 'YOUR_API_KEY',  
        'url': 'http://httpbin.org/anything'  
    }  
)  
print(response.text)  # Returns the HTML content
```

--------------------------------

### Configure Python Requests with ScrapeOps Residential Proxy

Source: https://scrapeops.io/docs/intro

Use the requests library to route traffic through the ScrapeOps Residential Proxy Aggregator by setting the proxy dictionary with your API key.

```python
import requests  
  
proxies = {  
    'http': 'http://scrapeops:YOUR_API_KEY@residential-proxy.scrapeops.io:8181',  
    'https': 'http://scrapeops:YOUR_API_KEY@residential-proxy.scrapeops.io:8181'  
}  
  
response = requests.get('https://httpbin.org/ip', proxies=proxies)  
print(response.text)  
```
Tokens:
Raw