HasData

https://docs.hasdata.com/
Admin
HasData is a cloud-based web scraping API that extracts data quickly and reliably from any source...
Tokens:326,372
Snippets:1,850
Trust Score:9.3
Update:1 week ago
Show doc for...
Tokens:
Raw
### Install hasdata binary

Source: https://docs.hasdata.com/openclaw

Installs the required `hasdata` binary using a shell script. This is a one-time setup step.

```bash
curl -sSL https://raw.githubusercontent.com/HasData/hasdata-cli/main/install.sh | sh
```

--------------------------------

### GET /scrape/google/immersive-product

Source: https://docs.hasdata.com/apis/google-serp/immersive-product

Example of calling the immersive product endpoint using Ruby and Rust.

```APIDOC
## [GET] /scrape/google/immersive-product

### Description
Retrieves immersive product data from Google SERP using a page token.

### Method
GET

### Endpoint
https://api.hasdata.com/scrape/google/immersive-product

### Parameters
#### Query Parameters
- **pageToken** (string) - Required - The page token for the immersive product request.

### Request Example
```
GET /scrape/google/immersive-product?pageToken=eyJyZHMiOiJQQ18zMjQ1NDc2NDAwODMzNTUxOTQ4fFBST0RfUENfMzI0NTQ3NjQwMDgzMzU1MTk0OCIsInByb2R1Y3RpZCI6IjE2NTYxODg2MzMwNjI5NzA1MjY5IiwiY2F0YWxvZ2lkIjoiMTA5MDU3MjEzODE1NDM1NDgwMCIsImhlYWRsaW5lT2ZmZXJEb2NpZCI6IjEwNTQwMDUxMzg0NjEzOTczOTg1IiwiaW1hZ2VEb2NpZCI6IjE3MjMwMzM3NDkwMTYzODIyNjMiLCJncGNpZCI6IjgyOTk1MTI3NTExOTg2NzE2MjIiLCJtaWQiOiI1NzY0NjI2MTIyODAxMzA0ODEiLCJxIjoiYnV5IGNvZmZlZSIsImhsIjoiZW4iLCJnbCI6InVzIiwiY29va2llcyI6Il9fU2VjdXJlLVNUUlA9QU5tWndhMHZsZUx5TFN3SDZKcmFHRU15RGxnbEhJN3NJelN2NFVJcXhZUDhFQk5kd1FXNTRoRHVsX3RZRl9hSFBsQjM3ajhNMWZRY1NwOVhTMy1icmVOdzIwa1RybjhnajhCaDsgQUVDPUFkSlZFYXR5TE1ZbHktUk5IRGxTVm04MGkySWRhWm4yeE5mWlVBX3JzV3pDX0xyTFFTeUwzTGJ3TkJnOyBOSUQ9NTMyPWtadG5CQnpoNE02cU5lTW9VM1Rjekd1d0VKdmtkcjBZMzFFbmNPTlZUT084TmlVX0oyUTVucmR3Q0dWUU5pWVlvWUROSEdWTE9BdUd0SWI2ZjEwSDk3OHM3bk9hajFFTVN1ellIaDVTMzdDTkJDZkdwLWlmcThVenV4aHR3TTR0YmNidXdnbVBNUHJHeXBlMS1aQmZtTEVCOXpTam9aMFpGOUZHQ3ZQdkc3aGdXZzRCcndvb1RYclhnTHdhc3BtYXpUVi1YYUg1bzJjV2lUNTUwc0dHNG5pRVpYLUI1aFZsbllYQ1QxZU91LXU0Tjk4MXQtUnYzYi1RZS1nTGV2NmV4ZGNFdlE7IERWPU02U2J0ZDljdGtvc1VKSEhKMHhOMXZfa3lxX0M5Tm42MHAxSjhPd3dCd1FBQUFBIiwieHNyZiI6IkFGNXRTTzRGb3VnZDItOVJPN09YU29oMzlvWnhLUzZGNVE6MTc4MzY4OTMxMzM5MiIsIm9hcHZmYyI6IkVvc0RDc3dDUVVwcFZEUjBTMGMwTmxObk16TktTRmxmYW05SlpUbFNNM1ZaVTFJeWJ6ZENlRGgwWm5kRVNGWTFja2hzZFVZNVMzWnVOMVUxYkVSSU1YTlVSMUpyV1VwWFpVWlZTVVY0Y2s5ak1EaElYMWd3UVRaR1RVbzJTVmxpZVdGdU5IRklVV1o0WTJ4d1RVUm1hRFZPT1dSbGFXOVZaVFpNT1ZaT1VXZHJNMlJTTlZNMlQzWlhiSEI1UW01aU5DMHlUR0psYnpWTVJEVkhSazVoYlZkZlVFUmxlbkIwTlc1U2FtRjJOVUprVWkxTloxcFJhbHBsY21kc1VXbDNXVWcxY1dKeFdtTjZWR0ZEVDB0a2RISldTekYwYzB0MVlqaHBiR1o2TFc1cFZsODNjV296VTI5RVgydDVkSE13WlVNNVJVaGhhRTU0WHpKT2ExY3plR3BXY1VGMlJXVjBhVmN5T1ZkNk9WaEVialV5VldVNGNtdHlPVUV4Ym1ZdFNYRjRkM1J3VUMxdFNYUjZORUk0Y3pCV1REUlhkbTVHUldodE1ETnVaaTFNTFZSUlRuUm9PVmRDWDNoaVoyNXVkVWtTRmxsUVFsRmhjV1ZrVFZCWGRIRjBjMUEwV1U5elRWRWFJa0ZFYzNJNVpsRjZSMVpNTkZKR2IwRmhZbmhQWmpSRFRqbHBNRTVCWjAxcFowRSIsInZlcnNpb24iOjJ9 HTTP/1.1
Host: api.hasdata.com
Content-Type: application/json
x-api-key: <your-api-key>
```

### Response
#### Success Response (200)
- **body** (string) - The response body containing the immersive product data.

#### Response Example
```
{
  "response": "..."
}
```
```

--------------------------------

### Get job status - Go

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

Go example using net/http to check the status of a batch job.

```go
package main

import (
	"fmt"
	"io"
	"net/http"
)

func main() {
	req, _ := http.NewRequest("GET", "https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0", nil)
	req.Header.Add("Content-Type", "application/json")
	req.Header.Add("x-api-key", "<your-api-key>")

	res, _ := http.DefaultClient.Do(req)
	defer res.Body.Close()

	body, _ := io.ReadAll(res.Body)
	fmt.Println(string(body))
}
```

--------------------------------

### Get job results - Python

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

Python example using requests to retrieve batch job results with pagination.

```python
import requests

url = "https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0/results"

querystring = {"page":"1","limit":"100"}

headers = {
    "Content-Type": "application/json",
    "x-api-key": "<your-api-key>"
}

response = requests.get(url, headers=headers, params=querystring)

print(response.json())
```

--------------------------------

### Java OkHttp request to Airbnb Listing API

Source: https://docs.hasdata.com/apis/airbnb/listing

Java example using OkHttp to call the Airbnb Listing API. It builds a URL with query parameters and sends a GET request with the required headers, then executes it.

```java
OkHttpClient client = new OkHttpClient();

HttpUrl url = HttpUrl.parse("https://api.hasdata.com/scrape/airbnb/listing")
  .newBuilder()
  .addQueryParameter("location", "New York")
  .addQueryParameter("checkIn", "2026-10-19")
  .addQueryParameter("checkOut", "2026-10-23")
  .addQueryParameter("neLat", "40.8")
  .addQueryParameter("neLng", "-73.9")
  .addQueryParameter("swLat", "40.6")
  .addQueryParameter("swLng", "-74.1")
  .build();

Request request = new Request.Builder()
  .url(url)
  .get()
  .addHeader("Content-Type", "application/json")
  .addHeader("x-api-key", "<your-api-key>")
  .build();

Response response = client.newCall(request).execute();
```

--------------------------------

### Go: Fetch Airbnb listing with net/http

Source: https://docs.hasdata.com/apis/airbnb/listing

Go example using net/http to call the HasData Airbnb listing API. Sends a GET request with query parameters for location, dates, and bounding box coordinates, and requires an x-api-key header.

```go
package main

import (
	"fmt"
	"io"
	"net/http"
	"net/url"
)

func main() {
	params := url.Values{}
	params.Set("location", "New York")
	params.Set("checkIn", "2026-10-19")
	params.Set("checkOut", "2026-10-23")
	params.Set("neLat", "40.8")
	params.Set("neLng", "-73.9")
	params.Set("swLat", "40.6")
	params.Set("swLng", "-74.1")

	u := "https://api.hasdata.com/scrape/airbnb/listing?" + params.Encode()

	req, _ := http.NewRequest("GET", u, nil)
	req.Header.Add("Content-Type", "application/json")
	req.Header.Add("x-api-key", "<your-api-key>")

	res, _ := http.DefaultClient.Do(req)
	defer res.Body.Close()

	body, _ := io.ReadAll(res.Body)
	fmt.Println(string(body))
}

```

--------------------------------

### C# HttpClient request to Airbnb Listing API

Source: https://docs.hasdata.com/apis/airbnb/listing

C# example using HttpClient to call the Airbnb Listing API. It builds the query string with HttpUtility and sends a GET request with the x-api-key header, then prints the response content.

```csharp
using System.Net.Http;
using System.Web;

var client = new HttpClient();

var query = HttpUtility.ParseQueryString(string.Empty);
query["location"] = "New York";
query["checkIn"] = "2026-10-19";
query["checkOut"] = "2026-10-23";
query["neLat"] = "40.8";
query["neLng"] = "-73.9";
query["swLat"] = "40.6";
query["swLng"] = "-74.1";

var url = $"https://api.hasdata.com/scrape/airbnb/listing?{query}";

var request = new HttpRequestMessage(new HttpMethod("GET"), url);
request.Headers.Add("x-api-key", "<your-api-key>");

using var response = await client.SendAsync(request);
response.EnsureSuccessStatusCode();
var content = await response.Content.ReadAsStringAsync();
Console.WriteLine(content);
```

--------------------------------

### Go request to Zillow listing API

Source: https://docs.hasdata.com/apis/zillow/listing

This Go example uses the net/http package to make a GET request to the Zillow listing endpoint. It builds the URL with query parameters and sets the required headers, then prints the response body.

```go
package main

import (
	"fmt"
	"io"
	"net/http"
	"net/url"
)

func main() {
	params := url.Values{}
	params.Set("keyword", "New York, NY")
	params.Set("type", "forSale")

	u := "https://api.hasdata.com/scrape/zillow/listing?" + params.Encode()

	req, _ := http.NewRequest("GET", u, nil)
	req.Header.Add("Content-Type", "application/json")
	req.Header.Add("x-api-key", "<your-api-key>")

	res, _ := http.DefaultClient.Do(req)
	defer res.Body.Close()

	body, _ := io.ReadAll(res.Body)
	fmt.Println(string(body))
}
```

--------------------------------

### Java request to Booking.com Place API

Source: https://docs.hasdata.com/apis/booking/place

Uses OkHttp to make a GET request to the Booking.com Place API. The example builds the URL with query parameters and adds the required headers, then executes the request.

```java
OkHttpClient client = new OkHttpClient();

HttpUrl url = HttpUrl.parse("https://api.hasdata.com/scrape/booking/place")
  .newBuilder()
  .addQueryParameter("url", "https://www.booking.com/hotel/fr/le-bristol-paris.html")
  .addQueryParameter("checkInDate", "2026-10-19")
  .addQueryParameter("checkOutDate", "2026-10-23")
  .addQueryParameter("rooms", "1")
  .addQueryParameter("adults", "2")
  .addQueryParameter("children", "0")
  .build();

Request request = new Request.Builder()
  .url(url)
  .get()
  .addHeader("Content-Type", "application/json")
  .addHeader("x-api-key", "<your-api-key>")
  .build();

Response response = client.newCall(request).execute();

```

--------------------------------

### Get Scraper Job Status with cURL and Python

Source: https://docs.hasdata.com/quickstart

Get the status of an existing scraper job by making a GET request to `/scrapers/jobs/:jobId`. The cURL example and Python example are two independent code samples; they are grouped here for convenience because they both perform the same GET request.

```bash
curl --request GET \
  --url 'https://api.hasdata.com/scrapers/jobs/:jobId' \
  --header 'Content-Type: application/json' \
  --header 'x-api-key: <your-api-key>'
```

```python
import requests

url = "https://api.hasdata.com/scrapers/jobs/:jobId"

headers = {
    "Content-Type": "application/json",
    "x-api-key": "<your-api-key>"
}

response = requests.get(url, headers=headers)

print(response.json())
```

--------------------------------

### Install HasData CLI on Windows

Source: https://docs.hasdata.com/cli

Install the HasData CLI on Windows by downloading the .zip from the Releases page, extracting it, and adding hasdata.exe to %PATH%.

```bash
# Download the .zip from the Releases page, extract, then add hasdata.exe to %PATH%.
# https://github.com/HasData/hasdata-cli/releases

```

--------------------------------

### Get Scraper Job Status - Example JSON Response

Source: https://docs.hasdata.com/quickstart

Example JSON response from a successful GET request to `/scrapers/jobs/:jobId`. The response includes job details, credits spent, data row count, result download URLs for CSV/JSON/XLSX, and the original input configuration with webhook settings.

```json
{
  "id": "dd1a8c53-2d47-4444-977d-8d653a6a3c82",
  "status": "finished",
  "creditsSpent": 250,
  "dataRowsCount": 25,
  "data": {
    "csv": "https://api.hasdata.com/scrapers/jobs/dd1a8c53-2d47-4444-977d-8d653a6a3c82/results/b6cc6733-6d0e-4e44-9e94-38688aad3884.csv",
    "json": "https://api.hasdata.com/scrapers/jobs/dd1a8c53-2d47-4444-977d-8d653a6a3c82/results/9cb592e3-6700-42ff-b58c-e7da3f478f28.json",
    "xlsx": "https://api.hasdata.com/scrapers/jobs/dd1a8c53-2d47-4444-977d-8d653a6a3c82/results/ecea853c-e0ca-4a23-ae74-eea0588e54b6.xlsx"
  },
  "input": {
    "limit": 25,
    "urls": ["https://hasdata.com", "https://example.com"],
    "maxDepth": 5,
    "includePaths": "(blog/.+|articles/.+)",
    "webhook": {
      "url": "https://example.com/webhook",
      "events": ["scraper.job.started", "scraper.job.finished", "scraper.data.scraped"]
    }
  }
}
```

--------------------------------

### Install HasData CLI with Go

Source: https://docs.hasdata.com/cli

Install the HasData CLI using Go's install command.

```bash
go install github.com/HasData/hasdata-cli@latest

```

--------------------------------

### Make first request with Go

Source: https://docs.hasdata.com/apis/bing/serp

Uses Go's net/http to perform a GET request. Builds query parameters with url.Values and prints the response body.

```go
package main

import (
	"fmt"
	"io"
	"net/http"
	"net/url"
)

func main() {
	params := url.Values{}
	params.Set("q", "Coffee")
	params.Set("location", "Austin, Texas, United States")
	params.Set("deviceType", "desktop")

	u := "https://api.hasdata.com/scrape/bing/serp?" + params.Encode()

	req, _ := http.NewRequest("GET", u, nil)
	req.Header.Add("Content-Type", "application/json")
	req.Header.Add("x-api-key", "<your-api-key>")

	res, _ := http.DefaultClient.Do(req)
	defer res.Body.Close()

	body, _ := io.ReadAll(res.Body)
	fmt.Println(string(body))
}

```

--------------------------------

### Go: Scrape Walmart Reviews with net/http

Source: https://docs.hasdata.com/apis/walmart/reviews

Go example using net/http to call the Walmart reviews API with query parameters. Requires an API key in the x-api-key header.

```go
package main

import (
	"fmt"
	"io"
	"net/http"
	"net/url"
)

func main() {
	params := url.Values{}
	params.Set("itemId", "1028936148")
	params.Set("url", "https://www.walmart.com/ip/Restored-Apple-iPhone-14-Carrier-Unlocked-128-GB-Starlight-MPUN3LL-A-Refurbished/1028936148")
	params.Set("language", "en")
	params.Set("page", "1")
	params.Set("sort", "mostRelevant")

	u := "https://api.hasdata.com/scrape/walmart/reviews?" + params.Encode()

	req, _ := http.NewRequest("GET", u, nil)
	req.Header.Add("Content-Type", "application/json")
	req.Header.Add("x-api-key", "<your-api-key>")

	res, _ := http.DefaultClient.Do(req)
	defer res.Body.Close()

	body, _ := io.ReadAll(res.Body)
	fmt.Println(string(body))
}

```

--------------------------------

### Example Output for Multiple Fields

Source: https://docs.hasdata.com/apis/web-scraping-api/features/structured-data-extraction

Shows the JSON output returned when using the multiple fields example.

```json
{
  "title": "Apple iPhone 14",
  "price": "$799",
  "description": "The latest iPhone with A15 Bionic chip..."
}
```

--------------------------------

### Get job status - C#

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

C# example using HttpClient to check the status of a batch job.

```csharp
using System.Net.Http;

var client = new HttpClient();

var request = new HttpRequestMessage(new HttpMethod("GET"), "https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0");
request.Headers.Add("x-api-key", "<your-api-key>");

using var response = await client.SendAsync(request);
response.EnsureSuccessStatusCode();
var content = await response.Content.ReadAsStringAsync();
Console.WriteLine(content);
```

--------------------------------

### Get job status - PHP

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

PHP example using cURL to check the status of a batch job.

```php
<?php

$curl = curl_init();

curl_setopt_array($curl, [
  CURLOPT_URL => "https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0",
  CURLOPT_RETURNTRANSFER => true,
  CURLOPT_CUSTOMREQUEST => "GET",
  CURLOPT_HTTPHEADER => [
    "Content-Type: application/json",
    "x-api-key: <your-api-key>",
  ],
]);

$response = curl_exec($curl);
curl_close($curl);

echo $response;
```

--------------------------------

### Google SERP Query Example

Source: https://docs.hasdata.com/cli

Run a Google SERP query with the HasData CLI, forcing pretty JSON output.

```bash
hasdata google-serp --q "langchain vs llamaindex" --gl us --pretty

```

--------------------------------

### Getting Results - Webhooks

Source: https://docs.hasdata.com/scrapers/amazon-search

Receive real-time updates when your scraper job starts, completes, or collects data.

```APIDOC
## Getting Results - Webhooks

### Description
Receive real-time updates when your scraper job starts, completes, or collects data.

### Usage
Configure a webhook endpoint to receive notifications about job events.

### Events
- Job started
- Job completed
- Data collected

### Response Format
No specific response format is documented.
```

--------------------------------

### Make first request with Java

Source: https://docs.hasdata.com/apis/bing/serp

Uses OkHttp's builder to craft a GET request to the Bing SERP API. Executes the call synchronously and stores the response.

```java
OkHttpClient client = new OkHttpClient();

HttpUrl url = HttpUrl.parse("https://api.hasdata.com/scrape/bing/serp")
  .newBuilder()
  .addQueryParameter("q", "Coffee")
  .addQueryParameter("location", "Austin, Texas, United States")
  .addQueryParameter("deviceType", "desktop")
  .build();

Request request = new Request.Builder()
  .url(url)
  .get()
  .addHeader("Content-Type", "application/json")
  .addHeader("x-api-key", "<your-api-key>")
  .build();

Response response = client.newCall(request).execute();

```

--------------------------------

### C#: Scrape Walmart Reviews with HttpClient

Source: https://docs.hasdata.com/apis/walmart/reviews

C# example using HttpClient and HttpUtility to build query parameters for the Walmart reviews API. Requires an API key in the x-api-key header.

```csharp
using System.Net.Http;
using System.Web;

var client = new HttpClient();

var query = HttpUtility.ParseQueryString(string.Empty);
query["itemId"] = "1028936148";
query["url"] = "https://www.walmart.com/ip/Restored-Apple-iPhone-14-Carrier-Unlocked-128-GB-Starlight-MPUN3LL-A-Refurbished/1028936148";
query["language"] = "en";
query["page"] = "1";
query["sort"] = "mostRelevant";

var url = $"https://api.hasdata.com/scrape/walmart/reviews?{query}";

var request = new HttpRequestMessage(new HttpMethod("GET"), url);
request.Headers.Add("x-api-key", "<your-api-key>");

using var response = await client.SendAsync(request);
response.EnsureSuccessStatusCode();
var content = await response.Content.ReadAsStringAsync();
Console.WriteLine(content);

```

--------------------------------

### Get job results - Node.js

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

Node.js example using axios to retrieve batch job results with pagination.

```javascript
const axios = require('axios').default;

const options = {
  method: 'GET',
  url: 'https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0/results',
  params: {page: '1', limit: '100'},
  headers: {'Content-Type': 'application/json', 'x-api-key': '<your-api-key>'}
};

try {
  const { data } = await axios.request(options);
  console.log(data);
} catch (error) {
  console.error(error);
}
```

--------------------------------

### Go (net/http) request to Shopify Products API

Source: https://docs.hasdata.com/apis/shopify/products

Use this Go example with net/http to call the HasData Shopify Products API. It sets query parameters, adds the required headers, and prints the response body.

```go
package main

import (
	"fmt"
	"io"
	"net/http"
	"net/url"
)

func main() {
	params := url.Values{}
	params.Set("url", "https://b2bdemoexperience.myshopify.com")
	params.Set("limit", "1")

	u := "https://api.hasdata.com/scrape/shopify/products?" + params.Encode()

	req, _ := http.NewRequest("GET", u, nil)
	req.Header.Add("Content-Type", "application/json")
	req.Header.Add("x-api-key", "<your-api-key>")

	res, _ := http.DefaultClient.Do(req)
	defer res.Body.Close()

	body, _ := io.ReadAll(res.Body)
	fmt.Println(string(body))
}

```

--------------------------------

### Get job status - Ruby

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

Ruby example using Net::HTTP to check the status of a batch job.

```ruby
require 'net/http'
require 'uri'

uri = URI("https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0")

http = Net::HTTP.new(uri.host, uri.port)
http.use_ssl = true

request = Net::HTTP::Get.new(uri)
request["Content-Type"] = 'application/json'
request["x-api-key"] = '<your-api-key>'

response = http.request(request)
puts response.read_body
```

--------------------------------

### Go: Search Walmart products with net/http

Source: https://docs.hasdata.com/apis/walmart/search

Go example using net/http to search Walmart products. Replace <your-api-key> with your actual API key. The facet parameter includes a newline separating multiple facet values.

```go
package main

import (
	"fmt"
	"io"
	"net/http"
	"net/url"
)

func main() {
	params := url.Values{}
	params.Set("q", "coffee")
	params.Set("language", "en")
	params.Set("sort", "bestMatch")
	params.Set("deliveryType", "shipping")
	params.Set("facet", "brand:Great Value
retailer_type:Walmart")

	u := "https://api.hasdata.com/scrape/walmart/search?" + params.Encode()

	req, _ := http.NewRequest("GET", u, nil)
	req.Header.Add("Content-Type", "application/json")
	req.Header.Add("x-api-key", "<your-api-key>")

	res, _ := http.DefaultClient.Do(req)
	defer res.Body.Close()

	body, _ := io.ReadAll(res.Body)
	fmt.Println(string(body))
}

```

--------------------------------

### Get job status - Java

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

Java example using OkHttp to check the status of a batch job. Requires OkHttp library.

```java
OkHttpClient client = new OkHttpClient();

Request request = new Request.Builder()
  .url("https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0")
  .get()
  .addHeader("Content-Type", "application/json")
  .addHeader("x-api-key", "<your-api-key>")
  .build();

Response response = client.newCall(request).execute();
```

--------------------------------

### Example request with custom headers (Java)

Source: https://docs.hasdata.com/apis/web-scraping-api/features/custom-headers-and-cookies

Uses OkHttp to send a POST request with custom headers. Replace `<your-api-key>` with your actual API key.

```java
OkHttpClient client = new OkHttpClient();

MediaType mediaType = MediaType.parse("application/json");
String json = """
  {
    "url": "https://example.com/products",
    "headers": {
      "User-Agent": "Mozilla/5.0",
      "Cookie": "consent=accepted; currency=USD"
    },
    "outputFormat": [
      "html"
    ]
  }
""";
RequestBody requestBody = RequestBody.create(json, mediaType);

Request request = new Request.Builder()
  .url("https://api.hasdata.com/scrape/web")
  .post(requestBody)
  .addHeader("Content-Type", "application/json")
  .addHeader("x-api-key", "<your-api-key>")
  .build();

Response response = client.newCall(request).execute();
```

--------------------------------

### Get job status - Python

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

Python example using requests to check the status of a batch job. Requires the requests library.

```python
import requests

url = "https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0"

headers = {
    "Content-Type": "application/json",
    "x-api-key": "<your-api-key>"
}

response = requests.get(url, headers=headers)

print(response.json())
```

--------------------------------

### Get job status - Node.js

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

Node.js example using axios to check the status of a batch job. Requires the axios library.

```javascript
const axios = require('axios').default;

const options = {
  method: 'GET',
  url: 'https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0',
  headers: {'Content-Type': 'application/json', 'x-api-key': '<your-api-key>'}
};

try {
  const { data } = await axios.request(options);
  console.log(data);
} catch (error) {
  console.error(error);
}
```

--------------------------------

### Make a GET request to Google AI Overview API using Java

Source: https://docs.hasdata.com/apis/google-serp/ai-overview

Use this Java code with OkHttp to fetch AI Overview data. Replace <your-api-key> with your actual API key. The request requires the x-api-key header.

```java
OkHttpClient client = new OkHttpClient();

Request request = new Request.Builder()
  .url("https://api.hasdata.com/scrape/google/ai-overview")
  .get()
  .addHeader("Content-Type", "application/json")
  .addHeader("x-api-key", "<your-api-key>")
  .build();

Response response = client.newCall(request).execute();

```

--------------------------------

### Make first request with Ruby

Source: https://docs.hasdata.com/apis/bing/serp

Uses Net::HTTP in Ruby to send a GET request. Encodes query parameters with URI.encode_www_form and prints the response body.

```ruby
require 'net/http'
require 'uri'

uri = URI("https://api.hasdata.com/scrape/bing/serp")
params = {
  "q" => "Coffee",
  "location" => "Austin, Texas, United States",
  "deviceType" => "desktop",
}
uri.query = URI.encode_www_form(params)

http = Net::HTTP.new(uri.host, uri.port)
http.use_ssl = true

request = Net::HTTP::Get.new(uri)
request["Content-Type"] = 'application/json'
request["x-api-key"] = '<your-api-key>'

response = http.request(request)
puts response.read_body

```

--------------------------------

### Get job status - Rust

Source: https://docs.hasdata.com/apis/google-serp-api/batch-api

Rust example using reqwest to check the status of a batch job. Requires reqwest with blocking feature.

```rust
use reqwest::blocking::Client;

fn main() -> Result<(), Box<dyn std::error::Error>> {
    let client = Client::new();
    let res = client
        .get("https://api.hasdata.com/scrape/batch/google/serp/9a35f32e-4f9c-4d49-9c6e-7c4de4a091e0")
        .header("Content-Type", "application/json")
        .header("x-api-key", "<your-api-key>")
        .send()?
        .text()?;
    println!("{}", res);
    Ok(())
}
```

--------------------------------

### Ruby: Scrape Walmart Reviews with Net::HTTP

Source: https://docs.hasdata.com/apis/walmart/reviews

Ruby example using Net::HTTP to call the Walmart reviews API with query parameters. Requires an API key in the x-api-key header.

```ruby
require 'net/http'
require 'uri'

uri = URI("https://api.hasdata.com/scrape/walmart/reviews")
params = {
  "itemId" => "1028936148",
  "url" => "https://www.walmart.com/ip/Restored-Apple-iPhone-14-Carrier-Unlocked-128-GB-Starlight-MPUN3LL-A-Refurbished/1028936148",
  "language" => "en",
  "page" => "1",
  "sort" => "mostRelevant",
}
uri.query = URI.encode_www_form(params)

http = Net::HTTP.new(uri.host, uri.port)
http.use_ssl = true

request = Net::HTTP::Get.new(uri)
request["Content-Type"] = 'application/json'
request["x-api-key"] = '<your-api-key>'

response = http.request(request)
puts response.read_body

```

--------------------------------

### Node.js request to Google Shopping API

Source: https://docs.hasdata.com/apis/google-serp/shopping

Uses axios in Node.js to send a GET request to the HasData Google Shopping API. Requires axios installed.

```javascript
const axios = require('axios').default;

const options = {
  method: 'GET',
  url: 'https://api.hasdata.com/scrape/google/shopping',
  params: {q: 'Coffee', location: 'Austin,Texas,United States', deviceType: 'desktop'},
  headers: {'Content-Type': 'application/json', 'x-api-key': '<your-api-key>'}
};

try {
  const { data } = await axios.request(options);
  console.log(data);
} catch (error) {
  console.error(error);
}
```

--------------------------------

### Node.js: GET Shopify collections with axios

Source: https://docs.hasdata.com/apis/shopify/collections

Node.js example using axios to call the HasData Shopify collections endpoint. Requires an API key in the x-api-key header.

```javascript
const axios = require('axios').default;

const options = {
  method: 'GET',
  url: 'https://api.hasdata.com/scrape/shopify/collections',
  params: {url: 'https://b2bdemoexperience.myshopify.com', limit: '10'},
  headers: {'Content-Type': 'application/json', 'x-api-key': '<your-api-key>'}
};

try {
  const { data } = await axios.request(options);
  console.log(data);
} catch (error) {
  console.error(error);
}

```

--------------------------------

### Python request to Google Shopping API

Source: https://docs.hasdata.com/apis/google-serp/shopping

Uses the requests library in Python to send a GET request to the HasData Google Shopping API. Requires requests installed.

```python
import requests

url = "https://api.hasdata.com/scrape/google/shopping"

querystring = {"q":"Coffee","location":"Austin,Texas,United States","deviceType":"desktop"}

headers = {
    "Content-Type": "application/json",
    "x-api-key": "<your-api-key>"
}

response = requests.get(url, headers=headers, params=querystring)

print(response.json())
```

--------------------------------

### Make first request with C#

Source: https://docs.hasdata.com/apis/bing/serp

Uses HttpClient in C# to perform an async GET request. Builds the query string with HttpUtility.ParseQueryString and prints the content.

```csharp
using System.Net.Http;
using System.Web;

var client = new HttpClient();

var query = HttpUtility.ParseQueryString(string.Empty);
query["q"] = "Coffee";
query["location"] = "Austin, Texas, United States";
query["deviceType"] = "desktop";

var url = $"https://api.hasdata.com/scrape/bing/serp?{query}";

var request = new HttpRequestMessage(new HttpMethod("GET"), url);
request.Headers.Add("x-api-key", "<your-api-key>");

using var response = await client.SendAsync(request);
response.EnsureSuccessStatusCode();
var content = await response.Content.ReadAsStringAsync();
Console.WriteLine(content);

```

--------------------------------

### HasData CLI command for Glassdoor Listing

Source: https://docs.hasdata.com/apis/glassdoor/listing

Uses the HasData CLI to fetch Glassdoor listings with the same parameters as the cURL example. Requires the CLI to be installed and configured with an API key.

```bash
hasdata glassdoor-listing \
  --keyword 'software engineer' \
  --location 'New York, NY' \
  --sort recent \
  --domain www.glassdoor.com \
  --date-posted 7 \
  --radius 25 \
  --min-salary 90000 \
  --max-salary 150000 \
  --min-rating 4
```

--------------------------------

### Make first request with Node.js

Source: https://docs.hasdata.com/apis/bing/serp

Uses Axios to call the Bing SERP API. Uses async/await and logs the response data; errors are caught and logged.

```javascript
const axios = require('axios').default;

const options = {
  method: 'GET',
  url: 'https://api.hasdata.com/scrape/bing/serp',
  params: {q: 'Coffee', location: 'Austin, Texas, United States', deviceType: 'desktop'},
  headers: {'Content-Type': 'application/json', 'x-api-key': '<your-api-key>'}
};

try {
  const { data } = await axios.request(options);
  console.log(data);
} catch (error) {
  console.error(error);
}

```

--------------------------------

### Install HasData skill via ClawHub

Source: https://docs.hasdata.com/openclaw

Installs the HasData skill using the ClawHub CLI. Run this command in your terminal.

```bash
npx clawhub@latest install hasdata-api
```

--------------------------------

### Node.js request to Google AI Mode API

Source: https://docs.hasdata.com/apis/google-ai-mode/quickstart

Uses axios to send a GET request to the Google AI Mode API. Requires axios to be installed. The response is logged to the console.

```javascript
const axios = require('axios').default;

const options = {
  method: 'GET',
  url: 'https://api.hasdata.com/scrape/google/ai-mode',
  params: {q: 'Is coffee good for health?', location: 'Austin,Texas,United States'},
  headers: {'Content-Type': 'application/json', 'x-api-key': '<your-api-key>'}
};

try {
  const { data } = await axios.request(options);
  console.log(data);
} catch (error) {
  console.error(error);
}

```

--------------------------------

### HasData CLI: google-serp with --q

Source: https://docs.hasdata.com/apis/google-serp-api/quickstart

Use the HasData CLI to run a Google SERP search with query 'Coffee'. Requires the CLI to be installed and configured with your API key. Outputs the raw API response.

```bash
hasdata google-serp \
  --q Coffee
```

--------------------------------

### Make a GET request to Google News API with HasData CLI

Source: https://docs.hasdata.com/apis/google-serp/news

Use the HasData CLI command to fetch Google News results. Ensure you have the CLI installed and configured with your API key.

```bash
hasdata google-news

```

--------------------------------

### Ruby: Scrape Amazon Product

Source: https://docs.hasdata.com/apis/amazon/product

Ruby example using Net::HTTP to GET the Amazon product endpoint. Encodes the asin and otherSellers parameters and sends the request with the API key header.

```ruby
require 'net/http'
require 'uri'

uri = URI("https://api.hasdata.com/scrape/amazon/product")
params = {
  "asin" => "B0DHJ7SBDR",
  "otherSellers" => "true",
}
uri.query = URI.encode_www_form(params)

http = Net::HTTP.new(uri.host, uri.port)
http.use_ssl = true

request = Net::HTTP::Get.new(uri)
request["Content-Type"] = 'application/json'
request["x-api-key"] = '<your-api-key>'

response = http.request(request)
puts response.read_body
```

--------------------------------

### Java (OkHttp): Scrape Amazon Product

Source: https://docs.hasdata.com/apis/amazon/product

Java example using OkHttp client to call the Amazon product endpoint. Adds query parameters asin and otherSellers, plus the API key header, then executes the request.

```java
OkHttpClient client = new OkHttpClient();

HttpUrl url = HttpUrl.parse("https://api.hasdata.com/scrape/amazon/product")
  .newBuilder()
  .addQueryParameter("asin", "B0DHJ7SBDR")
  .addQueryParameter("otherSellers", "true")
  .build();

Request request = new Request.Builder()
  .url(url)
  .get()
  .addHeader("Content-Type", "application/json")
  .addHeader("x-api-key", "<your-api-key>")
  .build();

Response response = client.newCall(request).execute();
```

--------------------------------

### PHP: Scrape Amazon Product

Source: https://docs.hasdata.com/apis/amazon/product

PHP example using cURL to perform a GET request to the Amazon product endpoint. Builds the query string with http_build_query and sets the API key header.

```php
<?php

$params = [
    "asin" => "B0DHJ7SBDR",
    "otherSellers" => "true",
];

$curl = curl_init();

curl_setopt_array($curl, [
  CURLOPT_URL => "https://api.hasdata.com/scrape/amazon/product?" . http_build_query($params),
  CURLOPT_RETURNTRANSFER => true,
  CURLOPT_CUSTOMREQUEST => "GET",
  CURLOPT_HTTPHEADER => [
    "Content-Type: application/json",
    "x-api-key: <your-api-key>",
  ],
]);

$response = curl_exec($curl);
curl_close($curl);

echo $response;
```
Tokens:
Raw