Fetch URL | Dialogue API

Fetches a public URL and returns the readable body copy, stripped of navigation, headers, footers, and cookie banners. Handles JavaScript-rendered pages via headless browser. Text is capped at 20,000 characters.

Use this before calling /v1/search to analyse a competitor’s or client’s website copy against the corpus.

Authentication

AuthorizationBearer

Bearer authentication of the form Bearer <token>, where token is your auth token.

Request

This endpoint expects an object.

urlstringRequiredformat: "uri"

Full URL to fetch.

Response

Page title and extracted body text

urlstring

titlestring

Page title.

textstring

Readable body copy, stripped of navigation and boilerplate. Max 20,000 characters.

Errors

400

Bad Request Error

500

Internal Server Error

$	curl -X POST https://api.dialogue-ai.co/v1/fetch-url \
>	-H "Authorization: Bearer <token>" \
>	-H "Content-Type: application/json" \
>	-d '{
>	"url": "https://www.example.com/life-insurance"
>	}'