Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
0.5.1Bright Data is a web data platform that provides large-scale scraping, crawling, and search capabilities without getting blocked. This toolkit exposes Bright Data's infrastructure through Arcade, enabling agents and apps to retrieve web content, run search queries, and extract structured data from major platforms.
Capabilities
- Web scraping: Fetch any public webpage and return its content as clean Markdown, suitable for LLM consumption or downstream processing.
- Multi-engine search: Query Google, Bing, or Yandex with configurable parameters including result count, country code, and search type (web, images, etc.).
- Structured data extraction: Pull pre-structured records from 20+ source types across Amazon, LinkedIn, Instagram, Facebook, X, Zillow, YouTube, ZoomInfo, and Booking.com — no custom parsing required.
Secrets
This toolkit requires two secrets to authenticate with Bright Data's API.
-
BRIGHTDATA_API_KEY— Your Bright Data account API key. Obtain it from the Bright Data control panel under Account Settings → API Token. A paid or trial Bright Data account is required. The key authorizes all API calls made on your behalf. -
BRIGHTDATA_ZONE— The name of a Bright Data zone (proxy/scraping zone) configured in your account. Zones define the network type (datacenter, residential, ISP, etc.) and geo-targeting used for requests. Create or find zone names in the Bright Data control panel under Proxies & Scraping Infrastructure → Zones; use the zone's exact name string as the secret value.
Store both secrets in Arcade before using this toolkit. See the Arcade secrets guide for setup instructions, or manage secrets directly at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MADE UP LINKS - IF LINKS ARE NEEDED, EXECUTE search_engine FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 2 |