Spider integration
The Web Crawler for AI Agents and LLMs.
What your agents can do with Spider
1 pre-built Spider tool steps, ready to drop into any agent. Anything they do not cover, an agent can reach with an authenticated API call.
Actions (1)
Scrape New Page
Initiates a new page scrape (crawl).
Set up Spider in Relevance AI
Do this once. Every agent in your workspace can then use the connection.
1
Create a Relevance AI account
Sign in, or create a free account. You do not need to be a developer to set this up.
2
Connect your Spider account
In Relevance AI, open Integrations and add Spider, then paste your API Key. You will find it in your Spider account settings.
3
Use Spider in an agent
Create a tool, add a Spider tool step, and connect it to an agent. The agent fills in the step's inputs each time it runs.
Put Spider to work in your agents
Connect Spider alongside 1,800+ other integrations and let your agents run the busywork.