ForcePilot/backend/package/yuxi/agents/toolkits/buildin/crawl
Kris 077de8e6d6 feat(agent-toolkit): add web search and crawl built-in toolkits
实现了完整的网页搜索与抓取内置工具集:
1. 新增搜索工具链:支持SearXNG与Tavily多Provider降级、滑动窗口限流、统一结果格式
2. 新增网页抓取工具:单页抓取、站点递归抓取、内容入库知识库功能
3. 完善安全防护:SSRF校验、robots.txt合规、请求限流
4. 自动注册工具到系统注册表,无需额外配置即可使用
2026-06-22 21:20:02 +08:00
..
__init__.py feat(agent-toolkit): add web search and crawl built-in toolkits 2026-06-22 21:20:02 +08:00
client.py feat(agent-toolkit): add web search and crawl built-in toolkits 2026-06-22 21:20:02 +08:00
ingester.py feat(agent-toolkit): add web search and crawl built-in toolkits 2026-06-22 21:20:02 +08:00
rate_limiter.py feat(agent-toolkit): add web search and crawl built-in toolkits 2026-06-22 21:20:02 +08:00
security.py feat(agent-toolkit): add web search and crawl built-in toolkits 2026-06-22 21:20:02 +08:00
tools.py feat(agent-toolkit): add web search and crawl built-in toolkits 2026-06-22 21:20:02 +08:00