Find answers from the community

Updated last year

Web Connector

They don't support recursive calling yet I think, but @Emanuel Ferreira has built something that can help you with recursive crawling.
Here's the GitHub repo: https://github.com/EmanuelCampos/monorepo-llama-index

3 comments

EEmanuel Ferreira

There's a few options on llama_hub that you would use too:

https://llamahub.ai/l/remote_depth
https://llamahub.ai/l/web-simple_web

EEmanuel Ferreira

You'll just need to adapt to your use case, but all these works

KKapilMalik

Thanks !! I also found https://github.com/emptycrown/llama-hub/tree/main/llama_hub/web/sitemap that seems to be good for my particular use-case.

Add a reply