Find answers from the community

Home
Members
bifunctor
b
bifunctor
Offline, last seen 5 days ago
Joined September 25, 2024
Hi all,
I am a beginner in LlamaIndex, and I am trying to build a chatbot that allows users to enter their company values.

The description of the workflow is attached as a file.

The problem is that I do not know the right approach. I would greatly appreciate it if someone could give me some advice.

Thank you in advance
Hi all,
Is a node equal to a document? For example, when I have a JSON file, it is equal to 1 node?
2 comments
b
L
Hello everyone,

I intend to utilize openchat_3.5 as my Language Model (LLM) instead of ChatGPT for Retrieval-Augmented Generation. To achieve this, I've successfully downloaded the openchat_3.5.Q8_0.gguf model onto my computer. I'm employing the llama_cpp library to establish a connection to the LLM, as illustrated below:
Plain Text
from llama_cpp import Llama

llm = Llama(model_path="/Users/developer/ai/models/openchat_3.5.Q8_0.gguf", n_gpu_layers=1, n_ctx=2048)

Now, I'm seeking guidance on how to link LlamaIndex to the local LLM, such as openchat_3.5.Q8_0.gguf.

Thank you.
15 comments
b
S