The community member is seeking clarification on what the docstore is intended to store - chunks or full documents. The documentation states that the docstore stores chunks, but the community member has found that the ingestion pipeline stores the full document text before chunking when using document management. The comments indicate that the docstore can store both chunks and full documents, as a document and a chunk are essentially the same class under the hood. There is no explicitly marked answer, but the community members provide this clarification.
its just metadata/chunk enrichment -- nothing new really. Us and other libraries have had similar modules for ages. The cooler part about it is leveraging prompt caching to make it scalable