Interface KnowledgeBaseSourceProcessingPipeline
- All Known Implementing Classes:
DefaultKnowledgeBaseSourceProcessingPipeline
public interface KnowledgeBaseSourceProcessingPipeline
PROCESSING
----------
KnowledgeBaseSourceProcessor
- input: KnowledgeBaseSourceItem
- output: KnowledgeBaseItem has List<KnowledgeBaseItemSection>
-> split into dumb chunks
-> split into markdown sections
-> split into 'smart' sections
KnowledgeBaseSourceProcessor : Pipeline in Design/runtime:
Work Folder -> Document --> TextBasedFormat --> Conversion into chunks --> Conversion into embeddings --> KnowledgeBaseItem
Important! In one Knowledgebase: define embedding model outside of pipeline
On publish - when embedding model changes --> remove / redo all existing ones!
In UI:
* manage the KnowledgeBaseItems
notes
* config options, what to do with the pictures?
-
Method Summary
Modifier and TypeMethodDescriptionvoidprocess(String knowledgeBaseDefinitionId, KnowledgeBaseDefinitionModel definition, KnowledgeBaseSourceItem sourceItem)
-
Method Details
-
process
void process(String knowledgeBaseDefinitionId, KnowledgeBaseDefinitionModel definition, KnowledgeBaseSourceItem sourceItem)
-