Interface KnowledgeBaseSourceProcessingPipeline

All Known Implementing Classes:
DefaultKnowledgeBaseSourceProcessingPipeline

public interface KnowledgeBaseSourceProcessingPipeline

 PROCESSING
    ----------

    KnowledgeBaseSourceProcessor
     - input: KnowledgeBaseSourceItem
     - output: KnowledgeBaseItem has List<KnowledgeBaseItemSection>

         -> split into dumb chunks
         -> split into  markdown sections
         -> split into 'smart' sections

     KnowledgeBaseSourceProcessor : Pipeline in Design/runtime:
     Work Folder -> Document --> TextBasedFormat --> Conversion into chunks --> Conversion into embeddings --> KnowledgeBaseItem

     Important! In one Knowledgebase: define embedding model outside of pipeline
     On publish - when embedding model changes --> remove / redo all existing ones!

     In UI:
     * manage the KnowledgeBaseItems

     notes
     * config options, what to do with the pictures?