AI Terminology
Navigator Terminology
Use Cases & AI Architectures
Element Library
How to Deploy a Solution
How to create a local expert LLM
LLM Dataset Generator
LLM Trainer
LLM Chat
Document QnA
How to create a computer vision model
Building a Dataset: Image Classifier
Building a Dataset: Object Detector
Prototyping & Hardening for Production
How to implement your AI model
Templates: Document QnA
Templates: LLM Dataset Generation
Templates: Train an LLM
Templates: Custom LLM Chatbot
Templates: Local Expert
Supported LLM Base Models

Table of Contents

Templates: Local Expert

To use this template, you'll need a Trained Model. If you haven't created one yet, you can

  1. Start by creating a new Canvas and drag the LLM Chat element onto the Canvas.
  2. Open the LLM Chat Element setting and and make the following adjustments:‍
    • Model Dropdown: Select a model you have trained yourself. If you haven't trained a model, download a pre-made one at the link above and add it to the Model Adapter Folder Path.‍
    • Model Storage Path: Using the “Select Directory” button, choose the folder where you want the base model to be saved.‍
    • Model Adapter Folder Path: Use this to upload trained models from us, or models shared by others.
  3. Leave all other settings as the default.
  4. You can now hit run.
    Note:     Dependencies will be installed the first time this flow is run and may take a while.

‍