Long Term Memory
The Cat has memory that persist across restarts, this memory is implemented using a vector database.
The name of this memory is Long Term Memory
(LTM), it is made of three components:
- Episodic Memory, contains an extract of things the user said in the past;
- Declarative Memory, contains an extract of documents uploaded to the Cat;
- Procedural Memory, contains the set of Python functions that defines what the Cat is able to do.
During conversation between the Cat and the user, the memories are accessed by the Cat to retrieve relevant context for passing to the LLM and are updated when the LLM responds (details of the read and write flow of the Long Term Memory can be found in this diagram).
The retrieved relevant context is used to make up the Main prompt and the Instruction prompt.
You can interact with the LTM using the memory page of the Admin Portal.