A cache that uses Upstash as the backing store. See https://docs.upstash.com/redis.
Lookup LLM generations in cache by prompt and associated LLM key.
Update the cache with the given generations.
Note this overwrites any existing generations for the given prompt and LLM key.
Generated using TypeDoc
A cache that uses Upstash as the backing store. See https://docs.upstash.com/redis.