tocache

tocache - Token Cache. This little library stores each prompt and response in the cache and retrieves it when such a prompt has been used. This minimizes the number of requests needed when used.