Search results
Welcome to KoboldAI on Google Colab, GPU Edition! KoboldAI is a powerful and easy way to use a variety of AI based text generation experiences. You can use it to write stories, blog posts, play...
How to use. Choose a GPTQ model in the "Run this cell to download model" cell. You can type a custom model name in the Model field, but make sure to rename the model file to the right name, then...
You can use our GPU colab and select the United version to load models up to 13B. Both versions are capable of using our API and will work as you expect from a KoboldAI product. If you are...
Apr 10, 2020 · If you don't use GPU but remain connected with GPU, after some time Colab will give you a warning message like Warning: You are connected to a GPU runtime, but not utilising the GPU. Change to a standard runtime.
Jun 23, 2023 · KoboldAI offers a variety of AI models, each designed for a specific style of writing. In this tutorial, we'll be using the GPU version of these models on Google Colab. Here's an overview of the models we can choose from: Nerys: A hybrid model designed for both novel writing and adventure mode.
Jun 14, 2023 · Kobold AI Colab is a special version of Kobold AI that runs on Google Colab and lets you use any of the supported models and features. You can use Kobold AI Colab by finding the link on the official website or the GitHub repository.
Operating within Google Colab, Kobold Colab offers GPU and TPU access. While it's free with a Google Account, note potential limitations like slowdowns. Customize your experience with various models and settings, and elevate your creative journey with Kobold AI on Google Colab!
Jan 17, 2020 · I'm using a GPU on Google Colab to run some deep learning code. I have got 70% of the way through the training, but now I keep getting the following error: RuntimeError: CUDA out of memory.
Google Colab is a platform for AI researchers / programmers to get free compute for their AI experiments. Strengths of Colab: Free for a multiple hours per day if GPU's are available. Easy to use with the KoboldCpp colab notebook. Runs up to 20B models on the free tier.
No matter if you want to use the free, fast power of Google Colab, your own high end graphics card, an online service you have an API key for (Like OpenAI or Inferkit) or if you rather just run it slower on your CPU you will be able to find a way to use KoboldAI that works for you.
