August 30, 2023

Added Llama2 70B quickstart template endpoint at: https://octoai.cloud/templates/llama-2-70b-chat-demo. We can also host custom Llama2 LoRAs/ checkpoints for you-- please reach out on Discord if you're interested.
Enabled users to upload data via URL in the authoring experience (CLI + Python SDK)
Added real-time streaming capabilities to our Whisper audio flow, with a React hook called useWhisper for ease of integration into web/mobile apps. You can learn about how to use this feature here: https://github.com/octoml/octoai-template-apps/tree/main/real-time-audio-conversation
Changed the domain for all newly created endpoints from octoai.cloud to octoai.run Existing endpoints on octoai.cloudwill still work, but we suggest that you start changing your code to call endpoints from octoai.run instead of octoai.cloud, since we'll also update existing endpoints in about a month.