Environment setup

To run our example app, there are four simple steps to take:

1. Clone the Falcon-7b demo template to your OctoAI account by visiting https://octoai.cloud/templates/falcon-7b-demo then clicking "Clone Template."
   1. If you want to use a different LLM model you can select another demo template. You can also containerize the model and make a custom OctoAI endpoint yourself, by following Build a Container from Python and Create a Custom Endpoint from a Container
2. Paste your Endpoint URL in a file called .env in the root directory of the project.

ENDPOINT_URL=<your Endpoint URL here>

3. Get an API Token from your OctoAI account page.
4. Paste your API key in a file called .env in the root directory of the project.

OCTOAI_API_TOKEN=<your key here>

The next few pages will walk you through the detailed code in the repo.