Configuring Bia-bob

We euquip Bia-bob with the open-weight model gpt-oss-120b hosted by academic LLM service providers. This file contains API-Keys for accessing LLM servers. We may use the server of ScaDS.AI at the ZIH of TU Dresden or the server of KISSKI hosted by GWDG in Göttingen.

Local installation

In case you execute these notebooks from your local computer, unzip the api_key.zip into the same folder. Afterwards, there should be an .env file. Afterwards, uncomment these two code lines and execute the cell:

#from dotenv import load_dotenv
#load_dotenv()

ScaDS.AI LLM service

import os
from bia_bob import bob
bob.initialize(endpoint='https://llm.scads.ai/v1', model='openai/gpt-oss-120b', api_key=os.environ.get('SCADSAI_API_KEY'))

This notebook may contain text, code and images generated by artificial intelligence. Used model: openai/gpt-oss-120b, vision model: None, endpoint: https://llm.scads.ai/v1, bia-bob version: 0.34.3.. Do not enter sensitive or private information and verify generated contents according to good scientific practice. Read more: https://github.com/haesleinhuepf/bia-bob#disclaimer

%bob print hello world

KISSKI ChatAI LLM service

import os
from bia_bob import bob
bob.initialize(endpoint='https://chat-ai.academiccloud.de/v1', model='openai-gpt-oss-120b', api_key=os.environ.get('KISSKI_API_KEY'))

%bob print hello world

Github models

For accessing github models you need to obtain an API Key from this servie and store it in the .env file as GH_MODELS_API_KEY.

from dotenv import load_dotenv
load_dotenv()

from bia_bob import bob
bob.initialize(endpoint='github_models', model="gpt-4o", vision_model="gpt-4o")

This notebook may contain text, code and images generated by artificial intelligence. Used model: gpt-4o, vision model: gpt-4o, endpoint: https://models.inference.ai.azure.com, bia-bob version: 0.34.3.. Do not enter sensitive or private information and verify generated contents according to good scientific practice. Read more: https://github.com/haesleinhuepf/bia-bob#disclaimer

%bob print hello world