Mohan Poornachandra • 9 months ago
Using Google Colab for building local agent
Since the gpt-oss 20B doesn't run efficiently on my machine, can I use Google Colab and import the open source model through hugging face?
It will be considered as a local agent right?
Comments are closed.
1 comment
Shawni Devpost Manager • 9 months ago
You are welcome to use a cloud provider to either host the model yourself on those cloud providers or use any of them that provide inference for the model. A lot of the providers are still improving their implementations so if you are running into issues over the next couple of days, trying a different provider or waiting for a few days might resolve some issues. Some hosted providers are listed on openai.com/open-models.
Hugging Face also recently released a cookbook explaining how to use the model in Google Colab for free: https://cookbook.openai.com/articles/gpt-oss/run-colab. Hope this helps and best of luck!