GPT4All from nomic ai lets your run models locally hassle free

got access to Fly GPUs · Fly , this makes serverless AI possible.