Can I run AI in an air-gapped or on-premises environment?
Yes. Open-weight models and local inference software run with no internet connection. Download the models and software on a connected machine, move them into the secure network, and run everything there.
Verify the files you bring in. Download weights from the official publisher, record checksums, and prefer the safetensors format, which cannot run code when loaded.
Turn off remote code. Some models ask to run custom Python from their repository (trust_remote_code). Leave this off unless you have reviewed the code.
Plan updates. New models and security patches need the same transfer process, so schedule it.
Sources
Updated