The most rapid route to a local installation of this model is through WSL2.

Follow the guidelines below to continue.

The loader auto-caches the model archive (several GBs included).

An automated hardware sweep ensures the system will select the best tuning parameters.