Repository navigation
Unsloth #2125
Description
Name of the Script
Unsloth
Script Type
CT (LXC Container)
Does this script support arm64?
arm64 not supported
📋 Script Details
Unsloth Studio — local web UI for running and fine-tuning LLMs. Search/download/serve GGUF, LoRA and safetensors models, side-by-side model comparison, export, and OpenAI-/Anthropic-compatible endpoints (/v1/chat/completions, /v1/responses, /v1/messages) so local models can back Claude Code or Codex.
This was initially assessed as "a Python library, not an app" and rejected — that was wrong. The repo description is now "Unsloth is a local UI for training and running…", studio/ contains a full backend/ + frontend/, and the README states Windows, Linux and macOS.
- No
curl | sh: the vendor installer was read and its essentials reproduced —uv pip install --torch-backend=auto unsloth-zoo unslothinto a venv, launched via<venv>/bin/unsloth studio. Installer lines 4178/4487 for reference. -H 0.0.0.0is passed explicitly; the default binds loopback only.UNSLOTH_STUDIO_PASSWORDis generated and written to the env file. Without itstudio/backend/auth/terminal_prompt.pyasks on the terminal, which a systemd unit cannot answer — the service would hang on first start.--torch-backend=autolets uv pick CPU or CUDA wheels depending on what the container sees, so the same script works with and without passthrough.var_gpu="yes".- Note: fine-tuning needs an NVIDIA GPU. On CPU-only, inference/model management/export/API work but training does not — documented as a warning.
has_arm: false— the torch/CUDA stack makes arm64 untested at best.
Reacted by Andrea Draghetti
Activity
flatlinebb commentedon Aug 3, 2026
It's not working for me:
Here is my system:
Let me know if you need any other info.
MickLesk commentedon Aug 4, 2026
Its currently not for testing, we need to add the label if its Ready for Testing
github-actions commentedon Aug 4, 2026
The Unsloth script is ready for testing:
The generated UI password is stored as UNSLOTH_STUDIO_PASSWORD in /opt/unsloth.env. Without it Unsloth Studio would prompt for one on the terminal, which a systemd service cannot answer.
Fine-tuning requires an NVIDIA GPU. Without one, inference, model management, export and the OpenAI-compatible API work, but training does not. Pass a card through and install the NVIDIA driver in the container to enable it.
Models and Hugging Face caches land in /opt/unsloth_data, which fills up quickly - a single 7B model at Q4 is roughly 4 GB. Give the container more disk if you plan to keep several, and back that directory up rather than /opt/unsloth.
PyTorch is installed with uv's --torch-backend=auto, so a CPU-only container gets the CPU wheels and a GPU container the matching CUDA build. Re-run the update after adding a GPU so the right backend is pulled.
Note: This is not in the official repo yet—it's just a dev version! After merging into ProxmoxVE, it will need to be recreated.
Discord testing thread: https://discord.com/channels/1302816934508630047/1534101359845052477
kintaro1981 commentedon Aug 6, 2026
I just installed it.
I activated unsloth/gemma-4-E2B-it-qat-GGUF but if I try to ask for a web search doesn't work.
ping to google.com is working
kintaro1981 commentedon Aug 6, 2026
Another issue:
after rebooting the LXC unsloth is unreachable.
kintaro1981 commentedon Aug 6, 2026
The issue is the password in
/opt/unsloth.envAFAIK this env var is needed only during the installation.
I tried to comment the env variable
UNSLOTH_STUDIO_PASSWORDand aftersystemctl start unsloth.servicethe service started without errors.MickLesk commentedon Aug 6, 2026
Its their official Installer 🤔
MickLesk commentedon Aug 6, 2026
ive pushed now a little fix, but i dont have the time now to test it, feel free to redeploy the container and test it :-)
kintaro1981 commentedon Aug 6, 2026
I confirm that now after a reboot unsloth studio start correctly
right now after installing it, you need to use
unsloth studio reset-password(no need to restart) because the password is unknown so a warning in the info page is needed.about web search is now working so it works with local models too.
MickLesk commentedon Aug 7, 2026
Password is in /root/unsloth.creds
kintaro1981 commentedon Aug 7, 2026
So it's needed to update the script page with this new information.
kintaro1981 commentedon Aug 14, 2026
The tool calling issue from connected model has been addressed, see here:
unslothai/unsloth#7761 (comment)
But I haven’t tried yet.
13 remaining items
github-actions commentedon Nov 13, 2026
📊 Install telemetry for
unslothRuns reported by the DevScripts version of this script since this issue was opened (2026-08-03).
Last success: 2026-11-12 20:15 UTC · Last failure: 2026-11-02 15:27 UTC · Avg. install time: 14 min
Failures by cause (top 5)
214Proxmox: Not enough storage spaceExit 214: Proxmox: Not enough storage spaceStorage 'local-zfs' is 99% full – refusing install in unattended mode
7curl: Failed to connect (network unreachable / host down)Exit 7: curl: Failed to connect (network unreachable / host down)Failed to download uv from https://github.com/astral-sh/uv/releases/download/0.x.x/uv-x86_64-unknown-linux-gnu.tar.gz
1General errorExit 1: General error1General errorsh /tmp/unsloth-install.shVersion-pinned install failed - trying unpinned
223Proxmox: Template not available after downloadExit 223: Proxmox: Template not available after downloadTemplate debian-13-standard_13.6-1_amd64.tar.zst not available in storage local after download.
Open in the telemetry dashboard · updated hourly · last refresh 2026-11-13 07:22 UTC
michelroegl-brunner commentedon Nov 13, 2026
/test unsloth
Screenshot: ct/unsloth.sh (pve) for #2125 at 9abafac
Screenshot: ct/unsloth.sh (pve)-after-update for #2125 at 9abafac
Screenshot: ct/unsloth.sh (incus) for #2125 at 9abafac
Screenshot: ct/unsloth.sh (incus)-after-update for #2125 at 9abafac
github-actions commentedon Nov 13, 2026
Proxmox script test
@michelroegl-brunner @MickLesk ✅ 2/2 passed at
9abafacct/unsloth.shct/unsloth.shNotes (information only, not counted):
ct/unsloth.sh(pve): a second 'update' right after the first updated again: update_script does not notice it is current (e.g. a version file it never writes)ct/unsloth.sh(incus): a second 'update' right after the first updated again: update_script does not notice it is current (e.g. a version file it never writes)📊 Resources
ct/unsloth.shct/unsloth.sh📸 ct/unsloth.sh (pve) — http://10.99.0.205:8888: after install / after update
📸 ct/unsloth.sh (incus) — http://10.98.0.253:8888: after install / after update
Not built:
ct/unsloth.shon ARM64: the script setsvar_arm64=no📄 ct/unsloth.sh (pve) — install log (1398 lines)
🔄 ct/unsloth.sh (pve) — update log (19 lines)
🔁 ct/unsloth.sh (pve) — second update log
📄 ct/unsloth.sh (incus) — install log (647 lines)
🔄 ct/unsloth.sh (incus) — update log (18 lines)
🔁 ct/unsloth.sh (incus) — second update log
Full logs: workflow run (artifacts
result-*). Comment/test unslothto build again.github-actions commentedon Nov 13, 2026
A PR has been created for unsloth: community-scripts/ProxmoxVE#18697
MickLesk commentedon Nov 13, 2026
Merged with #18697 in ProxmoxVE
github-actions commentedon Nov 13, 2026
Files deleted with PR #2611