by ontouchstart
1 subcomments
- I still have trouble to get unsloth studio setup working on my MacBook because of Python tooling issues.
However, since I already have pi working with llama.cpp server from a docker container, I did a quick experiment to compare three code bases:
https://gist.github.com/ontouchstart/7483c12efa3c3d3a49e38c2...
https://gist.github.com/ontouchstart/217fe2b8103a5c0bfaee1e9...
Very interesting.
Will do it again next week if I can get unsloth studio working.
- What is unsloths business/income? They seem to be publishing lot of stuff for free, with no clear product to back them?
by illusive4080
1 subcomments
- Apache license. Can’t wait to try it out at work! LMStudio’s proprietary license makes getting permission hard.
- Unsloth is the real thing. Highly recommended for those running their own AI engines and that want to get the most out of them.
- I noticed the training part, that was interesting for my use case. Unfortunately it's said 'on NVIDIA'.
Is there an alternative, tutorial, or project you'd recommend that would help me do supervised fine tuning (SFT) with the metal stack / macOS?
by pentagrama
0 subcomment
- LM Studio user here. Unsloth looks great, wanted to check it out, but there is no app file to download and install? Sorry I'm not familiar with the command line.
- Tried to build from source on MacOS, but got this error:
(base) unsloth git:(main) unsloth studio setup
╔══════════════════════════════════════╗
║ Unsloth Studio Setup Script ║
╚══════════════════════════════════════╝
Node v25.8.1 and npm 11.11.0 already meet requirements. Skipping nvm install.
Node v25.8.1 | npm 11.11.0
npm run build failed (exit code 2):
> unsloth-theme@0.0.0 build
> tsc -b && vite build
src/features/chat/shared-composer.tsx(366,17): error TS6133: 'status' is declared but its value is never read.
- Installing with pip on macOS is just not an acceptable option. It'll mess up your system just like npm or gem.
This needs to go on homebrew or be a zip file with an app for manual download.
- I hope you will support AMD. This looks Nice but I went the complicated route with AMD GPUs.
- Will check back when there's AMD support.
by meowokIknewit
1 subcomments
- The GUI for the fine tuning looks interesting. Hopefully this leads to a lot of new custom models
- FYI, if any devs are around, the privacy policy still links to the gitbook.
- Does it use gpu support on mac? At least when running setup, it said cpu only.
- Excited to use this been using unsloth models for the past couple years
- Congrats to team. Busy build a dataset for training so will def test it out
by peddling-brink
0 subcomment
- This looks really cool. Any chance you'll support pretraining runs as well?
- Nice! Is there something planned to run the finetuning via hf jobs or runpod?
- Can Unsloth Studio use already downloaded models?
- wish there were an option to disable the annoying startup messages with emojis when using the library.
by saberience
4 subcomments
- Who's the intended user for this?
Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?
Is it a competitor to LMStudio?
- [dead]
by smissingham
0 subcomment
- [dead]
- [dead]