[Feature] LM Studio

[Phlogix]

1Panel Version

Pro V2.1.0

Please describe your needs or suggestions for improvements

LMStudio - AI is a beautiful project that allow people use local LLMs more effectively.

If dependencies are not high or mainly unfit to 1Panel like mailcow, it could be awesome to this project under application market.

it is basically like ollama plus it has gui, easly could get configured with openwebui.

Iftrastructure is a little bit though, it might not be quite easy to integrate to the 1Panel at this point. Maybe integrating their web interface + running a local ai server from a different machine and connect them through installation step it could be more easier like we do on openwebui app rn.

GUI allows user to manage more effectively local llms, context length etc etc.

Please describe the solution you suggest

Additional Information

It is basically an application what works like ollama. It has gui management as an application. It provides more flexibility to run local llms. It can easly get configured with openwebui but the main problem is mainly you need to unload or load the models on the server. to use it. GUI can we be alternative of openwebui, it has not an official docker but you can check this docker created by community https://hub.docker.com/r/noneabove1182/lmstudio-cuda

No response

[wanghe-fit2cloud]

Thanks for the feedback. Does LMStudio officially provide a Docker image? If so, please also share the Docker image link and your current docker run or docker-compose configuration so we can proceed with listing it in the app store.

[Phlogix]

Unfortunately, LMStudie does not provide officially a docker container. It most likely designed to run on operating system such as ollama, but it externally also provides GUI to manage local LLM models. Maybe updating openwebui in current app store that might be more helpful in current stage of project. So people can chose during installation configuration of ollama or LMStudio server pointing. Until that stage, we can close the ticket, or you can close it after openwebui integration. I will re-open in the future if LMStudio starts to provide an official docker container. Until that time 1Panel users can get benefit on it through openwebui integration.