Frustratingly bad at self hosting. Can someone help me access LLMs on my rig from my phone
MTK @ MTK @lemmy.world Posts 50Comments 1,923Joined 2 yr. ago
MTK @ MTK @lemmy.world
Posts
50
Comments
1,923
Joined
2 yr. ago
Mod at Palestine@lemmy.ml removes comment, probably based on a political bias.
There were probably some people who just really liked "Never gonna give you up" and really enjoyed getting rick rolled
Americans, how do you feel about the latest statment from Trump about deporting legal US born citizens?
Ollama + open webui + tailscale/netbird
Open webui provides a fully functional docker with ollama, so just find the section that applies to you (amd, nvidia, etc) https://github.com/open-webui/open-webui?tab=readme-ov-file#quick-start-with-docker-
And on that host install netbird or Tailscale, install the same on your phone, in tailscale you need to enable magicdns but in netbird I think it provides dns by default.
Once the docker is running and both your server and phone are connected to the vpn (netbird or tailscale) you just type the dns of your server in your phone's browser (in netbird it would be "yourserver.netbird.cloud" and in tailscale it would be "yourserver.yourtsnet.ts.net")
Checkout networkchuck on youtube as he has a lot of simple tutorials.