266
submitted 5 months ago by Clbull@lemmy.world to c/196@lemmy.blahaj.zone
top 28 comments
sorted by: hot top controversial new old
[-] sunoc@sh.itjust.works 18 points 5 months ago

Wait, just the client? I thought the madlad ran the model on their phone!

[-] Smorty@lemmy.blahaj.zone 20 points 5 months ago

apparently not. it seems they are refering to the official bs deepseek ui for ur phone. running it on your phone fr is super cool! Imma try that out now - with the smol 1.5B model

[-] sunoc@sh.itjust.works 5 points 5 months ago

Good luck ! You’ll need it to run it without a GPU…

[-] Smorty@lemmy.blahaj.zone 13 points 5 months ago

i kno! i'm already running a smol llama model on the phone, and yeaaaa that's a 2 token per second speed and it makes the phone lag like crazy... but it works!

currently i'm doing this with termux and ollama, but if there's some better foss way to run it, i'd be totally happy to use that instead <3

[-] gandalf_der_12te@lemmy.blahaj.zone 3 points 4 months ago* (last edited 4 months ago)

i think termux is probably already the best way to go, it ensures linux-like flexibility, i guess. but yeah, properly wiring it up, with a nice Graphical User Interface, would be nice, i guess.

Edit: now that i think about it, i guess running it on some server that you rent, is maybe better, because then you can access that chat log from everywhere, and also, it doesn't drain your battery so much. But then, you need to rent a server, so, idk.

Edit again: Actually, somebody should hook up the DeepSeek chatbot to Matrix chat, so you can message it directly through your favorite messaging protocol/app.


edit again: (one hour later) i tried setting up deepseek 8b model on my rented server, but it doesn't have enough RAM. i tried adding swap space, but it doesn't let me. I figured out that you can't easily add swap space in a container. somehow, there seems to be a reason to that. too tired to explore further. whatever.

[-] Smorty@lemmy.blahaj.zone 2 points 4 months ago

big sad :(

wish it would be nice and easi to do stuff like this - yea hosting it somewhere is probably best for ur moni and phone.

[-] gandalf_der_12te@lemmy.blahaj.zone 1 points 4 months ago

actually i think it kinda is nice and easy to do, i'm just too lazy/cheap to rent a server with 8GB of RAM, even though it would only cost $15/month or sth.

[-] Smorty@lemmy.blahaj.zone 2 points 4 months ago

it would also be super slow, u usually want a GPU for LLM inference.. but u already know this, u are Gandald der zwölfte after all <3

[-] gandalf_der_12te@lemmy.blahaj.zone 1 points 4 months ago

woag you speak german (gasp)

where are you from?

[-] Smorty@lemmy.blahaj.zone 1 points 4 months ago

eh, Rheinland Pfalz, near Mainz. how bout u? <3

[-] gandalf_der_12te@lemmy.blahaj.zone 1 points 4 months ago* (last edited 4 months ago)

o.O du verarscht mich jetzt oder? noch so'n cutie das aus deutschland stammt. Ich wohne in Wien ;-)

[-] Smorty@lemmy.blahaj.zone 1 points 4 months ago* (last edited 4 months ago)

heyyyyyy... maybe don use this aggressive word... maybemaybs... - i jus don like it for som reason...

also, nuuuuu don just say ~cutie~ like that!!! >~< That's like - im used to reading it in English but not in ~german...~

also also, who else did u find here who u would call ~that~ ~word~ an who is also from the grrrmn land?

[-] gandalf_der_12te@lemmy.blahaj.zone 1 points 4 months ago

"silberzunge" miss brainfart z.b.

bist du nicht eh in mia's gruppenchat? dann kennst du sie ja

[-] Smorty@lemmy.blahaj.zone 2 points 4 months ago

jaja ich kenne miss brainfart, ich erinnere mich noch... als sie auf lemmy war...

das waren Zeiten <3

[-] Smorty@lemmy.blahaj.zone 16 points 5 months ago

wait what's bad about it?

~i~ ~installed~ ~llama~ ~on~ ~my~ ~phone...~

[-] Clbull@lemmy.world 42 points 5 months ago

A US senator has introduced a bill trying to criminalize it with a 20 year prison sentence.

Also, the US and El Salvador are doing a prisoner deportation deal.

I'm not making this up.

[-] SoftestSapphic@lemmy.world 3 points 4 months ago

Capitalism hates competition

[-] jmcs@discuss.tchncs.de 2 points 5 months ago

If it's running locally nothing.

If you install the actual deepseek app, you might as well post your prompts openly on social media.

[-] Smorty@lemmy.blahaj.zone 3 points 5 months ago

oh yea, installing the app is super dum. your point is very good.

[-] SoftestSapphic@lemmy.world 3 points 4 months ago

It doesn't require any permissions.

Meanwhile Facebook, Google, Snap Chat, fucking TEAMS, require you to give them access to your camera and microphone 24/7

But yeah app bad cuz china

[-] Smorty@lemmy.blahaj.zone 1 points 4 months ago

its all about peeps sharing their personal info on these chatbots. Many peeps do, so I guess it kinda makes sense.

[-] Gigliorananomicom@sh.itjust.works 3 points 5 months ago

So...this whole thing is about hiding lewd prompts?

[-] Smorty@lemmy.blahaj.zone 6 points 5 months ago* (last edited 5 months ago)

nono, the whole thing is about some people putting personal info into these chatbots.

and even if not, they are guaranteed to train their newer models on the requests and generated responses.

if ur putting personal info, running in locally/privately is kinda a must, if u care about security at all.

i think peeps try lewd prompts once, then find out it doesn't work, and then give up. (they don't know about huggingface)

[-] Gigliorananomicom@sh.itjust.works 2 points 5 months ago

Why would anyone....you know, nevermind 😂

[-] Foni@lemm.ee 3 points 5 months ago

I normally use it to help me with my English translations here on lemmy (I can more or less get by but I prefer it to be correct), so I already do it.

[-] Soup@lemmy.world 6 points 5 months ago

You can also use DeepL for that, which I’m willing to bet uses a lot less energy and is a very reliable translation service.

[-] Foni@lemm.ee 2 points 4 months ago

Yes and I use it more often, but sometimes a literal translation is not enough, I know enough English to notice when something is weird and in those cases I go to chatgpt or deepseek who understand what you mean and its context and give you the same thing and with the same tone in another language. I don't use it all the time, but it greatly improves the result.

[-] criitz@reddthat.com 0 points 4 months ago

I would never install Chinese spyware on my Samsung!

/s

this post was submitted on 05 Feb 2025
266 points (98.9% liked)

196

17993 readers
989 users here now

Be sure to follow the rule before you head out.


Rule: You must post before you leave.



Other rules

Behavior rules:

Posting rules:

NSFW: NSFW content is permitted but it must be tagged and have content warnings. Anything that doesn't adhere to this will be removed. Content warnings should be added like: [penis], [explicit description of sex]. Non-sexualized breasts of any gender are not considered inappropriate and therefore do not need to be blurred/tagged.

If you have any questions, feel free to contact us on our matrix channel or email.

Other 196's:

founded 2 years ago
MODERATORS