17
How can I use a local LLM on Linux to generate a long story? (lemmy.world)
submitted 4 months ago by ChasingEnigma@lemmy.world to c/linux@lemmy.ml
11 comments fedilink

I'm interested in automatically generating lengthy, coherent stories of 10,000+ words from a single prompt using an open source local large language model (LLM) on low-spec hardware like a laptop without GPU and with i5-8250U, 16GB DDR4-2400MHz. I came across the "Awesome-Story-Generation" repository which lists relevant papers describing promising methods like "Re3: Generating Longer Stories With Recursive Reprompting and Revision", announced in this Twitter thread from October 2022 and "DOC: Improving Long Story Coherence With Detailed Outline Control", announced in this Twitter thread from December 2022. However, these papers used GPT-3, and I was hoping to find similar techniques implemented with open source tools that I could run locally. If anyone has experience or knows of resources that could help me achieve long, coherent story generation with an open source LLM on low-spec hardware, I would greatly appreciate any advice or guidance.

3
... (lemmy.world)
submitted 4 months ago* (last edited 2 months ago) by ChasingEnigma@lemmy.world to c/asklemmy@lemmy.ml
1 comments fedilink

I just watched "Fun with AI by Sheldon Cooper" on YouTube and I think that's just a preview of what's coming. I think it will be pretty much the same as social media where anything you say has already been said before dozens of times. But for video, so anything you want to watch has many different and similar spins. I think there will be more AI-generated movies similar to existing popular ones than there are fanfics written today. How do you think it will be like?

... by ChasingEnigma in c/fediverse@lemmy.world
... by ChasingEnigma in c/fediverse@lemmy.world
... by ChasingEnigma in c/fediverse@lemmy.world
*Permanently Deleted* by ChasingEnigma in c/til@lemmy.world
*Permanently Deleted* by ChasingEnigma in c/til@lemmy.world
*Permanently Deleted* by ChasingEnigma in c/asklemmy@lemmy.world
*Permanently Deleted* by ChasingEnigma in c/til@lemmy.world
*Permanently Deleted* by ChasingEnigma in c/asklemmy@lemmy.world
*Permanently Deleted* by ChasingEnigma in c/til@lemmy.world
*Permanently Deleted* by ChasingEnigma in c/asklemmy@lemmy.world
[-] ChasingEnigma@lemmy.world 18 points 6 months ago* (last edited 6 months ago)

That already came in the latest 0.19 release.

This is the issue: Add option to open links in a new tab

*Permanently Deleted* by ChasingEnigma in c/asklemmy@lemmy.world
[-] ChasingEnigma@lemmy.world 18 points 6 months ago* (last edited 6 months ago)

Right now I'm not particularly excited about any upcoming features.

I wish there was some feature in the works to let me see less memes and US politics without having to block or subscribe to a bunch of communities. I thought scaled sorting would solve this issue, I was really looking forward to it, but it didn't quite live up to my expectations. I thought it would be like the "top" sort but with more diversity, but it ended up feeling more like the "new" sort with most posts having just a single vote.

The last release had some great additions. I wish there was a roadmap for Lemmy so I could anticipate future releases and features like I do with other projects.

It would also be great to have nightly builds for testing new features before they're officially released on most instances.

86
What software do you wish that existed? (lemmy.world)
submitted 8 months ago by ChasingEnigma@lemmy.world to c/asklemmy@lemmy.world
121 comments fedilink
20
Stash v0.24.0 released (github.com)
submitted 8 months ago by ChasingEnigma@lemmy.world to c/opensource@lemmy.ml
0 comments fedilink

cross-posted from: https://discuss.online/post/3916219

v0.24.0 - 2023-12-27

This release boasts a (long asked for) management interface for installing, updating and uninstalling scrapers and plugins. Note that this interface is not compatible with any already installed scrapers/plugins, so you will need to use the management interface to install these, and delete your existing ones if you want to use the new UI.

It also adds a suite of new abilities to plugins, allowing for more advance plugins to be created. It also has a bunch of other improvements and bug fixes, see the changelog for details.

Full changelog: https://github.com/stashapp/stash/releases/tag/v0.24.0

*Permanently Deleted* by ChasingEnigma in c/asklemmy@lemmy.world

ChasingEnigma

joined 1 year ago