103

My best list of free ChatGPT and other models. Required - no signups.

you are viewing a single comment's thread
view the rest of the comments
[-] speck@kbin.social 1 points 1 year ago

Is it cost prohibitive to adopt your own chatgpt?

[-] XEAL@lemm.ee 3 points 1 year ago

You're billed per token usage. GPT-3.5-Turbo price per 1K tokens is quite low now.

I kinda made my own Custom ChatGPT with Python (and LOTS of coding help from Web CharGPT). It evolved from a few lines shitty script to a version that uses Langchain and has access to custom tools, including custom data indexes and has a persistent memory.

What will ramp up the cost are things like how much context (memory) you want the chatbot to have. If you use something like a recursive summarizer, that summarizes a text by chunks over and over until the text is below a set length, that also uses many API calls that consume tokens. Also, if you want your chatbot to use custom info that you provided to it, solutions like LlamaIndex are easy to use, but require quite some tokens per query.

On my worst month, with lots of usage due to testing and without the latest price drop, I reached 70$.

[-] speck@kbin.social 3 points 1 year ago

Loved the depth of this info - although it's over my head. But I kind of understood? I have a project for next while to focus on. But I hear that it's possible to do, and that's exciting

[-] XEAL@lemm.ee 0 points 1 year ago

I know, it's fuxxing dense all the info about the Open API and Python to create a model.

I don't even know how I got so far.

load more comments (3 replies)
load more comments (4 replies)
this post was submitted on 11 Jul 2023
103 points (96.4% liked)

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

54609 readers
410 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others



Loot, Pillage, & Plunder

📜 c/Piracy Wiki (Community Edition):


💰 Please help cover server costs.

Ko-Fi Liberapay
Ko-fi Liberapay

founded 1 year ago
MODERATORS