GoThread
all local communities rss
log in
c/programmer_humor@programming.dev · sanitation@lemmy.today · 2 Sep 2026 23:30

New compression technique

check post at origin

1188
155 comments

log in to comment.

comments

top new hot controversial
‹ show full thread · in reply to @ShellMonkey@piefed.socdojo.com
  • @SorryQuick@lemmy.ca · 3 Sep 2026

    Saves input tokens and uses more output because of OCR, and output is priced way higher.

    2
    link
    • @Rooster326@programming.dev · 3 Sep 2026

      It’s an accounting trick. It uses a different budget…

      2
      link
    • @boonhet@sopuli.xyz · 3 Sep 2026 · edited

      Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol

      0
      link
GoThread · self-hosted threadiverse · instances · AGPL-3.0