GoThread
all local communities rss
log in
c/programmer_humor@programming.dev · sanitation@lemmy.today · 2 Sep 2026 23:30

New compression technique

check post at origin

1188
155 comments

log in to comment.

comments

top new hot controversial
‹ show full thread
  • @ShellMonkey@piefed.socdojo.com · 3 Sep 2026

    On a similar note, I saw a story a bit back of someone saving input tokens by feeding the bot an image of a wall of text rather than the text itself and having it read the image via OCR.

    Satire and reality are too hard too distinguish these days.

    40
    link
    • @skisnow@lemmy.ca · 3 Sep 2026

      I see this one all the time on LinkedIn, the management rubes love it

      6
      link
    • @SorryQuick@lemmy.ca · 3 Sep 2026

      Saves input tokens and uses more output because of OCR, and output is priced way higher.

      2
      link
      • @Rooster326@programming.dev · 3 Sep 2026

        It’s an accounting trick. It uses a different budget…

        2
        link
      • @boonhet@sopuli.xyz · 3 Sep 2026 · edited

        Also if you’re doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol

        0
        link
    • @topperharlie@lemmy.world · 3 Sep 2026

      I mean, back in my days (👴) people sent a photo pasted into a word document, so things haven’t change that much…

      2
      link
      • @Natanael@infosec.pub · 3 Sep 2026

        They still do

        1
        link
    • @brian@programming.dev · 3 Sep 2026

      this is the default compaction method in omp now. afaik it’s exploiting the pricing structure of the big providers more than anything

      0
      link
GoThread · self-hosted threadiverse · instances · AGPL-3.0