Spyke

Syndicated from the fediverse. Read and engage on the original instance.

View original on lemmy.durstig.online
ai_reddit·AI (Reddit RSS)byeifachposte

I am ditching .mp4 for use with Claude. Instead use an oss .cdaf (AI-friendly) format for 91% cost efficiency

Original Reddit post

If you have tried editing videos with claude, you already know the reason. .mp4 is flawed. You just can't give a whole video file to claude's context for it to edit. I am talking about B-rolls, raw footages, assets, SVGs, etc. A 3 min 4k or 1080 video will eat 100K of tokens at minimum. Go 2-3 times back-and-forth and the limit is exhausted. Plus.. the latency increases hugely and the accuracy/efficiency decreases exponentially. And at this point, if you think using hyperframes or remotion is easy, god bless you! I have open sourced a .cdaf or 'cached descriptive asset file' format. It stores she256-encrypted timestamped visual description of videos and links it to the original .mp4 file. Anytime your Claude wants to use a video, it uses the .cdaf file to read what scene it should pick from it or what duration and then continues the edit. We tested on benchmarks -

  • 91% token and cost reduction
  • 65% latency reduction Everything is in the evals & bench. Try it out and ask me if you have an open Q. submitted by /u/Uditakhourii

Originally posted by u/Uditakhourii on r/ClaudeCode

https://zenodo.org/records/22110594Open linkView original on lemmy.durstig.online
1

No replies yet

No comments on the original post yet.
I am ditching .mp4 for use with Claude. Instead use an oss .cdaf (AI-friendly) format for 91% cost efficiency | Spyke