I am ditching .mp4 for use with Claude. Instead use an oss .cdaf (AI-friendly) format for 91% cost efficiency
If you have tried editing videos with claude, you already know the reason. .mp4 is flawed. You just can't give a whole video file to claude's context for it to edit. I am talking about B-rolls, raw footages, assets, SVGs, etc. A 3 min 4k or 1080 video will eat 100K of tokens at minimum. Go 2-3 times back-and-forth and the limit is exhausted. Plus.. the latency increases hugely and the accuracy/efficiency decreases exponentially. And at this point, if you think using hyperframes or remotion is easy, god bless you! I have open sourced a .cdaf or 'cached descriptive asset file' format. It stores she256-encrypted timestamped visual description of videos and links it to the original .mp4 file. Anytime your Claude wants to use a video, it uses the .cdaf file to read what scene it should pick from it or what duration and then continues the edit. We tested on benchmarks -
- 91% token and cost reduction
- 65% latency reduction Everything is in the evals & bench. Try it out and ask me if you have an open Q. submitted by /u/Uditakhourii
Originally posted by u/Uditakhourii on r/ClaudeCode
No replies yet