@pavnilschanda@lemmy.worldcake to Technology@lemmy.worldEnglish • 9 months agoLLMs are surprisingly great at compressing images and audio, DeepMind researchers findventurebeat.comexternal-linkmessage-square12fedilinkarrow-up195arrow-down15cross-posted to: technology@lemmy.mltech@kbin.social
arrow-up190arrow-down1external-linkLLMs are surprisingly great at compressing images and audio, DeepMind researchers findventurebeat.com@pavnilschanda@lemmy.worldcake to Technology@lemmy.worldEnglish • 9 months agomessage-square12fedilinkcross-posted to: technology@lemmy.mltech@kbin.social
minus-squareNaibofTabrlinkEnglish10•9 months agoDo you need the dataset to do the compression? Is the trained model not effective on its own?
minus-square@Tibert@compuverse.uklinkfedilinkEnglish12•9 months agoWell from the article a dataset is required, but not always the heavier one. Tho it doesn’t solve the speed issue, where the llm will take a lot more time to do the compression. gzip can compress 1GB of text in less than a minute on a CPU, an LLM with 3.2 million parameters requires an hour to compress
Do you need the dataset to do the compression? Is the trained model not effective on its own?
Well from the article a dataset is required, but not always the heavier one.
Tho it doesn’t solve the speed issue, where the llm will take a lot more time to do the compression.
deleted by creator