Hi!
I hope this is the right place to ask this, but I’ve got about 30TB of videos from a variety of sources that I know has numerous duplicates, however most of the duplicates will either have a watermark that is different or one video will be a part of the other or simply be different resolutions, I have been hunting for suitable software to scan for this but have had no luck in my own searches.
surely something exists that scans videos for matching or similar frames?
I am willing to pay for software (within reason) if someone can confirm that it’s likely to do what I need.
I’ve used things like dupeguru and czkawka consistently and they’ve been good for images and identical videos, but they can’t handle this type of issue with videos.
Czkawka is quite good for photos, use “Duplicate files” mode first, then “similar images” and work down the similarity levels one by one. Good for watermarked versions and different resolution Bad for cropped versions, also draws false positives on similar images mode if you have two frames from a video saved as images.
I used NoClone for the longest time and loved it. Czkawka has been my go to since NoClone hasn’t been updated in a while and tends to crash.
The GUI is a bit awkward to get used to, like for instance I haven’t figured out if you can browse a path, and filtering by path is a little different to me, but I’m still generally very happy to use it.