On 03/08/2020 10:58, Huge wrote:

On Fri, 2020-07-31 at 16:22 +0100, B D wrote:

...

Hi,

I suppose that this could be an issue that the majority of us have faced at some point in the past. So you might have a simple solution. In last few weeks I had to move my small and old NAS box (adding some drives to make it a tad more resilient). I moved all the data to a portable drive and now I would like to merge all I have on my laptop with what's on the USB HDD.

Content.. endless folders with various photos, music and video.

The idea is that once files are organized the NAS will become a storage share for Nextcloud running on Pi.

Any ideas are greatly appreciated

I have found 'fdupes' to be an excellent command-line tool for finding duplicate files (& optionally deleting them, although read the man pages about using the 'follow links' and 'delete' switches at the same time!) It ran about 1000 times faster than the crappy shell script I wrote to do the same job!!

Regards,

H.

fslint used to be my go-to but it now is generally missing a dependency and won't run/install. rmlint (aka Shredder) is the Gnome equivalent.

Both find duplicated files given a specific path and let you delete based on what it finds.  Both GUI programs.

I often use Meld to compare two directories - to check that both sets of files are the same before deleting one set.

Not quite the same, but occasionally I use FindImageDupes which can detect the same picture even if it has a different name. Usage, something like

cd /home/user/Pictures/ findimagedupes -f database.db -R -v=fp -t=95 -p /usr/bin/feh .

NB - that uses feh command line image viewer.  Feh used (I think) left & right to look through the duplicate photos, and ctrl-del to delete from disk the currently displayed picture.  Esc to close this set of duplicates and move to the next.

Steve