{"id":1170,"date":"2020-05-24T17:29:55","date_gmt":"2020-05-25T01:29:55","guid":{"rendered":"https:\/\/accretiondisc.com\/blog\/?p=1170"},"modified":"2020-05-24T17:29:55","modified_gmt":"2020-05-25T01:29:55","slug":"duff-duplicate-file-finder","status":"publish","type":"post","link":"https:\/\/accretiondisc.com\/blog\/2020\/05\/24\/duff-duplicate-file-finder\/","title":{"rendered":"Duff &#8211; duplicate file finder"},"content":{"rendered":"\n<p>I&#8217;ve got this folder called <code>vast\/todo\/t.temp<\/code> that&#8217;s got a 100 GB of stuff from old computers in it. Typically, I just copy stuff there and tell myself I&#8217;ll get back to it.  There are 61,287 files, none less than a year old, and (as of now) only 5 of those 60-thousand files are less than 2 years old.<\/p>\n\n\n\n<p>How will I ever &#8220;get back to&#8221; making sense of all that junk? Enter <a href=\"http:\/\/duff.dreda.org\">duff<\/a> &#8211; the CLI duplicate file finder. Just say:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">$ duff *.txt<\/pre>\n\n\n\n<p>and it tells you something like this:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">2 files in cluster 1 (19925 bytes, digest 8b5cc01edd340e91957b54f10c22d6d3283b7962)\nccc.txt\nzzz.txt<\/pre>\n\n\n\n<p>Then you decide whether you want to nuke &#8216;ccc.txt&#8217; or &#8216;zzz.txt&#8217;. Bob&#8217;s wife&#8217;s your aunt.<\/p>\n\n\n\n<p>Installation is just <code>port install duff <\/code><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;ve got this folder called vast\/todo\/t.temp that&#8217;s got a 100 GB of stuff from old computers in it. Typically, I just copy stuff there and tell myself I&#8217;ll get back to it. There are 61,287 files, none less than a year old, and (as of now) only 5 of those 60-thousand files are less than [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[52],"tags":[377,1090,1086,1087,1088,1089],"class_list":["post-1170","post","type-post","status-publish","format-standard","hentry","category-technology","tag-cli","tag-disk-space","tag-duff","tag-duplicates","tag-file","tag-utility"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/paRqpr-iS","_links":{"self":[{"href":"https:\/\/accretiondisc.com\/blog\/wp-json\/wp\/v2\/posts\/1170","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/accretiondisc.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/accretiondisc.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/accretiondisc.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/accretiondisc.com\/blog\/wp-json\/wp\/v2\/comments?post=1170"}],"version-history":[{"count":0,"href":"https:\/\/accretiondisc.com\/blog\/wp-json\/wp\/v2\/posts\/1170\/revisions"}],"wp:attachment":[{"href":"https:\/\/accretiondisc.com\/blog\/wp-json\/wp\/v2\/media?parent=1170"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/accretiondisc.com\/blog\/wp-json\/wp\/v2\/categories?post=1170"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/accretiondisc.com\/blog\/wp-json\/wp\/v2\/tags?post=1170"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}