Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. The Lounge
  3. Any tool out there that allow me to find duplicated files?

Any tool out there that allow me to find duplicated files?

Scheduled Pinned Locked Moved The Lounge
comsysadminquestion
10 Posts 10 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • J Offline
    J Offline
    Joan M
    wrote on last edited by
    #1

    Hello all, As I'm the admin of our server and people on the company loves to duplicate information, is there any tool out there that would allow me to find all the files that are duplicated? I mean: if there is three times the same file A.TXT with the same content in several different places I would like to know it. Now I'm running out of space in my backup system and manually I can see that there are lots of duplicated files... I would like to remove all the duplicate ones. The ideal scenario would be: - Scan some folders. - Show a list with all the results. - Allow me to choose what to delete and what to retain. As always thank you in advance.

    [www.tamelectromecanica.com][www.tam.cat]

    E J J K G 7 Replies Last reply
    0
    • J Joan M

      Hello all, As I'm the admin of our server and people on the company loves to duplicate information, is there any tool out there that would allow me to find all the files that are duplicated? I mean: if there is three times the same file A.TXT with the same content in several different places I would like to know it. Now I'm running out of space in my backup system and manually I can see that there are lots of duplicated files... I would like to remove all the duplicate ones. The ideal scenario would be: - Scan some folders. - Show a list with all the results. - Allow me to choose what to delete and what to retain. As always thank you in advance.

      [www.tamelectromecanica.com][www.tam.cat]

      E Offline
      E Offline
      Ennis Ray Lynch Jr
      wrote on last edited by
      #2

      Linux should let you do that with a script and a hash function, no?

      Need custom software developed? I do C# development and consulting all over the United States. A man said to the universe: "Sir I exist!" "However," replied the universe, "The fact has not created in me A sense of obligation." --Stephen Crane

      M 1 Reply Last reply
      0
      • J Joan M

        Hello all, As I'm the admin of our server and people on the company loves to duplicate information, is there any tool out there that would allow me to find all the files that are duplicated? I mean: if there is three times the same file A.TXT with the same content in several different places I would like to know it. Now I'm running out of space in my backup system and manually I can see that there are lots of duplicated files... I would like to remove all the duplicate ones. The ideal scenario would be: - Scan some folders. - Show a list with all the results. - Allow me to choose what to delete and what to retain. As always thank you in advance.

        [www.tamelectromecanica.com][www.tam.cat]

        J Offline
        J Offline
        Jesse Evans
        wrote on last edited by
        #3

        Hi, Joan! You may find what you're looking for here: http://www.tinyapps.org/file.html[^] Scan down the page to the section labeled, "Finding Duplicate Files". Hope this helps!

        'til next we type... HAVE FUN!! -- Jesse

        1 Reply Last reply
        0
        • J Joan M

          Hello all, As I'm the admin of our server and people on the company loves to duplicate information, is there any tool out there that would allow me to find all the files that are duplicated? I mean: if there is three times the same file A.TXT with the same content in several different places I would like to know it. Now I'm running out of space in my backup system and manually I can see that there are lots of duplicated files... I would like to remove all the duplicate ones. The ideal scenario would be: - Scan some folders. - Show a list with all the results. - Allow me to choose what to delete and what to retain. As always thank you in advance.

          [www.tamelectromecanica.com][www.tam.cat]

          J Offline
          J Offline
          Jim Crafton
          wrote on last edited by
          #4

          You might try cygwin. Then, like Ennis mentions, a bash script and hash (maybe MD5) should do the trick. Cygwin will give you a command line console with all the various icky linux tools like grep, find, sed, awk, and other vowel challenged unix like utilities. Should be pretty easy to put together a custom script for this.

          ¡El diablo está en mis pantalones! ¡Mire, mire! SELECT * FROM User WHERE Clue > 0 0 rows returned Save an Orange - Use the VCF! Personal 3D projects Just Say No to Web 2 Point Oh

          1 Reply Last reply
          0
          • E Ennis Ray Lynch Jr

            Linux should let you do that with a script and a hash function, no?

            Need custom software developed? I do C# development and consulting all over the United States. A man said to the universe: "Sir I exist!" "However," replied the universe, "The fact has not created in me A sense of obligation." --Stephen Crane

            M Offline
            M Offline
            Miszou
            wrote on last edited by
            #5

            Faster than light travel is easy. All you have to do is fold space and then step across the two planes, no? The implementation is left as an exercise for the reader. ;P

            The StartPage Randomizer - The Windows Cheerleader - Twitter

            B 1 Reply Last reply
            0
            • J Joan M

              Hello all, As I'm the admin of our server and people on the company loves to duplicate information, is there any tool out there that would allow me to find all the files that are duplicated? I mean: if there is three times the same file A.TXT with the same content in several different places I would like to know it. Now I'm running out of space in my backup system and manually I can see that there are lots of duplicated files... I would like to remove all the duplicate ones. The ideal scenario would be: - Scan some folders. - Show a list with all the results. - Allow me to choose what to delete and what to retain. As always thank you in advance.

              [www.tamelectromecanica.com][www.tam.cat]

              K Offline
              K Offline
              Kschuler
              wrote on last edited by
              #6

              Beyond Compare[^] is a nice tool. Not sure it's exactly what you're looking for, but you should give it a look. It's very reasonably priced as well.

              1 Reply Last reply
              0
              • M Miszou

                Faster than light travel is easy. All you have to do is fold space and then step across the two planes, no? The implementation is left as an exercise for the reader. ;P

                The StartPage Randomizer - The Windows Cheerleader - Twitter

                B Offline
                B Offline
                Brady Kelly
                wrote on last edited by
                #7

                Miszou wrote:

                All you have to do is fold space and then step across the two planes, no?

                That's old. We move space these days instead of folding it.

                1 Reply Last reply
                0
                • J Joan M

                  Hello all, As I'm the admin of our server and people on the company loves to duplicate information, is there any tool out there that would allow me to find all the files that are duplicated? I mean: if there is three times the same file A.TXT with the same content in several different places I would like to know it. Now I'm running out of space in my backup system and manually I can see that there are lots of duplicated files... I would like to remove all the duplicate ones. The ideal scenario would be: - Scan some folders. - Show a list with all the results. - Allow me to choose what to delete and what to retain. As always thank you in advance.

                  [www.tamelectromecanica.com][www.tam.cat]

                  G Offline
                  G Offline
                  GuyThiebaut
                  wrote on last edited by
                  #8

                  I wrote an application to find duplicate images > clickety (ok it's advertising but it is relevant) It does this using a hash table which is probably what you want to look for in an application. My app will do some of the work for you but alas it does not cover all file types - now there's a development idea for my application :)

                  Continuous effort - not strength or intelligence - is the key to unlocking our potential.(Winston Churchill)
                  1 Reply Last reply
                  0
                  • J Joan M

                    Hello all, As I'm the admin of our server and people on the company loves to duplicate information, is there any tool out there that would allow me to find all the files that are duplicated? I mean: if there is three times the same file A.TXT with the same content in several different places I would like to know it. Now I'm running out of space in my backup system and manually I can see that there are lots of duplicated files... I would like to remove all the duplicate ones. The ideal scenario would be: - Scan some folders. - Show a list with all the results. - Allow me to choose what to delete and what to retain. As always thank you in advance.

                    [www.tamelectromecanica.com][www.tam.cat]

                    J Offline
                    J Offline
                    jeffwask
                    wrote on last edited by
                    #9

                    This is a neat tool for disk management. http://windirstat.info/[^]

                    1 Reply Last reply
                    0
                    • J Joan M

                      Hello all, As I'm the admin of our server and people on the company loves to duplicate information, is there any tool out there that would allow me to find all the files that are duplicated? I mean: if there is three times the same file A.TXT with the same content in several different places I would like to know it. Now I'm running out of space in my backup system and manually I can see that there are lots of duplicated files... I would like to remove all the duplicate ones. The ideal scenario would be: - Scan some folders. - Show a list with all the results. - Allow me to choose what to delete and what to retain. As always thank you in advance.

                      [www.tamelectromecanica.com][www.tam.cat]

                      N Offline
                      N Offline
                      Naruki 0
                      wrote on last edited by
                      #10

                      It's called TOTAL Commander for a reason. ;-) Alt+F7 gets you the search dialog. Look at the different tabs. There is an option for finding duplicates. The great thing is you can even view the contents of the file. http://www.ghisler.com

                      Codemonkeys don't do it at all. Too busy coding.

                      1 Reply Last reply
                      0
                      Reply
                      • Reply as topic
                      Log in to reply
                      • Oldest to Newest
                      • Newest to Oldest
                      • Most Votes


                      • Login

                      • Don't have an account? Register

                      • Login or register to search.
                      • First post
                        Last post
                      0
                      • Categories
                      • Recent
                      • Tags
                      • Popular
                      • World
                      • Users
                      • Groups