Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. The Lounge
  3. Working from home... need to backup a large set of files each day.

Working from home... need to backup a large set of files each day.

Scheduled Pinned Locked Moved The Lounge
comsysadminquestion
29 Posts 12 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • J Offline
    J Offline
    Joan M
    wrote on last edited by
    #1

    Hello all, We have some big files that need to be sent from a remote computer to the company server each day. The work computer has a 10 MB DSL connection and the server has an optical fiber (50MB) connection. The remote worker is not tech savvy. I can imagine three ways of handling that: 1. Files stored in the local computer and send them each day to the remote server (via a scheduled backup that will run automatically at a certain hour). The computer user can shut the computer down at the evening. 2. Files stored in the local computer synchronized automatically using a kind of "Google Drive" that the server has natively included. 3. Files in the remote server and access them remotely via WebDAV or similar. Knowing that... what would you choose? And why? Thank you very much! :thumbsup:

    www.robotecnik.com[^] - robots, CNC and PLC programming

    J H N C M 9 Replies Last reply
    0
    • J Joan M

      Hello all, We have some big files that need to be sent from a remote computer to the company server each day. The work computer has a 10 MB DSL connection and the server has an optical fiber (50MB) connection. The remote worker is not tech savvy. I can imagine three ways of handling that: 1. Files stored in the local computer and send them each day to the remote server (via a scheduled backup that will run automatically at a certain hour). The computer user can shut the computer down at the evening. 2. Files stored in the local computer synchronized automatically using a kind of "Google Drive" that the server has natively included. 3. Files in the remote server and access them remotely via WebDAV or similar. Knowing that... what would you choose? And why? Thank you very much! :thumbsup:

      www.robotecnik.com[^] - robots, CNC and PLC programming

      J Offline
      J Offline
      Jeremy Falcon
      wrote on last edited by
      #2

      A 10MB DSL connection is enough to RDP with. Unless they're doing multimedia work... problem solved.

      Jeremy Falcon

      J A 2 Replies Last reply
      0
      • J Joan M

        Hello all, We have some big files that need to be sent from a remote computer to the company server each day. The work computer has a 10 MB DSL connection and the server has an optical fiber (50MB) connection. The remote worker is not tech savvy. I can imagine three ways of handling that: 1. Files stored in the local computer and send them each day to the remote server (via a scheduled backup that will run automatically at a certain hour). The computer user can shut the computer down at the evening. 2. Files stored in the local computer synchronized automatically using a kind of "Google Drive" that the server has natively included. 3. Files in the remote server and access them remotely via WebDAV or similar. Knowing that... what would you choose? And why? Thank you very much! :thumbsup:

        www.robotecnik.com[^] - robots, CNC and PLC programming

        J Offline
        J Offline
        Jeremy Falcon
        wrote on last edited by
        #3

        Also, just how big and how many files are we talking about here?

        Jeremy Falcon

        J 1 Reply Last reply
        0
        • J Jeremy Falcon

          Also, just how big and how many files are we talking about here?

          Jeremy Falcon

          J Offline
          J Offline
          Joan M
          wrote on last edited by
          #4

          3.19GB 11300 files Yes, probably the remote connection is the way to go... X| I had not thought about that...

          www.robotecnik.com[^] - robots, CNC and PLC programming

          J 1 Reply Last reply
          0
          • J Jeremy Falcon

            A 10MB DSL connection is enough to RDP with. Unless they're doing multimedia work... problem solved.

            Jeremy Falcon

            J Offline
            J Offline
            Joan M
            wrote on last edited by
            #5

            Thank you... it looks like a good suggestion.

            www.robotecnik.com[^] - robots, CNC and PLC programming

            J L 2 Replies Last reply
            0
            • J Joan M

              Thank you... it looks like a good suggestion.

              www.robotecnik.com[^] - robots, CNC and PLC programming

              J Offline
              J Offline
              Jeremy Falcon
              wrote on last edited by
              #6

              You're totally welcome.

              Jeremy Falcon

              1 Reply Last reply
              0
              • J Joan M

                3.19GB 11300 files Yes, probably the remote connection is the way to go... X| I had not thought about that...

                www.robotecnik.com[^] - robots, CNC and PLC programming

                J Offline
                J Offline
                Jeremy Falcon
                wrote on last edited by
                #7

                It's not so bad either once you get into the swing of it. It's much like programming in a VM if your connection is solid enough. If they were technical, it would be a whole different story with available options. But since they aren't...

                Jeremy Falcon

                1 Reply Last reply
                0
                • J Joan M

                  Hello all, We have some big files that need to be sent from a remote computer to the company server each day. The work computer has a 10 MB DSL connection and the server has an optical fiber (50MB) connection. The remote worker is not tech savvy. I can imagine three ways of handling that: 1. Files stored in the local computer and send them each day to the remote server (via a scheduled backup that will run automatically at a certain hour). The computer user can shut the computer down at the evening. 2. Files stored in the local computer synchronized automatically using a kind of "Google Drive" that the server has natively included. 3. Files in the remote server and access them remotely via WebDAV or similar. Knowing that... what would you choose? And why? Thank you very much! :thumbsup:

                  www.robotecnik.com[^] - robots, CNC and PLC programming

                  H Offline
                  H Offline
                  H Brydon
                  wrote on last edited by
                  #8

                  I did something like that with an overseas connection a few years ago between Houston and France. I did some testing with the connection using various strategies. We tried copying files in native form and also dumped into 'split' zip files. We used a scheduled batch file to do the hard work. The zip file strategy got the best throughput if we were copying all files but our files typically had less than 1% change per 24 hour period... so we used "xcopy /d" (which does not delete files on the remote side which get deleted on the local side). There was a considerable difference in elapsed time on whether we used xcopy on the sending end or receiving end. I've forgotten now which was faster but I think we did one of the following:

                  xcopy /a /d /s /e /c /i /q /h /r /k /o /x /y D:\localfiles \\remote\blahblah

                  xcopy /a /d /s /e /c /i /q /h /r /k /o /x /y \\remote\blahblah D:\localfiles

                  I'm retired. There's a nap for that... - Harvey

                  M 1 Reply Last reply
                  0
                  • J Joan M

                    Hello all, We have some big files that need to be sent from a remote computer to the company server each day. The work computer has a 10 MB DSL connection and the server has an optical fiber (50MB) connection. The remote worker is not tech savvy. I can imagine three ways of handling that: 1. Files stored in the local computer and send them each day to the remote server (via a scheduled backup that will run automatically at a certain hour). The computer user can shut the computer down at the evening. 2. Files stored in the local computer synchronized automatically using a kind of "Google Drive" that the server has natively included. 3. Files in the remote server and access them remotely via WebDAV or similar. Knowing that... what would you choose? And why? Thank you very much! :thumbsup:

                    www.robotecnik.com[^] - robots, CNC and PLC programming

                    N Offline
                    N Offline
                    Nelek
                    wrote on last edited by
                    #9

                    We work using remote desktop (Germany <-> Asia) and it goes pretty well. For many small files is good enough. For big files is a PITA though.

                    M.D.V. ;) If something has a solution... Why do we have to worry about?. If it has no solution... For what reason do we have to worry about? Help me to understand what I'm saying, and I'll explain it better to you Rating helpful answers is nice, but saying thanks can be even nicer.

                    1 Reply Last reply
                    0
                    • J Joan M

                      Thank you... it looks like a good suggestion.

                      www.robotecnik.com[^] - robots, CNC and PLC programming

                      L Offline
                      L Offline
                      Luc VdV WGG
                      wrote on last edited by
                      #10

                      And think about security. The company's data remains at the company, it is never stored at the remote worker's home. For that alone, I prefer RDP for all remote workers by FAR.

                      J 1 Reply Last reply
                      0
                      • H H Brydon

                        I did something like that with an overseas connection a few years ago between Houston and France. I did some testing with the connection using various strategies. We tried copying files in native form and also dumped into 'split' zip files. We used a scheduled batch file to do the hard work. The zip file strategy got the best throughput if we were copying all files but our files typically had less than 1% change per 24 hour period... so we used "xcopy /d" (which does not delete files on the remote side which get deleted on the local side). There was a considerable difference in elapsed time on whether we used xcopy on the sending end or receiving end. I've forgotten now which was faster but I think we did one of the following:

                        xcopy /a /d /s /e /c /i /q /h /r /k /o /x /y D:\localfiles \\remote\blahblah

                        xcopy /a /d /s /e /c /i /q /h /r /k /o /x /y \\remote\blahblah D:\localfiles

                        I'm retired. There's a nap for that... - Harvey

                        M Offline
                        M Offline
                        Mike Winiberg
                        wrote on last edited by
                        #11

                        For future reference, you should look into something like the rsync protocol (usually available by default on linux, but there are versions for windows too). This is designed to synchronise large files over slow connections, and hence exchanges CPU power for line speed, by hashing the contents of large files and only sending changed blocks within files: thus, if you have a 4Gb file where only 10 bytes gets added every day, instead of transmitting the whole file each time it is updated, it will only sync the block(s) that contain the changed bytes. I've used this to keep many Gb of data backed up off-site when I only had a 512k upload speed to do it. The initial backup can take a long time, but once its done...

                        H 1 Reply Last reply
                        0
                        • J Joan M

                          Hello all, We have some big files that need to be sent from a remote computer to the company server each day. The work computer has a 10 MB DSL connection and the server has an optical fiber (50MB) connection. The remote worker is not tech savvy. I can imagine three ways of handling that: 1. Files stored in the local computer and send them each day to the remote server (via a scheduled backup that will run automatically at a certain hour). The computer user can shut the computer down at the evening. 2. Files stored in the local computer synchronized automatically using a kind of "Google Drive" that the server has natively included. 3. Files in the remote server and access them remotely via WebDAV or similar. Knowing that... what would you choose? And why? Thank you very much! :thumbsup:

                          www.robotecnik.com[^] - robots, CNC and PLC programming

                          C Offline
                          C Offline
                          ClockMeister
                          wrote on last edited by
                          #12

                          Have you considered using Dropbox or one of the other "cloud" drives? They keep the content synchronized pretty continuously.

                          J 1 Reply Last reply
                          0
                          • J Joan M

                            Hello all, We have some big files that need to be sent from a remote computer to the company server each day. The work computer has a 10 MB DSL connection and the server has an optical fiber (50MB) connection. The remote worker is not tech savvy. I can imagine three ways of handling that: 1. Files stored in the local computer and send them each day to the remote server (via a scheduled backup that will run automatically at a certain hour). The computer user can shut the computer down at the evening. 2. Files stored in the local computer synchronized automatically using a kind of "Google Drive" that the server has natively included. 3. Files in the remote server and access them remotely via WebDAV or similar. Knowing that... what would you choose? And why? Thank you very much! :thumbsup:

                            www.robotecnik.com[^] - robots, CNC and PLC programming

                            M Offline
                            M Offline
                            MikeD 2
                            wrote on last edited by
                            #13

                            RDP is an excellent tool BUT if you decide to allow the remote working then have an FTP Server (I use FileZilla) at the hosting end and use something like "winscp" to feed the modified files back winscp runs a sync across the ftp protocol and therefore only transfer modified files and can be run multiple times to make sure that transfers aborted due to PC restarts get completed you can run over ssl/tls and providing you have decent usernames and passwords then it would be reasonably secure for added/alternative security factor in a VPN FileZilla would also allow you to set different transfer rates for different times of day so that the DSL wouldn't be maxed out at busy times

                            J 1 Reply Last reply
                            0
                            • C ClockMeister

                              Have you considered using Dropbox or one of the other "cloud" drives? They keep the content synchronized pretty continuously.

                              J Offline
                              J Offline
                              Joan M
                              wrote on last edited by
                              #14

                              Second option in the original post. The server has an inbuilt "dropbox" like software that allow that. Thank you!

                              www.robotecnik.com[^] - robots, CNC and PLC programming

                              1 Reply Last reply
                              0
                              • M MikeD 2

                                RDP is an excellent tool BUT if you decide to allow the remote working then have an FTP Server (I use FileZilla) at the hosting end and use something like "winscp" to feed the modified files back winscp runs a sync across the ftp protocol and therefore only transfer modified files and can be run multiple times to make sure that transfers aborted due to PC restarts get completed you can run over ssl/tls and providing you have decent usernames and passwords then it would be reasonably secure for added/alternative security factor in a VPN FileZilla would also allow you to set different transfer rates for different times of day so that the DSL wouldn't be maxed out at busy times

                                J Offline
                                J Offline
                                Joan M
                                wrote on last edited by
                                #15

                                I'll have to look for the VPN thing (which sounds good when it increases security), but, the RDP (VNC, TeamViewer, the one that comes with windows...)... will help a lot and then, no files need to be stored into the remote computer as everything will stay in the server always... Thank you!

                                www.robotecnik.com[^] - robots, CNC and PLC programming

                                1 Reply Last reply
                                0
                                • J Joan M

                                  Hello all, We have some big files that need to be sent from a remote computer to the company server each day. The work computer has a 10 MB DSL connection and the server has an optical fiber (50MB) connection. The remote worker is not tech savvy. I can imagine three ways of handling that: 1. Files stored in the local computer and send them each day to the remote server (via a scheduled backup that will run automatically at a certain hour). The computer user can shut the computer down at the evening. 2. Files stored in the local computer synchronized automatically using a kind of "Google Drive" that the server has natively included. 3. Files in the remote server and access them remotely via WebDAV or similar. Knowing that... what would you choose? And why? Thank you very much! :thumbsup:

                                  www.robotecnik.com[^] - robots, CNC and PLC programming

                                  F Offline
                                  F Offline
                                  Forogar
                                  wrote on last edited by
                                  #16

                                  Step 1. Calculate how many floppy disks you will need...

                                  - I would love to change the world, but they won’t give me the source code.

                                  J 1 Reply Last reply
                                  0
                                  • F Forogar

                                    Step 1. Calculate how many floppy disks you will need...

                                    - I would love to change the world, but they won’t give me the source code.

                                    J Offline
                                    J Offline
                                    Joan M
                                    wrote on last edited by
                                    #17

                                    NOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO! :laugh: :laugh: :laugh: :laugh: :laugh:

                                    www.robotecnik.com[^] - robots, CNC and PLC programming

                                    F 1 Reply Last reply
                                    0
                                    • J Jeremy Falcon

                                      A 10MB DSL connection is enough to RDP with. Unless they're doing multimedia work... problem solved.

                                      Jeremy Falcon

                                      A Offline
                                      A Offline
                                      Alister Morton
                                      wrote on last edited by
                                      #18

                                      Agreed. It's how I work from home - citrix connection to remote terminal which RDPs onto my desktop machine (and it could just as equally be onto a VM) and then no files ever have to get to my home computer and none to transfer back, everything is kept secure in the company network. Both screens on my office PC visible on both screens at home, works very well.

                                      1 Reply Last reply
                                      0
                                      • J Joan M

                                        NOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO! :laugh: :laugh: :laugh: :laugh: :laugh:

                                        www.robotecnik.com[^] - robots, CNC and PLC programming

                                        F Offline
                                        F Offline
                                        Forogar
                                        wrote on last edited by
                                        #19

                                        So you got the nostalgic nightmare I was aiming for! Sorry... really! :sigh: :doh:

                                        - I would love to change the world, but they won’t give me the source code.

                                        1 Reply Last reply
                                        0
                                        • J Joan M

                                          Hello all, We have some big files that need to be sent from a remote computer to the company server each day. The work computer has a 10 MB DSL connection and the server has an optical fiber (50MB) connection. The remote worker is not tech savvy. I can imagine three ways of handling that: 1. Files stored in the local computer and send them each day to the remote server (via a scheduled backup that will run automatically at a certain hour). The computer user can shut the computer down at the evening. 2. Files stored in the local computer synchronized automatically using a kind of "Google Drive" that the server has natively included. 3. Files in the remote server and access them remotely via WebDAV or similar. Knowing that... what would you choose? And why? Thank you very much! :thumbsup:

                                          www.robotecnik.com[^] - robots, CNC and PLC programming

                                          P Offline
                                          P Offline
                                          patbob
                                          wrote on last edited by
                                          #20

                                          If they're not tech savvy, then they're probably using windows (you didn't say), so I'd suggest OneDrive if the files have to available locally to the user. With that, the files are locally cached and automatically synced to the cloud as they are changed. Just don't let the user put files elsewhere on their system, so maybe move all the microsoft directories to it. You'll get all their personal crap too, but hey, they're getting free backups of their person stuff, so they shouldn't complain. If the files don't need to be local with the user, then I agree with others -- have them remote desktop into a system at the company. That way you limit their person stuff, and you get to control what's installed on that machine, when (if) its virus checked, etc. If they're using a fruit, then you'll have to find an equivalent for that OS.

                                          We can program with only 1's, but if all you've got are zeros, you've got nothing.

                                          J 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups