File backup to external hard drive, incremental etc?

Advert

File backup to external hard drive, incremental etc?

Home Forums The Tea Room File backup to external hard drive, incremental etc?

Viewing 17 posts - 1 through 17 (of 17 total)
  • Author
    Posts
  • #806268
    Peter Bell
    Participant
      @peterbell11509

      I back my files up on a regular basis to an external hard drive by copying but it takes ages as I copy everything!

      Searching around mention is made of Incremental and Differential techniques to only update files which have changed but is seems a minefield to me.

      Can anyone recommend a simple reliable method or program to use?

      Thanks   Peter

      Advert
      #806270
      Peter Cook 6
      Participant
        @petercook6

        FreeFileSync is neat, works well and is free.

        #806273
        Macolm
        Participant
          @macolm

          Yes, Free File Sync is excellent, and fast and more or less foolproof.

          I use it to back up all my data locally, I have USB enclosures with M2 drives used in the traditional three generation rotation of backups. This uses mirror mode to the USB drive. You can choose an alternative synchronisation mode as necessary. It usually takes about a minute to do the backup unless you are reorganising the data..

          I also backup my Thunderbird email folders (profile) locally, again in mirror mode. Due to the use of thousands of tiny files by Thunderbird, this takes 3 or 4 minutes for much less actual data.

          Here is an example of a USB caddy. Of course you need three enclosures also three M2 drives, but it is not worth going beyond basic speed drives unless you expect to use them elsewhere. However, take note that both PCIe and SATA interfaces are available. I suggest you go for PCIe (drives and USBs).[edit – woops, item below is SATA]

          If this is as clear as mud, feel free to ask for more information (but it is simple enough in the end).

          https://www.scan.co.uk/products/akasa-ak-enu3m2-02-m2-sata-10gb-s-external-ssd-aluminium-enclosure-usb-31-gen-2-type-c

           

          #806275
          Martin Connelly
          Participant
            @martinconnelly55370

            Don’t you get a question about skipping identical files where you can tick “all instances” so only new files or changed files are copied?

            Martin C

            #806277
            Macolm
            Participant
              @macolm

              Yes, you want to copy only changed files. There is a choice of criterion, but I have had no trouble with “newer”.

              #806282
              peak4
              Participant
                @peak4

                I use SyncToy on Windows; now discontinued by Microsoft, but readily available.

                Bill

                #806297
                ChrisLH
                Participant
                  @chrislh

                  Malcolm,

                  Thanks for your input.

                  Your first line sounded hopeful but, as a computer user working on a need to know basis, what followed gave me a distinct sinking feeling ! In the past I have used a little back-up programme called “Easy-Back-it up” written by a US IT student. All that was required was to define :- source, destination and files. I don’t have (as far as I know) USB enclosures, M2 drives, 3 generation back-up arrangements, things which are mirrored and lots more. So would “FreeFileSync” be responsive to ignorance (and unwillingness to learn) on this scale, that is just backing up selected files to a local hard drive ?

                  #806301
                  Macolm
                  Participant
                    @macolm

                    Free File Sync is very easy for me to use, but being fairly comprehensive, there are quite a lot of choices. To me, it is well designed, so that it is quickly mastered and can do everything I need. I would suggest you download and install it, then somewhere with enough disk space in your existing drive(s), make new “test source” and “test backup” folders. Copy the entirety of a suitable folder into the “source” to work with, then experiment there with syncing to the “backup” to become conversant with the program and methods. Delete these folders once they have served their purpose, all without risk to your data, or dross left on your computer.

                    #806310
                    Peter Cook 6
                    Participant
                      @petercook6

                      Don’t worry – try it.

                      Opens a screen with two panes. Drag & Drop the folders you want to back up into the left hand pane. Assuming the external drive is connected, drag and drop the folders on the external drive to the right hand pane. Set the Compare Settings to Time & Size – the default. Set the Synchronise setting to Update ( Two-way is the default). If you then click the Compare button the programme will show you what it is going to do by comparing the two sets of files & folders.

                      Clicking Synchronise will do the update.

                      FreeFile

                      Hope this helps.

                      #806313
                      Harry Wilkes
                      Participant
                        @harrywilkes58467
                        On Peter Cook 6 Said:

                        Don’t worry – try it.

                        Opens a screen with two panes. Drag & Drop the folders you want to back up into the left hand pane. Assuming the external drive is connected, drag and drop the folders on the external drive to the right hand pane. Set the Compare Settings to Time & Size – the default. Set the Synchronise setting to Update ( Two-way is the default). If you then click the Compare button the programme will show you what it is going to do by comparing the two sets of files & folders.

                        Clicking Synchronise will do the update.

                        FreeFile

                        Hope this helps.

                        👍

                        H

                        #806318
                        Mike Hurley
                        Participant
                          @mikehurley60381

                          A really simple method that doesn’t require extra software etc is to use Windows explorer.

                          Go to the drive / directory you are interested in then in the search box (top right) simply put in something like the following

                          Datemodified:>yyyy-mm-dd

                          That will list everything updated since the date specified, then select them and copy to your backup drive/ memory stick.

                          There are options as well, like using >= (greater than or equal to) which then includes files modified on the date specified.

                          You can also select a range by also including less than or equal to ) such as Datemodified:>=yyyy-mm-dd <=yyyy-mm-dd

                          Looks more complicated than it is.

                          Easy & quite powerful. Enjoy

                          Mike

                          #806324
                          ChrisLH
                          Participant
                            @chrislh

                            Thanks Peter, Malcolm and Mike

                            I’ll give it a go.

                            #806394
                            Macolm
                            Participant
                              @macolm

                              Just a general comment that any widely used software actively developed in response to users will appear complicated. Free File sync has many flexible features to fit with the real world. For example, the “exclusions” provision may seem a needless complication, but when used for two way synchronisation, your folders soon fill up with multiple copies of the system admin files used by M$. For example, I have exclusions of:

                              \System Volume Information\

                              \$Recycle.Bin\

                              \RECYCLE\

                              *\thumbs.db

                              *\Desktop.ini

                              *.ffs_gui

                              \Downloads\

                              You can ignore such things at first until you become aware of how useful they are.

                              #806477
                              Peter Bell
                              Participant
                                @peterbell11509

                                Many thanks for all the help and options….pleased I asked.

                                FreeFileSync has worked for me.

                                 

                                Peter

                                #806568
                                Howi
                                Participant
                                  @howi

                                  In Windows, FILE HISTORY will back up all user files whether new or modified with no fuss.

                                  It keeps copies of the same file but different mod times so you can go back to an original before modification and anything in between.

                                  #806602
                                  SillyOldDuffer
                                  Moderator
                                    @sillyoldduffer
                                    On Macolm Said:

                                    Just a general comment that any widely used software actively developed in response to users will appear complicated. …

                                    Well, backup/recovery is complicated!  The user has to decide what needs to be backed up, how often, and what to.   Backing-up the operating system and installed software is different from backing up user files.  Don’t muddle the two!    “What to” could be a local disc, or a memory stick, or another machine at home, or the cloud.  They all have issues.   For example, when backing up to the cloud it pays to encrypt (in case the cloud provider is hacked), and to compress the data to get it across the network pronto.    At home, probably best not to encrypt because it’s something else to go wrong. I feel the same about compression.   And then we’re into full vs differential vs incremental backups.  Any software has to cover a lot of options ranging from trivially easy up to OMG complicated!

                                    In a home system there’s much to be said in favour of keeping it simple:  manually copy important user files in full, and keep a paper logbook.   Easy to understand and recovery is straightforward.

                                    But too simple is dangerous.   Not thinking it through increases the chance that something important is missed.   The risk is low on a singleton PC, but some home systems are very advanced:  anyone operating a NAS or a shared service should plan backups carefully.

                                    Failing to consider and test recovery can be painful.  Recovery is when we discover we can’t find a particular file, or the backup was incomplete, or is full of crud, or the media is in a muddle, or was lost in the same fire!   Or a technical problem: on a memory stick, the maximum size of a FAT32 file is 4Gb and the maximum size of a FAT32 partition is 32Gb.   These limits are easily exceeded when archiving photos, videos and music.  Neglecting the recovery problem, taking a “worry about it if it happens” approach, causes a lot of issues.

                                    Woe, woe and thrice woe.  This thread caused me to check my system, and it’s broken!   Sad story: the computer was bought in May 2021, files were copied from the old machine, and, after confirming all was well,  a full backup was taken, and an automated incremental backup started.   The software is duplicity, based on rsync.  Looking at the disc, I see backups were taken correctly until I upgraded Linux a month later.   Looks like upgrading the operating system disabled the automated incremental backup,.  As I didn’t notice, no backups taken for 4 years!  Moral of the story: double check!  Backups aren’t “fire and forget”.

                                    I have to rethink what to do next.  When my laptop failed a few months ago, I found it’s backup contained 1.2Gb of unwanted junk and only about 50Mb of worthwhile data.  For simplicity I’d chosen to backup application files as well as user data.  Not smart, because mixing the two complicated recovery and triggered a time consuming tidy up.

                                    rsync is technically better than FreeFileSync, but it’s UNIX command line software, not as easy to drive as a GUI app, and tricky to set up on Windows.  Though FreeFileSync is fine for most purposes, advanced users should check the details.  There are many alternatives and they’re not all equally good at everything.

                                    Dave

                                     

                                     

                                    #806609
                                    Graham Stoppani
                                    Participant
                                      @grahamstoppani46499

                                      Just to add a few general thoughts to this thread. BTW my background was in large scale accounting software implementations.

                                      Backing up and archiving files serve two different purposes. A backup gives you a second copy of a file should the original become lost / damaged in the future. An archive gives you a copy of a file at a given date / time should you find the original file has become damaged or lost during a period between the present and the archive date. Why? it is possible that corruption has occurred to a file and has not been noticed and it has been updated since. For example, you’ve just completed chapter 23 of your magnum opus and you realise chapters chapters 13 to 17 are missing from the file and from the backup. (Think of poor T.E.Lawrence of Arabia who left his draft copy of the Seven Pillars of Wisdom on a train and had to rewrite it without his notes as he’d destroyed those thinking he’d not need them any more!)

                                      Large organisations will perform both archives and backups, with the backup media being recycled on a regular basis while the archive media is held for a year or more.

                                      The next thought is the location of your backups. Having an external hard disk by your PC is fine if your PC fails but not much use if its stolen or destroyed in a fire alongside your PC. There are lots of options for cloud backups from people like Amazon, Microsoft and Norton, for example.

                                      Being a retired accountant I do all of the above, external hard disks and multiple cloud backup regimes.

                                      One last thing I would also recommend is periodically test restoring from you backups (to a different location) to ensure all is well. Also, store the installation files for your local backup software on external media so if you lose your PC you can install the software on a new machine to perform the restore of your backup files.

                                    Viewing 17 posts - 1 through 17 (of 17 total)
                                    • Please log in to reply to this topic. Registering is free and easy using the links on the menu at the top of this page.

                                    Advert

                                    Latest Replies

                                    Home Forums The Tea Room Topics

                                    Viewing 25 topics - 1 through 25 (of 25 total)
                                    Viewing 25 topics - 1 through 25 (of 25 total)

                                    View full reply list.

                                    Advert

                                    Newsletter Sign-up