The software is paid: 2500 rubles.
The transition to the new version (from 3 to 4) is also paid: 1250₽.
I wrote instructions for a friend, but I think it will come in handy for one of you.
And as always, in the comments, you will teach me something new =)
At the end of the instruction is an example of a log that shows the speed of the task.
Purpose:
Automatic creation of encrypted backups on a schedule with an error report to the mail.
Logic backups:
- Daily last 30 pcs (shelf life 1 month)
- Monthly 1st day last 24 pcs (shelf life 2 years)
- Annually, February 1, the last 10 pieces (shelf life 10 years)
- Backups are uploaded to the backup storage (local or network) from under the backup account
- Backups are uploaded to the Goole Drive cloud (possibly with its own OAuth ID Client / Secret)
- Email error report
A little explanation
- This manual is provided as a ready-made example of use, which can and should be adapted to your needs.
- Tasks can run at the same time, because parallel tasks are supported, which significantly reduces the time for backups.
- Additional copying is performed based on the task, i.e. copying the last backup already created. For example, if additional copying should be performed on the 10th, and the backup of the selected task from the 10th ended with an error (and we did not intervene), then the additional copying will make a copy for the last successful backup of the selected task, in our example it will be from the 9th.
- In the program, you can configure the unloading of databases using 1C tools in the form of .dt files, with automatic locking / unlocking of the database and ejecting users. In this manual, this method is not considered as an unreliable way to backup the .dt format.
1. Installation and setup
Install, run.
- Tools> Options
- Autoload
Run as a Windows service (server)
backup user, your password
Explanations for the backup user, for which a separate accountFor backups, I consider it important to create and use a separate account, for example, backup. It can be both local and domain accounting.
Access to the backup storage for admins should be configured for reading, and only for accounting backup to write. This will protect your backups from many dangers (a bad head, viruses). And if you need to make any changes to the backup storage, you can always give yourself temporary access, or run any explorer (for example Total Commander) on behalf of the backup account for full access to the storage.
- Agent Parameters
Allow concurrent work of streaming tasks : 5
We select from the server power and the speed of the Internet channel (for uploading to the cloud)
Use the specified directory of temporary files :
\\ NAS \ Backup \ Temp
Network Path ExplanationIt is desirable to place the network folder on the computer with this program, i.e. in fact, for us it will be a local folder (if speed allows, then any other network path).
Access to the Temp folder (directory of temporary files) should be:
- for backup write
- for accounting from under which the MS SQL Server service is running for writing
- read admins
Unfortunately, this program does not report its features to the user when he sets up a backup of SQL databases. She believes that the SQL server is on the same computer as her. When a backup of the SQL database is created, the path to the temporary folder is passed to the SQL server literally, and the SQL server uploads the backup to its local temporary folder. After that, he cannot find a backup in his temporary folder and throws an error.
To get around this restriction, we select the network path for the temporary folder. Then the SQL server will receive the network path and will unload the backup at this address.
In future versions, the developers promised to think about adding a setting for SQL backup tasks, in which it would be possible to specify a network path for unloading, and not change the general path to temporary folders. - Manager Options
Set a password if an unwanted user can access the program. - Archive Files
Options for ending the archive name : yyyy.mm.dd_hh.nn.ss
For aesthetics and name without spaces (old habit) - Office
OAuth application data in the cloud - Update ClientID / ClientSecret data
It is not necessary to make changes here, but as always there is a small BUTRecently, I received an error uploading backups to the cloud due to OAuth limits being exceeded. The error was only once, the developers fixed this problem, but why wait for it again. I decided to get my OAuth on Google Drive and forget about it.
Instructions with pictures on how to get your Client ID and Secret found here: https://github.com/Cloudbox/Cloudbox/wiki/Google-Drive-API-Client-ID-and-Client-Secret
2. Preparation
- Tools> Storage Management> Create
- Local / network folder :
Everything is clear here, following our backup logic (at the beginning of the article) we create 3 repositories for convenience
\\ NAS \ Backup \ EveryDay
\\ NAS \ Backup \ EveryMonth
\\ NAS \ Backup \ EveryYear
- Google drive :
Create a connection to the Google Cloud drive.
We will give the name according to our logic: EveryDay
Click the Authorization button, enter the username / password, ready.
If you configure it remotely on a server or another computerThen you can perform authorization in an alternative way. We close the login and password entry window - an authorization error appears - click the User mode button, then click the Get confirmation code link the authorization link will open in the browser. Copy the link to your computer, log in to your computer, confirm the access rights, get the key, copy it back to the box in the Application authorization window in user mode , click OK
Choose the path to the folder in the cloud, similarly:
Backup / EveryDay
We do additional cloud storage for monthly and annual copies through copying (Create> Copy)
As a result, we get 3 cloud storage:
EveryDay (Google Drive)
EveryMonth (Google Drive)
EveryYear (Google Drive)
This completes the Warehouse Management setup.
3. Creating backup tasks
3.1. Tasks> Add Task> Backing Up Files and Databases (SQL)
- main parameters
Include backup of the SQL database in the archive (using Microsoft SQL Server as an example)
- Microsoft SQL Base
We register all the details.
We check that TCP 1433 port is open on the MS SQL server.
Click: Check
- Archive storage
- Add storage \\ NAS \ Backup \ EveryDay
Automatically delete obsolete backups : 30
- Add storage EveryDay (Google Drive)
Automatically delete obsolete backups : 30
- Archive file
Archive file name: database name
End of archive name : yyyy.mm.dd_hh.nn.ss
Archiving
Format : 7z
Compression : no compression
Why no compression?When backing up your SQL database, you should consider 2 options
1. Database compression by means of SQL server. - Fast, but compresses worse than 7z.
If you choose this option, then you need:
- Select: no compression (since compressing an already compressed .bak file is useless)
- In the properties of the MS SQL server, enable : Database parameters> Compress backups.
2. Database compression with 7z - Slow, but compresses better than SQL.
If you choose this option, then you need:
- Select: maximum compression
- In the properties of MS SQL Server, disable : Database options> Compress backups.
In SQL backups, I use the first option, although it compresses worse, but unloading is done in a matter of minutes (or even seconds). But the second option can stretch for hours.
In future versions of the program, the developers promised to think about adding the option of compressing MS SQL databases to the properties of the task so as not to run into the properties of the MS SQL server.
Encrypt archives
Encrypt file names
Set a password (write it down, if you forget, backups will not be restored)
- Startup Schedule:
Run on schedule : enable
Daily 03:00 - Abort a task in: enable
2 hours 0 min
3.2. Tasks> Add task> Backing up files and databases (file)
- main parameters
Include files in the archive
- Files
The path to the files : Choose the path to the folder in which the 1C file bases are located, for example, “D: \ Bases”
If we want to backup all the databases in subdirectories, select:
Names of saved files, directories ... :
1Cv8.1CD
Include subdirectories (recursively)
If we want to backup selected databases in subdirectories, select:
Names of saved files, directories ... :
Buh \ 1Cv8.1CD
Trade \ 1Cv8.1CD
- Archive storage
- Add storage \\ NAS \ Backup \ EveryDay
Automatically delete obsolete backups : 30
- Add storage EveryDay (Google Drive)
Automatically delete obsolete backups : 30
- Archive file
Archive file name: database name
End of archive name : yyyy.mm.dd_hh.nn.ss
Archiving
Format : 7z
Compression : maximum
Encrypt archives
Encrypt file names
Set a password (write it down, if you forget, backups will not be restored)
- Startup Schedule:
Run on schedule : enable
Daily 03:00
- Abort a task in: enable
2 hours 0 min
We set up the main tasks of daily backup, move on to additional
4. Tasks> Add task> Additional copying
- main parameters
Backup task - source : select the desired task
Storage ... source : select storage \\ NAS \ Backup \ EveryDay
- Archive storage
- Add storage \\ NAS \ Backup \ EveryMonth
Automatically delete obsolete backups : 24
- Add storage EveryMonth (Google Drive)
Automatically delete obsolete backups : 24
- Archive file
Archive file name: database name
End of archive name : yyyy.mm.dd_hh.nn.ss
Archiving
Format : 7z
Compression : no compression
Encrypt archives
Encrypt file names
Set a password (write it down, if you forget, backups will not be restored)
- Startup Schedule:
Run on schedule : enable
Monthly. All months are 1st day.
05:00
- Abort a task in: enable
2 hours 0 min
By analogy, we create the Additional copy task for the annual plan , for speed, copy the last monthly task and change the name, storage and schedule in it
- Archive storage
- Add storage \\ NAS \ Backup \ EveryYear
Automatically delete obsolete backups : 12
- Add storage EveryYear (Google Drive)
Automatically delete obsolete backups : 12
- Startup Schedule:
Run on schedule : enable
Monthly. February 1st (year closed)
05:00
Configure additional backup tasks, proceed to the report generation by e-mail
5. Tasks> Add task> Sending reports
- main parameters
Number of days ... : 1
- We select all the tasks, for all we select the record filter: Log entries with errors
- Mail Options
Fill in the details of the mail. Where and with what topic to send reports.
- Startup Schedule:
Run on schedule : enable
Daily
07:00
It remains to run all the tasks in turn and check for errors.
Example of a backup log of MS SQL database weighing 52GB (mdf):
===========================================
: Base1
:
: SRVTS0
: 4.5 / 2
: ,
: 11.11.2019 4:01:08
: 11.11.2019 5:13:57
:
===========================================
11.11.2019 4:01:08 - MSSQL "Base1" ...
11.11.2019 4:01:08 - SQL Server version 11
11.11.2019 4:22:15 -
11.11.2019 4:22:15 - ...
11.11.2019 4:22:15 - 7z, , c
11.11.2019 4:26:50 - 1 , 0
11.11.2019 4:26:50 -
11.11.2019 4:26:52 - 5,41 GB "EveryDay (Google )" ...
11.11.2019 4:26:54 - "Base1_2019.11.11_04.26.52.7z" 5,41 GB (1 1)
11.11.2019 5:13:57 -
11.11.2019 4:26:52 - 5,41 GB "\\NAS\Backup\EveryDay" ...
11.11.2019 4:26:52 - "Base1_2019.11.11_04.26.52.7z" 5,41 GB (1 1)
11.11.2019 4:28:13 -
It can be seen from the log that the download to the storage and the cloud began simultaneously.
The backup to the vault was completed after 27 minutes. And it was uploaded to the cloud after 1 hour 12 minutes from the start of the task.
Provided that at the same time at the same time 4 more backup tasks of the databases were performed, the sizes of which are 38GB, 28GB, 6GB and 5GB (mdf).
All tasks were simultaneously started at 4:00 and successfully completed before 5:15:00.
Conclusions:
There are of course minor flaws, except for those that have already been described in the article:
- the inability to export and import settings and tasks in the form of a text file (namely a text file, not mdb, etc., so that you can easily open and edit)
- there is no visual saving of OAuth settings, it is always empty and it is not clear whether it is configured or not.
- there is no way to quickly turn on / off tasks (you need to open each and go to the schedule). Although the main window intuitively asks for a double click on the checkmark.
But on the whole, I was very pleased with the result. I find the program very useful.UPD1: Added information on the cost of software, thanks Filex
Write about your backup algorithms that may have greatly helped you and may be useful to others.