What's New in Retrospect – Retrospect Backup 19 + Retrospect Virtual 2022 + Retrospect Cloud Storage

Cloud Backup - How to Set Up Amazon S3 for Cloud Backup

Cloud Backup



title: Cloud Backup - How to Set Up Amazon S3 for Cloud Backup created_at: 2016.03.01 updated_at: 2021.06.21 category: Cloud Backup --- :toc: macro :toc-title:

Amazon S3 provides a low-cost, scalable cloud storage location for secure off-site data protection. It offers a free tier to its cloud services that includes 5GB of storage for a year. Retrospect 11 and higher for Windows and Retrospect 13 and higher for Mac are certified for Amazon S3. Follow these step-by-step instructions for setting up an Amazon S3 account, configuring a storage location (called a "bucket"), and creating a set of security credentials (an Access Key and a Secret Key, similar to a username and password).


Video Tutorial - Retrospect Backup for Windows


Video Tutorial - Retrospect Backup for Mac


Account Setup Guide

See the following video or the steps below to quickly create an Amazon AWS account.

  1. Visit Amazon AWS to start the account creation process and click "Create an AWS Account".

  2. Fill in an email address and password.

  3. Complete the contact information form.

  4. Complete the payment information form.

  5. Complete the identity verification.

  6. Select an appropriate Support Plan.

  7. The new account is created. You’re ready to set up the storage location.


Storage Setup Guide

Now we will create a bucket that Retrospect can use to store backups.

  1. Log into AWS Console.

  2. Search for S3 and select.

  3. Click "Create Bucket".

  4. Type in an appropriate name for the bucket. Note that these are globally-unique names.

  5. Continue through the rest of the wizard with default options.

  6. Your bucket is now ready. In Retrospect, the "Path" is s3.amazonaws.com/your_bucket_name. Next, you need a set of security credentials for Retrospect to use to access it.


Choosing a Storage Class

Amazon S3 offers different storage classes to tailor its feature set and pricing model to different use cases. Retrospect supports "Standard", "Reduced Redundancy", "Infrequent Access", "One-Region", "S3 Glacier", and "S3 Glacier Deep Archive". The default storage class is "Standard". See below for how to use the other storage classes.

Using "Infrequent Access" Storage Class

You can use Amazon’s guide to Lifecycle Management or follow the steps below.

  1. Go to S3, select your Retrospect bucket, click on Properties, select Lifecycle, and click "Add Rule".

  2. Choose the target for the rule. This must include your set.

  3. Select "Transition to the Standard - Infrequent Access Storage Class". The minimum number of days is 30. Click "Review" and then "Create and Activate Rule"

  4. You will see the rule listed in your bucket’s Properties under Lifecycle.

Using "S3 Glacier" or "S3 Glacier Deep Archive" Storage Class

Amazon S3’s Glacier storage classes are very cost-effective but come with a performance trade-off. When you utilize either "S3 Glacier" or "S3 Glacier Deep Archive", objects (backups) are not immediately accessible and must be restored. Retrospect defaults to storing objects under the "Standard" tier, so you will need to make a lifecycle to transition objects to Glacier storage.

You can use Amazon’s guide to Lifecycle Management or follow the steps below.

Backup

  1. Go to S3, select your Retrospect bucket, click on Management.

  2. Click "Create Lifecycle Rule".

  3. Fill out the name and prefix (what backup sets you want to transition). Retrospect only uses the current version of the object, so check "Transition current versions of objects between storage classes". You can transition directly from your current storage tier to "S3 Glacier Deep Archive". Click "Create Rule".

  4. You will see the rule listed in your bucket’s Properties under Lifecycle.

Restore

  1. Files stored on Glacier require a separate restore process before Retrospect can access them. You need to select the files in the set and click "Initiate Restore". You can also use a CLI to perform this in bulk.

  2. Select the number of days you need to files temporarily available (for the restore) and the method (which affects cost).

  3. The restore will start, and the set will be available for Retrospect. You can see verify what storage class the set is by looking at the file browser.

Using "Reduced Redundancy" Storage Class

The "Reduced Redundancy" storage class is not available in Lifecycle. You must set this storage class periodically after a backup. You can use the AWS Console or a third-party tool like Cyberduck.

  1. Go to S3, select your Retrospect bucket, navigate to your set, click on Properties, select "Reduced Redundancy, and click "Save".


Simple Access Setup Guide

Now we will create the security credentials it can use to access that bucket. To grant Retrospect more granular access to your S3 account, please see the Advanced Access Setup Guide.

  1. Open the IAM console.

  2. In the navigation pane, choose Users.

  3. Choose your IAM user name (not the check box).

  4. Choose the Security Credentials tab and then choose Create Access Key.

  5. To see your access key, choose Show User Security Credentials. Your credentials will look something like this:

    Access Key ID: AKIAIOSFODNN7EXAMPLE
    Secret Access Key: wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY
  6. Choose Download Credentials, and store the keys in a secure location. Note that your secret key will no longer be available through the AWS Management Console; you will have the only copy. Keep it confidential in order to protect your account, and never email it. Do not share it outside your organization, even if an inquiry appears to come from AWS or Amazon.com. No one who legitimately represents Amazon will ever ask you for your secret key.


Advanced Access Setup Guide

  1. Go to IAM and click on "Users".

  2. Click on "Create New Users".

  3. Type in an appropriate username for Retrospect and click "Create". AWS will show you a set of credentials: an Access Key and a Secret Key. This is the only time AWS will show these, so download them to a safe place.

  4. On the new user’s account, click "Inline Policy" and then "Create User Policy". We are going to restrict this user’s access to only the bucket we just created.

  5. Choose "Custom Policy" and click "Select". Enter the following policy, replacing "your_bucket_name" with the name of the bucket you created.

    {
        "Version": "2012-10-17",
        "Statement": [
            {
                "Effect": "Allow",
                "Action": [
                    "s3:*"
                ],
                "Resource": [
                    "arn:aws:s3:::your_bucket_name",
                    "arn:aws:s3:::your_bucket_name/*"
                ]
            }
        ]
    }
  6. When you’re done, click "Validate Policy" then "Apply Policy". With this, Retrospect will have full access to that bucket but no access to anything else on S3 or other AWS services.


Information for Retrospect

Retrospect needs three pieces of information to access Amazon S3:

  • Virtual-Host Pathyour_bucket_name.s3.us-east-1.amazonaws.com

  • Access Key – Use the Access Key from above.

  • Secret Key – Use the Secret Key from above.

Note that for the new virtual-host path, the region is required. Otherwise, you will receive a "Host not found or network unavailable" error.

For the path, Amazon S3 supports different paths for its regions. Please see the following paths for the region you specified when creating the bucket:

  • Irelandyour_bucket_name.s3.eu-west-1.amazonaws.com

  • Sydneyyour_bucket_name.s3.ap-southeast-2.amazonaws.com

  • Singaporeyour_bucket_name.s3.ap-southeast-1.amazonaws.com

  • Tokyoyour_bucket_name.s3.ap-northeast-1.amazonaws.com

  • Sao Pauloyour_bucket_name.s3.sa-east-1.amazonaws.com

See Amazon S3 Regions/Endpoints for further details.

Note that if you use the default path of s3.amazonaws.com for a region outside of the United States, you may receive the following error: "These credentials are not valid". Please use the region-specific URL above to correct this.

Note that as of September 30, 2020, new buckets on S3 require virtual-host domains instead of path-style domains. Please see our KB article to learn more.

If you see error "Host not found or network unavailable", the issue could be that you are using a Retrospect version below 17.5 with a path-style domain. See screenshot.

Please upgrade to Retrospect 17.5 to use virtual-host domains.


Adding Cloud Storage in Retrospect

Adicionar armazenamento em nuvem como um destino é simples. O Retrospect tem um novo tipo de conjunto chamado "Cloud". Crie um novo conjunto de backup / conjunto de mídias e selecione "Cloud" como o tipo.

Interface do Windows

Interface Mac

Next you’ll need to enter your cloud storage credentials. Retrospect allows customers to enable or disable SSL encryption (HTTP or HTTPS) and to set the maximum storage usage, up to 8TB per cloud member.

Interface do Windows

Interface Mac


Using Cloud Storage in Retrospect

Usar o armazenamento em nuvem é simples. Depois de criar um conjunto de nuvens, crie um novo script ou adicione-o a um existente e clique em "Executar". O backup começará com o conteúdo do conjunto sendo carregado para o local de armazenamento na nuvem. Você pode acompanhar o progresso na execução / atividade.

Interface do Windows

Interface Mac


Throttling Cloud Backups in Retrospect

A otimização para backup na nuvem e restauração na nuvem está disponível em Preferências.

Interface do Windows

Interface Mac


General Tips

Below are a number of tips for using cloud storage in Retrospect:


Última atualização: 21 de junho de 2021