Quantcast
Channel: RRS – CloudBerry Lab Blog

CloudBerry S3 Explorer: Improved Reduced Redundancy Storage support

$
0
0

Reduced Redundancy Storage(RRS) enables users to store data in S3 at a 33% discount to our standard pricing in return for a reduced level of durability. Amazon S3 stores objects according to their storage class, which is assigned when an object is written.

Since we added RRS support to CloudBerry Explorer in version 2.1 we got a lot of feedback from our customers who wanted to make it even easier to apply RRS storage class to their files. Newer release of CloudBerry Explorer adds some usability enhancements to RRS support including displaying storage class in the object list, setting storage class one click operation and displaying storage class in the properties screen.

First, you can now see the Storage Class in the object list panel. It doesn’t add up anything to the transfer costs as the storage class is returned by LIST operation. This feature is available in both freeware and PRO versions.

image001

Second, you can now view Storage Class using object properties. Again, this feature is available in both freeware and PRO versions.

image003

And finally, in the PRO version you can easily apply Storage Class to your object (s) by using the context menu.

image005

We hope these enhancements will make it even easier and you keep using CloudBerry Explorer and prefer it over other Amazon S3 clients.

Note: this post applies to CloudBerry Explorer 2.2 and later.

CloudBerry S3 Explorer is a Windows freeware product that helps managing Amazon S3 storage and CloudFront.

Related products:
Like our products? Please help us spread the word about them. Learn here how to do it.

How to configure Lost Object Notification with CloudBerry S3 Explorer

$
0
0

As always we are trying to stay on top of the new functionality offered by Amazon S3 to offer the most compelling Amazon S3 and CloudFront client on Windows platform.

Notification of Lost Objects is a new feature that enables users to have notifications sent to an Amazon Simple Notification Service. Amazon S3 is now integrated with Amazon Simple Notification Service (SNS). You can configure your bucket to send a notification, via SNS, when an RRS object in that bucket is lost.(Check out here on how to enable RRS using CloudBerry Explorer). Notifications are enabled on a bucket level similar to the server logging and versioning.

Newer release of CloudBerry Explorer allows you to turn on notification of lost objects, retrieve current notification settings for a bucket and disable notification, all using convenient user interface.

The new option can be found in the bucket level context menu.

image001

It opens up a dialog that combines other RRS related options.

image003

Discussion of Amazon Simple Notification Service is outside of the scope of this article and doesn’t fall into the area of CloudBerry Lab expertise. You can learn more about this service here. You can create a Topic using a Command Line Interface Tool for Amazon Simple Notification Service. The description of the tool is available here http://awsdocs.s3.amazonaws.com/SNS/latest/sns-gsg.pdf

As always we would be happy to hear your feedback and you are welcome to post a comment.

Note: this post applies to CloudBerry Explorer 2.2.3 and later.

CloudBerry S3 Explorer is a Windows freeware product that helps managing Amazon S3 storage and CloudFront.

CloudBerry S3 Explorer PRO is a Windows program that helps managing Amazon S3 storage and CloudFront. It is priced at $39.99

Like our products? Please help us spread the word about them. Learn here how to do it.

CloudBerry Backup: Reduced Redundancy Storage Improvements

$
0
0
CloudBerry S3 Backup is a powerful Windows backup and restore program that automate backup and restore processes to Amazon S3 cloud storage.
Ever since we introduced a Reduced Redundancy Storage support in the version 1.5 we realized that it is inconvenient to set up storage class on the account level. It is much more reasonable to configure it on the backup plan level. In the newer release you can decide if you want to use RRS on the plan level and we added an appropriate option to the Compression and Encryption step.
image001
Now, you can have several backup plans with different storage classes. For example, one with standard storage class for the data that under no account you can lose and another one with RRS storage class with the less important data.
Note: In the current version only newly copied data will assume the new storage class. In the future version we are going to add an ability to modify storage class for existing data.
As always we would be happy to hear your feedback and you are welcome to post a comment.
Note: this post applies to CloudBerry Backup 1.6 and later.
CloudBerry Backup is a Windows program that leverages Amazon S3 storage. It comes with onetime fee of $29.99 (US) per copy.
Like our products? Please help us spread the word about them. Learn here how to do it.
Please, check out our featured products:

How to Set Reduced Redundancy Storage Class With PowerShell and CloudBerry S3 Explorer

$
0
0
As always we are adding features that our customers are requesting. This time we decided to add new PowerShell command that will help automate the way you apply storage class to Amazon S3 objects. Many users like to update their existing objects and set Reduced Redundancy storage class to benefit from reduced storage costs.
Check out here for more info how CloudBerry Explorer supports Reduced Redundancy Storage. We have introduced the new command that will help with setting storage class to an object
Set-CloudStorageClass
Here is an example how you can set RRS the storage class to an object
$s3 = Get-CloudS3Connection -Key $key -Secret $secret
$bucket = $s3 | Select-CloudFolder -Path $bucketname
$item = $bucket | Get-CloudItem $itemname
$item | Set-CloudStorageClass -StorageClass rrs
Here is an example how you can set the RRS storage to all text files in a specified folder:
$s3 = Get-CloudS3Connection -Key $key -Secret $secret
$bucket = $s3 | Select-CloudFolder -Path $bucketname
$folder = $bucket | Get-CloudItem $foldername
$folder | Set-CloudStorageClass -Filter *.txt -StorageClass rrs
If you want to set the RRS storage class for new objects while copying them to S3 use the following command that have been extended with the StorageClass parameter:
$src | Copy-CloudItem $destination -filter "results.xls" -StorageClass rrs
As always we would be happy to hear your feedback and you are welcome to post a comment.
Note: this post applies to CloudBerry Explorer 2.6 and later. 
CloudBerry S3 Explorer is a Windows product that helps managing Amazon S3 storage and CloudFront.
Related products:
Like our products? Please help us spread the word about them. Learn here how to do it.

CloudBerry Drive for Amazon S3 support for Reduced Redundancy Storage and Server Side Encryption

$
0
0
CloudBerry Lab presents new version of CloudBerry Drive 1.2. This application provides you with an ability to mount Amazon S3 as a drive on your computer. And Amazon S3 is not the only cloud storage supported by CloudBerry Drive, you can find a list of supported cloud storages on the CloudBerry Drive product page. The new version comes with an ability to configure Reduced Redundancy Storage (RRS) and Server Side Encryption (SSE).

New Features of CloudBerry Drive for Amazon S3

As always we are adding new features to the product to make it even more useful and efficient. In new release we've added two new features:
  • Support for Amazon S3 Reduced Redundancy Storage (RRS) – This storage options allows for cheaper storage in exchange for reduced reliability (99.99%). Pricing for Amazon S3 Reduced Redundancy Storage starts at only $0.0240 /GB/month and decreases as you store more data. According to Amazon if you store 10 000 objects on your Amazon S3 bucket you may expect to lose 1 object per year. For many practical purposes this reliability level is more than sufficient.
  • Support for Amazon S3 Server Side Encryption (SSE)  provides you the ability to encrypt data stored at rest in Amazon S3. With Amazon S3 SSE, you can encrypt data on upload simply by adding an additional request header when writing the object to Amazon S3. Decryption happens automatically when data is retrieved.
You can configure both options on per mapped drive basis on the Mapped Drive Options screen:
CloudBerry Drive for Reduced Redundancy Storage
You can try CloudBerry Drive for Amazon S3 absolutely free. Just download fully functional 15 days trial version and see how easy it is to mount Amazon S3 and Reduced Redundancy Storage as a local drive. We hope that most of Cloud Berry Drive users will appreciate the improvements we’ve made to our product. We work hard to provide you with really compelling product and will be glad to hear any feedback to make our services better.
Related products:
Like our products? Please help us spread the word about them. Learn here how to do it.

Amazon Import/Export Updates in CloudBerry Explorer

$
0
0
Amazon has recently updated its Import / Export service with a list of minor changes. Now applications that support AWS Import / Export need to be updated to continue proper working with AWS Import / Export service. We hurried to update CloudBerry Explorer to put it in the up-to-date conditions as soon as possible.

What’s changed in AWS Import / Export service:
  • Device erasure for import jobs is now mandatory;
  • Encryption for export jobs is now mandatory;
  • Providing a notification email is now mandatory.
In a short time after the AWS announce we are glad to present updated CloudBerry Explorer. Now our cloud management solution for Amazon S3 is fully ready for Import and Export jobs. Just download the latest version of CloudBerry Explorer and you will be able to use all the features of Import / Export service.
For import jobs Explorer now will ask user to choose whether to erase all the data from device or not. Notification email will be set automatically with the email specified while registering a copy of CloudBerry Explorer (or it can be specified manually if you prefer). Encryption for export job will occur automatically with no need for any actions from the user.
Conclusion
As always CloudBerry tracks for AWS updates in order to keep our solutions for Amazon S3 up-to-date. We believe that our customers deserve the best and so we care for all the features of our products worked well even if the storage provider has made fresh changes really a short time ago.
You can learn more about CloudBerry products and AWS Import / Export service with in:
+++
Please, check out our featured products:
Like our products? Please help us spread the word about them. Learn here how to do it.
Want to get CloudBerry Backup for FREE? Make a blog post about us!

Amazon S3 Features: RRS, ACL, Lifecycle, Versioning, CloudFront and More

$
0
0

Amazon S3 (Simple Storage Service) is the publicly available online web service offered by Amazon Web Services. S3 provides unlimited cloud storage for your data with no volume restrictions. Bucket is one of key concept for Amazon S3.

Common Information

Every object stored in S3 is placed in a bucket. It is possible to create up to 100 buckets per account. Buckets' volume is unlimited. All folders and files in S3 buckets are called «Objects».

All buckets share common namespace in Amazon S3. Therefore each bucket name must be unique: you can’t use the name that's already occupied by other bucket. The name becomes available only when bucket is deleted.

There are more bucket restrictions and limitations like rules for bucket naming or impossibility to put one bucket inside another. Also S3 buckets have several properties and usage methods. Let's make a small overview.

Policies and Security, ACL

Access to buckets and objects is managed by Policies and ACL (Access Control list). ACL is a list with specified permissions like read/write or full control for selected groups of users. You can use it to make you objects in S3 bucket publicly available.

S3 Bucket Policies are used for access management too, but that is more difficult and flexible instrument than ACL. You can grant or deny permissions for specified group of users, for each action or group of actions, and also you can specify some conditions like time, source etc. For example, you can deny access to get objects to all requests from user agent "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.153 Safari/537.36".

To write S3 bucket policies you need to use JSON-based APL (access policy language) or AWS Policy Generator.

Accessing, Website and CloudFront

There are several ways to access objects in S3 buckets: (i) via AWS console, (ii) with cloud managers like CloudBerry Explorer or (iii ) through direct links. Another two ways – hosting a static web site on Amazon S3 and using CloudFront distributions. Also there is a way to download objects via BitTorrent.

S3 bucket can be used to host simple static website that doesn't use server-side scripts such as PHP, JSP, or ASP.NET. If you enable "s3 website" feature you can access website stored in you bucket with address <bucket-name>.s3-website-<AWS-region>.amazonaws.com. Instead of accessing the website by using an Amazon S3 website endpoint, you can use your own domain by using redirect requests.

One of the interesting ways to use S3 buckets is creation of CloudFront distributions. CloudFront is a web service that speeds up access of end users to the static and dynamic web content - html, css, php, images, video etc. For more information see AWS CloudFront Overview.

Using Buckets for Backup and Restore Data

Data backup is very important for users and enterprises that need to increase reliability of their systems and data. In this case storing data in S3 buckets is one of the very popular, easy-to-use and low cost solutions.

Backing up is not Amazon S3 service therefore you need to use the third-party software such as CloudBerry Backup and CloudBerry Explorer.

Lifecycle and Versioning

Bucket versioning allows you to preserve, retrieve, and restore every version of every object stored in this bucket. Versioning is intended to increase a reliability of storage: you can restore deleted or overwritten objects. This option has restriction: once enabled for the bucket, it cannot be disabled, only suspended.

Lifecycle defines how Amazon S3 manages objects during their lifetime, from creation to delete. The objects that use Lifecycle can be automatically deleted or marked for the Glacier storage after a specified period of time. It helps to reduce storage costs. Recently Amazon expanded possibilities of the Versioning, by adding an Lifecycle option. For more information see Amazon S3 Now Supports Lifecycle Rules for Versioning.

Logging

For all created buckets you can enable a logging. Log record contains details about the requests, resources, time and date the request was processed. Logging can be applied to any bucket in your account.

RRS, Tagging and Pricing

You can find prices for storage, requests and data transfer at Amazon S3 Pricing – that’s all information about paying and prices. But some moments we have to be noted.

When you want to share data but not incur charges associated with others accessing the data you can configure bucket to charge requester. This option called "Requester Pays". If enabled, one requested an object will pay the cost of the request and the data download from a bucket. Storage cost is always paid by the owner. Anonymous access to that bucket is not allowed.

Also pay attention to the section "Request Pricing". Request in Amazon S3 refers to any user action with buckets and objects. Accessing  the folder is obtaining the list of files in the folder, accessing the bucket is obtaining the list of files and folders in a bucket - all these actions are charged by AWS. Of course the price is insignificant small, but you need to keep it in mind when working with a large number of files.

The price also depends on whether RRS (Reduced Redundancy Storage) is enabled or disabled. RRS is a storage option that allows you to reduce costs by storing a non-critical and reproducible data.

Tagging (Cost Allocation Tagging) is an AWS billing feature that enables you to organize and track your AWS costs using tags for buckets. It allows easily track buckets' cost with identical tags against buckets with different tags.

Introducing CloudBerry Drive 2.2.1 with new enhancements

$
0
0

We are pleased to announce a new version of CloudBerry Drive which features the following changes:

  • Support of AWS Asia Pacific (Seoul) region
  • Support of AWS Standard-IA storage class
  • Support of Azure China

Let us explore them in more detail!

Support of AWS Asia Pacific (Seoul) region

CloudBerry Drive 2.2.1 supports a new AWS Asia Pacific (Seoul) region. This feature allows mapping Amazon S3 buckets created in Seoul region as network drives under Windows. Basically, you will not need to do anything specific to use this feature. Just map a desired bucket with a nested folder as you normally do and that’s it.

Support of AWS Standard-IA storage class

In addition to Reduced Redundancy storage, CloudBerry Drive 2.2.1 brings support for AWS Standard-IA storage class. Now CloudBerry Drive allows using a less expensive (in comparison with Amazon S3 Standard storage) class providing for a more increased redundancy level than before. AWS Standard-IA storage class is designed to effectively manage data that is not accessed very often. To use this feature, bring up the “Mapped Drive Options” dialog box and select the “Use Standard-IA” check box as illustrated in picture below.

Changing Mapped Drive options

Support of Azure Blob Storage in China

CloudBerry Drive 2.2.1 supports Azure Blob storage in China. To use this option, choose the Azure Blob storage provider and then select the “Azure in China” check box.

Adding Storage Account

Conclusion

Starting from today, these functions are available in CloudBerry Drive. Are you interested in these functions and want to try our product? Download a free 14-day trial and see it yourself.

Download CloudBerry Drive FREE TRIAL

 


Lost Object in Amazon S3 RRS: How to Setup Notification and Re-Upload to the Cloud

$
0
0

Before we begin

Amazon S3 Reduced Redundancy Storage (RRS) is a storage class within Amazon S3 that costs 30% less than Amazon S3 Standard Storage, but with lower durability: 99.99% (RRS) vs 99.999999999% (S3 Standard). That means AWS can lose 1 from 10 000 files during one year.

It’s great to save 30% on storage cost, but no one wants to lose their data, especially if you’re using Amazon S3 RRS as a backup storage. In this post we’ll show how to setup an automatic notification when the object was lost and how to recover it in the cloud using CloudBerry Backup.

Step 1: Create a notification with Amazon SNS

Amazon Simple Notification Service (Amazon SNS) is a web service that enables applications, users, and devices to instantly send and receive notifications. We’ll use to create email notifications.

In order to setup Amazon SNS, please perform the following steps:

  • Sign in to your AWS Management Console, under the Mobile Services section, choose SNS.
  • Choose Create Topic, specify a Topic name and a Display name.
  • Press Create Subscription in the window underneath choose Email in the Protocol drop-down list.
  • In the Endpoint field, specify an email address that will be used for your notifications. You will receive a confirmation email. Follow the link in the email to activate your subscription.
  • In the SNS dashboard, choose the topic created, go to Edit Topic Policy in the Actions menu. In the Allow these users to publish messages to this topic section choose Everyone. SNS-dashboard-topic-policy-email-notifications

Once an email address is confirmed, you are ready to receive notifications from your S3 buckets.

Step 2: Enable event notifications for your S3 RRS bucket

Amazon S3 allows you to forward event notifications to Amazon SNS. In order to enable this feature, follow the steps below:

  • Open AWS Management Console, go to Amazon S3.
  • Choose your bucket, go to Properties, expand the Events section.Amazon-S3-dashboard-bucket-properties-notifications
  • Specify a name for your notification in the Send to, section, choose SNS.
  • In the SNS topic field select SNS topic created previously, hit Save.

Now you all set to get notified once an object is lost.

What to do if the object is lost

So, what happens when your object is lost. You receive a notification to your email address. In order to keep your backup consistent, you will have to update your local metadata storage in CloudBerry Backup by going to Tools -> Options -> Repository -> Synchronize Repository.

restore-backup-consistency-amazon-rrs

After the operation is finished, your lost file will be identified and reuploaded next time the backup plan run.

Note: The workflow described in this article is only applied if we have enabled only one (latest) version of a file in CloudBerry retention settings.

Conclusion

Now you have a workaround that allows you to have a consistent backup in Amazon RRS with minimum efforts. Amazon SNS also provides a way to automate entire process. Drop us a line if you'd like us to elaborate this topic further. 

Download CloudBerry Backup 15-day free trial

 

Automatically Set Standard_IA Storage Class for Amazon S3 Uploads

$
0
0

Note: this post applies to CloudBerry S3 Explorer 4.5.1 and later.

Starting from CloudBerry Explorer 4.5.1 you can set a global option for your bucket where to set  a storage class for your uploads to Amazon S3.  In previous versions there was only RRS option, now you can set Standard, RRS or Standard-IA storage class for your bucket.

Let's learn how to do that! It will take just few steps.

In CloudBerry Explorer right-click on your bucket and choose Properties or use a Properties toolbar button, select Storage Class tab:

Storage Class

Choose a storage class you want to set for a particular bucket (e.g. Standard-IA), click OK.

Every upload to the bucket will come with Standard-IA storage class:

Standard-IA uploads

Note: Standard - IA has a minimum object size of 128KB. This is why the second file has Standard storage class, not Standard-IA.

CloudBerry S3 Explorer is a Windows product that helps managing Amazon S3 storage, CloudFront and Amazon Glacier.

Conclusion
CloudBerry Explorer 4.5.1 comes with a flexible option to set a storage class for your uploads.
Like our products? Please help us spread the word about them. Learn here how to do it.





Latest Images