Data de-duplication is an emerging technology that when coupled with D2D (disk-to-disk) backup has tremendous value. Simply, de-duplication reduces the amount of redundant data requiring back up resulting in less capacity needed to store data.
Companies are realizing great value by retaining more data on disk for longer periods of time while reducing the need to recover data from tape. For organizations that have multiple sites, replication is often used for disaster recovery. A well designed data de-duplication solution enables greater efficiency when moving data across a WAN by reducing costs and complexity.
Although, the technology behind de-duplication can be quite sophisticated, the concept of data de-duplication is quite simple and begins with the process of examining and identifying redundant data. Backups traditionally have been inefficient because of the amount of redundant data - the same data is backed up day after day escalating costs and consuming storage space.
For example, suppose a 2 MB image has been embedded in a Word document and e-mailed to ten people. Those ten people embed the image into other documents and in turn forward documents with the 2MB image throughout the organization to the point where the image has been embedded in 200 different documents. This creates 400 MB of additional capacity requirement to support 2MB of information. With de-duplication, the original 400 MB needed to store the attachment is reduced to just 2 MB for one iteration of the file.
Today, data de-duplication technology is realizing storage savings of 10 to 30 times. Companies can store 10 TB to 30 TB of backup data on 1 TB of physical disk creating tremendous value. Increasing storage capacity eliminates the cost differences between tape and disk. Factor in the operational efficiencies of not having to move, store and manage redundant data and D2D with data de-duplication is a game changing technology!
There is a great deal of buzz in the market around data de-duplication and it is only going to get louder. Data de-duplication offers landscape changing value that is quantifiable, improves reliability, simplifies management and provides rapid recovery of data. To find out more on data de-duplication please contact your Clear North Sales Representative.
