Storage

Storage being one of the key infrastructure component, presents itself with a critical candidature against which products have to be tested. Along with the existing types of storages, the products need to be verified with latest storage optimization techniques.

While testing storage, 2 key points need to be verified:

  1. No over consumption of Storage
  2. No Data loss

A stable product should be intelligent enough to maintain an equilibrium between these 2 goals. In simple words,

“The egg has to be hatched only at the right time.”

There are various storage internal techniques available across different vendors, which need to be tested against products.

Deduplication:

Data deduplication is a method of optimizing storage by eliminating redundant data. Data is retained in form of only one single unique unit using this technique. The redundant occurrences of data are replaced with pointers to the unique copy of data preserved. If a chunk of data has 1 TB worth file size but contains 100 GB of unique data and 10 copies for the same, only one copy of the unique data needs to be preserved. The remaining content can be stored using the hashes to the unique copy of data. There are two primary techniques used:

  1. Intelligent compression
  2. Single Instance Storage

Compression:

Compression is a method of shrinking the size of data present on the storage. It removes the space consumed by unneeded data using a particular algorithm. This optimizes the space used by data on the storage. There are 2 types:

  1. Lossless
  2. Lossy

Encryption:

Encryption is the most effective way to achieve data security. To read an encrypted file, one must have access to a secret key or password that enables the user to decrypt it. It can be achieved using different types of algorithms used in the marked. The product should understand the type of encryption it supports with different types and vendors of storage.

File-System:

A product should be tested against different types of file-system, especially in the cases where support is not called out as compatible or not. Different types of file systems present different capabilities in terms of storage techniques, performance, IO throughput and change tracking. Some of the file systems are:

  1. Windows: FAT, NTFS, ReFS, exFAT
  2. Flat File Systems
  3. Unix : ext* family, BTRFS, XFS, VMFS
  4. MAC : HFS, HFS+