# Deduplication

{% hint style="warning" %}
The deduplication feature is **not supported** (from ver. 2.0.5) on 32-bit operating systems. Previously created backups remain backward compatible and can be restored using agents on 32-bit operating systems.
{% endhint %}

## Understanding deduplication

Deduplication is a data compression technique that eliminates duplicate copies of repeating data. It ensures that only unique data instances are stored, significantly reducing the required storage space.

### <mark style="background-color:blue;">Deduplication benefits</mark>

Deduplication provides significant advantages in data backup. By removing duplicate data blocks, it can reduce storage requirements by **50%** to **90%**, depending on data type and redundancy level. This results in substantial cost savings in physical storage, data center space, and energy consumption.

### <mark style="background-color:blue;">Optimization with encryption</mark>

While deduplication provides significant benefits, its effectiveness can be reduced when combined with encryption. If different encryption keys are used for backup plans targeting the same storage repository, deduplication becomes less efficient, as encryption alters data blocks to the extent that duplicates are no longer recognized.

To maintain optimal deduplication and maximize storage savings, it is recommended to use the same encryption key for all backup plans within a single storage repository.

Encryption modifies even identical data blocks to the point that duplicates are no longer recognized. Using the same encryption key ensures that the deduplication process can accurately identify and remove redundant data, resulting in improved data management.

***

## Deduplication in Xopero ONE

**Xopero ONE** uses software-based global deduplication at the source, employing block-level deduplication to identify and remove duplicate blocks within and across files (when backup is performed, the process scans data for duplicate blocks). Rather than storing multiple copies of the same block, it saves a single instance and replaces subsequent duplicates with a reference to the original block.

### <mark style="background-color:blue;">How it works</mark>

In **Xopero ONE**, deduplication is performed at the source, meaning it begins on the client side (agent) before data is transmitted to the storage repository. This deduplication method ensures that redundant data is eliminated early in the process. The backup agent scans the data for duplicate blocks by retrieving a deduplication table from the storage repository, which contains information about previously stored blocks. By comparing new data against this table, the agent can identify duplicates and avoid transmitting them, significantly reducing the amount of data sent over the network.

### <mark style="background-color:blue;">Bandwidth and time efficiency</mark>

The primary advantage of source-side deduplication in **Xopero ONE** is the substantial reduction in network bandwidth usage and backup execution time. By identifying and eliminating duplicates before data transmission, only unique data blocks are sent to the storage repository, which optimizes bandwidth efficiency, making it especially beneficial in environments with limited network capacity or high data transfer costs.

***

## Configuring deduplication settings

{% hint style="warning" %}
When configuring deduplication with encryption, use <mark style="color:$danger;">**the same encryption key**</mark> for all backup plans within the same storage repository.
{% endhint %}

{% hint style="danger" %}
If you create a backup plan without deduplication, <mark style="color:$danger;">**it cannot be enabled later**</mark>— you can’t change deduplication settings in an already configured plan. To use deduplication in a backup plan, you <mark style="color:$danger;">**must create a new one**</mark>. The existing plan can be easily cloned during editing.
{% endhint %}

To enable deduplication in **Xopero ONE**, login to your **Xopero ONE Management Service** (**XMS**) and go to **Plans** > **Backup** > ➕ **Add plan**. When configuring a new backup plan, scroll to **Advanced settings**, click **Edit**, and toggle the **Deduplication** option to enable it.

<figure><img src="https://319733277-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F0CBTl43C3OO6ySL1DJ6k%2Fuploads%2FU9hq3HrqTCDaetyQwl7S%2Fimage.png?alt=media&#x26;token=dce0c582-9def-41a2-8ae6-0c1c36b79c6f" alt=""><figcaption></figcaption></figure>

***

## Useful links and items

{% content-ref url="cleanup-of-deduplication-data" %}
[cleanup-of-deduplication-data](https://helpcenter.xopero.com/xopero-one-en/backup-plans-and-features/cleanup-of-deduplication-data)
{% endcontent-ref %}