Deduplication plug-in

The plug-in runs on the deduplication storage server and on load balancing servers.

Multi-Threaded Agent

The NetBackup Deduplication Multi-Threaded Agent uses multiple threads for asynchronous network I/O and CPU core calculations. The agent runs on the storage server, load balancing servers, and clients that deduplication their own data.

See About the MSDP Deduplication Multi-Threaded Agent.

NetBackup Deduplication Engine

The NetBackup Deduplication Engine is one of the storage server core components. It provides many of the deduplication functions, which are described in Table: NetBackup Deduplication Engine components and functions.

The binary file name is spoold, which is short for storage pool daemon; do not confuse it with a print spooler daemon. The spoold process appears as the NetBackup Deduplication Engine in the NetBackup Administration Console.

NetBackup Deduplication Manager

The deduplication manager is one of the storage server core components. The deduplication manager maintains the configuration and controls internal processes, optimized duplication, security, and event escalation.

The deduplication manager binary file name is spad. The spad process appears as the NetBackup Deduplication Manager in the NetBackup Administration Console.

Proxy plug-in

The proxy plug-in manages control communication with the clients that back up their own data. It communicates with the OpenStorage proxy server (nbostpxy) on the client.

Reference database

The reference database stores the references that point to every data segment of which a file is composed. Unique fingerprints identify data segments. The reference database is partitioned into multiple small reference database files to improve scalability and performance.

The reference database is separate from the NetBackup catalog. The NetBackup catalog maintains the usual NetBackup backup image information.

Connection and Task Manager

The Connection and Task Manager manages all of the connections from the load balancing servers and the clients that deduplicate their own data. The Connection and Task Manager is a set of functions and threads that does the following:

Data integrity checking

The NetBackup Deduplication Engine checks the integrity of the data and resolves integrity problems.

See About MSDP data integrity checking.

Data Store Manager

The Data Store Manager manages all of the data container files. The datastore Manager is a set of functions and threads that provides the following:

See About MSDP container files.

Index Cache Manager

The Index Cache Manager manages the fingerprint cache. The cache improves fingerprint lookup speed.

See About the MSDP fingerprint cache.

Queue processing

The NetBackup Deduplication Engine processes the transaction queue.

See About MSDP queue processing.

Reference Database Engine

The Reference Database Engine stores the references that point to the data segments, such as read-from or write-to references. It manipulates a single database file at a time.

Reference Database Manager

The Reference Database Manager manages all of the container references. It provides a transaction mechanism to manipulate a single database file.