Menu

Nature of Logic and Perception

November 2, 2018 0 Comment

Situational Analysis
Enterprise Backup Solution

This document was prepared to analyze the backup infrastructure, and prepare an action plan, for the Ridgefield location.
Content
1Situation Analysis3
2Objective3
3Situation Fact3
4Options4
4.1Option # 1: Veritas Netbackup4
4.2Option # 2: Legato Networker5
4.3Option #3: Commvault Galaxy7
4.4Enterprise Backup Solution – Evaluation Analysis8
4.5Summary of options available11
4.6Updated analysis of Legato Networker subsequent to inclusion of Visual Storage Resource Migrator and Alphastor11
5Recommendation17
1Situation Analysis
This document was prepared to analyze the current backup environment and prepare an action plan, for the Ridgefield location regarding the incorporation an Enterprise Backup Solution.

2Objective
Our objective is to determine the best course of action regarding the selection and implementation of an Enterprise Backup Solution.

3Situation Fact
The current network environment has been outgrown the ability of Veritas BackupExec, the backup software platform used by BI Ridgefield- Production Services, in terms of amount of data being backed up, functionality, and reliability. At the time of its initial purchase approximately six years ago (with BackupExec 7.x), the server infrastructure consisted of approximately 80 clients with one TB of data captured on a weekly full backup. This small-business level backup solution provided a good fit for the environment and served the company’s data protection needs well. Accordingly, we continued to leverage BackupExec 8.x – 9.x in our organization as the network infrastructure expanded though out the years.

The server environment has now grown to the point where there are 370 servers with approximately 16 Terabytes of data captured on a weekly full backup. In light of this, meeting the established backup/restore service agreement is becoming increasingly challenging. Some of the functionality/features required to address this challenge includes:
-The ability to direct multiple streams of data to one media device simultaneously (Multiplexing).
-A provision for re-starting backup jobs from the point at which they failed (Checkpointing).
-Descriptive reporting on backup media content.

-Automation of Media Duplication and Vaulting tasks.

-Compete compatibility with SANs and NAS support
As a result, Production Services has evaluated a number of solutions from the leading backup software manufacturers. The final list was narrowed down to three competitors we thought could best meet our outlined requirements. They are: Veritas NetBackup, Legato Networker, and Commvault Galaxy. The tables below list the details of the evaluations.


4Options
The reviews of the three options are listed in the following table:
4.1Option # 1: Veritas NetBackup
Option Table # 1:
ProsCons
Administrative/management tasks performed from a centralized location. (Familiar Microsoft Management Console style interface).

Provides the ability to browse resources through Graphical User Interface when creating backup and restore jobs, reducing the possibility of typographical errors.

Provides straightforward media management. Multiple media erased, moved and exported at once.

Existing BackupExec 9.1 tape media can be imported / read in NetBackup. Eliminates need to keep BackupExec media servers in environment.

Remote agents can be deployed remotely to many servers at once. Only requires one agent install for all applications (SQL,Oracle.Sybase).

One can view real-time alert and job status (Byte Count, Rate, Files backed up, Errors, etc). There is also a troubleshooter option to provide error explanations and recommended actions.

Limited Grooming capability. The application requires Storage Migrator component for advanced features.
Pre and post job scripted commands are difficult to implement into job.


Synthetic backups allow for quick client backups restore from a single backup image. This is essentially the process of combining multiple incremental/differential backups into one image.

Robust backup / restore performance with the use of streams and multiplexing. Up to 32 streams per drive supported.

Disk to tape staging for increased backup performance. Inline tape copy is also supported (write to multiple media simultaneously).

Restarting a backup job can be from the point of failure is accomplished with the Checkpoint feature.
Log purge subsequent to a SQL full recovery backup can be performed NetBackup can also invoke RMAN for Oracle on-line backups.

Open File Option (Veritas Snapshot Provider) is included with product. Windows 2003 Server backups use Microsoft Volume Shadow Copy Service.

Fully supports VMWare ESX/GSX Virtual Server host / instance backups.The application requires Bare Metal Recovery component for OS and System State recovery. This is an additional cost item.


Comprehensive reporting which includes:
Media=ServerResource report
Server=Media needed for recovery report
Vaulting tasks can be set up to automatically duplicate data, create reports, and eject tapes for archiving.

Master server implementation in a clustered configuration provides fault tolerance.


4.2Option # 2: Legato Networker
Option Table # 2:
Ease of management/administration has been added through the incorporation of the Networker Management Console user interface version 7.1.

The application also includes enhancement of Media Management through the Networker Management Console version 7.1. The application can simultaneously erase, move and export Multiple media
De-centralized Management Structure. Use of Networker Administration Console, Networker Management Console, and Networker User interfaces to manage operations.

Does not show real-time rate, percentage complete, or current file/directory being backed up in activity monitor.

There is no ability to Browse when setting up backup or restore jobs.


No built in reports for: Media=ServerResource report or Server=Media needed for recovery report. We evaluated Visual Storage Resource Migrator for this additional functionality and this type of report was still not included.

Networker agent cannot be pushed to remote clients. Clients have to be visited to locally install agent.

Checkpointing provides ability to restart/resume jobs. Re-runs only the save sets that failed from the point at which they failed without having to create new separate backup jobs.

Save Set Consolidation combines multiple incremental backups into one full backup image. Backups using Save Set Consolidation consume less network bandwidth and decrease the impact on the application host.

With the use of streams and parallelism, more rapid backup performance can be achieved.Cannot write to multiple media simultaneously (In-line tape copy).

Requires Open File Manager for open file backups. This is an additional cost component.

Uses ASR recovery for Windows 2003 Server Disaster Recovery.

Uses SMTP to send logs and alerts vial e-mail.

Uses Volume Shadow Copy Services for Window 2003 Snapshots.

Fully supports VMWare ESX/GSX Virtual Server host/instance backups.Grooming cannot be performed to meet our requirements with the base Networker Product. As a result, EMC provided Visual Storage Resource Migrator at no additional cost. While this product can do certain types of grooming, NetWorker still does not provide the type of grooming we require. In order to groom data-based on modified and accessed dates, NetWorker must first move them to an alternate data directory. While this does not seem like a large issue at first, we must think about the potential volume of the data to be groomed (sometimes upwards of 1 TB) and the additional storage that will need to be purchased as a result.
Inability to purge SQL transaction logs subsequent to full backup.
Vaulting tasks can be set up to automatically, duplicate data, create reports, and eject tapes for offsite storage using AlphaStor. This product was added by EMC at no additional cost. NetBackup is a very intuitive tool that provides a great deal of additional functionality with respect to tape lifecycle management.

Master Server can be clustered for fault tolerance
Can leverage with existing Legato Networker implementation in the UNIX environment.


4.3Option #3: Commvault Galaxy
The Web management console appears and acts the same as the Media Server management console. This allows for same functionality in both places. (Java based)
.Difficult to monitor jobs. Does not show real-time rate, percentage complete, or current file/directory being backed up in activity monitor
Difficult media management. Can only erase one tape at a time.

Non-intuitive GUI. Duplication of options at many levels makes job management difficult
Fast backup performance with the use of Streams and Multiplexing. Up to 32 streams per drive can be configured.


Synthetic backups allow for quick client backups restore from a single backup image. This is essentially the process of combining multiple incremental/differential backups into one image.

Agent is pushed from CD. Requires separate agents for every application (SQL, Oracle, Sybase, etc).

Cannot write to multiple media simultaneously (In-line tape copy).

Inability to perform SQL transaction log purge subsequent to full database backup.

Checkpoint feature. Able to restart from point of backup failure rather than re-running entire job.


Uses SMTP to send alerts and errors via e-mail.Requires quick recovery option for OS/System State restore.


Can be clustered for fault toleranceLimited reporting capabilities.

No reports for:
Media=ServerResource
Server=Media needed for recovery
4.4Enterprise Backup Solution – Evaluation Analysis
IT To what does “it” refer? If a pronoun is used without first identifying for what it stands, the reader might be confused. (28) System/Technology Analysis
System or technology list (Blue)
Analysis Requirements (Yellow)Veritas NetBackupLegato NetworkerCommvault Galaxy
Hardware/Software/Installation
1OS requirementsWindows 2000/2003Windows 2000/2003Windows 2000/2003
2Leverage existing hardwareYes; However, will require processor and memory upgradesYes; However, will require processor and memory upgradesYes; However, will require processor and memory upgrades
3Multi-Vendor SupportYes, STK, BrocadeYes, STK, BrocadeYes, STK, Brocade
4SQL / InstallationN/AN/AYes
5Automatic Device DiscoveryYesYesYes
6Media discoveryStraight ForwardStraight ForwardStraight Forward
7Master Server setupStraight ForwardStraight ForwardStraight Forward
8Media server setupStraight ForwardStraight ForwardStraight Forward
9Master server failure / recoveryCluster awareCluster awareCluster aware
10Media server failure / recoveryStraight ForwardStraight ForwardStraight Forward

Job Management
1Centralized Management ConsoleYes, MMC StyleNo, Uses Networker Administrative console and Networker Management ConsoleYes, Java-based
2Job CreationStraight ForwardMostly Straight ForwardMostly Straight Forward
3Policy setupStraight ForwardMostly Straight ForwardMostly Straight Forward
4Remote system discoveryYes NoNo
5Remote system agent installationYesNoYes
6Remote system resource selectionYesNoNo
7Ability to browse network resources when creating a backup or restore taskYesNoNo
8Redirection of files during restoreStraight ForwardDifficultDifficult
9Alignment with policy / scheduleStraight ForwardStraight ForwardDifficult
10Viewing of scheduled tasksStraight ForwardMostly Straight ForwardDifficult
11Viewing of active tasksStraight ForwardMostly Straight ForwardDifficult
12Viewing of completed tasksStraight ForwardMostly Straight ForwardDifficult
13Manual start of scheduled tasksStraight ForwardStraight ForwardDifficult
14One time run of a taskStraight ForwardStraight ForwardDifficult
15Grooming of a serverYes, Can be scripted using BPARCHIVE command in base product.Not in base product. Limited in Visual SRM. Must first move data to additional folder before deleting.No
16Pause / Resume of JobYesYesYes

Media Management
1Viewing of available mediaStraight ForwardStraight ForwardDifficult
2Viewing of used mediaStraight ForwardStraight ForwardDifficult
3Viewing of offsite mediaStraight ForwardStraight ForwardDifficult
4Viewing of retired mediaStraight ForwardStraight ForwardDifficult
5Manual recycling of mediaStraight ForwardMostly Straight ForwardDifficult
6Cataloging of mediaStraight ForwardMostly Straight ForwardDifficult
7Setup of media sets / poolsStraight ForwardStraight ForwardStraight Forward
8Retention for mediaStraight ForwardStraight ForwardStraight Forward
9Move data between media sets / poolsStraight ForwardStraight ForwardStraight Forward

Alert management
1Viewing of active alertsStraight ForwardStraight ForwardDifficult
2Clearing of active alertsStraight ForwardStraight ForwardDifficult
3Viewing of alert historyStraight ForwardStraight ForwardDifficult

Remote agent installation / use
1SQL 7 /2000Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents
2Oracle 7 / 8 / 9iYes: 1 Agent for allYes: Separate AgentsYes: Separate Agents
3Exchange 5.5Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents
4Exchange 2003Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents
5LinuxYes: 1 Agent for allYes: Separate AgentsYes: Separate Agents
6Windows NT4.0Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents
7Windows 2000Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents
8Windows 2003Yes: 1 Agent for allYes: Separate AgentsYes: Separate Agents

Backup Scenarios
1Standard file backupStraight ForwardStraight ForwardStraight Forward
2OS backupStraight ForwardStraight ForwardStraight Forward
3System State backupStraight ForwardStraight ForwardStraight Forward
4SQL backupStraight ForwardStraight ForwardStraight Forward
5Oracle backupStraight ForwardStraight ForwardStraight Forward
6Exchange backupStraight ForwardStraight ForwardStraight Forward
7Open File backupYes: Included in base productNo – Requires St. Bernard Open File ManagerNo – Requires Open File Option
8IDR backupNo – Requires Bare Metal Recovery OptionNo – Requires Network Recovery ManagerNo – Requires Quick Recovery Option
9Backup – to – DiskYesYesYes
10Disk – to – Tape stagingYesYesYes
11Inline Tape Copy (Write to two media simultaneously)YesNoNo
12Synthetic Backups/Save Set ConsolidationYesYesYes

Recovery Scenarios
1Standard file recoveryYesYesYes
2OS recoveryNo – Requires Bare Metal Recovery OptionYes – LimitedNo – Requires Quick Recovery Option
3SQL recoveryYesYesYes
4Oracle recoveryYesYesYes
5Exchange recoveryYesYesYes
6IDR recoveryNo – Requires Bare Metal Recovery OptionNo – Requires Network Recovery ManagerNo – Requires Quick Recovery Option
7VMWare Host recoveryYesYesYes
8VM Server recoveryYesYesYes

Reporting
1Job Success / FailureYesYesYes
2Media retentionYesYesYes
3Media vaultingYesYesYes
4Media = ServerresourceYesNoNo
5Server = Media needed for recoveryYesNoNo

Other items to review
1CheckpointYesYesYes
2Device fail overYesYesYes
3Job fail overYesYesNo
4SQL Transaction log purge subsequent to full backupYesNoNo
5Read existing Backup Exec mediaYesNoNo
6Multiplexing/ParallelismYesYesYes
7Support for NAS/SANYes, EMC, HP, Netapp. NDMP capable.Yes, EMC, HP, Netapp. NDMP capable.Yes, EMC, HP, Netapp. NDMP capable.

8VaultingYes, vault option must be purchased at additional cost. It What is “it”? Avoid use of undefined pronouns. (28) is a snap in and is fully integrated with base product.Not with base product. AlphaStor was provided by Legato at no additional cost. This is a separate product that is not integrated into base product.Yes, vault option must be purchased at additional cost. It is a snap in and is fully integrated with base product.


Support
1Technical Support (24 X 7)YesYesYes

Training
1Training for ProductsYes, Certification availableYes, Certification availableYes
4.5Summary of options available
Option 1: Implement Veritas NetBackup.

Option 2: Implement Legato Networker.

Option 3: Implement Commvault Galaxy.


4.6Updated analysis of Legato Networker subsequent to inclusion of Visual Storage Resource Migrator and Alphastor
EMC has recently proposed to BI that AlphaStor and Visual SRM will both be delivered free of charge, along with the Legato NetWorker product.
AlphaStor
The inclusion of AlphaStor is needed on EMC’s part because vaulting type functionality is a requirement at BI. AlphaStor is an EMC product that works with EMC NetWorker to provide a great deal of additional vaulting functionality that NetWorker lacks. Essentially, AlphaStor is a media management product that also functions as a device resource manager for shared tape device environments. Originally, it was designed to grant various backup products the ability to share devices. But now for the most part, all major backup vendors have their own media and device management capabilities.
Because AlphaStor is a separate product and not an option of NetWorker, it is installed, configured and managed separately. This results in increased system administration and hardware costs since AlphaStor would need to be installed on a separate server and would involve NetWorker administrators to be trained on the new product. Additionally, AlphaStor may be a point of contention between various NetWorker implementations as it would be another software layer loaded on top of the backup environment. Most importantly, because the AlphaStor server controls all the Networker servers it would present the possibility of disrupting all backup/restore services in the event it is down or unreachable.

In contrast, a many of the functionality added by AlphaStor is already available from the NetBackup core product. NetBackup’s “Shared Storage Option” (SSO) provides a centralized and efficient manner to share tape devices among media managers. Likewise, Veritas’ Vault option provides a robust and easy to use way of managing media onsite as well as offsite.

NetBackup offers flexible vaulting schedules, in-line tape copy/duplication, and comprehensive reporting of tape media. Additionally it can generate reports in the format acceptable to various vaulting vendors like Iron Mountain. NetBackup can also create reports for the dockworkers to pull tapes out of the tape library docks and put them into bins for offsite storage. This is end-to-end media management, and integrated and centralized inside of the core NetBackup product. Below is a matrix with a side-by-side comparison of the functionality of both products.

Installation and Configuration
FeatureNetBackupAlphaStor and NetWorkerComments
Installation of productNASeparateAlphaStor is installed as a separate product from NetWorker
ConfigurationSimple, Wizard-based ComplexNetBackup provides wizards for device, media configurations. AlphaStor lists a total of 15 steps to configure itself. There are additional steps needed to configure NetWorker to work with AlphaStor.

AdministrationSingle GUI-based consoleSeparateAlphaStor and NetWorker use different GUIs for each product. In addition NetWorker uses different GUIs for different platforms like Windows and UNIX
Shared Storage OptionPart of Media manager (Option)Part of AlphaStorNetBackup SSO is a licensable option
VaultOptionPart of AlphaStorVault is a licensable option of NetBackup
Media Configuration
StepsOnceTwiceThe media is configured twice. Once in AlphaStor and once in NetWorker. The products are not integrated properly
Usability
FeatureNetBackupAlphaStor and NetWorkerComments
Separate ServerNoYesBecause AlphaStor uses a separate server to store the database and manage media, it can be an added point of failure. If the AlphaStor server or services are unreachable, the whole backup/restore service is DOWN!
GUIJava-basedWeb-based, UNIX and/or WindowsAlphaStor uses a web-based GUI. But NetWorker uses a platform-based GUI. All three are inconsistent with each other
Administration conflictsNonePossibleBecause NetBackup uses its own media management software, the administrator can make good choices about media and devices. Because AlphaStor admin is usually separate, s/he may be a point of contention for NetWorker admins.

Database SynchronizationNAMUSTAlphaStor and NetWorker databases need to sync’ed. If they are not in sync, backups/restores may fail
ReportingExtensiveLimitedNetBackup allows extensive reports about media not only when using Vault option but many valuable reports can be obtained within core product itself. NetBackup’s reporting capability is unmatched in the industry
Media Management
When AlphaStor is installed and configured, NetWorker has to be configured again to work with AlphaStor
FeatureNetBackupAlphaStor and NetWorkerComments
Onsite and OffsiteYesYesAlphaStor takes care of the offsite media management. NetWorker does not keep track of the location of tapes
Adding MediaOnceTwiceThe media is added twice. Once into AlphaStor and once into NetWorker.

Managing media poolOnceTwiceBoth AlphaStor and NetWorker must manage media pools independently. The media pool if deleted from AlphaStor has to be deleted from NetWorker again.
Robot management and inventoryCore ProductAlphaStorNetBackup core product can do the robot configuration and inventory.
Rotation scheduleYesYesAlphaStor uses a counter to reset a rotation of volume. When this counter reaches a certain value the media is rotated
In Line duplicationYesNoNetBackup allows for making more than 1 copy of the backup stream (upto 4), so as to reduce extraneous vaulting cycles. But vaulting can happen anytime desired by the admin
Device Resource Management
When AlphaStor is configured into NetWorker environments, two distinct configurations need to be performed. AlphaStor controls the actual devices while presenting NetWorker with the “virtual jukeboxes” to backup on. However, while AlphaStor controls the device and media to which the backup would go, it is the NetWorker product, which ultimately has the control over type of media to use for the backup. In all instances, it is assumed that AlphaStor and NetBackup databases are in-sync.

AlphaStor allows the administrator to divide the backup device and media infrastructure into resource queues. It then assigns the actual drives to the resource queues. AlphaStor administrator also defines mount class for the devices. The NetWorker administrator uses these predefined resources to make backup requests. The NetWorker administrator has no control over which resource is used for the operation. If a resource is busy, the NetWorker administrator cannot assign the job to another resource queue without the help from the AlphaStor administrator. If the same individual performs these roles, it requires the user to manage two applications and user interfaces to accomplish this simple task.

NetBackup takes this complexity away. Using SSO option, the NetBackup administrator has complete control over devices. Devices are shared among various NetBackup media managers. SSO is configured using the usual device configuration wizard.
NetBackup also allows for special directives to be used on media managers. These directives allow the administrator to reserve a drive only for restores, for example. If specified, one drive is always kept available for restores. Even if backup jobs are pending, restores can start using this drive. Along with backup restart capability of the NetBackup core product, this facility makes sure that restores are never held up due to backups taking place.

FeatureNetBackupAlphaStor and NetWorkerComments
Complexity of configurationLowHighAlphaStor is a complex product to implement. Along with NetWorker, the limitations of the products may make configuring them painful.

Special DirectivesYesYesNetBackup allows special directives like local drive only, or reserve for restore etc
Core product functionality–NetBackup offers many reports, administrative capabilities within the core product. EMC NetWorker does not provide much of it and pushes for AlphaStor
Alternate interface for sharing storageYesNoNetBackup allows for separate interfaces to be used for SSO. NetWorker does not offer this functionality
Visual SRM
The inclusion of Visual SRM (VSRM) was required on EMC’s part to meet BI Production Services-Server Technologies archive and deletion requirements. Visual SRM software is designed to provide centralized storage resource management (SRM) for multi-vendor, mid-tier storage environments; ensuring capacity is available when and where it is needed by actively managing the storage resources with powerful visualization tools. With Visual SRM, the operator can manage utilization according to thresholds set and deploy active policies to meet the demands of the critical business applications. Some of the strengths include:
Increase capacity utilization, improve availability and automate management processes.
Reduce or eliminate server outages due to out-of-control disk space consumption.
Eliminate time-consuming processes and reduce costsfor a lower TCO.
Shorten backup windows so more work can be done in less time.
Improve capacity planning and charge back capabilities.
Focus on core business rather than storage administrative tasks.
While this is an extremely powerful product with respect to file system analysis and reporting we still do not feel like this free product will get BI-Production Services-Server Technologies entirely where it needs to go. From the Enterprise Backup project perspective, we are predominantly concerned with the ability to select data efficiently, back data up, and delete data-based on last time accessed/modified and/or data ranges ( referred to as grooming). This particular functionality is not included in the base Networker product. As a result, EMC has offered VSRM to help meet this requirement. This product does an extremely good job of locating data-based on modified and accessed dates however, it does not have the ability to groom a file system at the level we require it too. In order to groom a file system VSRM requires that the data first be moved to an alternate location, after which a Networker command can be invoked to backup and ultimately delete the data. This would not be an option for us as it will require the purchase of substantial amount of additional storage to accommodate (at times we may have to groom upwards of 500 gigabytes of information). With our current backup software, Veritas BackupExec we are able to groom without having to move the data and as such we would like to continue to operate this way. To this end, VERITAS NetBackup will allow BI to use a command known as bp_archive to help backup data and delete it from primary storage without first moving it to alternate location. A file list, based on whatever characteristics defined, can be generated then bp_archive can be engaged to meet BI’s needs. Of additional importance, this bp_archive command is part of the base VERITAS NetBackup offering and does not require the implementation of an additional product to accommodate this task.
5Recommendation
While the inclusion of the AlphaStor and Visual SRM products does put NetWorker a good deal closer to meeting our Vaulting and Grooming requirements it still does not provide “like” functionality with VERITAS NetBackup and will still present many issues for our IT environment.
As such, the recommendation for the primary backup software of choice would still be to implement Veritas NetBackup. In summary, this software offers a centralized solution with a wide range of functionality, ease of use/management, and exemplary performance as is outlined in the above documentation.
The recommendation for the secondary backup software of choice goes to Legato Networker. This software also offers a wide variety of features and functions with almost all the capabilities of Veritas NetBackup. However, it is marred by a non-user friendly graphical interface that is less intuitive for performing everyday operations as well as some inherent shortcomings