Quantcast
Channel: System Center Data Protection Manager
Viewing all 339 articles
Browse latest View live

Backup of Enterprise data made easier with System Center Data Protection Manager

$
0
0

System Center Data Protection Manager (DPM) 2012 R2 UR9 went live on 26th Jan, 2016. In the previous release, we focused on stability – in this release, we have added a slew of features to optimize on-prem and cloud backups for large Enterprise deployments. The feedback so far from customers has been very positive. Today, we are happy to announce that we are making it an “Important Update” on Microsoft Update, so it will be made available to more customers. As with all DPM URs, this update is cumulative and contains all the reliability fixes from the previous release. Below is the list of key improvements.

1. Never miss backup SLA for large file server

In some cases, for e.g. production server node shutdown due to power failure, DPM file tracking filter gets corrupted which marks replica as inconsistent. Previously, this required a consistency check to repair the corruption which could run into several hours or even days for large file server deployments. In this update we have made major improvements to optimize the filter repair process.

DPM now leverages USN journal (Update Sequence Number Journal) technology in Windows to track files that have changed since the last synchronization job, making the repair operation much faster. We have seen up to 60X improvements in the tests we have run with large file servers (see more details in the test table below).

To optimize it further, the new repair operation will be triggered automatically with-in 15 minutes of the filter corruption. So there is no manual intervention required. The repair operation will be displayed as a synchronization job in DPM and will also sync the replica to latest.
Table below summarizes the time to complete repair synchronization job based on our internal testing. We have focused on two common deployments, large number of small files and small number of large files.

# Files protected Churn Size # Files modified Time for repair synchronization job
1 million files in a 1 TB volume, each file being a few MBs 1 MB (static file server with no changes) 5 1 minute
20 GB (2% churn) 20,000 1 hour 15 minutes
80 million files in a 2 TB volume, each file being a few KBs 1 MB (static file server with no changes) 5 2 minutes
40 GB (2% churn) 40,000 2.5 hours

Notes:

  • Test Setup configuration

DPM Server- 3.4 GHz processor, 100 Mbps network speed and 2.4 GB RAM

Production File Server- 2.67 GHz, 10 Gbps network speed, 3 GB RAM

  • Please note, individual file server repair times will vary depending on number of files, size of each file and directory structure.

2. No production server restart required

Production Server reboot while upgrading to the new release of SCDPM has been a big concern with our customers. With this release, we have done an extensive review of all the cases which were causing a reboot and eliminated all cases, except filter driver update where it is unavoidable. All backup products that do incremental backups use a filter driver on the production server and need to re-boot whenever they make changes to the filter driver. Good news is we don’t anticipate making more changes in this part of the code so this should hopefully bring smiles to the customer and upgrading to latest URs is easier.

3. Reduced cache space for Online backups

In addition to backing up data to disk, DPM also provides an option to use Azure cloud for long term retention and offsite storage using Azure Backup. Previously, Azure Backup required cache space of 15% of the data source size for backup to Azure. This was an issue for customers with large data sources (for e.g. volumes greater than 10 TB). With the latest Azure Backup agent, we reduced the cache space requirements to less than 5% which is 3X improvement.

4. Increased retention for Online backups

DPM & Azure Backup has increased the number of recovery points for cloud backups. This enables flexible retention policies to meet stringent compliance requirements such as HIPAA for large enterprises. For those who are curious on what the new maximum number of recovery points is, it has been increased to 9999 from 366.

5. And More…

We have made a bunch of other optimizations to improve customer experience when using DPM. For more detailed list and to download the latest DPM please refer to DPM 2012 R2 UR9 KB article

Download DPM 2012 R2 UR9 and also upgrade to the latest Azure Backup agent to get started with these great features.

Additional Resources


System Center Data Protection Manager 2006 End of Support

$
0
0

Microsoft System Center Data Protection Manager 2006 has reached its end of support date. If you are using this version, please upgrade to a newer version before April 12, 2016 to ensure supportability.

The following resources are available to help you upgrade:

Upgrade to System Center Data Protection Manager 2010

Upgrade to System Center 2012 Data Protection Manager

Have questions about supported products? Visit Microsoft Support Lifecycle to view a list of supported products and related policies.

DPM 2012 R2 UR7 re-released

$
0
0

We had an issue with DPM 2012 R2 UR7 that was released on July 28th, 2015. After installing UR7, expired recovery points on the disk were not getting cleaned up, causing an increase in DPM recovery point volume. The issue is fixed now with this re-release of UR7. Please install the update via Microsoft Update or download it via DPM 2012 R2 UR7 KB just like you install other DPM URs.

Existing customers who already installed UR7 before August 21st, 2015

New UR7 bits will not be pushed via Microsoft Update for the customers who installed UR7 before Aug 21, 2015. So they are advised to follow the below steps:

  1. Download the updated UR7 bits from DPM 2012 R2 UR7 KB article
  2. Manually install the update on the DPM Server that has older UR7 bits installed. The update will automatically update the pruneshadowcopiesDpm2010.ps1 script to fix the issue.

Note:

1. DPM version(4.2.1338.0) will remain the same with our re-release

2. Please update the Azure Backup Agent to latest version(2.0.8719.0) prior to installing DPM UR7 for cloud backups to work seamlessly.

System Center Data Protection Manager 2006 End of Support

$
0
0

Microsoft System Center Data Protection Manager 2006 has reached its end of support date. If you are using this version, please upgrade to a newer version before April 12, 2016 to ensure supportability.

The following resources are available to help you upgrade:

Upgrade to System Center Data Protection Manager 2010

Upgrade to System Center 2012 Data Protection Manager

Have questions about supported products? Visit Microsoft Support Lifecycle to view a list of supported products and related policies.

A few tips and best practices for Microsoft Azure Backup

$
0
0

~ Rupanter Chhabra | Support Engineer | Microsoft

Hi everyone, Rupanter Chhabra here again. In my last post I talked about Azure Backup portal and explained all of the options that we have there, and today I want to talk about some of the issues you may see in setting up Microsoft Azure Backup (MAB) as well as share a few best practices.

Getting Started

For Microsoft Azure Backup we need two things: Vault credentials and the Azure Recovery Services agent. You can find both of these under the Quick Start tab or in the right-hand side of Dashboard of the Backup Vault.

Vault Credentials

clip_image001

Note that Vault credentials are valid only for 2 days and you must install them again if you want to re-register the server.

The Microsoft Azure Recovery Services Agent

clip_image002

You can always find the LATEST agent for Microsoft Azure Backup here. You can install Microsoft Azure Backup on Windows Server or a client using the option selected above. Once downloaded you can proceed with the installation.

A few things to note during installation:

A quick installation guide for Microsoft Azure Backup can be found here: https://azure.microsoft.com/en-us/documentation/articles/backup-azure-backup-windows-server/. Installation is fairly simple and well explained already, so I am just going to highlight a few things that we generally miss or are confused about that end up causing issues with backups. So let’s begin!

Installation Settings

clip_image003

Here we have the Installation folder where we want MAB to be installed, but what we need to look for here is the Cache Location. Cache Location is something that is important as it stores the VHDs that are created after the snapshot is taken via VSS (Volume Shadow Copy). You can find the VHD’s here if you have set the location of the scratch folder to the default:

C:\Program Files\Microsoft Azure Recovery Services Agent\Scratch\VHDs

The MAB agent takes a snapshot via VSS and then it creates a VHD in the scratch folder. Once the VHD is created during the initial replication (the first time the backup runs) then this VHD acts as the latest state for sequential backups that take place following the initial replication. This VHD is compared with the disks that we are trying to backup, and whatever changes are made in the disk are noted and compiled in a small new VHD. This VHD is then mounted and the data is sent to Azure. Once this is done the small new VHD is merged with the old one so that we have the latest state again for comparison the next day.

Now that we have an understanding of how the backup happens, let’s take a look at the 5%-10% of free space required. The creation of the VHD is a constant process of expansion and contraction as the data sent to Azure is compressed, so we recommend keeping the scratch folder in a location where you have at least that much free space. If you don’t have the necessary free space then you can face multiple issues: The backups might fail completely, or the backup for one drive may work and the other might fail.

If you find that you need to change the scratch location after the backups have been started then you can do so by pointing the registry keys below to the new location where you want the scratch folder to be. Please note that you should stop the Microsoft Azure Recovery Service Agent service before making this change.

Change Registry keys:

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows Azure Backup\Config]

ScratchLocation

[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows Azure Backup\Config\CloudBackupProvider]

ScratchLocation

Registration

The rest of the installation is pretty simple and self-explanatory but I would like to note a few things about registration. When you register your server, you’ll see a tab where you are asked to enter a passphrase:

clip_image004

Please be aware that that the passphrase is the second level of encryption that we have; the first being the encryption of data that we do while sending the data to Azure. This passphrase is something that is very important when it comes to recovery of data from another server. Also note that if you recover data from another server, both servers should be in the same backup vault.

clip_image005

If you recover data from the same server using the This server option then the passphrase is not mandatory, however when you want to recover the data from another server the passphrase is necessary and without it you won’t be able to recover the data.

If you lose the passphrase and want to recover the data from another server, but you don’t have access to the main server, then as designed we will not be able recover the data. However, if you have access to the server and don’t have the passphrase then there are a few options that can help us:

1. We can opt for Change properties using the console for MAB:

clip_image007

There you will see the Encryption tab and under that will be Change Passphrase:

clip_image008

You just need to click on the check box and you should be able to change the passphrase. Once that’s been done and the changes have been replicated to Azure, you can recover the data from this server using another server.

2. We can re-register the server (recommended):

For this option we have to go to the backup vault under Registered Items. We need to select the server under the type of Windows Server and in the bottom we will see a button for Allow Re-Registration:

clip_image010

Once we have allowed re-registration using this option then we can safely register the server again using the MAB console and enter a new passphrase there.

The Console

The first thing that you notice if your backups are failing is the Jobs section and the Alerts section which contain all the alerts that we need to check (e.g. update the agent).

clip_image012

clip_image014

If you click on any of the successful jobs you will usually see something like this:

clip_image016

For a failed job you will see two tabs: Items and Errors. Usually you don’t notice the Errors tab but it can help you understand the exact nature of the issue with your backup.

clip_image018

Data

Many times we wonder “How much data have I sent to Azure from this server?” or “How can I check it?” Well the answer is right in front of our eyes:

clip_image019

You can also check how much total data has been consumed in the backup vault in the Dashboard of the backup vault.

Scheduling

There are a few things to note under the Schedule Backup option that may come in handy as well.

clip_image021

When making a schedule and planning to do multiple backups in one day, you must make sure that you allow some buffer time for the first job to complete. If the second job gets triggered before the first one completes then the second job will fail and give us an error. So again, in order to prevent that always give yourself some buffer time for job completion.

clip_image022

Another thing to note under scheduling is the data limit for one backup operation. This limit depends on which server you are on because if you are on Windows Server 2008 R2 then the limit is different from what it is on Windows Server 2012 and above. You can always check this on the Confirmation tab in the backup schedule just when you are about to finish scheduling.

clip_image024

Versions

Another question that often comes to mind is “What version of Microsoft Azure Backup Agent am I using?” The easiest and the best way to find out is to click on About Microsoft Azure Recovery Services Agent on the console of MAB:

clip_image025

clip_image026

In summary, there are a lot of things that the console tells us, we just need to figure out the location where that information is kept. I’ve tried my best to explain as much as I can and to keep it as simple as possible, so hopefully it will help you with a few issues if not all of them. Most of the issues we see are caused by the tiniest of the things that we fail to notice!

Rupanter Chhabra, Support Engineer
Microsoft Enterprise Cloud Group

Troubleshooting Azure VM Backup failures: “Snapshot VM sub task timed out” error

$
0
0

Here’s a quick tip for you in case you’re using Microsoft Azure Backup for infrastructure as a service (IaaS) and a scheduled VM backup fails with the following error message in the job error details in the Azure Portal:

Could not communicate with the VM agent for snapshot status – Snapshot VM sub task timed out.

There are four common causes for this error:

  • The VM does not have Internet access.
  • The Microsoft Azure VM agent installed in the VM is out of date (for Linux VMs).
  • The backup extension failed to update or load.
  • The snapshots status cannot be retrieved or the snapshots cannot be taken.

To read about the solutions for each of these, please see the following:

Azure VM Backup fails: Could not communicate with the VM agent for snapshot status – Snapshot VM sub task timed out

 

J.C. Hornbeck, Solution Asset PM
Microsoft Enterprise Cloud Group

Update Rollup 10 for System Center 2012 R2 Data Protection Manager is now available

$
0
0

Update Rollup 10 for Microsoft System Center 2012 R2 Data Protection Manager (DPM 2012 R2) is now available to download.

Issues that are fixed in this update rollup

  • If you try to exclude a page file for a VM running on Microsoft Hyper-V Server 2012 R2 server, DPM may still continue to back up the page file.
  • DPM provides an Active Directory schema extension tool to make required changes to Active Directory for DPM End-User Recovery. However, you may the tool may not work on System Center 2012 R2 Data Protection Manager.
  • If you try to protect a SharePoint content database that has Always On enabled, and there is a failover of the database, you may notice that new sites, lists, and items are not displayed on the Recovery tab. This applies only to new items that are created after failover. Additionally, the issue is automatically resolved after failback.
  • If you run Update Rollup 7 for System Center 2012 R2 Data Protection Manager, or a later version, and then try to do item level recovery for a Hyper-V VM, you may receive the following error message when you click the VHDX file on the Recovery tab:

DPM Cannot browse the contents of the virtual machine on the protected computer DPMServerName.

  • The DPM Console crashes when you try to open any of the six built-in DPM reports.
  • Optimized item level recovery doesn’t work for a SharePoint farm. This causes the full farm data to be copied to the staging server that’s running Microsoft SQL Server.
  • The DPM UI crashes when you try to recover online recovery points by using another DPM server that is registered to the same backup vault as the original server.
  • The Get-DPMJob cmdlet does not provide any information about recovery jobs that are performed through the external DPM server.
  • This update revises the message of error code 33504 to add details about the issue and steps to resolve the issue.
  • If you try to protect Microsoft Exchange Server 2016 while you create a protection group, the server that’s running Exchange Server is displayed as “Exchange 2013 Database” instead of “Exchange 2016 Database.”
  • If you use the DPM Central console, and you receive an EvalShareInquiryAlert (3123) alert on DPM, the alert is still displayed as active in System Center Operations Manager even though the issue is resolved on DPM.
  • DPM crashes when you try to configure SMTP settings.
  • If you try to stop protection of a data source in which the FQDN contains more than 64 characters, the DPM service crashes.

For complete details including installation instructions and a download link, please see the following:

3143871Update Rollup 10 for System Center 2012 R2 Data Protection Manager (https://support.microsoft.com/en-us/kb/3143871)

For information regarding all System Center fixes included in Update Rollup 10, please see the following:

3164172Description of Update Rollup 10 for Microsoft System Center 2012 R2 (https://support.microsoft.com/en-us/kb/3164172)

 

J.C. Hornbeck, Solution Asset PM
Microsoft Enterprise Cloud Group

Four simple steps to backup VMware VMs using SC DPM

$
0
0

System Center Data Protection Manager (SCDPM) is well recognized in the industry for protection of Microsoft workloads and environments. It protects key Microsoft workloads such as SQL, SharePoint and Exchange as well as virtual machines running on Hyper-V.  Today, we are announcing support for protection of VMware virtual machines. This will allow enterprise customers to have a single backup solution across their heterogeneous IT environment.

Here are the four simple steps to configure VMware server and DPM to protect VMware VMs.

1. Enable a secure SSL communication between DPM and VMware server

 

 

2.Add a new user with certain minimum privileges

 

 

3.Add VMware Server to DPM

 

 

4.Protect VMware VMs with DPM

 

If you are new to Azure Backup and want to enable Azure Backup for longterm retention, refer to Preparing to backup workloads to Azure with DPMClick for a free Azure trial subscription

Here are some additional resources:

Key words: Announcement, VMware VM Backup, DPM, DPM 2012 R2, SC DPM, Microsoft Azure Backup Server, MABS, Azure Backup, Backup & Recovery, OMS, Cloud Backup, Virtual Machines, VMware, vCenter, ESXi


Announcing VMware VM Backup using System Center Data Protection Manager

$
0
0

System Center Data Protection Manager (SCDPM) is well recognized in the Industry for protection of Microsoft workloads and environments. It protects key Microsoft workloads such as SQL, SharePoint and Exchange as well as virtual machines running on Hyper-V.  Today, we are announcing support for protection of virtual machines running on VMware platform. This will allow enterprise customers to have a single backup solution across their heterogeneous IT environment.

Value Prop

  • Agentless Backup – DPM uses VMware’s VADP API to protect VMware VMs remotely without installing agents on vCenter or ESXi servers. This frees admins from the hassle of managing agents for VMware VM backup.
  • Integrated Hybrid Backup helps customers in backing up to disk for operational recovery and to cloud using Azure Backup for offsite copy or longterm retention
  • First class integration with VMware allows customers to backup VMs stored in different storage targets like NFS and cluster storage seamlessly without any extra manual steps. vCenter’s capability to organize VMs in folders helps customers in managing large environments with ease.  DPM can discover and protect at folder level.  This enables protection of VMs that are present currently and also any new VMs that gets added into this folder in future.

Here is a short video that provides value prop and overview of VMware VM backup.

Be sure to go through 4 simple steps to protect VMware VMs using DPM.  Please reach out to VMwareVMBkp@microsoft.com for any questions or clarifications.

If you already have DPM 2012 R2 installed, please download and install UR11 to get started with VMware VM Backup.

If you are new to Azure Backup and want to enable Azure Backup for longterm retention, refer to Preparing to backup workloads to Azure with DPMClick for a free Azure trial subscription

Here are some additional resources:

 

Key words: Announcement, VMware VM Backup, DPM, DPM 2012 R2, SC DPM, Microsoft Azure Backup Server, MABS, Azure Backup, Backup & Recovery, OMS, Cloud Backup, Virtual Machines, VMware, vCenter, ESXi

Microsoft OMS + System Center product (including DPM and Azure Backup) meetup at Ignite 2016

$
0
0

Would you like to participate in a discussion on IT Management?  This is an opportunity for you to meet the Microsoft leadership team and influence the direction of the management products (OMS and System Center) including DPM and Azure Backup at Microsoft. We will have dedicated tables to discuss various topics with members of the product team and you will get a chance to speak directly with the Microsoft Directors. This is a FREE event for Ignite attendees and dinner will be provided. You can participate by filling out this short survey and if selected and depending on capacity we will send you a meeting invite with details on the time and location of the meetup at Ignite.

We are looking forward to meeting you!

Update Rollup 1 for System Center 2016 Data Protection Manager is now available

$
0
0

Update Rollup 1 for Microsoft System Center 2016 Data Protection Manager (DPM 2016 UR1) is now available. After you install this update, you can store backups by using Modern DPM Storage technology. Using Resilient File System (ReFS) block-cloning technology to store incremental backups, System Center 2016 Data Protection Manager significantly improves storage usage and performance. Here are some benefits:

  • 30-40 percent savings in storage
  • Backups that are 70 percent faster with Modern DPM Storage
  • Ability to configure workloads for storage on certain volumes
  • Backup storage inline with the production data source
Announcing RCT based Hyper-V VM backups

System Center 2016 Data Protection Manager uses RCT based change tracking, by using Windows Server 2016. This makes backups more reliable, scalable, and improves backup performance. System Center 2016 Data Protection Manager also enables you to do the following:

  • Meet backup SLAs during cluster operating system rolling upgrade
  • Seamlessly protect and recover Shielded VMs
  • Protect VMs stored on Storage Spaces Direct
  • Protect VMs stored on ReFS-based SOFS clusters

For complete details, please see the following:

3190600Update Rollup 1 for System Center 2016 Data Protection Manager (https://support.microsoft.com/en-us/kb/3190600)


J.C. Hornbeck, Solution Asset PM
Microsoft Enterprise Cloud Group

SQL Server support for System Center 2016 Data Protection Manager

$
0
0

If you’re using Microsoft System Center 2016 Data Protection Manager (DPM 2016), we have a new KB article available that describes the Microsoft SQL Server version that can be used with it. For all the details, see the following:

3195291SQL Server supported version for System Center 2016 DPM (https://support.microsoft.com/en-us/kb/3195291)

 

J.C. Hornbeck, Solution Asset PM
Microsoft Enterprise Cloud Group

Announcing SC 2016 DPM with Modern Backup Storage

$
0
0

System Center 2016 Data Protection Manager (SCDPM) is well recognized in the Industry for protection of Microsoft workloads and environments. It protects key Microsoft workloads such as SQL, SharePoint and Exchange as well as virtual machines running on Hyper-V or VMware.

SC DPM 2016 brings in features that delivers improvements in multiple key areas of backup efficiency, performance, flexibility and security.  With Modern Backup Storage (MBS), DPM 2016 is turning around the way backups are stored by leveraging modern technologies like ReFS Block Cloning, ReFS Allocate On Write and VHDX.  This to 3X faster backups and 50% reduction in storage consumption thus reducing overall backup TCO.

Windows Server 2016 Private Cloud deployments are faster, secure and cost efficient with enhancements like Storage Spaces Direct (S2D), Rolling Cluster Update, Shielded VMs and Resilient Change Tracking (RCT).  DPM 2016 can protect Windows 2016 Private Cloud deployments efficiently and seamlessly.

3X Faster backups and 50% storage savings

Modern Backup Storage (MBS) uses technologies such as ReFS Block Cloning, VHDX and Deduplication to reduce storage consumption and improve performance. ReFS block cloning uses Allocate On Write technology where all new backup writes go to new location directly as opposed to Copy On Write. This leads to 70% reduction in IOs leading to 3X faster backups.  MBS is able to grow and shrink backup storage consumption inline with production storage by leveraging VHDX as backup container and storing it on ReFS volume.  Thus MBS helps in reducing overall storage consumption by 50%.

Optimized Backup Storage Utilization

DPM 2016’s workload-aware backup storage technology gives you the flexibility to choose appropriate storage for a given data source type.  For ex., SQL DBs with 15 minute RPO would need high-performance backup storage to ensure that storage is able to meet the backup speeds.  Backup of a file system with 1 day RPO can be stored on a low cost JBOD.  This flexibility optimizes overall storage utilization and thus reduces backup TCO further.

MBSWorkloadAwareStorage

 

Hyper-V Private Cloud Protection Enhancements

Windows Server 2016 introduced RCT technology that tracks backup changes natively within a VM.  This takes away the necessity of tracking backup changes by DPM’s filter driver.  As a result, VM backups are resilient, avoiding painful Consistency Checks in scenarios like VM storage migration.

Windows Server 2016 comes with Storage Spaces Direct (S2D), that eliminates the need for expensive shared storage and related complexities.  DPM recognizes and protects Hyper-V VMs deployed on any S2D or ReFS based SOFS cluster configurations.

DPM’s ability to do backup and recovery of Shielded VMs securely helps in maintaining security in backups. DPM maintains backup SLA by continuing VM backups while Cluster is being upgraded to Windows 2016 using Cluster OS Rolling Upgrade .

Upgrade with ease and peace of mind

DPM 2016 upgrade is very simple and will not disrupt your production servers. After upgrading to DPM 2016 and upgrading agents on production servers, DPM backups will continue without rebooting production servers.  DPM MBS capability is enabled after upgrading DPM OS to Windows Server 2016.

Be Sure to go through Introducing SC 2016 DPM Modern Backup Storage, to understand how MBS work.

Get these features Now!

You can get DPM 2016 up and running in ten minutes by downloading Evaluation VHD.  Questions?  Reach out to us at AskAzureBackupTeam@microsoft.com.

If you want to enable Azure Backup for longterm retention, refer to Preparing to backup workloads to Azure with DPM Click for a free Azure trial subscription

Here are some additional resources:

 

Introducing DPM 2016 Modern Backup Storage

$
0
0

 

With System Center 2016 Data Protection Manager, we announced Modern Backup Storage (MBS), delivering 50% storage savings, 3x faster backups, and efficient backup storage utilization with Workload Aware Storage.

Data Protection Manager can backup key workloads such as SQL, SharePoint, Exchange, file servers, clients and VMs running on Hyper-V or VMware. With Modern Backup Storage and RCT based Hyper-V VM backups, DPM 2016 goes a step further in enhancing Enterprise backups by completely restructuring the way data is backed up and stored.  As MBS uses Windows Server 2016 ReFS Block Cloning and VHDX technology, MBS is enabled when DPM 2016 is running on Windows Server 2016.

 

How does Modern Backup Storage work?

 

 

Add volumes to MBS and configure Workload Aware Storage

 

 

Begin backing up by creating Protection Group with MBS

With these simple steps, you can efficiently store your backups using Modern Backup Storage technology.

Get these features Now! 

You can get DPM 2016 up and running in ten minutes by downloading Evaluation VHD.  Questions? Reach out to us at AskAzureBackupTeam@microsoft.com.

If you are new to Azure Backup and want to enable Azure Backup for longterm retention, refer to Preparing to backup workloads to Azure with DPM.  Click for a free Azure trial subscription.

Here are some additional resources:

The October 2016 Azure Backup update for Microsoft Azure Recovery Services Agent is now available

$
0
0

The October 2016 Azure Backup update for the Microsoft Azure Recovery Services Agent is now available for download. The new features, improvements, and fixes for Azure Backup that are provided in the October 2016 update for Microsoft Azure Recovery Services (MARS) agent are detailed in the following KB article:

3196148Azure Backup Update for Microsoft Azure Recovery Services Agent: October 2016 (https://support.microsoft.com/en-us/kb/3196148)

The MARS agent is used by both Microsoft Azure Backup and Microsoft Azure Site Recovery (ASR) to transfer data to Azure. Please note that this is the first update of the Microsoft Azure Backup for MARS agent that officially supports System Center 2016 Data Protection Manager (SC DPM). This update is required for several features of DPM 2016 such as Modern Backup Storage to work seamlessly together with Azure Backup.

J.C. Hornbeck, Solution Asset PM
Microsoft Enterprise Cloud Group


Implementing Microsoft DPM host level protection of VMware VMs

$
0
0

Note: This post is also available as a downloadable PDF here.

System Center 2012 R2 Data Protection Manager (DPM 2012 R2) with Update Rollup 11 (UR11) or later adds support for protecting host level backup of virtual machines running on VMware 5.5 and 6.0 servers. This is accomplished by using VMware APIs over the network and does not require that a DPM agent be installed on the VMware ESXi hosts or vCenter servers.

IMPORTANT NOTE: DPM 2016 will add support for VMware protection in Update Rollup 2 (DPM 2016 UR2). During the upgrade, you will receive a message stating that VMware protection was detected and the console will not run until DPM 2016 UR2 is installed. Once DPM 2016 UR2 is installed, the console will work and VMware protection will resume.

DPM agentless VMware VM backup

DPM is a true agentless VMware VM backup solution. There is no need to install a DPM agent on any vCenter or ESX servers to start backup protection of virtual machines. The DPM server will communicate with vCenter or ESX hosts directly using SOAP calls over HTTPS to perform backups. To start protecting VMware hosted VMs, you first need to add vCenter or ESX servers to DPM by providing the IP address or FQDN of the vCenter or ESX server along with proper login credentials to authenticate with VMware.

The diagram below illustrates communications between DPM and VMware performed by DPMRA. The DPM Engine is not directly involved with any communications between vCenter or ESX or ESXi hosts. Note that the destination files are vhdx files which are native Hyper-V format which allows for DPM Item Level Recovery (ILR) from protected Windows guests.

clip_image002

If the ESXi servers are managed by vCenter, the vCenter should be added to DPM. Otherwise, add the ESXi server to DPM. Below are examples of how DPM can enumerate VMs running in large data center deployments using vCenter or by protecting individual VMware ESXi servers that are not being managed by vCenter.

clip_image004

clip_image006

Keep in mind that it is possible that both vCenter and an ESX host could accidently be added to a DPM server, and in that case DPM would show both views of the same VMs as seen below.

clip_image008

To prevent this, if the ESX host is being managed by vCenter, Lockdown mode can be enabled on that ESX host. Lockdown mode prevents remote users from logging directly into the host, meaning that the host will only be accessible through the local console or an authorized centralized management application like vCenter. You can change the lockdown mode setting from the vSphere web UI by navigating to Hosts and Clusters and selecting the ESX host, then changing LockDown to enabled.

VMware credential management

Because DPM’s VMware backup is an agentless backup solution, DPM performs backups by interacting with vCenter/ESX servers remotely. This is achieved by DPM remotely authenticating with the VMware server. This authentication is required and performed every time DPM interacts with VMware servers. DPM securely stores the required credentials locally in Windows Credentials Manager and uses them whenever needed. Since these credentials can be changed periodically, and because a datacenter may have multiple vCenters or ESX hosts that need different credentials, DPM has built-in credentials management. However, before creating a credential in DPM, the VMware user account used for the credential must have certain privileges.

Required privileges

The required VMware user privileges are in the following table:

ReqUserPriv

These privileges are assigned to Roles in vCenter or the vSphere client, and can be created or managed under Administration –> Roles. Once you create a role with the privileges above, you can assign that role to an existing or a new user account.

Creating new role for an individual ESXi server

The steps below demonstrate how to create a new role for an individual ESXi host. If the host is managed by vCenter, go to the Creating a new role for vCenter section.

1. Connect to the ESXi host using the vSphere client.

clip_image010

2. In the vSphere client while on the Home screen click on the Inventory icon.

3. Under the Local users & groups tab, right-click and Add a new user.

4. Fill out the form and select a strong password. In this example the user name is DPMBKUP.

clip_image012

To add a dedicated role and assign required privileges, complete the following:

1. In the vSphere client while on the Home screen, under Administration click on the Roles icon.

2. Click on the Add Role button.

clip_image014

3. In the example below, the DPMBKUP role is created. Select the required privileges from the list of required user privileges above and save them.

clip_image016

Now assign permissions to the DPMBKUP user account:

1. From the vSphere client screen, select the Inventory icon.

2. Click on the Permissions tab.

3. Right-click and select Add permissions…

clip_image017

4. In the new Assign Permissions dialog box, press Add…

5. Select the DPMBKUP user then press the Add button, then click OK.

clip_image019

6. Once the DPMBKUP user is added, select the DPMBKUP role from the Assigned Role drop down list. This will give that user account the required privileges to perform backups and restores.

clip_image021

Creating a new role in vCenter

In large VMware deployments, the ESXi hosts will be managed by one or more vCenter servers. DPM can protect all the VMs through the vCenter server instead of having to add each ESXi host to protection. To create a new role with the required privileges using the vCenter console, perform the following steps:

1. Connect to the vCenter server using the vSphere client and go to the Home screen.

clip_image023

2. Under Administration, click on the Roles icon.

3. Click the plus (+) sign to create a new role.

clip_image025

4. In the Create Role dialog, enter a role name, then locate and enable the required privileges as shown in the required user privileges table above. Click OK to save.

clip_image027

5. After the new role is saved, go back to the Home menu and click the Hosts and Clusters icon under Inventories.

6. Select Manage, then go to the Permissions tab to show a list of users/groups.

clip_image029

7. Click on the plus (+) sign to add the role to an existing user that will be used for the DPM credentials. The Add Permission dialog will open.

8. Select the DPMBKUP role created earlier from the Assigned Role drop down list.

clip_image031

9. Click Add… to select the user to add to this role, then add the user and click OK.

clip_image033

10. Once added, that user account can then be used for DPM credentials.

clip_image035

11. On the DPM server, enter that username and password:

clip_image037

Creating VMware credentials

VMware credentials can be managed by selecting the Manage VMware credentials option as shown below. You can add credentials here before adding a VMware server, or you can specify credentials while adding a VMware server.

NOTE: After installing DPM 2012 R2 UR10 or later, the Agents link under Management has been changed to Production Servers. This was necessary because VMware servers do not require agents. A new Type column was added to the protected servers page to differentiate between Windows servers and VMware servers.

clip_image039

The Add Credential screen will be displayed to enter a friendly name of the credential, a description, the user ID and password. This new credential can be used when adding vCenter or ESXi hosts to DPM.

clip_image041

When adding a new server for protection and selecting VMware, the wizard will allow you to select a pre-existing credential, or you can create a new credential on the fly while adding the server.

clip_image043

Modifying the credentials of a VMware server

Most organizations need to update credentials for security reasons or when personnel changes. When VMware server credentials are changed, credentials that are used by DPM also need to be updated. There are two methods to change credentials used by DPM to communicate with a VMware server:

1. You can change the username and password associated with the current credential used by one or more server.

2. You can create or select a completely different credential to use for one or more servers.

Changing an existing credentials User ID or Password:

clip_image045

clip_image047

Changing a credential used by a vCenter or ESX server:

clip_image049

Notes on credentials:

  • A single credential can be used for authenticating multiple VMware servers.
  • Credential details include credential description, login name and password. Once it is updated, all VMware servers that are using this credential will be authenticated with the new credentials.
  • A credential cannot be deleted if it is currently being used by any VMware server’s authentication setting. Before attempting to delete a credential, change all VMware servers using that credential to use a different credential.
  • VMware credentials are stored locally on the DPM server using Windows Credential Manager (CredMan). The passwords are stored encrypted in the CredMan database. The friendly credential’s name, user name and description are stored in the DPMDB in a table called tbl_IM_Credentials. Should the DPM server need to be rebuilt and the DPMDB restored, only the password will need to be re-entered.

Adding a VMware server

First step in protecting a VMware server is to add it to DPM server. VMware server authentication can be done by two step process.

Step 1: Setting up secure communication between DPM and the VMware server

To communicate securely with a VMware server, a certificate is used. DPM connects to VMware via the HTTPS protocol, so the certificate that is installed on VCenter or ESX host must be trusted by the DPM server. Each ESX server will have its own certificate, however if the vCenter server is added as a protected server, you do not have to deal with the certificates of all the other ESX servers that are managed by that vCenter server.

If a certificate is not deployed on vCenter or the ESX hosts, or you did not install the certificate on the DPM server, you can disable secure communication between DPM and VMware via the registry. Currently, this is a global setting and will disable all secure authentication between DPM and the VMware servers. Even if certificates are deployed on one or more ESX hosts and the DPM server, they will not be used by DPM if this registry setting is enabled.

To disable secure communication via the registry, copy and paste the following text into a file called DisableSecureAuthentication.reg on DPM sever and double-click the file to add the entry to the local registry.

Windows Registry Editor Version 5.00
[HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Microsoft Data Protection Manager\VMware]
“IgnoreCertificateValidation”=dword:00000001

That will create the following registry value:

clip_image051

Step 2: Add the VMware server to DPM

Add a new VMware server by selecting the Production Server tab. then Add as shown below.

clip_image053

The Production Server Addition Wizard allows multiple VMware servers to be added to the DPM server at one time. Each server added can share the same credentials or use separate credentials as needed.

clip_image055

Each vCenter or VMware server that need to be added should have the following details:

1. The FQDN of the vCenter, the FQDN of the VMware server, or the IP address of the server.

2. The SSL port used to communicate with the VMware server. Because HTTPS is used, DPM needs to know the SSL port that the VMware server is configured to use. If the VMware servers is not explicitly configured with a non-standard SSL port, simply use the default port which is 443.

3. The credential needed to authenticate with the VMware server. If the required credential is not yet added to DPM, create a new credential by selecting Add New Credential as shown below.

clip_image057

clip_image059

After adding the vCenter or ESXi servers, proceed through the wizard to completion.

If the credentials are incorrect, of if there is no valid trusted certificate, or if the ESX server has the lockdown option enabled because it’s being managed by vCenter, you will get an error 0x80990EF2 or 0x8099DEF2 when trying to add the ESX server to DPM. Check the DPMRACurr.errlog to see what the true cause is for the error and correct it accordingly. Here is an example:

VMware version: 5.5.0
Error: Data Protection Manager Error ID: 33623
Unable to communicate with VMware Server 172.29.11.229.
Detailed error code: Internal error code: 0x80990EF2
Recommended action: Please ensure that the specified VMware server is up and running and reachable from DPM Server.
Also, ensure that right credentials are specified for interacting with specified VMware Server.

Protecting VMware VMs

DPM supports both application consistent and crash consistent backups. To obtain application consistent backups, you must install the VMware tools on the guest. VMware tools is an optional free set of drivers and utilities that interact between the host and guest operating systems and support taking snapshots inside guests that support snapshots. The VMware tools are equivalent in nature to the Windows Hyper-V Integration components. If the VMware tools are not installed, backups should succeed, however they will only be crash consistent.

You can install the VMware tools for guests using either the vSphere web client or vCenter by clicking on the link to install the tools, then following the directions in the resulting dialog.

clip_image061

DPM can protect VMware guests hosted on both NFS and VMFS storage. Fault tolerant clustered VMs are supported, however VMs hosted on shared disk clusters are not. Change tracking on shared disks is not supported by VMware.

Before starting protection in DPM, disk storage need to be added to DPM as documented in Adding Storage to DPM. After adding storage to DPM, VMware VMs can be protected by going to the Protection tab and expanding the VMware servers tree as shown below.

clip_image063

If there are Inquiry errors, they will be displayed in a DataSource enumeration details popup with a list of errors. Possible reasons are an invalid certificate, login failures or permissions issues. In the screenshot below, the credentials used were invalid at the time of the inquiry. There is no need to look at the logs for this failure because the details show InvalidLogonFault.

clip_image065

Differences between protecting VMs hosted on NFS and VMFS storage

Initial Replica (IR): For VMFS hosted VMs, DPM will use a VMware API call to ask for a list of allocated blocks inside the vmdk files. DPM will only read and transfer those allocated blocks and write them to a corresponding vhdx file on the replica volume. DPM uses the vhdx format so that item level recovery can be performed for Windows guests.

For NFS hosted VMs, the VMware API call to get the allocated blocks list is unsupported, therefore DPM must read all vmdk files (including empty blocks) and transfer all blocks to the DPM server, then write them to the vhdx file on the replica. This takes longer, however the storage consumed on the replica will be approximately the same due to optimization for zero block writes to the vhdx file on the replica.

Delta Replication (DR): There is no difference between recovery point synchronizations for VMs hosted on NFS vs VMFS. They are both accomplished by using the VMware API to ask for the changed blocks based on ChangeID. Only changed blocks will be transmitted to the DPM server replica volume.

Consistency Check (CC): This is basically the same as IR, only here the changed blocks will be transferred for CC of VMFS hosted VMs, but a full end-to-end read like traditional CC will need to be done for NFS hosted VMs. The CC will take longer for NFS hosted VM’s.

Moving a VM’s vmdk from an NFS disk to a VMFS disk and vice versa is supported, however a CC will be needed before protection can continue.

Support for VM vMotion and migration to different storage

DPM supports continuous protection of VMware guests, including moving VMs between hosts using vMotion or migrating a VM to different storage using storage vMotion. Moving a VM to a different folder or datacenter is also supported. These capabilities are possible because DPM uses the VMware backup APIs that support the scenarios.

NOTE: In UR11, if a DPM backup is in progress and vMotion is triggered, the backup will fail. This will be fixed in a later update for DPM. In the ideal situation, backup should prevent vMotion and vMotion should prevent backup. Currently if vMotion is in progress, backup will not start.

Support for VM cloning

If a VM is cloned, it will have the same UUID but it will have a unique InstanceUUID which is guaranteed to be unique across the datacenter. This ensures that DPM can continue protection of the original VM.

Folder level protection under VMs and Templates

VMware provides two types of folders: Hosts and Clusters, and VMs and Templates. VMs and Templates folders let you organize VMs in a way that suits your needs. For example, you may want to organize VMs based on applications they belong to or group VMs by department, or any number of other criteria.

DPM only supports VMs and Templates folders. DPM can be configured to protect individual VMs or protect all VMs under a folder by selecting the folder. A major benefit of adding folder level protection is that any new VMs added to the folder are protected automatically. DPM detects and configures protection for these VMs as part of a nightly maintenance job, so all VMs created will be configured for protection by end of the day. You can also run the DPM PowerShell command start-autoprotection at any time to immediately initiate protection of newly added VM’s under an auto protected folder. When folder level protection is selected, the folder will show (Auto) in front of the name, as shown here:

clip_image066

Notes on folder level auto protection:

  • You can rename protected folders or move any protected folder to a new location in the hierarchy and the VMs that are protected under that folder will remain protected.
  • If you move protected VMs from under an auto-protect folder to different folder, DPM will continue protection of the VMs.
  • The DPM UI will reflect the new folder name/location or the VM’s new location after being moved while enumerating vCenter when modifying the PG or when adding new protection.
  • If you move all auto-protected VMs to different folders that are not located under the auto-protected folder, the original folder will lose its auto-protect status and any new VMs added under the folder will not be auto-protected. You need to re-enable auto-protect on that folder.

Excluding a VM from backup when in an auto-protected folder

To exclude one of more VMs in an auto-protected folder from protection, use vCenter and add a new custom attribute called DisableDPMBackup on the VMs you want to exclude from backup. After setting the DisableDPMBackup attribute on a VM, the VM will not be shown in the inquiry when creating or modifying a protection group, however if the attribute is set after an inquiry was already performed, that VM may still be shown. You will need to perform a refresh so it is removed from the DPM cache.

An example is shown below. In the screen shot, you can see the properties of a virtual machine called VM01. Under the annotations there is an edit link. To exclude the VM, you would click the link to bring up a new dialog box and add a new annotation called DisableDPMBackup, setting the value to TRUE.

clip_image067

Exclusion of VM in Auto Protection using VMware CLI

You can also set the custom attribute named DisableDPMBackup to True via a cmdlet in following way:

#Create custom attribute named DisableDPMBackup if it is already there then skip this step:
Connect-VIServer -Server 10.10.10.10 -Protocol https -User admin -Password pass
New-CustomAttribute -Name “DisableDPMBackup” -TargetType VirtualMachine

#Get the VM object and set the value
$vm = Get-VM –Name “DoNotbackupThisVM”
Set-Annotation –Entity $vm –CustomAttribute “DisableDPMBackup” –Value “TRUE”

Setting the above value to anything other than TRUE will reverse the effect.

To download vSphere PowerCLI and get more info on cmdlets, see the links below.

Scale out protection of large private cloud deployments

A single DPM server can typically only protect approximately 800 average size VMs. To protect a large VMware deployment, multiple DPM servers can be leveraged to protect VMs managed by one or more vCenters. While multiple DPM servers can protect VMs deployed on the same vCenter, any given VM/folder can be protected by a single DPM server at any given time. VMs and folders that are already protected by one DPM server are not selectable by other DPM servers, as demonstrated below.

clip_image069

Once a folder is selected by a DPM server, all VMs and folders underneath this folder will be protected by the same DPM server automatically.

NOTE: This feature is only supported when protecting VMware ESXi hosts through vCenter, and is not supported when individual ESXi hosts are added to a DPM server for protection. Only a single DPM server should be used when protecting an ESXi host directly. ESX hosts do not support the custom attributes so they will not support scale out protection via vCenter.

The scale out feature is controlled by DPM by maintaining state information within vCenter for every VM or folder under protection. vCenter supports custom attributes called annotations for every object, and DPM leverages the annotations by creating a new global attribute called DPMServer which is then used to control which DPM server owns protection for a given folder or VM. Other DPM servers can query the custom attributes and find out if that folder or VM is already under protection, and if so, by which DPM server. If the DPMServer attribute contains a value for that object (folder/VM), DPM will show that the item is already protected and the DPM server protecting that item will be displayed.

Be aware that there is a delay between when a folder or VM is added to protection and when the DPMServer attribute is added to the object. The attribute is committed at Initial Replica (IR), Delta Replication (DR) and Consistency Check (CC) time. This means there is a window where another DPM server may attempt to protect the same folder or VM. This will not cause problems other than two DPM servers will be protecting the same objects. VMware change tracking will not be affected as each DPM server keeps track of its own reference points.

There may be times when a DPM server is no longer available, meaning that you need to re-protect a folder or guest using a different DPM server to continue protection. In such cases, use vCenter to clear the DPM server name in the DPMServer attribute for that object.

In our example below, the screen shot shows the properties of a VM called ir-dr-cc-1disk. Under the annotations there is an edit link, and clicking that link will bring up a new dialog box. To clear the existing DPM server name, find the name called DPMServer and clear it. This will allow another DPM server to protect it. Do not remove the entire attribute or all scale-out tracking will be lost. To clear the value, click in the Value box containing the DPM server name and remove the entry.

NOTE: Modifications of custom attributes on vCenter are not immediately committed in vCenter. A new backup or CC needs to be run against any guest under protection to commit attribute changes.

clip_image071

In addition to the DPMServer attribute, DPM also sets heartbeat on VCenter’s root folder with a custom field named LastRefreshTime_DPMServerName which is set to the UTC time in ticks.

Whenever the DPMServer property on a folder or VM is read, it will also read the last refresh time of that DPM server if the field does not exist. If it has a time value older than 15 days, it will be ignored. Access to this custom field is not locked which means multiple DPM servers can set the value at essentially the same time, and whatever value is set last remains. DPM reads those values at inquiry and updates them when a backup operation is run on that server. Because of this, there can be cases when a Protection Group is created but the attributes are not yet reflected on the vCenter server. Because of this, please be aware of the following:

  • If protection of VMware VMs is done on one DPM server, and the DPM server does not protect any other VMs on that server, there will be no immediate backup operations. Because of this, custom attributes will not get updated on vCenter.
  • If a DPM server is down or removed, it will take 15 days until the other DPM servers will ignore the attributes set by that DPM server.

There may also be scenarios where you want to protect the same VM via multiple DPM servers. In this case, and in the ones above, you may not be able to protect a folder or VM on vCenter on any other DPM server. You can use the following VMware cmdlets to overcome the issue via VMware PowerCLI.

1. To reset the value on a single object (folder or VM):

Connect-VIServer -Server 10.10.10.10 -Protocol https -User admin -Password pass
$f = Get-Folder –Name “TestFolder”
Set-Annotation –Entity $f –CustomAttribute “DPMServer” –Value “”

2. To reset all the info for the DPM server (e.g. if the DPM server is removed):

Connect-VIServer -Server 10.10.10.10 -Protocol https -User admin -Password pass
#Get custom attribute object
$ca = Get-CustomAttribute –Name “LastRefreshTime_DPMServername”
$ca
#Remove the last refresh time field so that all the values set by this dpm server will be ignored
Remove-CustomAttribute –CustomAttribute $ca

Backing up VMs to various storage targets

DPM supports backup of VMware VMs to disk as well as to a Microsoft Azure cloud backup vault. DPM’s protection to disk and cloud are integrated into the protection workflow the same as other supported workloads. Secondary protection or tape backup for VMware workloads are not currently supported.

clip_image073

For all operational recovery scenarios like accidental deletion or corruption, disk backups can be used. Cloud backup can be leveraged for long-term retention or offsite backup requirements as documented in Azure Backup for long term retention.

DPM can also do application consistent backup of Windows VMs and file consistent VM backup of Linux VMs. For this to work, you will need to install the VMware tools inside the guest.

Note: At the time of this writing, DPM will protect the VMware vhdk files by copying only allocated blocks inside the vhdk files and storing them on the DPM replica as a vhdx file. The size of the vhdx file is the same size as the protected vhdk file, however during recovery, DPM will restore the entire vhdk file including unallocated space. This means that the restored VM will require more physical disk space on the selected datastore than what was originally used.

Example: Let’s say that a VM has a 40GB virtual disk attached and the allocated space inside the vhdk file is only 23GB. After protecting the VM, the DPM replica will have a 23GB vhdx file. When the restore is done, the resulting vhdk file will not be the original 23GB, but rather the 40GB size of the virtual disk.

Unsupported scenarios

DPM VMware protection does not support the following scenarios:

1. Raw Device Mapping (RDM) pass thru disks can be configured in either physical compatibility mode or virtual compatibility mode. Physical RDM (PRDM) is not supported, however Virtual RDM (VRDM) is supported. More about Raw Device Mapping can be found here.

2. Clustered VMs are supported, however VMs hosted on shared disk clusters are not supported. Change tracking on shared disks is not supported by VMware.

3. DPM cannot detect or protect VApps.

4. DPM currently cannot protect VMware VMs to tape or a secondary DPM server.

5. Manual replica creation is not supported. You must either let DPM create the initial replica at the time of protection or schedule it to run later.

6. DPM can protect VMs with snapshots, however the snapshots are not backed up and are not restored during a VM recovery. If the snapshot was created before protection, DPM cannot protect that VM because VMware does not support enabling change tracking for any VM that has existing snapshots. A work around is to delete the existing snapshots.

7. The Microsoft Operations Manager console does not currently support monitoring VMware data sources, however they will show up under the All Datasources view. VMware protection alerts will only show under All Alerts. You can modify the OpsMgr management pack (MP) by making a custom view and overriding the DPM MP.

Recovering VMs

DPM supports both Original Location Recovery (OLR) and Alternate Location Recovery (ALR).

Original Location Recovery (OLR)

Protected VMs can be recovered to their original location which will overwrite the existing VM. Original Location Recovery (OLR) is supported only when the VM is still present and the VM disk configuration did not change from backup time. This is done by selecting Original Location Recovery as shown below.

clip_image075

DPM will perform the following when doing an Original Location Recovery (OLR):

1. Check to see if the number of disks on the VM being recovered matches the number of disks in the recovery point.

2. Check to see if the UUID of the disks and the paths match.

If either of these checks fail, the recovery will fail with error VMConfigMismatched.

DPM will always transfer the whole disk; it does not matter if the original disk was thick or thin provisioned. If the VM was deleted and you attempt to restore to the original location, the recovery will fail with the below error and failed job details:

clip_image077

Type: Disk recovery
Status: Failed
Description: DPM encountered error from VMware server 172.29.9.219 with Fault – VMNotFound (ID 33614 Details: Internal error code: 0x80990EF0)
More information
End time:
Start time:
Time elapsed:
Data transferred: 0 MB (0 bytes)
Source details: testbox01
Target details: testbox01 on 172.29.9.219
Cluster node –

If the Datastore does not have enough free space for the recovery, the failed job details will show an error similar to the following:

Type: Disk recovery
Status: Failed
Description: DPM encountered error from VMware server 172.29.9.219 with Fault – NoDiskSpace (ID 33614 Details: Internal error code: 0x80990EF0)
More information
End time:
Start time:
Time elapsed:
Data transferred: 0 MB (0 bytes)
Source details: testbox01
Target details: testbox01 on 172.29.9.219
Cluster node –

Alternate Location Recovery (ALR)

If the original VM is missing, or you do not want to disturb the original VM, the VM can be recovered to an alternate location. When recovering to an alternate location, DPM will need certain parameters as shown below. Each parameter is enumerated and selectable using the browse button. The screen shot below shows an alternate location recovery with the parameters filled in.

clip_image079

Example summary page with final details:

clip_image081

When a VM is recovered to an alternate location, DPM will create a new virtual machine and append a “-Recovered” to the name of the VM and the underlying files to help in differentiating from the original VM.

clip_image083

Individual vmdk file recovery

There may be times when you want to restore a single vmdk file instead of an entire VM. With Hyper-V protection, this is possible because the VM’s files are stored natively as vhd or vhdx files. Unlike Hyper-V protection, it is not possible to restore individual vmdk files associated for a VMware virtual machine. You can see in the screen shot below that the option to recover an individual vmdk file is not available.

clip_image085

This is because the vmdk file is stored as a vhdx file on the DPM server so that it can be mounted when performing Item Level Recovery for Windows VM’s. When restoring a VMware virtual machine, DPM will mount and read the vhdx file and write the data to the vmdk file on the ESX server.

Item Level Recovery (ILR)

If the protected VM is a Windows VM, individual files or folders inside the VM can be recovered using DPM’s Item Level Recovery (ILR) capability. To do this, click on Recovery, select the corresponding vmdk file, then select the files to recover as shown below. This will mount the corresponding vhdx file and copy it to the destination location.

clip_image087

PowerShell commands

VMware operations can also be achieved using PowerShell commands. Below is a list of PowerShell commands that have been added to support VMware protection. All examples will follow these commands:

PS C:\Program Files\Microsoft System Center 2012 R2\DPM\DPM\bin> $PS=get-dpmproductionserver
PS C:\Program Files\Microsoft System Center 2012 R2\DPM\DPM\bin> $ps |format-list

Output

ServerName : DPM01
ClusterName :
Domain : fabrikam.local
ServerProtectionState : NoDatasourcesProtected

ServerName : 172.29.9.219
ClusterName :
Domain :
ServerProtectionState : HasDatasourcesProtected

ServerName : FBKMDC01
ClusterName :
Domain : fabrikam.local
ServerProtectionState : NoDatasourcesProtected

Get-DPMVMWareInventory

VMware’s folder infrastructure and other related VMware infrastructure can be retrieved using the Get-DPMVMWareInventory PowerShell command.

Get-DPMVMWareInventory [-ProductionServer] <ProductionServer> [-Async] [-Inquire] [-Tag <Object> ] [ <CommonParameters>]

Output

Returns the VMWareRecoveryInfra object. The VMWareRecoveryInfra object includes the following:

VMWareRecoveryInfra

{
VMWareFolder RootFolder;
VMWareComputtteResource ComputeResources[];
}

VMWareFolder

{
VMWareFolder Childfolders[];
}

VMWareComputeResource

{
VMWareDataStore VMWareDataStore[];
VMWareResourcePool RootResourcePool;
}

VMWareResourcePool

{
VMWareResourcePool Childresourcepools[];
}

Example

get-dpmvmwareinventory -productionserver $ps[1] -inquire

(get-dpmvmwareinventory -productionserver $ps[1] -inquire).rootfolder.childfolders | fl *

ChildFolders : {host, vm}
IsChildOfVMFolder : False
Name : CSS Lab LC
RefId : datacenter-21
ParetnRefId : group-d1
Type : Datacenter

ParentObject : Microsoft.Internal.EnterpriseStorage.Dls.UI.ObjectModel.OMCommon.VMWareFolder

Auto Protection of a folder

To protect VMs in a folder automatically, use the Set-DPMAutoProtectIntent PowerShell command:

Set-DPMAutoProtectIntent [-ProtectionGroup] <ProtectionGroup> [-VMWareFolder] <VMWareFolder> [-AutoProtectIntent] <AutoProtectionIntent> {Enable | Disable} [-ProductionServer] <ProductionServer>

Alternate Location Recovery (ALR)

If a VM needs to be recovered to an alternate location, DPM needs to know various parameters like target host, etc. In this process, first you need to get VMware Inventory using the Get-DPMVMWareInventory command as shown above, then using that inventory object, do an ALR using the following PowerShell command:

New-DPMRecoveryOption [-TargetServer] <string> [-DPMLibrary <Library>] [-RecoverToReplicaFromTape <Boolean –VMWareVM [-VMWareTargetFolder <VMWareFolder>] [-VMWareTargetResourcePool <VMWareResourcePool>] [-VMWareTargetComputeResource <VMWareComputeResource] [-VMWareTargetDatastore <VMWareDatastore] [<CommonParameters>]

Output

VMWareVMRecoveryOptions

Example

$inventory = Get-DPMVMWareInventory –ProductionServer $ps

Now you can do $inventory.RootFolder.ChildFolders[0].ChildFolder[0] to get access to various object of inventory.

Get-DPMCredential

This will return a DPM credential object that can be used as an input for subsequent commands.

Get-DPMCredential –Name <name>

Example

PS C:\Program Files\Microsoft System Center 2012 R2\DPM\DPM\bin> Get-DPMCredential

CredName Description UserName LastModified
——– ———– ——– ————
superman MS ESXi server root 6/10/2016 6:31:00 PM
vCenter Server VM1 vCenter Server VM1 root 6/10/2016 6:32:50 PM
vCenter2Credential vCenter2 Password root 6/3/2016 10:39:44 PM
VPXUser Test User vpxuser 6/21/2016 9:48:07 PM
PS C:\Program Files\Microsoft System Center 2012 R2\DPM\DPM\bin> Get-DPMCredential -name superman
CredName Description UserName LastModified
——– ———– ——– ————
superman MS ESXi server root 6/10/2016 6:31:00 PM

Add-DPMCredential

This command is used to add a new credential to DPM which can be used for authenticating to a VMware server.

Add-DPMCredential [-Name] <string> [-PSCredential] <pscredential> [[-Description] <string>] [<CommonParameters>]

Add-DPMCredential [-Name] <string> [-UserName] <string> [-Password] <securestring> [[-Description] <string>] [<CommonParameters>]

Example

PS C:\Program Files\Microsoft System Center 2012 R2\DPM\DPM\bin> add-dpmcredential -name batman -description pstest -username administrator

cmdlet Add-DPMCredential at command pipeline position 1
Supply values for the following parameters:
Password: *********
CredName Description UserName LastModified
——– ———– ——– ————
batman pstest administrator 6/24/2016 11:03:20 PM

Remove-DPMCredential

This command removes a given credential. Note that a credential can be removed only if no VMware server is using it for authentication.

Remove-DPMCredential [-Name] <string> [<CommonParameters>]

Example

Remove-DPMCredential -name batman

Update-DPMCredential

This updates a given credential.

Update-DPMCredential [-Name] <string> [-PSCredential] <pscredential> [[-Description] <string>] [<CommonParameters>]

Update-DPMCredential [-Name] <string> [-UserName] <string> [-Password] <securestring> [[-Description] <string>] [<CommonParameters>]

Update-DPMCredential –Name <name> -UserName <user> -Password <password>

Update-DPMCredential –Name <name> -UserName <user>

Update-DPMCredential –Name <name> -Password <password>

Example

PS C:\Program Files\Microsoft System Center 2012 R2\DPM\DPM\bin> update-DPMCredential -name batman -username newuser -description newdesc

cmdlet Update-DPMCredential at command pipeline position 1
Supply values for the following parameters:
Password: *****
CredName Description UserName LastModified
——– ———– ——– ————
batman newdesc newuser 6/24/2016 11:25:42 PM

Add-DPMProductionServer

This PowerShell command adds a given production server to a DPM server.

Add-DPMProductionServer –Name <servername> -CredName <dpmcred>

Parameters: <servername>: string <dpmcred>: string

Remove-DPMProductionServer

Remove a given production server from a DPM server.

Remove-DPMProductionServer –ServerId <ServerId>

Update-DPMProductionServer

Update a given production server settings.

Update-DPMProductionServer –Action <Credential> –ServerId <ServerId>-CredName <credname>

Parameters: <Credential>: enum <ServerId>: Guid <credname>: string

Troubleshooting

Since there is no DPM agent installed on the VMware host, most errors will be recorded in the DPMRA and MSDPM error logs on the DPM server. That is the first place to look for any DPM backup or restore failures as VMware errors will be included in the DPMRA logs.

VMware logs can be gathered using the vSphere client. After connecting to the ESX host you can export the logs under System Logs, then export system logs.

clip_image089

clip_image091

Problem: DPM does not enumerate or display one or more VMs to protect

It is possible that one or more VMs were excluded from auto-protection and have the DisableDPMbackup attribute set. Remove the DisableDPMbackup attribute from the VM as described in the section titled “Excluding a VM from backup when in an auto-protected folder” above.

Problem: Alternate Location Recovery (OLR) fails or causes console crashes

During a recovery to an alternate location, DPM converts the VMware VMs configuration file (called a ConfigSpec) captured during backup to a ConfigInfo object which is used to perform a restore to an alternate location. The mapping between ConfigSpec and ConfigInfo is performed by DPM as there is no method or API from VMware to create it. There may be rare cases when this mapping does not work which will cause the VM restore to fail or cause a DPM crash. Other symptoms are that the VM might not boot, or that some virtual hardware is missing from the VM. Look in the dpmra errlog and search for ConvertConfigInfoToSpec. If you find that then you know that the mapping failure was the cause.

Addendum

The VMware article below lists the step by which you can install and configure certificate on vCenter Server: http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2061973

To install the cert on a DPM server you would follow the procedure in the following article: https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2108294

The download button is not there but you can use the following PowerShell script to download the certificate, then continue with the steps.

NOTE: Replace https://vcenterserver.fabrikam.com with the vCenter server name.

$webRequest = [Net.WebRequest]::Create(“https://vcenterserver.fabrikam.com/”)
try { $webRequest.GetResponse() } catch {}
$cert = $webRequest.ServicePoint.Certificate
$bytes = $cert.Export([Security.Cryptography.X509Certificates.X509ContentType]::Cert)
set-content -value $bytes -encoding byte -path “$pwd\vcentervm1.cer”

J.C. Hornbeck, Solution Asset PM
Microsoft Enterprise Cloud Group

SC 2016 DPM Capacity Planner

$
0
0

SC 2016 DPM announced Modern Backup Storage. This changes the way data is backed up and stored. Modern Backup Storage delivers 50% Storage Savings and 3x faster by leveraging latest Windows Server 2016 technologies as ReFS Block Cloning, VHDX, Allocate on write, etc.

Further, DPM 2016 comes with Workload Aware Storage, which enables you to configure backups of certain kinds of workloads to go to certain volumes. Hence, you can now store your more frequently backed up SQL and SharePoint data on expensive, high performant volumes , while storing other less frequently backed up data on low performant storage. This further optimizes storage consumption, while decreasing spends on storage.

Here is the Backup Storage Capacity Planner to help you provision storage for DPM 2016 using the storage savings and efficiency. Based on inputs as the size, kind and policy of backups, the Planner suggests the amount of storage that will be needed to store the backups to disk, and to Azure.

3 Simple steps to plan Backup Storage Requirements

untitled

 

Provisioning Resources using SC 2016 DPM Capacity Planner

Once you have planned the storage, begin with adding volumes to SC 2016 DPM and using MBS. The best practice is to add your disks to a Storage Pool, create Virtual Hard Disks with Simple layout, and create a volume on it. This volume can be given to SC 2016 DPM, and extended as and when needed.

Get these Modern Backup Storage Now! 

You can get DPM 2016 up and running in ten minutes by downloading Evaluation VHD.  Questions? Reach out to us at AskAzureBackupTeam@microsoft.com.

If you are new to Azure Backup and want to enable Azure Backup for longterm retention, refer to Preparing to backup workloads to Azure with DPM.  Click for a free Azure trial subscription.

Here are some additional resources:

How to use certificates to authenticate computers in workgroups or untrusted domains

$
0
0

System Center 2012 R2 Data Protection Manager (DPM 2012 R2) supports protection of computers in workgroups and untrusted domains using local accounts and NTLM, however in scenarios where an organization does not allow creation of local accounts, this solution does not work. As an alternative, DPM 2012 R2 now allows the use of certificates to authenticate computers in workgroups or untrusted domains. DPM supports the following data sources for certificate-based authentication when they are not in trusted domains:

  • SQL Server
  • File server
  • Hyper-V

Note that DPM also supports the data sources above in clustered deployments.

The following data sources are not supported:

  • Exchange Server
  • Client computers
  • SharePoint Server
  • Bare Metal Recovery
  • System State
  • End user recovery of file and SQL
  • Protection between a Primary DPM server and Secondary DPM server using certs. The Primary DPM server and Secondary DPM server need to be in the same domain or mutually trusted domain. Certificate based authentication between a Primary and Secondary DPM servers is not supported.

If you have this scenario in your environment, we have a new article available that will guide you through all of the steps required for setting up System Center 2012 R2 Data Protection Manager to protect virtual machines (VMs) running in a Windows Server 2012 R2 workgroup, or VMs running in a Windows Server 2012 R2 Hyper-V cluster, in an untrusted forest using certificate authentication. You can download this new whitepaper here.

System Center Data Protection Manager 2007 End of Support

$
0
0

Product support for Microsoft System Center Data Protection Manager 2007 will reach its end of support date in 12 months. If you are using this version, please upgrade to a newer version before January 9, 2018 to ensure supportability.

The following resources are available to help you upgrade to the latest version of Data Protection Manager:

Have questions about supported products? Visit Microsoft Support Lifecycle to view a list of supported products and related policies.

Support Tip: DPM recovery point or consistency check for a protected VMware VM fails with FileFaultFault error

$
0
0

~ Maanas Saran | Program Manager | Microsoft

When DPM attempts to make a recovery point or run a consistency check for a protected VMware virtual machine (VM), the job can fail with a FileFaultFault error like the one shown below.

DPM encounterd error from VMware while trying to get ChangeTracking information. Server – Vmware_Server_name.  ErrorCode – FileFaultFault (ID 33621 Details: Internal error code: 0x80990EF3)

This can occur for one of the following reasons:

1. VMware vCenter and vSphere versions 5.5 and 6.0, including all updates, are supported by Microsoft Azure Backup Server (MABS) as well as the current releases of Microsoft Data Protection Manager (DPM).  If any version less than 5.5 is connected with MABS/DPM servers, you can receive this FileFaultFault error. To resolve this error, update VMware to version 5.5 or higher. Note that the update procedure includes a reboot of the host computer. You must ensure that the reboot is complete before the problem will be resolved.

2. MABS and DPM do not support protection of VMware VMs with Independent disks. Attempting to protect a VM with Independent mode enabled (as shown below) will result in the FileFaultFault error. 

clip_image001

To resolve this error, complete the following:

a. Disable and then re-enable “Changed Block Tracking” (CBT) on the VM experiencing the problem. For more information see the following VMware articles:

Be aware that when CBT is disabled or enabled, the VM must go through a stun/unstun cycle (power off/power on). Make sure this cycle is complete before proceeding.

b. Disable Independent mode by deselecting the Independent checkbox.

Once this is complete, creating a recovery point or running a consistency check for a protected VMware virtual machine should complete successfully.

Maanas Saran | Program Manager | Microsoft

DPM 2012 R2 DPM 2016

Viewing all 339 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>