{"id":4164,"date":"2018-06-20T12:00:34","date_gmt":"2018-06-20T11:00:34","guid":{"rendered":"https:\/\/www.data-protector.org\/wordpress\/?p=4164"},"modified":"2018-06-16T09:40:17","modified_gmt":"2018-06-16T08:40:17","slug":"optimize-mssql-backup-performance","status":"publish","type":"post","link":"https:\/\/www.data-protector.org\/wordpress\/2018\/06\/optimize-mssql-backup-performance\/","title":{"rendered":"Optimize MSSQL backup performance"},"content":{"rendered":"<p>Optimizing performance has always been a hot topic. This post contains information on how to optimize your MSSQL backup performance with the Data Protector. As always, with this kind of advice, this MAY be helpful in most environments but is not a general solution for any environment. Please test any of the changes and consult your SQL Server administrator if you have any doubts.<\/p>\n<ol>\n<li>General recommendations\n<ol>\n<li>Tuning using omnirc<\/li>\n<li>D<span class=\"SystemTitle\">atabase integrity check<\/span><\/li>\n<li><span class=\"SystemTitle\"><span class=\"SystemTitle\">SQL backup compression<\/span><\/span><\/li>\n<\/ol>\n<\/li>\n<li>Parallel database backup<\/li>\n<li>Multi-stream database backup<\/li>\n<\/ol>\n<p>Parallel database and\u00a0Multi-stream database backup for Microsoft SQL is available since Data Protector A.09.08.<\/p>\n<p><!--more--><\/p>\n<h3><strong>1. General recommendations<\/strong><\/h3>\n<h3><strong>Tuning using omnirc<\/strong><\/h3>\n<p>The following <strong>omnirc<\/strong> options are usually a good choice to optimize general backup performance using the MSSQL online integration agent. Using the settings will increase the transfer size and block size to their maximum values.\u00a0This assumes that the underlying file systems were formatted correctly (64k).<\/p>\n<pre># Increase block size and transfer size for MSSQL backups\r\nOB2SQLBLOCKSIZE=65536\r\nOB2SQLMAXTRANSFERSIZE=4194304<\/pre>\n<h3><strong>D<span class=\"SystemTitle\">atabase integrity check<\/span><\/strong><\/h3>\n<p>The option\u00a0<span class=\"SystemTitle\"><strong>Check database integrity<\/strong> is useful to detect silent database corruption at backup time. Checking the database integrity takes time and eats disk and CPU performance on the database server. If you have different backup jobs for full backups and transaction log backups it is recommended to <strong>Disable<\/strong> the <strong>Check database integrity<\/strong> on transaction log backups, especially if they have to run very frequently.<\/span><\/p>\n<h3><strong><span class=\"SystemTitle\">SQL backup compression<\/span><\/strong><\/h3>\n<p>Data Protector allows to configure the usage of <strong>SQL backup compression<\/strong>. By default the MSSQL server settings, configured in the database, are used. Typical backup devices such as tape and deduplication devices (StoreOnce, Data Domain) offer a high performance data reduction at backup time but having issues with pre-compressed data. If you have doubts, or not full control over the MSSQL server, choose to\u00a0<b>Disable <\/b>for\u00a0<b><strong>SQL backup compression.<\/strong><\/b><\/p>\n<h3><strong>2. Parallel database backup:\u00a0<\/strong><strong>Large number of databases per instance<\/strong><\/h3>\n<p>This is a typical example for MSSQL servers that contain hundreds of databases per instance. Even if they are relatively small the processing rate will be slow. The solution is to configure the integration agent to backup multiple databases at the same time. The following example assumes you have successfully installed the agent on the client system. Then add the following omnirc options to the client system to enable parallel processing.<\/p>\n<p># Allow to backup multiple SQL databases in parallel, one stream per database<br \/>\nOB2_PREFER_DATABASE_PARALLELISM=1<br \/>\nOB2_DEFAULT_CONCURRENT_STREAMS=1<\/p>\n<p>The entire MSSQL Server needs to be selected for backup.<\/p>\n<p><a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22.png\"><img loading=\"lazy\" class=\"alignnone size-medium wp-image-4167\" src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-450x323.png\" alt=\"\" width=\"450\" height=\"323\" srcset=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-450x323.png 450w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-150x108.png 150w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-768x551.png 768w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-1024x734.png 1024w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22.png 1063w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n<p>Choose the right amount of target devices. B2D libraries can open multiple data streams per gateway. In our example here up to 4 data streams will be accepted.<\/p>\n<p><a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29.png\"><img loading=\"lazy\" class=\"alignnone size-medium wp-image-4168\" src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29-450x218.png\" alt=\"\" width=\"450\" height=\"218\" srcset=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29-450x218.png 450w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29-150x73.png 150w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29.png 600w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n<p>In <strong>Backup Object Summary<\/strong> select <strong>Properties<\/strong> of the MSSQL server and change <strong>Concurrent streams<\/strong> in the <strong>MS SQL Integration<\/strong> tab to match the number of data streams selected for destination devices. This is 4 in our example.<\/p>\n<p><a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56.png\"><img loading=\"lazy\" class=\"alignnone size-medium wp-image-4173\" src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56-450x393.png\" alt=\"\" width=\"450\" height=\"393\" srcset=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56-450x393.png 450w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56-150x131.png 150w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56.png 762w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n<p>When the backup is executed we see 4 active data connections and the backup proceed very quickly compared to a single stream backup.<\/p>\n<p><a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h44_23.png\"><img loading=\"lazy\" class=\"alignnone wp-image-4192 size-medium\" src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h44_23-450x109.png\" alt=\"\" width=\"450\" height=\"109\" srcset=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h44_23-450x109.png 450w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h44_23-150x36.png 150w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h44_23-768x185.png 768w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h44_23-1024x247.png 1024w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h44_23.png 1619w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n<h3><strong>3. Multi-stream database backup:\u00a0<\/strong><strong>For of a few large databases<\/strong><\/h3>\n<p>If the MSSQL server that contains only a few, but very large databases the following might be useful. The solution is to configure the integration agent to backup databases with multiple data streams. The following example assumes you have successfully installed the agent on the client system. Then add the following omnirc options to the client system to enable multi-streaming. Please note that the number of streams per database is configured in this file. In our example we use 2 concurrent streams.<\/p>\n<p># Allow to backup multiple SQL databases in parallel, 2 streams per database<br \/>\nOB2_PREFER_DATABASE_PARALLELISM=1<br \/>\nOB2_DEFAULT_CONCURRENT_STREAMS=2<\/p>\n<p>The entire MSSQL Server needs to be selected for backup. Each database will be backed up in 2 pieces.<\/p>\n<p><a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22.png\"><img loading=\"lazy\" class=\"alignnone size-medium wp-image-4167\" src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-450x323.png\" alt=\"\" width=\"450\" height=\"323\" srcset=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-450x323.png 450w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-150x108.png 150w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-768x551.png 768w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22-1024x734.png 1024w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h22_22.png 1063w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n<p>Choose the right amount of target devices. B2D libraries can open multiple data streams per gateway. If we choose 4 here we will be able to accept up to 4 data streams. This is true for multi-streaming as well as for parallel backup.<\/p>\n<p><a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29.png\"><img loading=\"lazy\" class=\"alignnone size-medium wp-image-4168\" src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29-450x218.png\" alt=\"\" width=\"450\" height=\"218\" srcset=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29-450x218.png 450w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29-150x73.png 150w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_18h25_29.png 600w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n<p>In <strong>Backup Object Summary<\/strong> select P<strong>roperties<\/strong> of the MSSQL server and change <strong>Concurrent streams<\/strong> in the <strong>MS SQL Integration<\/strong> tab to match the number of data streams selected for destination devices. This is 4 in our example.<\/p>\n<p><a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56.png\"><img loading=\"lazy\" class=\"alignnone size-medium wp-image-4173\" src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56-450x393.png\" alt=\"\" width=\"450\" height=\"393\" srcset=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56-450x393.png 450w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56-150x131.png 150w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_19h12_56.png 762w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n<p>When the backup is executed we see 4 active data connections and the backup proceed very quickly compared to a single stream backup. 2 databases are backed up at the same time and each database is backed up in 2 pieces.<\/p>\n<p><a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h27_18.png\"><img loading=\"lazy\" class=\"alignnone size-medium wp-image-4190\" src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h27_18-450x152.png\" alt=\"\" width=\"450\" height=\"152\" srcset=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h27_18-450x152.png 450w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h27_18-150x51.png 150w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h27_18-768x259.png 768w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h27_18-1024x345.png 1024w, https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2018\/05\/2018-05-24_20h27_18.png 1159w\" sizes=\"(max-width: 450px) 100vw, 450px\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Optimizing performance has always been a hot topic. This post contains information on how to optimize your MSSQL backup performance with the Data Protector. As always, with this kind of advice, this MAY be helpful in most environments but is not a general solution for any environment. Please test any of the changes and consult [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"spay_email":""},"categories":[11],"tags":[212],"translation":{"provider":"WPGlobus","version":"2.8.8","language":"en","enabled_languages":["en","de"],"languages":{"en":{"title":true,"content":true,"excerpt":false},"de":{"title":true,"content":true,"excerpt":false}}},"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p28cjj-15a","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":1960,"url":"https:\/\/www.data-protector.org\/wordpress\/2014\/04\/special-whitepaper-protecting-ms-sql-server-hp-storeonce-catalyst-data-protector\/","url_meta":{"origin":4164,"position":0},"title":"Special Whitepaper &#8211; Protecting MS SQL Server \/ HP StoreOnce Catalyst \/ Data Protector","date":"17. April 2014","format":false,"excerpt":"{:en}In the past we learned from different whitepaper how to optimize the deduplication ratio for different applications and data types. And different whitepaper are available at HP.com, explaining the settings to optimize the backup to a StoreOnce system using Catalyst and HP Data Protector (Please note: most of the settings\u2026","rel":"","context":"In &quot;Data Protector Links&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":4083,"url":"https:\/\/www.data-protector.org\/wordpress\/2018\/05\/sysbackup-oracle-12c\/","url_meta":{"origin":4164,"position":1},"title":"SYSBACKUP for Oracle 12c","date":"28. May 2018","format":false,"excerpt":"{:en}Starting with Oracle 12c three new administrative roles and users have been introduced to conform the principle of access to the least privilege. The users and roles named SYSBACKUP, SYSDG and SYSKM will be created when the database is created with their account in expired and locked status.\u00a0SYSBACKUP is used\u2026","rel":"","context":"In &quot;HowTo&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":903,"url":"https:\/\/www.data-protector.org\/wordpress\/2012\/06\/backup-exec-no-longer-for-the-enterprise\/","url_meta":{"origin":4164,"position":2},"title":"Backup Exec no longer for the Enterprise","date":"7. June 2012","format":false,"excerpt":"{:de}Kurz und Knapp: Symantec hat in einem Artikel f\u00fcr Backup Exec 2012 einige seiner Komponenten auf EOL - end of life - gesetzt und verliert aus meiner Sicht die F\u00e4higkeit im Enterprise Backup & Recovery L\u00f6sungen anzubieten. Der Einsatz im Mittelstand ist fragw\u00fcrdig, da auch in diesem Bereich Anwendungen wie\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":831,"url":"https:\/\/www.data-protector.org\/wordpress\/2011\/12\/slow-backup-on-windows-2008-r2\/","url_meta":{"origin":4164,"position":3},"title":"Slow backup on Windows 2008 R2","date":"19. December 2011","format":false,"excerpt":"{:en}When running Data Protector 6.20 together with a media agent installed on Windows 2008 sometimes you might have a bad backup performance. Sure, this was a known problem when DP 6.20 was launched and it was fixed with patch DPWIN_00516. If you still experience bad backup performance I recommend to\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1155,"url":"https:\/\/www.data-protector.org\/wordpress\/2014\/01\/hanging-sessions-dp-7-01\/","url_meta":{"origin":4164,"position":4},"title":"Hanging Sessions with DP 7.01","date":"23. January 2014","format":false,"excerpt":"{:en}It has been told to me and I've seen it in some environments... with DP 7.01 it can occur that a sessions hang till forever or the backup is aborted after 7200 second. The message displayed shows IPC errors (i.e error below) as no more data from Disk Agent or\u2026","rel":"","context":"In &quot;HowTo&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2973,"url":"https:\/\/www.data-protector.org\/wordpress\/2016\/04\/hpe-cloud-optimizer\/","url_meta":{"origin":4164,"position":5},"title":"HPE Cloud Optimizer","date":"1. April 2016","format":false,"excerpt":"{:en} It is often found during the backup of virtual machines that performance of a backup job is disappointing. This is not necessarily a Data Protector issue, usually it is a sign for bottle necks in the IT environment you want to fix. At this point HPE can support with\u2026","rel":"","context":"In &quot;SCD&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts\/4164"}],"collection":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/comments?post=4164"}],"version-history":[{"count":27,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts\/4164\/revisions"}],"predecessor-version":[{"id":4214,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts\/4164\/revisions\/4214"}],"wp:attachment":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/media?parent=4164"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/categories?post=4164"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/tags?post=4164"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}