{"id":3126,"date":"2016-06-24T13:04:57","date_gmt":"2016-06-24T12:04:57","guid":{"rendered":"https:\/\/www.data-protector.org\/wordpress\/?p=3126"},"modified":"2016-07-20T16:17:50","modified_gmt":"2016-07-20T15:17:50","slug":"storeonce-performance-measure-theoretical-throughput","status":"publish","type":"post","link":"https:\/\/www.data-protector.org\/wordpress\/2016\/06\/storeonce-performance-measure-theoretical-throughput\/","title":{"rendered":"StoreOnce Performance &#8211; measure the theoretical throughput"},"content":{"rendered":"<p><b>Update 2016\/07\/20:<\/b> The procedure below explains how to measure the throughput for a single stream. If you select two or more files from different mount-points you can measure the performance for multiple streams. The procedure could be useful to assess the bandwidth utilization when using a known number of streams. And when running different tests using source-side and target-side deduplication you can compare the different deduplication methods available in Data Protector. In addition the result might be useful to estimate\/calculate how many CPU, RAM and LAN resources would be required on a given gateway.<\/p>\n<p>There is always a challenge for backup administrators to achieve the best performance and throughput during backups. That&#8217;s why I wrote many articles on how to test performance for different devices in Data Protector. Tools like &#8220;HPE LTT Tools&#8221; can be used for tape devices and measure the throughput. The good old HPCreateData and HPReadData usually will be used to measure the throughput on flesystems. So, how can you measure the theoretical throughput to StoreOnce when the Catalyst protocol is used along with HPE Data Protector, and without running a real backup to StoreOnce? The answer is simulating data instead reading data from filessystems. The &#8220;how to&#8221; below explain the steps required to do the tests. Of course, the measured throughput will differ from what you would get when doing the regular backup.<\/p>\n<p><b>How To:<\/b><\/p>\n<ul>\n<li>First you need to have a StoreOnce Gateway created. you should use a new Store during your tests in order to easily delete it afterwards. In addition you should used Target Side Deduplication for testing the performance. See picture as an example &#8211; if you need more details on StoreOnce, drop me a mail&#8230;<br \/>\n\t<a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf1.png\" target=\"soperf1\"><img src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf1.png\" alt=\"soperf1\"\/><\/a>\n\t<\/li>\n<li>Now you prepare a new backup specification, you only need to select one single file. As backup target use the device you created in first step. No other options or scheduling required, except for changing the default protection to none.<br \/>\n\t<a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf2.png\" target=\"soperf2\"><img src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf2.png\" alt=\"soperf2\"\/><\/a>\n\t<\/li>\n<li>On the Media Agent you need to temporarily add and save new parameters to the configuration file <code>.omnirc\/omnirc<\/code> (Linux\/Windows). <b>Please note:<\/b> use the parameter only during the performance test and make sure no other backups are running at the same time using the specified Media Agent. If you forget to change back, all future &#8220;backups&#8221; using this Media Agent have to be seen as not successfull.<br \/>\n<blockquote style=\"font: 12px Courier; background-color: #ffffff; border: 1px solid #ccc; border-radius: 6px; box-shadow: 1px 1px 1px #ccc;\">\n<pre style=\"border: 0px; background-color: #ffffff;\">\r\nOB2SIMULATEDATA=1\r\nOB2SIMULATEDFILESIZE=51200\r\n\t<\/pre>\n<\/blockquote>\n<p>\tThe first parameter will simulate data, the second parameter is the size of the data to be simulated, in this example 50 GB. If you wanna test physical devices, nul devices or file libraries, you could add the additional parameter <code>OB2BMASTATISTICS=2<\/code> in order to enable advanced statistics in the session messages.<\/li>\n<li>If you start the created backup specification no data are backed up, instead they are simulated.<br \/>\n<blockquote style=\"font: 12px Courier; background-color: #ffffff; border: 1px solid #ccc; border-radius: 6px; box-shadow: 1px 1px 1px #ccc;\">\n<pre style=\"border: 0px; background-color: #ffffff;\">\r\n[Warning] From: VBDA@w2012r2dp \"C:\"  Time: 24.06.2016 07:44:17\r\n \tSimulating backup data instead of reading it from object: \r\n\tC:\\_Perftest\\make a backup of this file.txt \r\n\t<\/pre>\n<\/blockquote>\n<\/li>\n<li>\n\tUsing omnispeed (refer to <a href=\"https:\/\/www.data-protector.org\/wordpress\/downloads\/\" target=\"downloads\">Downloads<\/a>) you can calculate the average throughput. During the test I used the StoreOnce Laptop Demo, hence the achieved throughput does not aply to productive environments.<\/p>\n<blockquote style=\"font: 12px Courier; background-color: #ffffff; border: 1px solid #ccc; border-radius: 6px; box-shadow: 1px 1px 1px #ccc;\">\n<pre style=\"border: 0px; background-color: #ffffff;\">\r\n*******************************************************************************\r\n*                                                                             *\r\n* OMNISPEED v 2.00 - Average Speed of DP Sessions                             *\r\n*                                                                             *\r\n* CoPyRiGhT (c) 2014  Data-Protector.org - Daniel Braun                       *\r\n*                                                                             *\r\n*******************************************************************************\r\nStarting script on: w2012r2dp - 24.06.2016, 13:25:39\r\nInit environment ... Done.\r\n\r\nGet details for historic session: 2016\/06\/24-1\r\nSessionID       Type            Status                 GB\/h    MB\/s    Dura Drv\r\n                                                        sum             min   #\r\n===============================================================================\r\n2016\/06\/24-1    BACKUP          COMPLETED            520.23  147.98    5.77   1\r\n\t<\/pre>\n<\/blockquote>\n<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Update 2016\/07\/20: The procedure below explains how to measure the throughput for a single stream. If you select two or more files from different mount-points you can measure the performance for multiple streams. The procedure could be useful to assess the bandwidth utilization when using a known number of streams. And when running different tests [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":3134,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"spay_email":""},"categories":[191],"tags":[],"translation":{"provider":"WPGlobus","version":"2.8.8","language":"en","enabled_languages":["en","de"],"languages":{"en":{"title":true,"content":true,"excerpt":false},"de":{"title":false,"content":true,"excerpt":false}}},"jetpack_featured_media_url":"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf3.png","jetpack_shortlink":"https:\/\/wp.me\/p28cjj-Oq","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":1588,"url":"https:\/\/www.data-protector.org\/wordpress\/2013\/09\/backup-performance\/","url_meta":{"origin":3126,"position":0},"title":"Backup performance","date":"23. September 2013","format":false,"excerpt":"{:en}If it matters, you had better trust on HP Data Protector to get fast backups and to achieve your backup windows. During the implementation of a StoreOnce appliance with a partner of HP, the following performance values were achieved (see pictures below). The environment: a backup of 5 virtual machines\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1960,"url":"https:\/\/www.data-protector.org\/wordpress\/2014\/04\/special-whitepaper-protecting-ms-sql-server-hp-storeonce-catalyst-data-protector\/","url_meta":{"origin":3126,"position":1},"title":"Special Whitepaper &#8211; Protecting MS SQL Server \/ HP StoreOnce Catalyst \/ Data Protector","date":"17. April 2014","format":false,"excerpt":"{:en}In the past we learned from different whitepaper how to optimize the deduplication ratio for different applications and data types. And different whitepaper are available at HP.com, explaining the settings to optimize the backup to a StoreOnce system using Catalyst and HP Data Protector (Please note: most of the settings\u2026","rel":"","context":"In &quot;Data Protector Links&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1432,"url":"https:\/\/www.data-protector.org\/wordpress\/2013\/06\/hp-data-protector-8-00-announced\/","url_meta":{"origin":3126,"position":2},"title":"HP Data Protector 8.00 announced","date":"13. June 2013","format":false,"excerpt":"{:en}During the event \"Discover\" HP announced the newest version of Data Protector - 8.00. The main approach is scalability for HP's latest version of backup and recovery software. More than thousand clients can be protected by Data Protector, up to 1000 sessions can run concurrently, up to 100000 sessions per\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":921,"url":"https:\/\/www.data-protector.org\/wordpress\/2012\/04\/data-protector-7-0\/","url_meta":{"origin":3126,"position":3},"title":"Data Protector 7.0","date":"16. April 2012","format":false,"excerpt":"{:en}HP releases the new version of Data Protector - version 7.0. starting on 2012\/04\/16. The download will be available as usual from the HP DP site, orders for DVD media can be placed starting on 2012\/05\/01. As always, customers with a valid system handle are able to get the new\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1626,"url":"https:\/\/www.data-protector.org\/wordpress\/2013\/10\/storeonce-put-smile-face\/","url_meta":{"origin":3126,"position":4},"title":"StoreOnce &#8211; put a smile into the face","date":"14. October 2013","format":false,"excerpt":"{:en}We have learned how to use StoreOnce in our environments, we read Best Practice Guides, Whitepaper, Tips, etc. We know that we have to follow some rules when StoreOnce is in place. As a review you may read Mr_T's (HP) blog; maybe it will put a smile into your face\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":834,"url":"https:\/\/www.data-protector.org\/wordpress\/2011\/12\/data-protector-6-21\/","url_meta":{"origin":3126,"position":5},"title":"Data Protector 6 &#8211; Patch Bundle 6.21","date":"23. December 2011","format":false,"excerpt":"{:en}For coming christmas days HP delivers the next Data Protector version. Version 6.2 becomes 6.21 The new version 6.21 is a patch bundle you need to install on your existing DP 6.2 installation. Most important feature is deduplication, which might be known from the HP D2D systems or the StoreOnce\u2026","rel":"","context":"In &quot;DP A.06.00&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts\/3126"}],"collection":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/comments?post=3126"}],"version-history":[{"count":11,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts\/3126\/revisions"}],"predecessor-version":[{"id":3169,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts\/3126\/revisions\/3169"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/media\/3134"}],"wp:attachment":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/media?parent=3126"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/categories?post=3126"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/tags?post=3126"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}