{"id":3126,"date":"2016-06-24T13:04:57","date_gmt":"2016-06-24T12:04:57","guid":{"rendered":"https:\/\/www.data-protector.org\/wordpress\/?p=3126"},"modified":"2016-07-20T16:17:50","modified_gmt":"2016-07-20T15:17:50","slug":"storeonce-performance-measure-theoretical-throughput","status":"publish","type":"post","link":"https:\/\/www.data-protector.org\/wordpress\/2016\/06\/storeonce-performance-measure-theoretical-throughput\/","title":{"rendered":"StoreOnce Performance &#8211; measure the theoretical throughput"},"content":{"rendered":"<p><b>Update 2016\/07\/20:<\/b> The procedure below explains how to measure the throughput for a single stream. If you select two or more files from different mount-points you can measure the performance for multiple streams. The procedure could be useful to assess the bandwidth utilization when using a known number of streams. And when running different tests using source-side and target-side deduplication you can compare the different deduplication methods available in Data Protector. In addition the result might be useful to estimate\/calculate how many CPU, RAM and LAN resources would be required on a given gateway.<\/p>\n<p>There is always a challenge for backup administrators to achieve the best performance and throughput during backups. That&#8217;s why I wrote many articles on how to test performance for different devices in Data Protector. Tools like &#8220;HPE LTT Tools&#8221; can be used for tape devices and measure the throughput. The good old HPCreateData and HPReadData usually will be used to measure the throughput on flesystems. So, how can you measure the theoretical throughput to StoreOnce when the Catalyst protocol is used along with HPE Data Protector, and without running a real backup to StoreOnce? The answer is simulating data instead reading data from filessystems. The &#8220;how to&#8221; below explain the steps required to do the tests. Of course, the measured throughput will differ from what you would get when doing the regular backup.<\/p>\n<p><b>How To:<\/b><\/p>\n<ul>\n<li>First you need to have a StoreOnce Gateway created. you should use a new Store during your tests in order to easily delete it afterwards. In addition you should used Target Side Deduplication for testing the performance. See picture as an example &#8211; if you need more details on StoreOnce, drop me a mail&#8230;<br \/>\n\t<a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf1.png\" target=\"soperf1\"><img src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf1.png\" alt=\"soperf1\"\/><\/a>\n\t<\/li>\n<li>Now you prepare a new backup specification, you only need to select one single file. As backup target use the device you created in first step. No other options or scheduling required, except for changing the default protection to none.<br \/>\n\t<a href=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf2.png\" target=\"soperf2\"><img src=\"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf2.png\" alt=\"soperf2\"\/><\/a>\n\t<\/li>\n<li>On the Media Agent you need to temporarily add and save new parameters to the configuration file <code>.omnirc\/omnirc<\/code> (Linux\/Windows). <b>Please note:<\/b> use the parameter only during the performance test and make sure no other backups are running at the same time using the specified Media Agent. If you forget to change back, all future &#8220;backups&#8221; using this Media Agent have to be seen as not successfull.<br \/>\n<blockquote style=\"font: 12px Courier; background-color: #ffffff; border: 1px solid #ccc; border-radius: 6px; box-shadow: 1px 1px 1px #ccc;\">\n<pre style=\"border: 0px; background-color: #ffffff;\">\r\nOB2SIMULATEDATA=1\r\nOB2SIMULATEDFILESIZE=51200\r\n\t<\/pre>\n<\/blockquote>\n<p>\tThe first parameter will simulate data, the second parameter is the size of the data to be simulated, in this example 50 GB. If you wanna test physical devices, nul devices or file libraries, you could add the additional parameter <code>OB2BMASTATISTICS=2<\/code> in order to enable advanced statistics in the session messages.<\/li>\n<li>If you start the created backup specification no data are backed up, instead they are simulated.<br \/>\n<blockquote style=\"font: 12px Courier; background-color: #ffffff; border: 1px solid #ccc; border-radius: 6px; box-shadow: 1px 1px 1px #ccc;\">\n<pre style=\"border: 0px; background-color: #ffffff;\">\r\n[Warning] From: VBDA@w2012r2dp \"C:\"  Time: 24.06.2016 07:44:17\r\n \tSimulating backup data instead of reading it from object: \r\n\tC:\\_Perftest\\make a backup of this file.txt \r\n\t<\/pre>\n<\/blockquote>\n<\/li>\n<li>\n\tUsing omnispeed (refer to <a href=\"https:\/\/www.data-protector.org\/wordpress\/downloads\/\" target=\"downloads\">Downloads<\/a>) you can calculate the average throughput. During the test I used the StoreOnce Laptop Demo, hence the achieved throughput does not aply to productive environments.<\/p>\n<blockquote style=\"font: 12px Courier; background-color: #ffffff; border: 1px solid #ccc; border-radius: 6px; box-shadow: 1px 1px 1px #ccc;\">\n<pre style=\"border: 0px; background-color: #ffffff;\">\r\n*******************************************************************************\r\n*                                                                             *\r\n* OMNISPEED v 2.00 - Average Speed of DP Sessions                             *\r\n*                                                                             *\r\n* CoPyRiGhT (c) 2014  Data-Protector.org - Daniel Braun                       *\r\n*                                                                             *\r\n*******************************************************************************\r\nStarting script on: w2012r2dp - 24.06.2016, 13:25:39\r\nInit environment ... Done.\r\n\r\nGet details for historic session: 2016\/06\/24-1\r\nSessionID       Type            Status                 GB\/h    MB\/s    Dura Drv\r\n                                                        sum             min   #\r\n===============================================================================\r\n2016\/06\/24-1    BACKUP          COMPLETED            520.23  147.98    5.77   1\r\n\t<\/pre>\n<\/blockquote>\n<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Update 2016\/07\/20: The procedure below explains how to measure the throughput for a single stream. If you select two or more files from different mount-points you can measure the performance for multiple streams. The procedure could be useful to assess the bandwidth utilization when using a known number of streams. And when running different tests [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":3134,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"spay_email":""},"categories":[191],"tags":[],"translation":{"provider":"WPGlobus","version":"2.8.8","language":"en","enabled_languages":["en","de"],"languages":{"en":{"title":true,"content":true,"excerpt":false},"de":{"title":false,"content":true,"excerpt":false}}},"jetpack_featured_media_url":"https:\/\/www.data-protector.org\/wordpress\/wp-content\/uploads\/2016\/06\/soperf3.png","jetpack_shortlink":"https:\/\/wp.me\/p28cjj-Oq","jetpack_sharing_enabled":true,"jetpack-related-posts":[{"id":1588,"url":"https:\/\/www.data-protector.org\/wordpress\/2013\/09\/backup-performance\/","url_meta":{"origin":3126,"position":0},"title":"Backup performance","date":"23. September 2013","format":false,"excerpt":"{:en}If it matters, you had better trust on HP Data Protector to get fast backups and to achieve your backup windows. During the implementation of a StoreOnce appliance with a partner of HP, the following performance values were achieved (see pictures below). The environment: a backup of 5 virtual machines\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2042,"url":"https:\/\/www.data-protector.org\/wordpress\/2014\/07\/physical-tape-vs-virtual-tape\/","url_meta":{"origin":3126,"position":1},"title":"Physical Tape vs. Virtual Tape","date":"13. July 2014","format":false,"excerpt":"{:en}In a modern Backup & Recovery infrastructure backup-to-disk solutions are used very often. But many customers need to look at capex and opex. With the implementation of modern deduplication technologies these expenses can be decreased very easily. However, to save money, you have to follow some rules, otherwise the backup-to-disk\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2084,"url":"https:\/\/www.data-protector.org\/wordpress\/2014\/08\/storeonce-chases-data-domain\/","url_meta":{"origin":3126,"position":2},"title":"Does StoreOnce chases Data Domain?","date":"13. August 2014","format":false,"excerpt":"{:en} The market for the use of de-dupe technologies in backup & recovery environments is growing, but providers with appropriate solutions become less. The good news: HP is a leader with its StoreOnce systems and is listed in the first \"Magic Quandrant\" for such systems. The hunting to the top\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1819,"url":"https:\/\/www.data-protector.org\/wordpress\/2014\/01\/storeonce-success-story-australia\/","url_meta":{"origin":3126,"position":3},"title":"StoreOnce success story from Australia","date":"27. January 2014","format":false,"excerpt":"{:en}Recently I asked you to share your StoreOnce success story. Here is a awesome story and a good example for federated deduplication from a company in Australia. Before using HP StoreOnce, the company used to protect its data in the two datacentres using HP Data Protector. The data (FileSystems, MS\u2026","rel":"","context":"In &quot;SCD&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2395,"url":"https:\/\/www.data-protector.org\/wordpress\/2015\/09\/future-tape-technology\/","url_meta":{"origin":3126,"position":4},"title":"The future of the Tape Technology","date":"25. September 2015","format":false,"excerpt":"{:en} Many customers continue to rely on tape storage to protect their business critical applications and data. The benefit to continue performing classic backup is obvious: Tape storage is cheap compared with backup-to-disk technolgies. In a TCO consideration lower cost per GB and lower energy costs are speaking for an\u2026","rel":"","context":"In &quot;Common&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1801,"url":"https:\/\/www.data-protector.org\/wordpress\/2014\/01\/storeonce-success-story\/","url_meta":{"origin":3126,"position":5},"title":"Share your StoreOnce success story","date":"17. January 2014","format":false,"excerpt":"{:en}HP StoreOnce, the leading and proofed deduplication technology by HP, helps customers worldwide to solve the current and future requirements for Backup & Recovery. To shorten the backup window, data protection for remote and branch offices, cost reduction and reliability are some hot topics for customers. Now, it's your turn,\u2026","rel":"","context":"In &quot;SCD&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts\/3126"}],"collection":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/comments?post=3126"}],"version-history":[{"count":11,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts\/3126\/revisions"}],"predecessor-version":[{"id":3169,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/posts\/3126\/revisions\/3169"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/media\/3134"}],"wp:attachment":[{"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/media?parent=3126"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/categories?post=3126"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.data-protector.org\/wordpress\/wp-json\/wp\/v2\/tags?post=3126"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}