soatest培训手册loadtest-training

《soatest培训手册loadtest-training》由会员分享，可在线阅读，更多相关《soatest培训手册loadtest-training（20页珍藏版）》请在装配图网上搜索。

1、Parasoft LoadTest Agenda Load Testing Introduction - Why Load Test? Creating and performing a SOA-based Load Testing Customizing LoadTest Machines Profiles Scenarios Monitors Command-line execution Viewing reports Review infrastructure and procedures - TBD Load Testing First Review the SLA Identify

2、the criteria of the SLA Why are we Load testing? What are the details of the SLA? What is being guaranteed? E.g. # of sessions What are the sequences in a session? Are there performance/timing requirements? What is the distribution of session Build the Model in Parasoft LoadTest Establish the distri

3、bution of Load profiles (session types) Establish the SLA metrics (Quality of Service), e.g. timing of the session or session components, as specified in the SLA Load Testing Validate the SLA Process the results of Parasoft LoadTest Results within defined metrics success Results outside of defined m

4、etrics failure Where is the problem? Hardware or Software Use monitors to diagnose the system Ensure ongoing maintenance of the SLA Schedule periodic testing of the live system Small scale tests during normal execution to ensure metrics are within defined parameters Results go to Parasoft Concerto f

5、or monitoring Failures go out as emails for alerts Quick Example using LoadTest Wizard Start LoadTest: Start Program Files SOAtest LoadTest 9.2 1. Create Load Test from SOAtest TST file 2. Select Test Suites for Load Profile(s) 3. Define Load Schedule/Scenario 4. Select Monitors (optional - skip) 5.

6、 Select Quality of Service criteria 6. Add Load Machines (optional skip) 7. Select Start Immediately, Record Individual Hits, Click Finish Review progress during the run and report data at the end LoadTest Configuration - Machines Define a LoadTest cluster to generate greater load Distribute generat

7、ed load across machines Use High-throughput mode to put the system under stress (no validations) Use regular mode to validate system behavior Start on Linux machines: loadtest -loadtestserver portnumber Documentation: Load Test Command Line Interface (cli) Starting the Load Test Server on Remote Mac

8、hines Test Application LT Master LT Server LT Server LT Server LT Probe Distributes Load Generation Request/Response Pairs Validates functional behavior when the system is under load Provides High throughput tests to put system under load Load Test Infrastructure: Master & Servers Load Test Infrastr

9、ucture: Load Balancer and Server Instances Master (Validating Responses) LoadTest Servers (High throughput load) Load Balancer Service Instances LoadTest Configuration - Profiles Defines SOAtest Test Suites/Scenarios used/controlled Control delays between invocations End to Begin How long after the

10、end before start another Begin to Begin How long after start before start another One SOAtest TST file used to define a LoadTest project (select Profiles folder). What Environment is used How data sources to be used by virtual users and distributed How setup tests are to be run NOTE: If you need to

11、run tests from multiple TST files, create a TST for Load testing that has referenced test suites LoadTest Configuration - Scenarios Defines how the Load test is to be performed Control parameter Virtual Users or Hits Per Second (Tests Per Second) Duration of the a test Distribution over time, profil

12、es and machines Quality of Service Metrics (expand a Scenario) Defines success of the Load test Numerous categories of QoS metric Reporting and Automated Stopping (select Scenarios Folder) What data to record When to stop if there is a problem Difference between VUs and HPS Example Avg. Service Resp

13、onse time = 2 seconds Load Test Duration = 180 seconds Scenario: VUs = 5vu Total Transaction Count = (duration / response time) * # of VUs Example: 180 / 2 * 5 = 450 Scenario: HPS = 3 Total Transaction Count (Duration * HPS) Example: 180 * 3 = 540 QoS: Execution vs. Server Time Execution time: Inclu

14、des the time to transmit the request and receive the response Server time: Time from last byte out to first byte in Last byte of response received Firs Message in transit Service is “thinking” Message in transit Last byte of request sent First t Understanding Timing Data Web Application LT Server Ti

15、me Request Send Time Response Receive Time Server Time Execution Time LoadTest Configuration - Monitors Monitors system information from the infrastructure and correlates with over the wire data Types: Windows Perf Mon JMX WebLogic/WebSphere SNMP rstat (requires additional licensing from 3rd party)

16、Custom (Java, JavaScript, Jython) http:/ SOAtest Scripting Examples Scripting Custom Load Testing Monitors Documentation: Using SNMP, Windows, JMX, rstat, and Custom Monitors Adding Monitors Adding Custom Monitors Load Test Infrastructure: Monitors Master (Validating Responses) LoadTest Servers (Hig

17、h through-put load) Load Balancer Service Instances Monitors on remote machines send metrics/stats back to the Master Custom Monitor Example Jython Example: using java.lang.Runtime object to get the current memory status of the JVM. from java.lang import Runtime def getTotalMemory(): return Runtime.

18、getRuntime().totalMemory() / (1024 * 1024) def getFreeMemory(): return Runtime.getRuntime().freeMemory() / (1024 * 1024) def getUsedMemory(): return getTotalMemory() - getFreeMemory() Reports LoadTest Binary Report Interactive report viewable in LoadTest Summary, Statistics, QoS metrics Detailed int

19、eractive graphs Filter data based on machine, profile, test View Errors, drill into data Export data for selected transactions Compare results between different runs Create composite reports with saved binary reports Reports Defining HTML Reports Build custom HTML report Specify Tables and Graphs to

20、 be included Right Mouse Menu View Report Configuration View/Save HTML report Right Mouse Menu View Report or Save As Command-line Automation LoadTest command line calls command file loadtest -cmd -run loadtest.cmd Command file opens LoadTest .lt file and executes the loadtest Open FilePath loadtest

21、 -minutes Number -vus Number | -hps Number -report reportFile.rpt -html htmlDirectory ScenarioName Documentation: Load Test Command Line Interface (cli) Running Load Tests Reports LoadTest Continuum LoadTest Continuum = Concerto plugin Command line sends data to the LTC Select Specific project click refresh if project not available Stores History, HTML and Binary reports for each Test