Performance Analysis for Javaв„ў Websites

2017-07-07 02:10:07

This checklist corresponds with the requirements covered in Chapter 8. Please refer to the chapter for more detailed descriptions of each requirement.

Website Type:__________________________________________________

Number of Users:_______________________________________________

Key Requirements:______________________________________________

U SER S IMULATION
	Requirement	Do you need this capability? How important is it to you?	Tool A	Tool B
Think time	Record and play back
	Customize at runtime
User load	User ramp-up
	Simulate spikes
Browser simulation	Simulate browser caching
	Simulate clearing cache
	Simulate specific browsers	Which browsers do you need?
	Client IP address simulation	Are you testing IP-based load balancing?
Cookie support	Supports cookies	Does your site use cookies?
	Automatically records and correlates cookies
	Dump cookie cache
Hardware and platform support	Estimated hardware per user	Number of users to simulate
	Controller platforms
	User agent platforms

S CRIPTS
	Requirement	Do you need this capability? How important is it to you?	Tool A	Tool B
Dynamic data	GUI based interface	What types of dynamic data do you need?
	User ID substitution
	Random files
	Random numbers
	Import from DB
Web page parsing	List of links	What support do you need?
	Other dynamic results
Scripting and skill	Scripting language
	Skills needed
Building and weighing scenarios	Run multiple scripts
	Random weighting across scripts
	Combine scripts into longer script
	Run scripts individually
Reuse scripts in production	Production monitoring product

A UTOMATION AND C ENTRALIZED C ONTROL
	Requirement	Do you need this capability? How important is it to you?	Tool A	Tool B
Multiple drivers	Support multiple client simulators	Will your site tests need multiple client drivers?
	Report consolidation
	Command line	Do you need to drive tests from command line?
	Remote control	Do you want to drive tests from remote location?

P RICING AND L ICENSING
	Requirement	Do you need this capability? How important is it to you?	Tool A	Tool B
Licensing terms	Price of controller
	Number of users needed and price
	Flat based license
	Unlimited license
Share users	Share users across controllers	Do you have a lot of tests and/or controllers?
Short- term license	License users by day or week
Existing relationship	Company relationship
	Test tools in use
	Production tools in use

R EPORTING
	Requirement	Do you need this capability? How important is it to you?	Tool A	Tool B
Key results	Average response time
	Granular response time data
	Pages per second
	Transactions per second
	Summary report
	Customizable reports
Steady state	Steady state supported
	Results automatically subset
Real-time charts	Results displayed during test
	Transactions per second
	Response time
	Schedule multiple runs
	Amount of data returned customizable

V ERIFICATION OF R ESULTS
	Requirement	Do you need this capability? How important is it to you?	Tool A	Tool B
Verification of data	Errors reported
	Verify data
	Verify dynamic data
Verification of logs	Verify web server logs	We haven't found a tool that automatically does this.
	Verify application server logs
Monitors	Supported by load test tool	What servers do you need to monitor?
	Monitor any server
	Real-time graphing of monitors
	Reports include monitor data and performance test results
Operating System	Operating Systems	What operating systems are your servers on?
	Network
	HTTP server
	Application server
	Database
	Others	What other applications or middleware do you have?

Категории