Recently I had a performance assessment capability (& high level proposal) walkthrough discussion with one of our clients. I had several queries regarding the performance analysis activities scoped in for the engagement. Some of them are shared below:
- Who will perform the analysis on the ground?
- You will pinpoint there is a performance degradation issue & from there on is it our responsibility to analyze and fix it?
- My previous vendor helped me only to run the performance tests whereas its our sole responsibility to do any analysis/tuning to meet the performance SLAs ?
- You are quoting 45 person days effort for performance assessment whereas my current vendor did this using 1/3rd of your quoted efforts ?
I parked all those questions saying will revert back while doing walkthrough of the RACI Matrix slide.
When I moved on RACI Matrix slide, all I said is below :
Performance Testing scope of work will always have below characteristics
CLIENT SMEs are Accountable for ensuring application performance
PERFORMANCE TEAM is Responsible only for carrying out / execution of performance tests
CLIENT SMEs are Accountable & Consulted for performance bottleneck analysis and performance team supports by running retests to verify the performance issues are fixed.
PERFORMANCE TEAM is Informed once the performance fix ready for them to carry out retests.
whereas Performance Engineering scope will have the below characteristics
PERFORMANCE TEAM is Responsible for carrying out / execution of performance tests
PERFORMANCE TEAM is Accountable for ensuring the application performance. (Carryout all possible required analysis to meet the performance SLAs set by the business).
CLIENT SMEs are usually Informed & sometimes Consulted (on need basis for some key decision making) during the detailed performance bottleneck analysis.
Now, finally its your choice to demand what to expect from the performance excellence team.
I personally feel its our (Performance Excellence Team's) responsibility to bring awareness among all our stakeholders on these stuff.
Performance benchmarking assignments would have only subset of activities that is quoted as part of Performance testing assignment.
Performance testing assignment would have only a subset of activities that is quoted as part of performance engineering assignment.
As you move up in the ladder (Performance Benchmarking --> Performance Testing --> Performance Engineering), the scope of activities & effort requirement & thereby cost goes high.
Decide what is required based on the performance criticality of the application and budget availability.
Happy Testing!
