Review Effectiveness of Various SDLC Phases

Kishore.Mavuri's picture

I am presenting here a small methodology to measure the effectiveness of Reviews in various phases of a Project Lifecycle.

For this mechanism to work, there should be a pre-defined condition that, ROOT_CAUSE_PHASE is available for every issue/bug/defect encountered throughout the Project Life-cycle. (It is advisable to find the Root-cause_Phase during the correction stage of every issue/bug/defect). Only the valid issues/bugs/defects are to be considered here. For this method to be more efficient, I suggest the inclusion of the Review Defects of all Documents in the Project Life Cycle.

Let us suppose we have 'n' defined phases P1, P2, P3,... Pn (phases like Requirements, High Level Design, Low level Design, Coding, Integration, Testing, Functional Testing, UAT, Maintenance).

Hence, for every issue/bug/defect, the possible Root-cause_phases are P1, P2, .... , Pn.

Once we have the phase-wise issue/bug/defect data along with the respective root-causes, we can find the Review Effectiveness with the following formula,

Checkpoint Review Effectiveness of Phase 'Pn' = (No. of defects found after the phase 'Pn' with root-cause_phase 'Pn')/(Total number of defects with the root-cause_phase 'Pn')

In ideal case, this value should be 1.0 which means we have an absolute effective review mechanism in place for that phase. If the value is below the Xpected value (Xpected values can be derived with the data from previous Projects) the Checkpoint review mechanism is to be altered as per the need (by introducing more checklists or by introducing more strict reviews,... etc).

With this we can arrive at basic level of review effectiveness values for all phases. These values are very much useful for the SEPG/Process_Groups. Also for top management who wants to know the phase_wise performances. And is used as input for reviewing the review mechanism of the system.

Plz give your comments at Kishore.Mavuri@gmail.com

Regards,
Kishore Mavuri

pradips's picture
Good post we can use the

Good post

we can use the following formulas for calculating the review efficiency

1. Review efficiency = No of defects identified during reviews / Total no of defect

Am i correct?

Submitted by pradips on February 4, 2010 - 3:18am.
Kishore.Mavuri's picture
Nope... That would not give

Nope... That would not give a proper info... Coz, defects may arrive from n-number of ways... The more possibilities, the less this value is... and there can be many other way of defect finding, The fact here is Reviews solely cant find defects.
Kishore Mavuri

Submitted by Kishore.Mavuri on February 4, 2010 - 6:25am.
pradips's picture
I agree to ur point that the

I agree to ur point that the defects may arrive from many ways but what i am feeling is "by doing proper reviews we can reduce 75 % of defects in the product

Submitted by pradips on February 5, 2010 - 8:52am.
csqa's picture
Good post Kishore, basic

Good post Kishore, basic hygiene like defect management system is required to achieve this.

Submitted by csqa on February 2, 2010 - 4:56pm.