Review Effectiveness of Various SDLC Phases

Primary tabs

I am presenting here a small methodology to measure the effectiveness of Reviews in various phases of a Project Lifecycle. For this mechanism to work, there should be a pre-defined condition that, ROOT_CAUSE_PHASE is available for every issue/bug/defect encountered throughout the Project Life-cycle. (It is advisable to find the Root-cause_Phase during the correction stage of every issue/bug/defect). Only the valid issues/bugs/defects are to be considered here. For this method to be more efficient, I suggest the inclusion of the Review Defects of all Documents in the Project Life Cycle. Let us suppose we have 'n' defined phases P1, P2, P3,... Pn (phases like Requirements, High Level Design, Low level Design, Coding, Integration, Testing, Functional Testing, UAT, Maintenance). Hence, for every issue/bug/defect, the possible Root-cause_phases are P1, P2, .... , Pn. Once we have the phase-wise issue/bug/defect data along with the respective root-causes, we can find the Review Effectiveness with the following formula, Checkpoint Review Effectiveness of Phase 'Pn' = (No. of defects found after the phase 'Pn' with root-cause_phase 'Pn')/(Total number of defects with the root-cause_phase 'Pn') In ideal case, this value should be 1.0 which means we have an absolute effective review mechanism in place for that phase. If the value is below the Xpected value (Xpected values can be derived with the data from previous Projects) the Checkpoint review mechanism is to be altered as per the need (by introducing more checklists or by introducing more strict reviews,... etc). With this we can arrive at basic level of review effectiveness values for all phases. These values are very much useful for the SEPG/Process_Groups. Also for top management who wants to know the phase_wise performances. And is used as input for reviewing the review mechanism of the system. Plz give your comments at Regards, Kishore Mavuri

csqa's picture

Good post Kishore, basic hygiene like defect management system is required to achieve this.

pradips's picture

Good post

we can use the following formulas for calculating the review efficiency

1. Review efficiency = No of defects identified during reviews / Total no of defect

Am i correct?

Kishore.Mavuri's picture

Nope... That would not give a proper info... Coz, defects may arrive from n-number of ways... The more possibilities, the less this value is... and there can be many other way of defect finding, The fact here is Reviews solely cant find defects.
Kishore Mavuri

pradips's picture

I agree to ur point that the defects may arrive from many ways but what i am feeling is "by doing proper reviews we can reduce 75 % of defects in the product