Six Sigma Quality Resources for Software & Information Technology In association withSix Sigma Advantage, Inc. - Six Sigma Third Wave for Software Development
 Main Site > Software / IT Channel > Methodologies  > DMAIC (Existing Product/Service) Search:
 
 for    
Publications
Marketplace
| iSixSigma
Stuff
| iSixSigma
Blogosphere
| Events
Calendar
| The
Dictionary
| Discussion
Forum
| Find
a Job
| Post
a Job
| Industry
News
| Newsletter
Signup
| Sigma
Calculator
| Online
Surveys
2008 Version! DMAIC Training Slides: 1,176 Slides + Instructor Notes and More for $99.95
iSixSigma Magazine Signup
 iSixSigma Live!  
  iSixSigma Live! Summit
  Agenda
  Registration Info
  Breakthrough Awards
 Free Newsletters!  
  Sign Up Now!
  Manage Subscriptions
  New To Six Sigma?
  Six Sigma Q&A
  Cert. Practice Test
  Problem Solving Wizard
  ISSSP Info
ISSSP Is The Official Six Sigma Society of iSixSigma
 Channels 
  iSixSigma Main
  Europe
  Financial Services
  Healthcare
  Military
 Quality Directory 
  Recent Articles
  Certifications/Awards
  Consultants
  Culture Evolution
  Methodologies
   BPR
   DMAIC
   Kaizen
   Metrics
   Six Sigma
   TQM
   Work-Out
  News & Events
  Organizations
  Product/Service Guides
  Statistics & Analysis
  Tools & Templates
  Voice of the Customer
  Free Whitepapers
 Related Topics 
  Innovation
  Outsourcing/Offshoring
  Business Process Mgt
 Quick Access 
  Help
  Search
  Advertise Here
  Article Archives
  Newsletter Archives
 User Feedback 
  Please suggest site
  improvements.
 
  [ larger form ]

A Six Sigma Case Study-Tutorial for IT Call Center
Part 3 of 6 – The Measure Phase

Bookmark This Page Bookmark This Page
Email This Page Email This Page
Format for Printing Format for Printing
Post a New Term Post A New Term
Cite This Article Cite This Article
Submit an Article Submit an Article
Six Sigma Article Archive Read More Articles
Related Tools & Articles
  • Discussion Forum
    "Is there a way to measure how well a company is adopting a new software development process? Our group is in the process of adoting a standard process towards our goal of CMM level 2. Our current DPMO is at about 180,000 and we are wondering if there is any industry standard/benchmark that we can set as a goal for ourselves."

    Contribute to this Discussion
    <
    Download Products
    TBODY>

    Part 3 of this case study-tutorial applying Six Sigma in an IT call center is about the Measure phase of a DMAIC project. The goal of the project is to make the company more competitive and profitable. Each part follows the project team as it works through another stage of the DMAIC methodology.
    The iSixSigma article archives contain Part 1Part 2, Part 4 and Part 5.

    By David L. Hallowell

    Having developed a good understanding of the project's business case and customer requirements (identifying the Y(s)), and the as-is process, the Six Sigma project team of the IT services business began to focus on the Measure phase. The team identified the measures and data collection plan for gathering the right amount of the right data to impel their learning about root causes and drivers that impact the project Y(s). 

    The DMAIC roadmap called for work in these areas during the Measure phase:

    M1. Refine the Project Y(s): Getting even clearer about how the project's key outcome measure(s) will be defined, measured and reported.

    M2. Define Performance Standards for the Y(s): Identifying how performance will be measured – usually somewhere on the continuum from capability measures like Cp and Cpk for "variables" data that is normally distributed to percentile or other capability metrics for "attribute" and other data that may be skewed in distribution.

    M3. Identify Segmentation Factors for Data Collection Plan: Starting with the natural segmentation of project Y(s) and moving though consideration of prospective driving factors (x's), segmentation suggests the packets of data that should be collected in order compare and contrast segments to shed light on Y root causes and drivers.

    M4. Apply Measurement Systems Analysis (MSA): In any project, raw data is gathered and then converted into measures. That process comprises a "measurement system" that should be characterized and strengthened in terms of its accuracy and repeatability.

    M5. Collect the Data: Gathering data, preserving its meaning and noting any departures from the discipline put in place under MSA.

    M6. Describe and Display Variation in Current Performance: Taking an initial look at the data for its distribution, extreme values and patterns that suggest special variation.

    M1. Refine the Project Y(s)

    During this step the team conisdered exactly how the project Y(s) would be defined and measured:

      Y(s) Measurement

    Primary
    Customer
    Satisfaction
    1. By industry standard monthly survey
    2. The project will require additional, more frequent, case-by-case customer satisfaction data. A measurement system that tracks with the industry survey will be devised and validated.


    Secondary  
    Supprt Cost
    (Per Call)

    The staff time connected with each call:
        - Call answering and discussion
        - Case research
        - Callback time
    will be loaded with a distribution of benefits and infrastructure costs to compute overall support cost per call.




    Related /
    Of Interest



    Days
    to Close

    Wait Time

    Transfers

    Service
    Time
    Time span from call origination through client indication that the issue is closed to their satisfaction.

    Automatically tracked for calls in queue. Summed for calls encountering multiple transfers.

    Automatically tracked for each call moved to another extension.

    Automatically tracked for time from staff call pickup until hangup or transfer.


    M2. Define Performance Standards for the Y(s)

    For each project Y, the current baseline and best-estimate target was documented. In some cases, the team found that good baseline data was unavailable. (Unfortunately that is a common occurrence in DMAIC projects.)

     MeasureCurrent BaselineTarget
    Primary Customer Satisfaction
    (Per Collins Industry Assessment)
    90th Percentile / 70-80% Satisfied
    90th Percentile / 85% Satisfied
    Secondary   Support Cost Per Call90th Percentile / $4090th Percentile / $32


    Related /
    Of Interest

    Days to Close

    Wait Time

    Transfers

    Service Time
    Did Not Have Good Baseline Data

    Did Not Have Good Baseline Data

    Did Not Have Good Baseline Data

    Did Not Have Good Baseline Data
    90th Percentile / 3 Days or Less

    90th Percentile / 4 Minutes

    90th Percentile / 2

    Mean: < 8 Minutes St.Dev.: < 0.5 Minutes


    M3. Identify Segmentation Factors for Data Collection Plan

    The first question was: How is Y naturally segmented? Often Y data is organized by customer type, geographic region, product or service type, etc. Thinking about where the strongest "action" was for the dynamics under study, the team focused its initial data collection effort on the segment(s) that offered the most potential for the team's learning. This helped conserve the limited resources available for data collection and analysis. Instead of "measuring everywhere," the team started with a focused subset of all possible data. The data was naturally segmented by call center – with most of the traffic in one center. Data from that site was used for the initial data collection.

    The next question was: What factors may be driving the Y(s)? Identifying these factors and gathering data on their behavior may shed light on the root causes and drivers for the Y(s). This is the planning part of the Six Sigma drill-down that is sometimes called "peeling the onion." While the fundamental interest is in the Y behavior, the idea is not to truly solve a problem by trying to "fix the Y." That approach might provide a temporary fix. Understanding the underlying drivers (the x's) offers the possibility of addressing the root cause, and fixing the problem so that it will stay fixed.

    A Y-to-x tree depicts the array of lower level x's that may be driving a Y. Other tools with a similar thrust – cause-and-effect diagrams and cause-and-effect matrices (illustrated later) – can be helpful in identifying and prioritizing the prospective x's for data collection and study.

    The team's Y-to-x trees for support cost and customer satisfaction are shown in Figures 1 and 2.

     Figure 1: Y-to-x Tree for Support Cost

     Figure 2: Y-to-x Tree for Customer Satisfaction

    Input-Output Analysis

    Building on the information developed in the SIPOC / COPIS table, the team reviewed process inputs and outputs, classifying each as "controlled" (with process provisions in place to measure and influence that input or output, if necessary) or "uncontrolled" (with no such provisions in place). See Figure 3.

     Figure 3: Process Inputs and Outputs Classified as Controlled or Uncontrolled

    Cause-and-Effect Matrix

    To further explore potentially influential factors, the team created a Cause-and-Effect Matrix (Figure 4). The high scoring items in this analysis were strongly considered for data collection. The highest, "Available Staff for Transfer," was included. The next highest scoring, "Staff Experience/Training" was not readily available in the historic database. (There had been reluctance to log personal data as part of the ongoing call logging.)

     Figure 4: Cause-and-Effect Matrix

    M4. Apply Measurement Systems Analysis (MSA)

    To prepare for the measures to be collected in the next step, the team reviewed the measurement systems. In transactional processes, any activity that gathers raw data and converts it into counts, classifications, numbers or other forms of measure is a "measurement system." While the statistical methodology connected with MSA is beyond the scope of this article (see other references under iSixSigma tools) , Figure 5 depicts the four questions that are usually posed for measurement systems in transactional processes. Viewed simply, the intent of MSA is to strengthen a measurement system so that it is suitably accurate, repeatable, reproducible and stable. A fifth issue, "linearity" (the accuracy of the system over the range of mesaured values), is sometimes considered..

     Figure 5: Questions Usually Posed for Measurement Systems

    M5. Collect the Data

    A plan was formulated to gather data from the past year's database. This required retrieving call data, as well as tracing call resolution times, staffing levels, call volume levels and relevant follow-up events. For each call sampled, the team rebuilt information about staffing, call type, number of transfers, wait time, etc. (Figure 6)

     Figure 6: Format Used to Record Collected Data

    M6. Describe and Display Variation in Current Performance

    A first look at the data coming in provided the team insights about extreme values and patterns suggesting problems with the measurement system. With the information, the team began to forecast what the Analyze phase would reveal. The team's question at this point was: How is the Y Distributed? The team looked for the layout of measured values collected – for symmetry and for extreme values. This suggested the kinds of graphical and statistical analysis that would be appropriate (Figure 7).

     Figure 7: How Is the Y Distributed?

    Data on the call center x measures was graphed and charted a number of ways. Figure 8 shows the variation in customer Wait Times on an Xbar-R control chart. Variation above and below the chart's control limits suggested that there were "special causes" in play – worth understanding in more detail by the team in the Analyze phase.

     Figure 8: Xbar-R Chart of Wait Time

    Part 4 is about the Analyze phase of the project.

    About the Author

    David L. Hallowell, a co-founder and managing partner of Six Sigma Advantage, Inc., has more than 20 years experience as an engineer, manager and master black belt. As Digital's representative to Motorola's Six Sigma Research Institute, he worked on the original courseware for Black Belts and the application of Six Sigma to software. Mr. Hallowell has supported Six Sigma deployments worldwide. With a special focus on Design for Six Sigma, he has led development teams in the concept development and design of a number of commercial products. Mr. Hallowell has patents and publications in the area of microelectronics packaging and high speed interconnect. He has authored courses in software DFSS, design of experiments, C++ and computational intelligence tools. He co-authored Six Sigma Advantage's Black Belt, Green Belt and foundation curriculum. Mr. Hallowell can be reached at dhallowell@6siga.com.

     
    Rate This Article:  Current Rating: 4.30
      Poor    Excellent     
              1    2    3     4    5
    Copyright © 2000-2008 iSixSigma – All Rights Reserved
    Reproduction Without Permission Is Strictly Prohibited – Copyright Requests


    Publish an Article: Do you have a Six Sigma tip, learning or case study?
    Share it with the largest community of Six Sigma professionals, and be recognized by your peers.
    It's a great way to promote your expertise and/or build your resume. Read more about submitting an article.

    BEST SELLING PRODUCTS (iSixSigma Publications)
    1. Certified Lean Six Sigma Green Belt Assessment Exam
      This assessment exam is useful for students interested in assessing their knowledge of Lean Six Sigma on the Green Belt ...
    2. Six Sigma Black Belt (DMAIC) Training Slides
      The 2008 Six Sigma Black Belt course is comprised of: 1,176 PowerPoint slides, Instructor notes, Slide explanations, 37 ...
    3. Six Sigma DMAIC Training Slides
      The complete 2008 Lean Six Sigma DMAIC course prepares participants to perform the role of a LSS Black Belt; covering wh...
    4. Process Management Training Slides
      The 2008 Process Management course is designed in two phases comprised of:352 Powerpoint slidesInstructor notesSlide exp...
    5. Six Sigma Green Belt Training Slides
      The 2008 Six Sigma Green Belt course is comprised of: 1047 slidesInstructor notesSlide explanations35 data sets20 suppo...
    6. Certified Lean Six Sigma Black Belt Assessment Exam
      Interested in assessing your knowledge of Lean Six Sigma? Preparing for certifications? Testing your students and traine...
    7. 5S Training Course
      One of the key fundamental tools of process improvement is 5S. 5S is a methodology for organizing and minimizing item...
     
    Six Sigma AdLinks
    Improve IT Projects With Six Sigma. Villanova University.
    iSixSigma Live! Save up to $700
    iSixSigma Job Shop: Find The Key Person
    Lean Office, Lean IT/IS. Act Now and Save.



    Google AdWords
     
    Home | Discussion Forum | Event Calendar | Job Shop
    Link To iSixSigma | Rate This Page | Report A Problem | Free Content For Your Site | Submit Article For Publishing
     Terms of Service. ©2000-2008 iSixSigma. All rights reserved. v3.0lb, 2.3-C-246
    About iSixSigma · Contact Us · Privacy Policy · Site Map
    nogeo