When planning experiments to examine how product performance depends on the design, manufacture and environment of use, there are invariably too few resources to enable a complete investigation of all possible variables (factors). We have developed new algorithms for generating and assessing efficient two-stage group screening strategies which are implemented through a web-based system called GISEL. This system elicits company knowledge which is used to guide the formulation of competing two-stage strategies and, via the algorithms, to provide quantitative assessment of their efficiencies. The two-stage group screening method investigates the effect of a large number of factors by grouping them in a first stage experiment whose results identify factors to be further investigated in a second stage. Central to the success of the procedure is ensuring that the factors considered, and their grouping, are based on the best available knowledge of the product. The web-based software system allows information and ideas to be contributed by engineers at different sites and allows the experiment organizer to use these expert opinions to guide decisions on the planning of group screening experiments. The new group screening algorithms implemented within the software give probability distributions and indications of the total resource needed for the experiment. In addition, the algorithms simulate results from the experiment and estimate the percentage of important or active main effects and interactions that fail to be detected. The approach is illustrated through the planning of an experiment on engine cold start optimization at Jaguar Cars.

1.
Meyer, M. A., and Booker, J. M., 2001, Eliciting and Analyzing Expert Judgment, ASA-SIAM, Philadelphia.
2.
Box
,
G. E. P.
, and
Meyer
,
R. D.
,
1993
, “
Finding the Active Factors in Fractionated Screening Experiments
,”
J. Quality Technol.
,
25
, pp.
94
105
.
3.
Chipman
,
H.
,
1996
, “
Bayesian Variable Selection With Related Predictors
,”
The Canadian Journal of Statistics
,
24
, pp.
17
36
.
4.
Grimshaw
,
S. D.
,
Collings
,
B. J.
,
Larsen
,
W. A.
, and
Hurt
,
C. R.
,
2001
, “
Eliciting Factor Importance in a Designed Experiment
,”
Technometrics
,
43
, pp.
133
146
.
5.
Cooke, R. M., 1991, Experts in Uncertainty: Opinion and Subjective Probability in Science, Oxford University Press, New York.
6.
Hoffman
,
R. R.
,
Shadbolt
,
N. R.
,
Burton
,
A. M.
, and
Klein
,
G.
,
1995
, “
Eliciting Knowledge from Experts: A Methodological Analysis
,”
Organisational Behavior and Human Decision Processes
,
62
, pp.
129
158
.
7.
Helmer, O., 1968, “Analysis of the Future: The Delphi Method,” Technological Forecasting for Industry and Government, Bright, J., ed., Prentice-Hall, Englewood Cliffs, N.J., pp. 116–134.
8.
Adler, M., and Ziglio, E., eds., 1996, Gazing into the Oracle: The Delphi Method and Its Application to Social Policy and Public Health, Jessica Kingsley, London, UK.
9.
Crowder, R., Hughes, G., and Hall, W., 2003, “An Agent Based Approach to Finding Expertise in the Engineering Design Environment,” Proc. 14th International Conference on Engineering Design, A. Folkeson et al., eds.
10.
Chipman
,
H.
,
Hamada
,
M.
, and
Wu
,
C. F. J.
,
1997
, “
A Bayesian Variable-Selection Approach for Analysing Designed Experiments With Complex Aliasing
,”
Technometrics
,
39
, pp.
372
381
.
11.
Lewis
,
S. M.
, and
Dean
,
A. M.
,
2001
, “
Detection of Interactions in Experiments on Large Numbers of Factors” (with discussion
),
J. R. Stat. Soc. Ser. B. Methodol.
,
63
, pp.
633
672
.
12.
Dean
,
A. M.
, and
Lewis
,
S. M.
,
2002
, “
Comparison of Group Screening Strategies for Factorial Experiments
,”
Comput. Stat. Data Anal.
,
39
, pp.
287
297
.
13.
Myers, R. H., and Montgomery, D. C., 2002, Response Surface Methodology: Process and Product Optimization Using Designed Experiments, Wiley, New York.
14.
Russell
,
K. G.
,
Lewis
,
S. M.
, and
Dean
,
A. M.
,
2004
, “
Fractional Factorial Designs for the Detection of Interactions Between Design and Noise Factors
,”
Journal of Applied Statistics
,
31
,
545
552
.
You do not currently have access to this content.