4. Process Modeling 4.3. Data Collection for Process Modeling 4.3.5. How can I tell if a particular experiment design is good for my application?
Assess Relative to the Six Design Principles	If you have a design, generated by whatever method, in hand, how can you assess its after-the-fact goodness? Such checks can potentially parallel the list of the six general design principles. The design can be assessed relative to each of these six principles. For example, does it have capacity for the primary model, does it have capacity for an alternative model, etc.
	Some of these checks are quantitative and complicated; other checks are simpler and graphical. The graphical checks are the most easily done and yet are among the most informative. We include two such graphical checks and one quantitative check.
Graphically Check for Univariate Balance	If you have a design that claims to be globally good in k factors, then generally that design should be locally good in each of the individual k factors. Checking high-dimensional global goodness is difficult, but checking low-dimensional local goodness is easy. Generate k counts plots, where the horizontal axis is the factor Xi and the vertical axis is the number of design points for each level in factor Xi. For many designs, these counts should be about the same (= balance) for all levels of a factor. Exceptions exist, but such balance is a low-level characteristic of many good designs.
Graphically Check for Bivariate Balance	If you have a design that claims to be globally good in k factors, then generally that design should be locally good in all pairs of the individual k factors. There are k-choose-2 such pairs. Graphically check such 2-way balance by generating all k-choose-2 pairs plots, where the horizontal axis of a given plot is Xi and the vertical axis is Xj. The response variable Y does NOT come into play in these plots. We are only interested in characteristics of the design, and so only the X's are involved. The 2-way plots of most good designs have a certain symmetric and balanced look about them--all combination points should be covered and each combination point should have about the same number of points.
Check for Minimal Variation:	For optimal designs, metrics exist (D-efficiency, A-efficiency, etc.) which can be computed and which reflect the quality of the design. Further, relative ratios of standard deviations of the estimated coefficients and relative ratios of predicted values can be computed and compared for such designs. Such calculations are more commonly done in computer packages which specialize in the generation of optimal designs (e.g., JMP from SAS).