Analyze a full factorial design

Use recorded experimental runs to estimate factor effects and interactions.

Guides · Design of experiments (DOE) · 5 min read

Example: pouch-seal strength

22 independent sealing runs: eight two-level combinations repeated on each of two days, plus three center runs per day. A block is one experimental day; keep its column assigned so the model accounts for day differences.

Download the recorded measurements (CSV)

This is the same recorded example used in Help. The CSV contains factor settings and measured responses to import together. Use Open example in a practice copy in Help to prefill the settings.

1. Create the workspace

In the sidebar, open Design of Experiments and create an analysis. Name it, select New blank worksheet, then choose Create analysis.

2. Import the measurements

Download the example CSV above and import it into the worksheet. Choose Comma as the delimiter, Dot as the decimal separator and First row contains column names. Keep each row’s response, factor settings, point type and execution order together.

3. Choose the study and enter factors

On Inputs, choose Analyze existing worksheet for Task and Full factorial for Design family.

Under Factors, use Add factor or remove a row until there are 3 factors. Keep this order and set Type to Numeric for each factor.

Enter the Factor name, Unit, Low and High values below.

FactorFactor nameUnitLowHigh
Ajaw_temperature_c°C150170
Bdwell_time_ss0.81.2
Cjaw_pressure_mpaMPa0.250.35

Leave Numeric levels, optional blank.

4. Assign the input columns

Under Response mappings, open each column picker and select the matching worksheet column.

Worksheet columnInput field
jaw_temperature_cFactor jaw_temperature_c
dwell_time_sFactor dwell_time_s
jaw_pressure_mpaFactor jaw_pressure_mpa

Assign seal_strength_n_per_15mm to Response 1 and enter 1 in Number of responses. Assign run_order to Execution order and point_type to Center point indicator. For Center point column convention, choose Point type (center / factorial / fractional / star / axial / edge / edge_midpoint).

Assign block to Block to keep the two experimental days in the model.

5. Set the model and plots

Under Model, choose Default hierarchical model for Model terms and enter 95 in Confidence level (%). Check Include center-point adjustment in model. Leave Calculate predictions unchecked.

Open Plot options. Check Effect estimates and Residual diagnostics. Leave Response contours unchecked. Leave Pareto view, Effect probability plot, Interaction plot and 3D surface unchecked.

Design of Experiments: Inputs with the example’s assignments and settings
Inputs with the recorded-study mappings, factor bounds, model, confidence level and plot options. View full-size image (opens in a new tab)

6. Analyze worksheet

Choose Analyze worksheet, then open Results. This fits the recorded measurements; it does not generate or randomize a new run plan.

7. Interpret results

  1. Start with the recorded runs

    All 22 sealing runs are included. The eight low/high combinations were repeated on each of two days, with three center runs per day. The model adjusts for the two days. Each response is the measured strength of an independently produced seal.

  2. Check whether the model misses a pattern

    Look at Lack of Fit in Adjusted term ANOVA. Its p-value is 0.9725, so this test does not detect a missing pattern at the 5% level. This does not prove the model is correct. The day effect has p = 0.01595; keep the block adjustment when comparing settings.

  3. Read the effects

    Temperature has the largest fitted high-minus-low effect: about +5.97 N per 15 mm. Dwell adds about +3.99 and pressure +1.25. Temperature × dwell is about +2.65; temperature × pressure is about −1.51. An interaction means the effect of one factor changes with another setting. These main effects do not apply unchanged to every combination.

    Effect estimates
    Fitted high-minus-low effects with 95% confidence intervals. View full-size chart (opens in a new tab)
  4. Read a residual

    A residual is the measured response minus the fitted value. Run 11 measured 23.87 N per 15 mm; the model fitted 22.55, leaving about +1.32 unexplained. This is the largest absolute raw residual. On the plot, look for curves, changing spread or unusual points.

    Residuals versus fits
    Residuals in N per 15 mm against the fitted response. View full-size chart (opens in a new tab)
  5. Check the run sequence

    The horizontal axis follows recorded execution order. Look for drift, cycles or a sudden change in the residuals. A pattern can suggest that the model missed a change during the experiment; the plot does not identify its cause.

    Residuals versus run order
    Residuals in N per 15 mm in recorded execution order. View full-size chart (opens in a new tab)
  6. Choose a confirmation run

    Review the records for unusual runs and compare combinations with their interactions and day adjustment. Confirm a promising, feasible setting with fresh independent seals. The largest main effect alone does not establish the best operating recipe.

More details: read each result section

Complete result tables use six significant digits, as in Help.

Model overview

Analyzed runs is 22; Missing runs is 0. DF counts the information available for the model and residual error. S is the residual standard deviation in N per 15 mm. R² describes variation fitted in these runs; adjusted R² accounts for model size. See Prediction and coefficient detail for PRESS and predicted R². A high R² does not establish model adequacy. Read the lack-of-fit test and residual plots.

Model overview · 12 rows
StatisticValue
Responseseal_strength_n_per_15mm
Analyzed runs22
Missing responses0
Model rank9
Residual degrees of freedom13
S0.565919
R²0.983747
Adjusted R²0.973744
PRESS9.07951
Predicted R²0.964555
Confidence level0.95
Lack of fit availableYes

Adjusted term ANOVA

Source names the model term or error component. Type distinguishes adjusted term tests from totals and error decomposition. DF is degrees of freedom; SS is sum of squares; MS is SS divided by DF. F compares variation with its error estimate; p-value measures evidence against the tested null assumption. Read Lack of Fit before relying on individual effects. A dash means a statistic is not applicable.

Adjusted term ANOVA · 13 rows
SourceTypeDFSSMSFp-value
jaw_temperature_cadjusted1142.325142.325444.3981.95327e-11
dwell_time_sadjusted163.600663.6006198.5882.97481e-9
jaw_pressure_mpaadjusted16.20016.200119.35930.000717766
jaw_temperature_c × dwell_time_sadjusted128.03728.03787.54333.87092e-7
jaw_temperature_c × jaw_pressure_mpaadjusted19.12049.120428.47770.000135106
dwell_time_s × jaw_pressure_mpaadjusted10.2450250.2450250.765070.397618
Blockadjusted12.455572.455577.667310.0159483
Center pointadjusted10.009503030.009503030.02967240.865888
Modelsummary8251.99331.499198.35352.27367e-10
Errorsummary134.163440.320265——
Totalsummary21256.15712.1979——
Pure Errordecomposition42.787130.696783——
Lack of Fitdecomposition91.376310.1529230.219470.972452

Coefficients

Term names a coded model term. Estimate is its fitted coefficient; SE measures uncertainty; t and p-value test a zero coefficient. CI low and CI high bound its 95% interval. Numeric low, midpoint and high settings are coded −1, 0 and +1. With interactions or squares, a main coefficient does not describe the change at every setting.

Coefficients · 9 rows
TermEstimateSEtp-valueCI lowCI high
Intercept22.9350.14148162.1087.05502e-2322.629423.2406
jaw_temperature_c2.98250.1414821.08071.95327e-112.676853.28815
dwell_time_s1.993750.1414814.09212.97481e-91.68812.2994
jaw_pressure_mpa0.62250.141484.399920.0007177660.3168510.928149
jaw_temperature_c × dwell_time_s1.323750.141489.356463.87092e-71.01811.6294
jaw_temperature_c × jaw_pressure_mpa-0.7550.14148-5.336450.000135106-1.06065-0.449351
dwell_time_s × jaw_pressure_mpa0.123750.141480.8746830.397618-0.1818990.429399
Block · contrast 1-0.3340910.120654-2.768990.0159483-0.594749-0.0734329
Center point-0.04666670.270913-0.1722570.865888-0.6319390.538606

Factorial effects

Effect is the fitted high-minus-low contrast. SE measures uncertainty, and CI low and CI high give its 95% interval. Standardized effect is the absolute effect divided by its SE. An interaction means a factor’s effect changes with another setting.

Factorial effects · 6 rows
TermEffectSECI lowCI highStandardized effect
jaw_temperature_c5.9650.282965.35376.576321.0807
dwell_time_s3.98750.282963.37624.598814.0921
jaw_pressure_mpa1.2450.282960.6337031.85634.39992
jaw_temperature_c × dwell_time_s2.64750.282962.03623.25889.35646
jaw_temperature_c × jaw_pressure_mpa-1.510.28296-2.1213-0.8987035.33645
dwell_time_s × jaw_pressure_mpa0.24750.28296-0.3637970.8587970.874683

Row diagnostics

Row ID identifies the worksheet row; Run order locates it in the experiment sequence. Status states whether it was analyzed. Observed is the measurement; Fit is the model value; Residual is Observed minus Fit. Standardized residual adjusts for residual variation and leverage. Leverage measures how unusual the model inputs are. All recorded rows are shown. Investigate an unusual row before changing or excluding it.

Row diagnostics · 22 rows
Row IDRun orderStatusObservedFitResidualStandardized residualLeverage
help-doe-getting-started-11Analyzed18.7218.7872-0.0671591-0.1650390.482955
help-doe-getting-started-22Analyzed28.3828.9097-0.529659-1.30160.482955
help-doe-getting-started-33Analyzed17.8217.69470.1253410.3080170.482955
help-doe-getting-started-44Analyzed22.5322.5542-0.0242424-0.04826050.212121
help-doe-getting-started-55Analyzed22.0922.5222-0.432159-1.0620.482955
help-doe-getting-started-66Analyzed21.8922.5542-0.664242-1.322340.212121
help-doe-getting-started-77Analyzed21.8321.78970.04034090.0991350.482955
help-doe-getting-started-88Analyzed2222.0097-0.00965909-0.02373650.482955
help-doe-getting-started-99Analyzed20.4520.20220.2478410.6090520.482955
help-doe-getting-started-1010Analyzed28.8928.8922-0.00215909-0.005305810.482955
help-doe-getting-started-1111Analyzed23.8722.55421.315762.619340.212121
help-doe-getting-started-1212Analyzed20.6820.8703-0.190341-0.4677490.482955
help-doe-getting-started-1313Analyzed23.4723.22240.2475760.492860.212121
help-doe-getting-started-1414Analyzed18.1818.3628-0.182841-0.4493190.482955
help-doe-getting-started-1515Analyzed22.3223.2224-0.902424-1.79650.212121
help-doe-getting-started-1616Analyzed29.6229.56030.05965910.1466080.482955
help-doe-getting-started-1717Analyzed30.0529.57780.4721591.16030.482955
help-doe-getting-started-1818Analyzed19.5819.45530.1246590.3063410.482955
help-doe-getting-started-1919Analyzed22.6322.6778-0.0478409-0.1175660.482955
help-doe-getting-started-2020Analyzed23.2523.22240.02757580.05489630.212121
help-doe-getting-started-2121Analyzed22.3622.4578-0.0978409-0.2404370.482955
help-doe-getting-started-2222Analyzed23.6823.19030.4896591.20330.482955

Factor coding

Factor names the input and Type its modeling type. Center and Scale translate numeric settings to coded values: (setting − center) / scale. Thus the midpoint is 0 and the entered low/high bounds are −1/+1. Levels / contrasts applies to categorical coding; a dash is not a missing numeric measurement. Keep the model-column, block and rank notes with this table.

Factor coding · 3 rows
FactorTypeCenterScaleLevels / contrasts
jaw_temperature_cnumeric16010—
dwell_time_snumeric10.2—
jaw_pressure_mpanumeric0.30.05—
  • Model columns: Intercept, jaw_temperature_c, dwell_time_s, jaw_pressure_mpa, jaw_temperature_c × dwell_time_s, jaw_temperature_c × jaw_pressure_mpa, dwell_time_s × jaw_pressure_mpa, Block · contrast 1, Center point
  • Rank tolerance: 1e-10
  • Block level: Day_1
  • Block level: Day_2

Coefficient covariance

Read each row and column term together. Diagonal entries are the squared standard errors of the fitted coefficients. Off-diagonal entries describe shared estimation uncertainty. This matrix concerns model coefficients, not correlations between the measured factor columns.

Coefficient covariance · 9 rows
ColumnInterceptjaw_temperature_cdwell_time_sjaw_pressure_mpajaw_temperature_c × dwell_time_sjaw_temperature_c × jaw_pressure_mpadwell_time_s × jaw_pressure_mpaBlock · contrast 1Center point
Intercept0.0200165000-1.73724e-18000-0.0200165
jaw_temperature_c00.02001651.25524e-181.59056e-18-2.37535e-181.14682e-186.87283e-19-3.11116e-192.40441e-19
dwell_time_s01.25498e-180.02001651.41339e-18-8.20222e-182.83927e-18-2.97871e-189.96778e-188.55081e-21
jaw_pressure_mpa01.34066e-181.85008e-180.0200165-8.38039e-191.83585e-19-4.22472e-18-8.36686e-184.86775e-20
jaw_temperature_c × dwell_time_s-1.73724e-18-1.7558e-18-8.74062e-18-7.0199e-190.0200165-2.49201e-186.54714e-18-4.5524e-184.71332e-18
jaw_temperature_c × jaw_pressure_mpa01.09564e-182.83401e-183.04389e-19-1.87779e-180.02001658.66089e-19-4.98088e-19-6.83801e-21
dwell_time_s × jaw_pressure_mpa01.56378e-19-2.08591e-18-3.66915e-187.17073e-185.66413e-190.02001651.36697e-182.63412e-19
Block · contrast 10-3.11116e-199.96778e-18-8.36686e-18-4.5524e-18-4.98088e-191.36697e-180.01455754.24889e-34
Center point-0.02001652.40441e-198.55081e-214.86775e-204.71332e-18-6.83801e-212.63412e-194.24889e-340.073394

Prediction and coefficient detail

PRESS sums leave-one-out prediction errors: each run is predicted by a model fitted without that run. Predicted R² uses those errors. Coefficient covariance records estimation uncertainty; its diagonal entries are squared coefficient standard errors. These diagnostics supplement, rather than replace, lack-of-fit and residual checks.

8. Create a report

Keep Model overview, Adjusted term ANOVA, Coefficients, Coefficient covariance, Row diagnostics and Factor coding, plus the Factorial effects table and effects and residual plots. Include the response units, factor settings, recorded run order and all model notes. Keep the lack-of-fit result with the residual checks; it does not validate the model on its own.

Choose Add to report from the completed run. Open Choose individual items and advanced options to select tables and charts, then choose Add to draft. Hidden items stay in the saved analysis.

Name the report and add the purpose of the study and your interpretation. Choose Save, review Preview, then use Export → Download HTML. The example below contains the full selected content, including results beyond one screen.

Complete native output for this Help example, including applicable tables, charts and run notes. Report numbers use the app’s displayed precision. Exported charts are static. On narrow screens, scroll wide charts and tables sideways.
View example report: Analyze Full factorial: pouch-seal strength

We use Microsoft Clarity to understand how visitors use this website, including session recordings and heatmaps. You can use the website without accepting analytics.

Your choice is saved in this browser for six months. Privacy notice

Current choice: Not chosen.