Next Page Previous Page Handbook Home Tools & Aids Search Handbook
4. Process Modeling
4.4. Data Analysis for Process Modeling
4.4.3. How are estimates of the unknown parameters obtained?

4.4.3.2.

Weighted Least Sum of Squares

As mentioned in Section 4.1, weighted least sum of squares (WLSS) regression is useful for estimating the values of model parameters when the data points being used differ in quality from one another on average. As suggested by the name, parameter estimation by the method of weighted least sum of squares is closely related to parameter estimation by "regular", "unweighted" or "equally-weighted" least sum of squares.
General WLSS Criterion In weighted least squares parameter estimation, as in regular least squares, the unknown values of the parameters, , in the regression function are estimated by finding the numeric values for the parameters that minimize the sum of the squared deviations between the observed responses and the functional portion of the model. Unlike least squares, however, each term in the weighted least squares criterion includes an additional weight, , that determines how much each observation in the data set influences the final parameter estimates. The weighted least sum of squares criterion that is minimized to obtain the parameter estimates is


Some Points Mostly in Common with Regular LSS (But Not Always!!!) Like regular least squares estimates:
  1. The weighted least squares estimates are denoted by to emphasize the fact that the estimates are not the same as the true values of the parameters.

  2. are treated as the variables in the optimization while values of the response and predictor variables and the weights are treated as constants.

  3. The parameter estimates will be functions of both the predictor and response variables and will generally be correlated with one another. (WLSS estimates are also functions of the the weights, .)

  4. Weighted least squares minimization is usually done analytically for linear models and numerically for nonlinear models.
Handbook Home Tools & Aids Search Handbook Previous Page Next Page