1 Definition and intuition
A sensitivity coefficient quantifies how strongly an output quantity responds to a change in an input quantity. In practice, it is often computed from a model-defined function and evaluated at a specific operating point, so the coefficient describes local responsiveness rather than behavior far away from that point.
1.1 Basic idea: “change in output per change in input”
If an output \(y\) depends on an input \(x\), a sensitivity coefficient answers the question: when \(x\) shifts slightly, how much does \(y\) move? A large magnitude indicates that small input variations produce noticeable output changes, while a small magnitude indicates relative insensitivity.
1.2 Mathematical forms
Sensitivity coefficients can be written in absolute (unit-preserving) or relative (scale-comparing) forms. The choice depends on whether the goal is to express changes in the same physical units as the output, or to compare different inputs that may have different scales.
1.2.1 Absolute sensitivity (derivative-based)
For a single-variable relationship \(y=f(x)\), the absolute sensitivity at \(x_0\) is often taken as the derivative \[
| S_{\text{abs}}(x_0)=\left.\frac{dy}{dx}\right | _{x=x_0}. |
|---|
\] For multivariable models, absolute sensitivity is typically a partial derivative with respect to the chosen input.
1.2.2 Relative/normalized sensitivity
Relative sensitivity compares output change to input change in a dimensionless way. A common normalized form is \[
| S_{\text{rel}}(x_0)=\left.\frac{x}{y}\frac{dy}{dx}\right | _{x=x_0}, |
|---|
\] which reflects the percentage (fractional) change in output resulting from a percentage (fractional) change in input.
1.3 Where the coefficient is evaluated
Sensitivity coefficients are usually local and therefore depend on the operating point. If the function is nonlinear, the sensitivity generally varies with the point at which the derivative (or normalized derivative) is evaluated. Reporting the evaluation point is therefore essential for interpretability.
1.4 Dimensional analysis and units
Absolute sensitivity inherits units from the ratio of the output units to the input units. For example, if \(y\) has units of meters and \(x\) has units of seconds, then \(dy/dx\) has units of meters per second. Relative sensitivity is often dimensionless because the input and output scalings cancel.
2 Sensitivity coefficient in calculus
In calculus, sensitivity is closely tied to derivatives. For functions with one or multiple variables, the relevant derivative determines how the output changes under small perturbations.
2.1 Partial derivatives for multivariable functions
For a function \(y=f(x_1,x_2,\dots,x_n)\), the sensitivity of \(y\) to \(x_i\) at a given operating point \(\mathbf{x}_0\) is typically \[
| S_i=\left.\frac{\partial y}{\partial x_i}\right | _{\mathbf{x}=\mathbf{x}_0}. |
|---|
\] This coefficient assumes other inputs are held fixed, capturing the effect of changing only \(x_i\).
2.2 Total derivative vs. partial derivative
The total derivative describes how \(y\) changes when inputs vary together. While a partial derivative isolates one variable’s influence, the total derivative includes contributions from all variables via the chain rule: \[ \frac{dy}{dt}=\sum_{i=1}^n \frac{\partial y}{\partial x_i}\frac{dx_i}{dt}. \] In uncertainty propagation, this distinction matters: correlated or jointly varying inputs require a framework that accounts for their combined effects.
2.3 Linear approximations and local behavior
Sensitivities are most directly interpreted through linearization, where the output is approximated by its first-order change near the operating point.
2.3.1 First-order Taylor expansion connection
For a small perturbation \(\Delta x_i\), a first-order Taylor approximation gives \[
| \Delta y \approx \sum_{i=1}^n \left.\frac{\partial y}{\partial x_i}\right | _{\mathbf{x}_0}\Delta x_i. |
|---|
\] Thus, sensitivity coefficients are precisely the slopes that appear in the linearized mapping from input changes to output changes.
2.3.2 Validity range and assumptions
The derivative-based interpretation assumes the perturbations are small enough that higher-order terms remain negligible. When input changes are large or the function has sharp curvature, first-order sensitivities may misrepresent the actual variation, and higher-order analysis becomes necessary.
3 Sensitivity and uncertainty
In uncertainty quantification, sensitivity coefficients are used to connect uncertain inputs to uncertain outputs. The basic workflow is to linearize the model around an operating point and then propagate uncertainty through the resulting approximation.
3.1 Error propagation basics
Given an output \(y=f(\mathbf{x})\) with uncertain inputs \(\mathbf{x}\), a first-order error propagation approach yields an approximate relationship between the variance of \(y\) and the variances of the inputs, mediated by sensitivities. The simplest case assumes small perturbations and differentiability near the evaluation point.
3.2 Using sensitivity coefficients with uncertainties
3.2.1 One-input uncertainty contribution
If only one input \(x_i\) is uncertain with standard deviation \(\sigma_{x_i}\), then the output standard deviation is approximated by \[
| \sigma_y \approx \left | \frac{\partial y}{\partial x_i}\right | \sigma_{x_i}, |
|---|
\] evaluated at the operating point. Here, the absolute magnitude of the sensitivity determines how strongly the input uncertainty transfers to the output.
3.2.2 Multiple inputs and combining effects
When multiple inputs are uncertain, the combined effect depends on whether inputs are treated as independent or correlated. For independent inputs, the variance contributions from each variable add after weighting by squared sensitivities. If correlation is present, cross terms appear, reflecting how co-variations can amplify or partially cancel changes in the output.
3.3 Dominant contributors and ranking sensitivities
Sensitivity coefficients allow practitioners to rank which uncertainties matter most. In many engineering and scientific workflows, the product of a sensitivity magnitude and an uncertainty magnitude indicates the largest contributors, guiding model refinement, calibration priorities, or additional data collection.
3.4 Interpreting sensitivity vs. statistical correlation
Sensitivity captures how the model maps changes in inputs to changes in outputs, while statistical correlation captures how inputs co-vary in the real world or in a probabilistic model. These are distinct concepts: an input with low sensitivity may still significantly affect output if its uncertainty is large or if it is strongly correlated with other influential variables.
4 Relative sensitivity and scaling
Relative sensitivity measures are designed to compare effects across inputs with different units or typical magnitudes. These coefficients highlight fractional responses, which are often more meaningful than absolute slopes in heterogeneous systems.
4.1 Dimensionless sensitivity measures
A dimensionless measure removes unit dependence by scaling derivatives with representative input and output values. This yields a coefficient that can be compared across variables without converting to a common unit system.
4.2 Logarithmic sensitivity
Logarithmic sensitivity uses derivatives of logarithms: \[ \frac{\partial \ln y}{\partial \ln x}. \] This form equals the normalized derivative when \(y\) and \(x\) are positive and differentiable. It directly represents the fractional change in the output associated with a fractional change in the input.
4.3 Comparing sensitivities across different units
When inputs have disparate scales (e.g., volts vs. millimeters), absolute sensitivities can be misleading for comparison. Relative and logarithmic sensitivities provide a consistent basis for judging which variable changes produce the largest fractional effect on the output.
4.4 Choice of reference values
Normalized sensitivity requires reference values (such as the operating point values of \(x\) and \(y\)). Different operating points yield different normalized coefficients, especially in nonlinear models. Selecting an appropriate reference point is therefore a modeling decision tied to the intended regime.
5 Computational methods
Sensitivity coefficients can be computed symbolically, numerically, or through algorithmic differentiation and related techniques. The best method depends on model complexity, availability of derivatives, and computational constraints.
5.1 Analytical derivation
For models with closed-form expressions, derivatives can be derived exactly and evaluated directly. Analytical differentiation provides accuracy and clarity about functional dependence, though it may be time-consuming for complex systems.
5.2 Numerical differentiation
If analytic derivatives are difficult, finite differences can approximate the sensitivity by evaluating the function at slightly perturbed input values.
5.2.1 Step-size selection considerations
Numerical differentiation requires selecting a perturbation size. Too large a step introduces truncation error from nonlinearity; too small a step amplifies floating-point round-off error. Practical strategies often use adaptive step sizes, centered differences, or error checks based on convergence.
5.3 Adjoint and automatic differentiation (overview)
Adjoint methods efficiently compute sensitivities in large-scale systems, particularly when there are many inputs and relatively few outputs (or vice versa, depending on formulation). Automatic differentiation computes derivatives by systematically applying the chain rule to the executed program, typically achieving accuracy comparable to analytic derivatives without symbolic manipulation.
5.4 Sensitivity under discrete simulations
When the model is implemented as a discrete simulation or involves event-driven logic, sensitivities may not be smooth in the usual calculus sense. Approaches include differentiating the underlying continuous components, using smoothed approximations, or estimating sensitivities through repeated perturbation experiments while acknowledging that the resulting coefficients represent local finite-difference behavior.
6 Applications
Sensitivity coefficients are used wherever models translate input variation into output variation, including measurement, experimentation, and system tuning.
6.1 Measurement systems and calibration
In calibration, uncertainties in instrument readings or calibration parameters propagate to uncertainty in derived quantities. Sensitivities identify which calibration constants or sensor parameters most strongly affect final measurement accuracy, supporting improved metrology practices.
6.2 Experimental design and parameter estimation
Sensitivity analysis informs which experiments are most informative. By evaluating how model outputs respond to parameter changes, designers can choose conditions that maximize identifiability and reduce uncertainty in estimated parameters.
6.3 Control systems tuning (general overview)
In control engineering, model sensitivities support tuning decisions by showing how system outputs or performance metrics respond to adjustments of gains, time constants, or other parameters. This helps avoid brittle designs that perform well only near a narrow operating regime.
6.4 Model validation and robustness checks
When validating a model, sensitivity coefficients help test whether the model remains reliable under plausible input variations. Robustness checks can focus on directions in parameter space where sensitivities are large, as these are typically where discrepancies would most strongly affect predictions.
7 Common conventions and notation
Different fields use different symbols and sign conventions. Clear notation is important to prevent misinterpretation, especially when absolute and relative forms are mixed.
7.1 Notation across disciplines
Sensitivity coefficients may be denoted by \(S\), \(\partial y/\partial x\), or other symbols depending on whether authors emphasize derivatives, normalized forms, or ranked measures. Some disciplines reserve “sensitivity” for dimensionless metrics, while others use it for raw derivatives.
7.2 Sign conventions and interpretation
The sign of a derivative indicates direction of response: positive sensitivity means increasing the input tends to increase the output locally, while negative sensitivity implies an inverse relationship. In uncertainty propagation, magnitudes often determine variance contributions, so it is common to use absolute values even when the sensitivity sign matters for mean behavior.
7.3 Converting between absolute and relative forms
Absolute and relative sensitivity are related through scaling by the operating values: \[ S_{\text{rel}} = \left(\frac{x_0}{y_0}\right)S_{\text{abs}}, \] when \(x_0\) and \(y_0\) are nonzero. Conversions therefore require specifying the reference values and ensuring they are consistent with the intended normalization.
7.4 Reporting sensitivity coefficient results
Good reporting includes: the function or model used, the evaluation point, whether sensitivities are absolute or normalized, units (for absolute forms), and the numerical method (if derivative estimates are computed). When uncertainties are involved, reporting how sensitivities were used—such as through first-order propagation—is also expected.
8 Limitations and best practices
Sensitivity coefficients are powerful but not universal. Their reliability depends on differentiability, local linearity, and the appropriateness of how uncertainties are modeled.
8.1 Nonlinear effects and higher-order terms
First-order sensitivities neglect curvature captured by second and higher derivatives. For strongly nonlinear relationships or larger perturbations, higher-order expansions or alternative approaches such as nonlinear uncertainty propagation may provide better accuracy.
8.2 Non-differentiable functions
If the model has discontinuities or corners, derivatives may not exist or may be unstable. In such cases, sensitivity analysis may need to use generalized derivatives, piecewise linearization, or simulation-based perturbation studies.
8.3 Sensitivity to parameter bounds
When inputs are constrained by physical limits or admissible ranges, the effective behavior of the system may be dominated by bound effects rather than local derivatives. If an operating point is near a constraint, perturbations can be truncated, altering the relevance of local sensitivity coefficients.
8.4 Communicating results clearly
Clear communication includes stating assumptions (e.g., small perturbations, local linearity, independence of inputs), listing reference points and units, and distinguishing between model-driven sensitivity and data-driven statistical relationships. Presenting ranked sensitivities alongside uncertainty magnitudes often yields the most actionable interpretation.