Numerical Methods with Applications
Front Cover
Information
License
Dedication
Principal Author
Preface
Chapter 01.01: Introduction to Numerical Methods
Lesson: Why Numerical Methods?
Learning Objectives
Introduction
Lesson: Steps of Solving an Engineering Problem
Learning Objectives
Introduction
Problem Description
Simple Mathematical Model
Solution to Simple Mathematical Model
Accurate Mathematical Model
Solution to More Accurate Mathematical Model
Implementing the Solution
Lesson: Overview of Mathematical Processes Covered in This Course
Learning Objectives
Introduction
Roots of a Nonlinear Equation
Simultaneous Linear Equations
Curve Fitting by Interpolation
Numerical Differentiation
Curve Fitting by Regression
Numerical Integration
Numerical Solution of Ordinary Differential Equations
Multiple Choice Test
Problem Set
Chapter 01.02: Quantifying Errors
Lesson: True Error
Learning Objectives
Introduction
What is true error?
Example 1
What is the relative true error?
Example 2
Lesson: Approximate Errors
Learning Objectives
Introduction
What is approximate error?
Example 1
What is the relative approximate error?
Example 2
Lesson: Review of Significant Digits
Learning Objectives
What do we mean by significant digits?
Example
Lesson: Relationship Between Significant Digits Correct and Relative Approximate Error
Learning Objectives
While solving a mathematical model using numerical methods, how can we use the value of relative approximate error to figure out if we have achieved an acceptable answer?
Example 1
Multiple Choice Test
Problem Set
Chapter 01.03: Sources of Error
Lesson: Round-Off Errors
Learning Objectives
Introduction
What is a round-off error?
What problems can be created by round-off errors?
Show an example of how not carrying enough significant digits can affect the solution to a problem?
References
Lesson: Truncation error
Learning Objectives
Introduction
Examples of Truncation Error
Example 1
Example 2
Lesson: Truncation error Extended Examples
Learning Objectives
Can you give me other examples of truncation errors?
Example 1
Example 2
Multiple Choice Test
Problem Set
Chapter 01.04: Fixed-Point Binary Representation of Numbers
Lesson: Introduction to Binary Representation of Numbers
Learning Objectives
Introduction
Example 1
Example 2
Example 3
Lesson: Fixed-Point Binary Representation of Numbers
Learning Objectives
Introduction
Example 1
But what is the mathematics behinds this process of converting a decimal number to binary format?
Example 2
Lesson: Writing a Fixed-Point Binary Number in Given Word Length
Learning Objectives
Introduction
Example 1
Multiple Choice Test
Problem Set
Chapter 01.05: Floating-Point Binary Representation of Numbers
Lesson: Floating-Point Representation Background
Learning Objectives
Introduction
Fixed point representation
Example 1
Floating-point representation
Example 2
Lesson: Introduction to Binary Floating-Point Representation of Numbers
Learning Objectives
How does the floating-point format work for binary representation?
Example 1
Example 2
Example 3
Example 4
Lesson: Binary Floating-Point Representation of Numbers with Biased Exponent
Learning Objectives
What is the floating-point format with a
biased
exponent for binary format? How is it different from the floating-point format with an
unbiased
exponent?
Example 1
Example 2
Appendix
How are numbers represented in floating-point in double precision in a computer?
Lesson: Accuracy of Binary Floating-Point Representation of Numbers
Learning Objectives
How do you determine the accuracy of a floating-point binary format number?
What is the significance of machine epsilon for a student in an introductory course in numerical methods?
Example 1
Appendix
Multiple Choice Test
Problem Set
Chapter 01.07: Taylor Theorem Revisited
Lesson: Introduction to Taylor Series
Learning Objectives
Introduction
Why are applications of Taylor’s theorem important for numerical methods?
Example 1
What does this mean in plain English?
More Examples of Taylor Series
Example 2
Lesson: Application of Taylor Series
Learning Objectives
What You Have Learned So Far
Example 1
Example 2
Example 3
Lesson: Remainder of Taylor Series
Learning Objectives
Introduction
Example 1
Example 2
Multiple Choice Test
Chapter 02.00: Physical Problem for Numerical Differentiation
Lesson: General Engineering
Summary
Modeling
Questions
Lesson: Chemical Engineering
Summary
Modeling
Questions
Lesson: Civil Engineering
Summary
Modeling
Lesson: Computer Engineering
Summary
Modeling
Questions
Lesson: Electrical Engineering
Summary
Modeling
Questions
Lesson: Industrial Engineering
Summary
Modeling
Questions
References
Lesson: Mechanical Engineering
Summary
Modeling
Questions
Chapter 02.01: Prerequisites to Numerical Differentiation
Lesson: Prerequisites to Numerical Differentiation
Learning Objectives
Introduction
Example 1
Example 2
Derivative of a Function
Example 3
Second Definition of Derivatives
Example 4
Higher-Order Derivatives
Example 5
Other Notations of Derivatives
Lesson: Equation of a Tangent Line
Learning Objectives
Finding equations of a tangent line
Example 1
Lesson: Theorems Related to Differentiation
Learning Objectives
Theorems of Differentiation
Theorem 1
Theorem 2
Theorem 3
Theorem 4
Theorem 5
Theorem 6
Table of Derivatives
Chain Rule of Differentiation
Implicit Differentiation
Lesson: Minimum and Maximum of a Function of One Variable
Learning Objectives
Finding maximum and minimum of a function
Example 1
Example 2
Example 3
Applications of Derivatives
Example 4
Example 5
Multiple Choice Test
Problem Set
Chapter 02.02: Numerical Differentiation of Continuous Functions
Lesson: Numerical Differentiation of Continuous Functions - First Derivative
Learning Objectives
Introduction
Forward Difference Approximation of the First Derivative
Example 1
Backward Difference Approximation of the First Derivative
Example 2
Central Divided Difference Approximation of the First Derivative
Example 3
Order of Accuracy of Divided Difference Schemes
Numerical Differentiation of Continuous Functions - Second Derivative
Learning Objectives
Introduction
Example 1
Error Analysis of Finite Difference Approximations
Learning Objectives
Introduction
Example 1
Example 2
Example 3
Richardson’s Extrapolation Formula for Central Divided Difference Approximation of First Derivative
Example 4
Example 5
Appendix
Multiple Choice Test
Problem Set
Chapter 02.03: Numerical Differentiation of Functions Given at Discrete Data Points
Lesson: Numerical Differentiation of Functions Given as Discrete Data Points - First Derivative
Lesson Objectives
Introduction
Example 1
Lesson: Numerical Differentiation of Functions Given as Discrete Data Points - Second Derivative
Learning Objectives
Introduction
Example 1
Lesson: Direct Fit Polynomials to Find Derivatives of Functions Given as Discrete Data Points
Learning Objectives
Introduction
Vandermonde Polynomial
Example 1
Example 2
Lesson: Lagrange Interpolation to Find Derivatives of Functions Given as Discrete Data Points
Learning Objectives
Introduction
Lagrange Polynomial
Example 3
Multiple Choice Test
Problem Set
Chapter 03.00: Physical Problem for Nonlinear Equations
Lesson: General Engineering
Summary
Modeling
Lesson: Chemical Engineering
Summary
Modeling
Lesson: Civil Engineering
Summary
Modeling
Lesson: Computer Engineering
Summary
Modeling
References
Appendix A
Lesson: Electrical Engineering
Summary
Modeling
References
Questions
Lesson: Industrial Engineering
Summary
Modeling
Questions
Lesson: Mechanical Engineering
Summary
Modeling
Chapter 03.01: Prerequisites to Numerical Methods for Solving Nonlinear Equations
Lesson: Review of Quadratic Equations
Learning Objectives
What are quadratic equations, and how do we solve them?
Example 1
Example 2
Multiple Choice Test
Problem Set
Chapter 03.03: Bisection Method for Solving a Nonlinear Equation
Lesson: Background of Bisection Method
Learning Objectives
Introduction
Theorem
Lesson: Bisection Method Algorithm
Learning Objectives
What is the bisection method, and what is it based on?
Theorem
Bisection method
Algorithm for the bisection method
Lesson: Application of Bisection Method
Learning Objectives
Applications
Example 1
Example 2
Lesson: Advantages and Pitfalls of Bisection Method
Learning Objectives
Advantages of the bisection method
Drawbacks of bisection method
Multiple Choice Test
Problem Set
Chapter 03.04: Newton-Raphson Method for Solving a Nonlinear Equation
Lesson: Tangent to a Curve
Learning Objectives
Introduction
Example
Lesson: Graphical Derivation of Newton-Raphson Method
Learning Objectives
Introduction
Derivation
Algorithm
Lesson: Derivation of Newton-Raphson Method from Taylor Series
Learning Objectives
Introduction
Lesson: Application of Newton-Raphson Method
Learning Objectives
Applications
Example 1
Example 2
Lesson: Advantages and Pitfalls of Newton-Raphson Method
Learning Objectives
Advantages of the Newton-Raphson Method
Drawbacks of the Newton-Raphson Method
Appendix A. What is an inflection point?
Multiple Choice Test
Problem Set
Chapter 03.05: Secant Method of Solving Nonlinear Equations
Lesson: Secant Method of Solving Nonlinear Equations
Learning Objectives
What is the secant method and why would I want to use it instead of the Newton-Raphson method?
Application of Secant Method
Example 1
Multiple Choice Test
Problem Set
Chapter 03.07: Newton-Raphson Method For Solving Simultaneous Nonlinear Equations
Lesson: Newton-Raphson Method For Solving Simultaneous Nonlinear Equations
Learning Objectives
Introduction
Derivation
Example 1
Example 2
Appendix A: General matrix form of solving simultaneous nonlinear equations.
Problem Set
Chapter 04.00: Physical Problem for Simultaneous Linear Equations
Lesson: General Engineering
Summary
Modeling
Questions
Lesson: Chemical Engineering
Summary
Modeling
Questions
Lesson: Civil Engineering
Summary
Modeling
Questions
Lesson: Computer Engineering
Summary
Modeling
Questions
Lesson: Electrical Engineering
Summary
Modeling
Questions
Lesson: Industrial Engineering
Summary
Modeling
Lesson: Mechanical Engineering
Summary
Modeling
Questions
Chapter 04.01: Prerequisites to Simultaneous Linear Equations
Lesson: Definition of Matrices and Special Matrices
Learning Objectives
What does a matrix look like?
So, what is a matrix?
What are the special types of matrices?
Row Vector
Example 1
Column vector
Example 2
Submatrix
Square matrix
Example 3
Upper triangular matrix
Example 4
Lower triangular matrix
Example 5
Diagonal matrix
Example 6
Identity matrix
Example 7
Lesson: Binary Matrix Operations
Learning Objectives
How do you add two matrices?
Example 1
How do you subtract two matrices?
Example 2
How do I multiply two matrices?
Example 3
Lesson: Setting Up Problems in Matrix Form
Learning Objectives
Matrix algebra is used for solving systems of equations. Can you illustrate this concept?
Example 1
Lesson: Inverse of a Square Matrix
Learning Objectives
Can you divide two matrices?
Example 1
Can I use the concept of the inverse of a matrix to find the solution of a set of equations [A][X] = [C]?
How do I find the inverse of a matrix?
Example 2
Chapter 04.01: Introduction to Matrix Algebra
Lesson: Introduction to Matrix Algebra
Learning Objectives
What does a matrix look like?
So, what is a matrix?
What are the special types of matrices?
Row Vector:
Example 1
Column vector:
Example 2
Submatrix: {#submatrix}
Example 3
Square matrix: {#square-matrix}
Example 4
Upper triangular matrix: {#upper-triangular-matrix}
Example 5
Lower triangular matrix: {#lower-triangular-matrix}
Example 6
Diagonal matrix: {#diagonal-matrix}
Example 7
Identity matrix: {#identity-matrix}
Example 8
Zero matrix:
Example 9
Tridiagonal matrices:
Example 10
Do non-square matrices have diagonal entries?
Example 11
Diagonally Dominant Matrix: {#diagonally-dominant-matrix}
Example 12
When are two matrices considered to be equal?
Example 13
Appendix A
What is a diagonally dominant matrix?
Example A.1
What is a weak diagonally dominant matrix?
What is a strictly diagonally dominant matrix?
Example A.2
What is an irreducible diagonally dominant matrix?
Example
What is an irreducible matrix?
Give examples of irreducible and reducible matrices.
Implications of diagonally dominant matrices?
References
Key Terms:
Multiple Choice Test
Multiple Choice Test
Problem Set
Introduction Exercise
Problem Set
Chapter 04.02: Vectors
Lesson: Vectors
Learning Objectives
What is a vector?
Example 1
When are two vectors equal?
Example 2
How do you add two vectors?
Example 3
Example 4
What is a null vector?
Example 5
What is a unit vector?
Example 6
How do you multiply a vector by a scalar?
Example 7
Example 8
What do you mean by a linear combination of vectors?
Example 9
What do you mean by vectors being linearly independent?
Example 10
Example 11
Example 12
What do you mean by the rank of a set of vectors?
Example 13
Example 14
Example 15
Prove that if a set of vectors contains the null vector, the set of vectors is linearly dependent.
Prove that if a set of
m
vectors is linearly independent, then a subset of the
m
vectors also has to be linearly independent.
Prove that if a set of vectors is linearly dependent, then at least one vector can be written as a linear combination of others.
Prove that if the dimension of a set of vectors is less than the number of vectors in the set, then the set of vectors is linearly dependent.
How can vectors be used to write simultaneous linear equations?
Example 16
What is the definition of the dot product of two vectors?
Example 17
Example 18
Key Terms:
Multiple Choice Test
Problem Set
Chapter 04.03: Binary Matrix Operations
Lesson: Binary Matrix Operations
Learning Objectives
How do you add two matrices?
Example 1
Example 2
How do you subtract two matrices?
Example 3
Example 4
How do I multiply two matrices?
Example 5
Example 6
What is the scalar multiplication of a matrix?
Example 7
What is a linear combination of matrices?
Example 8
What are some of the rules of binary matrix operations?
Commutative law of addition
Associative law of addition
Associative law of multiplication
Distributive law
Example 9
Is [A][B] = [B][A]?
Example 10
Key Terms:
Multiple Choice Test
Problem Set
Chapter 04.04: Unary Matrix Operations
Lesson: Unary Matrix Operations
Learning Objectives
What is the transpose of a matrix?
Example 1
What is a symmetric matrix?
Example 2
What is a skew-symmetric matrix?
Example 3
What is the trace of a matrix?
Example 4
Example 5
Example 6
Define the determinant of a matrix.
How does one calculate the determinant of any square matrix?
Example 6
Is there a relationship between det(
AB
), and det(
A
) and det(
B
)?
Are there some other theorems that are important in finding the determinant of a square matrix?
Example 7
Example 8
Example 9
Example 10
Example 11
Key Terms:
Multiple Choice Test
Problem Set
Chapter 04.05: System of Equations
Lesson: System of Equations
Learning Objectives
Matrix algebra is used for solving systems of equations. Can you illustrate this concept?
Example 1
A system of equations can be consistent or inconsistent. What does that mean?
Example 2
How can one distinguish between a consistent and inconsistent system of equations?
Example 3
Example 4
Example 5
Example 6
Example 7
If a solution exists, how do we know whether it is unique?
Example 8
Example 9
If we have more equations than unknowns in [A] [X] = [C], does it mean the system is inconsistent?
Consistent systems of equations can only have a unique solution or infinite solutions. Can a system of equations have more than one but not infinite number of solutions?
Can you divide two matrices?
Example 10
Can I use the concept of the inverse of a matrix to find the solution of a set of equations [A] [X] = [C]?
How do I find the inverse of a matrix?
Example 11
Is there another way to find the inverse of a matrix?
Example 12
If the inverse of a square matrix [A] exists, is it unique?
Key Terms:
Multiple Choice Test
Problem Set
Chapter 04.06: Gaussian Elimination Method for Solving Simultaneous Linear Equations
Lesson: Theory of Naive Gauss Elimination Method
Learning Objectives
How is a set of equations solved numerically by Gaussian elimination method?
Forward Elimination of Unknowns:
Back Substitution:
Lesson: Application of Naive Gauss Elimination Method
Learning Objectives
Applications
Example 1
Lesson: Finding Determinant of a Square Matrix Using Gaussian Elimination
Learning Objectives
Can we use Naive Gauss elimination methods to find the determinant of a square matrix?
Example 1
What if I cannot find the determinant of the matrix using the Naive Gauss elimination method, for example, if I get division by zero problems during the Naive Gauss elimination method?
Example 2
Example 3
Section: Pitfalls of Naive Gauss Elimination Method
Learning Objectives
Are there any pitfalls of the Naive Gauss elimination method?
Example 1
Example 2
Lesson: Theory of Gaussian Elimination with Partial Pivoting Method
Learning Objectives
What are some techniques for improving the Naïve Gauss elimination method?
How does Gaussian elimination with partial pivoting differ from Naïve Gauss elimination?
Lesson: Application of Gaussian Elimination with Partial Pivoting Method
Learning Objectives
Applications
Example 1
Example 2
Multiple Choice Test
Problem Set
Chapter 04.07: LU Decomposition Method for Solving Simultaneous Linear Equations
Lesson: Theory of LU Decomposition Method
Learning Objectives
I hear about LU decomposition used as a method to solve a set of simultaneous linear equations. What is it?
So how do I decompose a nonsingular matrix [A], that is, how do I find [A] = [L][U]?
Lesson: Application of LU Decomposition Method
Learning Objectives
Applications
Example 1
Example 2
Lesson: Finding Inverse of a Matrix Using LU Decomposition Method
Learning Objectives
How do I find the inverse of a square matrix using LU decomposition?
Example 1
Lesson: Computational Efficiency
Learning Objectives
LU decomposition looks more complicated than Gaussian elimination. Do we use LU decomposition because it is computationally more efficient than Gaussian elimination to solve a set of n equations given by
\([A][X]=[C]\)
?
This has confused me further! Why should I learn LU decomposition method when it takes the same computational time as Gaussian elimination, and that too when the two methods are closely related in the procedure? Please convince me that LU decomposition has its place in solving linear equations!
Appendix
Multiple Choice Test
Problem Set
Chapter 04.08: Gauss-Seidel Method of Solving Simultaneous Linear Equations
Gauss-Seidel Method
Learning Objectives
Why do we need another method to solve a set of simultaneous linear equations?
Example 1
The above system of equations does not seem to converge. Why?
Example 2
Example 3
Key Terms:
Multiple Choice Test
Multiple Choice Test
Gauss-Seidel Method Exercise
Chapter 04.09: Adequacy of Solutions
Lesson: Adequacy of Solutions
Learning Objectives
What do you mean by ill-conditioned and well-conditioned system of equations?
Example 1
Example 2
So, what if the system of equations is ill conditioned or well-conditioned?
To calculate the condition number of an invertible square matrix, I need to know what the norm of a matrix means. How is the norm of a matrix defined?
Example 3
How is the norm related to the conditioning of the matrix?
What are some of the properties of norms?
How do I use the above theorems to find how many significant digits are correct in my solution vector?
Example 4
Example 5
Key Terms:
Multiple Choice Test
Multiple Choice Test
Adequacy of Solutions Exercise
Chapter 04.10: Eigenvalues and Eigenvectors
Lesson: Eigenvalues and Eigenvectors
Learning Objectives
What does eigenvalue mean?
Can you give me a physical example application of eigenvalues and eigenvectors?
What is the general definition of eigenvalues and eigenvectors of a square matrix?
How do I find eigenvalues of a square matrix?
Example 1
Example 2
Example 3
What are some of the theorems of eigenvalues and eigenvectors?
Example 4
Example 5
Example 6
Example 7
How does one find eigenvalues and eigenvectors numerically?
Example 8
Key Terms:
Multiple Choice Test
Problem Set
Eigenvalues and Eigenvectors Exercise
Chapter 05.00: Physical Problem for Interpolation
Lesson: General Engineering
Summary
Problem Statement
Lesson: Chemical Engineering
Summary
Problem Statement
Solution
References
QUESTIONS
Lesson: Civil Engineering
Summary
Problem Statement
Lesson: Computer Engineering
Summary
Lesson: Electrical Engineering
Summary
References
Lesson: Industrial Engineering
Summary
Problem Statement
Solution
Lesson: Mechanical Engineering
Summary
Problem Statement
Solution
Questions
Chapter 05.01: Prerequisites to Interpolation
Lesson: Prerequisites to Interpolation
Learning Objectives
What is interpolation?
Lesson: Uniqueness of Interpolating Polynomials
Learning Objectives
Proof for a unique polynomial of degree
\(n\)
or less passes through
\(n+1\)
data points.
Example
Multiple Choice Test
Chapter 05.02: Direct Method of Interpolation
Lesson: Direct Method of Interpolation
Learning Objectives
Direct Method
Example 1
Example 2
Example 3
Multiple Choice Test
Problem Set
Chapter 05.03: Newton’s Divided Difference Method of Interpolation
Lesson: Newton’s Divided Difference Method of Interpolation
Learning Objectives
Introduction
Newton’s Divided Difference Polynomial Method
Linear Interpolation
Example 1
Quadratic Interpolation
Example 2
General Form of Newton’s Divided Difference Polynomial
Example 3
Multiple Choice Test
Problem Set
Chapter 05.05: Spline Method of Interpolation
Lesson: Why Do We Need Spline Interpolation?
Learning Objectives
Introduction
Lesson: Linear Spline Interpolation
Learning Objectives
Linear Spline Interpolation
Example 1
Lesson: Quadratic Spline Interpolation
Learning Objectives
Interpolating Quadratic Spline
Lesson: Application of Quadratic Spline Interpolation
Learning Objectives
Applications
Example 1
Lesson: Outline of Cubic Spline Interpolation
Learning Objectives
Introduction
Interpolating Cubic Spline
Multiple Choice Test
Problem Set
Chapter 05.06: Extrapolation is a Bad Idea
Lesson: Extrapolation is a Bad Idea
Learning Objectives
Description
Chapter 05.10: Length of a Curve
Lesson: Length of a Curve
Learning Objectives
Introduction
Example 1
Lesson: Comparing Lengths of Curves
Learning Objectives
Introduction
Example 1
Multiple Choice Test
Chapter 06.00: Physical Problem for Regression
Lesson: General Engineering
Summary
Modeling
Questions
Lesson: Chemical Engineering
Summary
Modeling
Questions
Lesson: Civil Engineering
Summary
Modeling
Questions
Lesson: Computer Engineering
Summary
Modeling
QUESTIONS
Lesson: Electrical Engineering
Summary
Modeling
Questions
References
Lesson: Industrial Engineering
Summary
Modeling
Questions
Lesson: Mechanical Engineering
Summary
Modeling
Solution
Questions
Chapter 06.01: Prerequisites to Regression
Lesson: Simple Statistics
Learning Objectives
Introduction
Example 1.
Lesson: Absolute Minimum of a Function of One Variable
Learning Objectives
Minimum of a twice differentiable continuous function
Example 1
Example 2
Lesson: Partial Derivatives
Learning Objectives
Introduction
Example 1
Lesson: Absolute Minimum of a Function of Multiple Variables
Learning Objectives
Recap: Local Minimum of a Single-Variant Function
Local Minimum of a Multivariant Function
First-Order Optimality Condition
Second-Order Optimality Condition:
Critical Points of a Function of Two Variables
Example 1
Appendix
Multiple Choice Test
Problem Set
Chapter 06.03: Linear Regression
Lesson: Introduction to Linear Regression
Learning Objectives
Introduction
Lesson: Straight-Line Regression Model without an Intercept
Learning Objectives
Introduction
Example 1
Lesson: Theory of General Straight-Line Regression Model
Learning Objectives
Introduction
Appendix
Lesson: Application of General Straight-Line Regression Model
Learning Objectives
Recap
Example 1
Multiple Choice Test
Problem Set
Chapter 06.04: Nonlinear Regression
Lesson: Introduction to Nonlinear Regression
Learning Objectives
Introduction
Exponential model
Power model
Saturation growth model
Harmonic decline model
Lesson: Exponential Regression Model with Transformation
Learning Objectives
Derivation of nonlinear regression models
Exponential model
Exponential Model through Transformation of Data
Example 1
Lesson: Nonlinear Regression Model Without Transformation
Learning Objectives
Nonlinear models using least squares
Exponential model
Example 1
Example 2
Lesson: Polynomial Regression Model
Learning Objectives
Polynomial Models
Example 1
Lesson: Optimum Order of a Polynomial Regression Model
Learning Objectives
Introduction
Lesson: Other Nonlinear Regression Models
Learning Objectives
Introduction
Growth model
Example 1
Logistic Growth Model
Logarithmic Functions
Example 2
Power Functions
Example 3
Multiple Choice Test
Problem Set
Chapter 06.05: Adequacy of Linear Regression Models
Lesson: Introduction to Adequacy of Linear Regression Models
Learning Objectives
Introduction
Lesson: Criteria for Adequacy of Linear Regression Models
Learning Objectives
Check 1. Plot the data and the regression model.
Check 2. Is the standard estimate of error within bounds?
Check 3. How close is the coefficient of determination to one?
Check 4. Find if the model meets the assumptions of random errors.
Lesson: Abuses of Regression
Learning Objectives
Introduction
Extrapolation
Generalization
Misidentification
Multiple Choice Test
Problem Set
Chapter 07.00: Physical Problem for Integration
Lesson: General Engineering
Summary
Modeling
Lesson: Chemical Engineering
Summary
Modeling
Questions
References
Lesson: Civil Engineering
Summary
Modeling
Questions
References
Lesson: Computer Engineering
Summary
Modeling
Questions
Lesson: Electrical Engineering
Summary
Modeling
Questions
References
Lesson: Industrial Engineering
Summary
Modeling
Questions
Lesson: Mechanical Engineering
Summary
Modeling
Questions
Chapter 07.01: Prerequisites to Numerical Integration
Lesson: Prerequisites to Numerical Integration
Learning Objectives
What is integration?
Riemann Sum
Example 1
Example 2
Mean Value of a Function
Example 3
Multiple Choice Test
Chapter 07.02: Trapezoidal Rule of Integration
Lesson: Single-Application Trapezoidal Rule
Learning Objectives
Introduction
Example 1
Example 2
Appendix
Lesson: Composite Trapezoidal Rule
Learning Objectives
Introduction
Derivation
Example 1
Example 2
Error in Composite Trapezoidal Rule
Appendix
Example A.1
Example A.2
Lesson: Error Analysis of Trapezoidal Rule
Learning Objective
Error in Composite Trapezoidal Rule
Richardson’s Extrapolation Formula for Trapezoidal Rule
Example 1
Multiple Choice Test
Problem Set
Chapter 07.03: Simpson’s 1/3
rd
Rule of Integration
Lesson: Single Application Simpson’s 1/3
rd
Rule
Learning Objective
What is integration?
Simpson’s 1/3 Rule
Appendix: Alternative Methods of Deriving Simpson’s 1/3
rd
rule (Not in syllabus)
Lesson: Composite Simpson’s 1/3
rd
Rule
Learning Objective
Composite Simpson’s 1/3 Rule
Error in Composite Simpson’s 1/3 Rule
Lesson: Error in Composite Simpson’s 1/3
rd
rule
Learning Objectives
True Error in Composite Simpson’s 1/3 rule
Multiple Choice Test
Problem Set
Chapter 07.05: Gauss Quadrature Rule of Integration
Lesson: Theory of Gauss Quadrature Rule
Learning Objective
Introduction
Trapezoidal Rule Derivation Using Method of Undetermined Coefficients
Two-point Gaussian Quadrature Rule Using Method of Undetermined Coefficients
One-point Gaussian Quadrature Rule Using Method of Undetermined Coefficients
Lesson: Applications of Gauss Quadrature Rule
Learning Objectives
Recap
Example 1
Example 2
Example 3
Lesson: Higher-Point Gauss Quadrature Rule
Learning Objectives
Introduction
Arguments and weighing factors for
n
-point Gauss quadrature rules
So if the table is given for integrals with [-1,1] integration limits, how does one solve for integrals with [a,b] integration limits.
Example 1
Example 2
So does Gaussian quadrature require that the integral must be transformed to the integral limit of [-1,1]?
Appendix
Example A.1
Example A.2
Multiple Choice Test
Problem Set
Chapter 07.06: Integrating Functions Given as Discrete Data Points
Lesson: Trapezoidal Rule for Functions Given as Discrete Points
Learning Objectives
Introduction
Example 1
Example 2
Lesson: Alternative Methods of Integrating Functions Given as Discrete Points
Learning Objectives
Introduction
Example 1
Example 2
Multiple Choice Test
Problem Set
Chapter 07.08: Simpson’s 3/8
th
Rule of Integration
Lesson: Simpson’s 3/8
th
Rule
Learning Objectives
Introduction
Simpsons 3/8 Rule for Integration
Composite Simpson 3/8 Rule
Computer Algorithm for Mixed Simpson 1/3 and 3/8 Rule for Integration
Multiple Choice Test
Problem Set
Chapter 08.00: Physical Problem for Ordinary Differential Equations
Lesson: General Engineering
Summary
Modeling
Questions
Lesson: Chemical Engineering
Summary
Modeling
Question
Lesson: Civil Engineering
Summary
Modeling
Lesson: Computer Engineering
Summary
Modeling
Questions
Lesson: Electrical Engineering
Summary
Modeling
Questions
References
Lesson: Industrial Engineering
Summary
Modeling
Questions
References
Lesson: Mechanical Engineering
Summary
Modeling
Chapter 08.01: Prerequisites to Numerical Methods for Solving Ordinary Differential Equations
Lesson: Why Do We Need Ordinary Differential Equations?
Learning Objectives
Introduction
Formulation of differential equations
Lesson: Solving First-Order Ordinary Differential Equations Exactly
Learning Objectives
Introduction
Classical Technique
Homogenous Part of the Solution
Particular Part of the Solution
Example 1
Example 2
Lesson: Solving Second-Order Differential Equations Exactly
Learning Objectives
Applications
Example 1
Example 2
Example 3
Lesson: Solving an Integral as a First-Order Ordinary Differential Equation
Learning Objectives
Introduction
Example 1
Lesson: Solving Ordinary Differential Equations by Laplace Transforms
Learning Objectives
Introduction
Properties of Laplace transforms
Laplace transforms of derivatives
Laplace transform technique to solve ordinary differential equations
Example 1
Example 2
Example 3
Example 4
Example 5
Multiple Choice Test
Problem Set
Chapter 08.02: Euler’s Method for Solving Ordinary Differential Equations
Lesson: Derivation of Euler’s Method
Learning Objectives
What is Euler’s method?
Example 1
Example 2
Derivation of Euler’s method
Derivation of Euler’s Method from Taylor Series
Lesson: Application of Euler’s Method
Learning Objectives
Recap of Euler’s Method
Example 1
Lesson: Using Euler’s Method to Solve Integrals
Learning Objectives
Introduction
Example 1
Multiple Choice Test
Problem Set
Chapter 08.03: Runge-Kutta 2nd-Order Method for Solving Ordinary Differential Equations
Lesson: Theory of Runge-Kutta 2nd-Order Method
Learning Objectives
What is the Runge-Kutta 2nd order method?
Runge-Kutta 2
nd
order method
Heun’s Method
Midpoint Method
Ralston’s Method
Lesson: Application of Runge-Kutta 2nd-Order Method
Learning Objectives
Recap
Example 1
How do these three methods compare with results obtained if we found
\(\mathbf{f^\prime (x,y)}\)
directly?
Lesson: Derivation of Runge-Kutta 2nd-Order Method
Learning Objectives
How do we get the 2nd order Runge-Kutta method equations?
Multiple Choice Test
Problem Set
Chapter 08.05: On Solving Higher-Order and Coupled Ordinary Differential Equations
Lesson: Solving Higher-Order Ordinary Differential Equations
Learning Objectives
Description
Example 1
Example 2
Example 3
Lesson: State-Space Modeling and Higher-Order and Coupled Ordinary Differential Equations
Learning Objectives
Introduction
Example 1
Example 2
Example 3
Problem Set
Published with bookdown
Numerical Methods with Applications
Dedication
To Sherrie, Candace, Angelie, and Bucky J Barks