Checking answers and numerical precision
Reading position saved on this browser; this is not a completion record.
Start here
Distinguish a useful approximation from an exact conclusion.
By the end of this section
Preserve exact values during work, round intentionally, enter numeric responses correctly, verify candidates in original equations, and recognize when a small display difference is not mathematical equality.
4.1 Three layers of correctness
A result can pass one test and fail another. Check all three layers:
Layer | Question to ask |
|---|---|
Mathematical | Does the candidate satisfy the original equation, domain, and conditions? |
Computational | Did I enter the intended expression, preserve precision, and interpret the display correctly? |
Response | Did I report the requested quantity in the required units and answer format? |
Keep an exact chain whenever it is available
Use 7/12 instead of a short approximation such as 0.58. Keep π and radicals in intermediate expressions. When a later step needs a computed value, reuse its defining expression rather than copying a rounded display.
The exact expression 27(14/9) equals 42. Replacing 14/9 by 1.56 first changes the final product to 42.12. Extra calculator digits cannot restore precision that was discarded before the final operation.
A display near an integer is evidence to check
A graph may display a coordinate near 3. That does not, by itself, prove the exact value is 3. Substitute 3 into the original equation or establish it algebraically. Similarly, a displayed coefficient near 2 does not justify silently replacing a fitted estimate by an exact coefficient in a new calculation.
Choose a different check, not a duplicate mistake
For an equation: substitute into the original two sides.
For a model: check units, the initial condition, and one known input.
For a count: test the chosen integer and its adjacent competitor.
For a geometric result: check positive lengths, plausible bounds, and a defining formula.
Independent checks are stronger than repeated keystrokes
If you entered the wrong denominator twice, two matching displays only repeat the error. A unit check, an exact identity, or substitution into the original wording tests a different part of the reasoning.
4.2 Numeric response entry is its own final step
Student-produced response questions ask you to generate a number rather than select one of four choices. Some permit more than one correct numerical response, but you supply only one.[13] Always follow the directions displayed with your test.
The official numeric-entry conventions allow up to five characters for a positive answer and six for a negative answer, including the minus sign. Use a fraction or decimal, not a mixed number. Omit units and symbols such as a percent sign, dollar sign, or comma.[14]
Mathematical value | Suitable example entry | Why |
|---|---|---|
3/8 |
| Exact forms that fit. |
7/12 |
| The fraction is exact; the decimal retains available precision. |
−11/6 |
| The negative field includes the sign. |
| Rounded approximation; the field is not a symbolic root editor. | |
2 |
| Improper fraction or decimal, not a mixed number. |
p |
| Report the percent number, without a percent sign. |
Do not impose a universal two-decimal rule
When a question requests a particular rounding, follow it. Otherwise retain an exact fraction that fits, or use the supported decimal precision rather than shortening a repeating or irrational result arbitrarily. For a number between 0 and 1, omitting a leading zero can leave room for an additional decimal digit.
For 7/12, .58 discards useful precision; 7/12 avoids that issue. For a negative value such as −11/6, -1.833 has six characters, whereas adding another digit would exceed that limit.
Entry guidance, not a universal acceptance tolerance
This book does not assert that every decimal within a fixed distance of an answer is accepted. Use the exact value when possible and the test’s stated entry rules. A rounding example is not a promise about arbitrary nearby responses.
4.3 Original restrictions survive transformations
Algebra can transform an equation into an easier one, but some operations require conditions or introduce additional candidates.
Multiplying by a variable denominator: record where the original denominator is zero. Those inputs remain forbidden after multiplication or cancellation.
Squaring both sides: the squared equation may accept opposite-signed original sides. Check each candidate in the unsquared equation.
Taking a square root: the principal square root is nonnegative, but solving x2
A hole that a graph may not visibly show
For x ≠ 3,
The formula on the right is easy to graph, but the left side is undefined at x
Small differences can matter
Compare x2 − 2x + 0.999999
Original explanatory graph with a deliberately narrow window. A broad view can hide the separation between the roots.
The original problem is the final authority
An equation created by squaring, cancelling, or rounding is not automatically equivalent at every input. The last check belongs in the original equation, not only in the transformed one.
4.4 Bounds, scale, and the meaning of “close”
A tiny absolute difference does not always mean a good answer. The size of the quantities and the structure of the equation matter. For x2
A residual close to zero can identify a promising approximation. It does not establish exact equality, uniqueness, or a valid domain. For exact questions, use algebra or a defining relationship to certify the conclusion.
Use bounds before trusting digits
Situation | Fast bound or check |
|---|---|
Probability | Must lie between 0 and 1; check the denominator names the correct group. |
Acute-angle sine or cosine | Must lie between 0 and 1; check the angle unit. |
Square-root length | Must be nonnegative; square the candidate to recover the defining quantity. |
Discounted price | Must be lower before later fees or tax; use the correct original base. |
Weighted mean | Must lie between the smallest and largest observation when weights are positive. |
Whole-item count | Must meet the original inequality, not merely be the nearest integer to a quotient. |
Rounding and choosing an integer are not the same operation
To seat 450 people in vehicles holding at most 16 each, 450/16
The final ten-second check
This is a suggested habit, not an official time requirement. Ask: “Is this the requested quantity? Is it permitted? Did I keep enough precision? Does it fit the original situation? Did I actually enter it?” A targeted check can be more useful than recalculating every line.
When checking changes an answer
Identify the exact defect: wrong coordinate, omitted root, excluded input, premature rounding, wrong percent base, or invalid integer. Write the replacement habit in your error log. “Use the calculator more carefully” is too vague to guide the next attempt.
15 worked examples
4.01. Check a candidate in both original sides
A student obtains x = 4 for (2x − 1)/3 = x − 2. Is it correct? If not, find the solution.
Show worked solutionHide worked solution for example 4.01
Recognize. Substitution checks the original claim, not the steps that produced a candidate.
Enter: (2*4-1)/3
Enter: 4-2
Work. At x
Answer: x
Check. At x
Avoid the trap. Checking a candidate in a line that already contains an algebra error only repeats the error. Return to the original equation and inspect the denominator grouping.
4.02. Reject an extraneous root after squaring
Solving = x by squaring produces x = 3 and x = −2. Which values solve the original equation?
Show worked solutionHide worked solution for example 4.02
Recognize. The square root is nonnegative, so a negative right side cannot match it.
Enter: sqrt(3+6)
Enter: sqrt(-2+6)
Work. At x
Answer: 3 only.
Check. The original domain requires x ≥ −6, but equality further requires x ≥ 0. The candidate −2 passes the radicand condition yet fails the equation.
Avoid the trap. Domain checking alone is not enough here. A radicand can be valid while the two original sides still have opposite signs.
4.03. Preserve a cancelled denominator restriction
How many real solutions does = 6 have?
Show worked solutionHide worked solution for example 4.03
Recognize. The original expression excludes x
Work. For x ≠ 3, the left side simplifies to x + 3. The equation x + 3
Answer: 0 real solutions.
Check. At every allowed input, x + 3
Avoid the trap. A graph of the simplified line can appear to intersect y
4.04. Prefer an exact fraction when it fits
If 8x = 3, give a suitable numeric response for x.
Show worked solutionHide worked solution for example 4.04
Recognize. The exact answer is a short fraction and also a terminating decimal.
Enter: 3/8
Work. x = 3/8 = 0.375. Both 3/8 and .375 are suitable entries. There is no need to approximate this exact terminating value or convert it to a percentage.
Answer: Enter 3/8 or .375.
Check. 8(3/8)
Avoid the trap. An entry of 37.5 reports the percent number corresponding to the fraction, not the value of x. A calculator decimal and its interpretation are separate steps.
4.05. Preserve repeating-decimal precision
If 12u = 7, compare the possible entries
7/12,.58, and.5833.
Show worked solutionHide worked solution for example 4.05
Recognize. The exact value is 7/12
Enter: 7/12
Work. The short exact fraction 7/12 fits the positive-response field. The entry .5833 retains four decimal digits. The entry .58 would receive no credit. For a repeating decimal, fill the available answer space by truncating or rounding, for example .5833. Prefer the exact fraction when it fits.
Answer: Use 7/12 or .5833, not .58.
Check. 12(7/12)
Avoid the trap. No instruction in the problem says to round to the nearest hundredth. Do not apply a habitual two-decimal format to every SAT numeric answer.
4.06. Count the negative sign in a response field
If 6u = −11, give an exact fraction entry and an appropriate decimal entry.
Show worked solutionHide worked solution for example 4.06
Recognize. A negative response includes the minus sign in its character count.
Enter: -11/6
Work. The exact value is −11/6 -11/6 has five characters. The decimal -1.833 has six characters and uses the negative-response space appropriately.
Answer: -11/6 or -1.833.
Check. 6(−11/6)
Avoid the trap. The calculator can display more digits than the answer field can accept. Do not copy a long display blindly or omit the negative sign to make it fit.
4.07. Turn an irrational result into a numerical entry
The positive solution of x2 = 7 is requested as a numeric response. Give a suitable rounded entry.
Show worked solutionHide worked solution for example 4.07
Recognize. The exact value is an irrational root; the response field is not a symbolic expression editor.
Enter: sqrt(7)
Work. ≈ 2.64575131. Rounding to the displayed-entry precision gives 2.646. Keep the exact radical during any intermediate work, and convert only for the final numeric response.
Answer: 2.646.
Check. 2.62
Avoid the trap. Do not enter sqrt(7) in the numeric-response field or round the value to 3 merely because the prompt asks for one number. A number need not be an integer.
4.08. Do not round a radius before squaring it
A circle has radius centimeters. Find its area to the nearest tenth of a square centimeter.
Show worked solutionHide worked solution for example 4.08
Recognize. The square in the area formula cancels the square root exactly.
Enter: 50*pi
Work. A = π()2 = 50π ≈ 157.0796327, which rounds to 157.1. Rounding the radius first to 7.1 would instead give π(7.1)2 ≈ 158.4, a noticeably different area.
Answer: 157.1 cm2.
Check. The ratio A/π must equal r2
Avoid the trap. A direction to round the answer does not authorize rounding every intermediate measurement. Preserve the exact relationship until the final output.
4.09. Reuse an exact rate instead of a rounded display
A cyclist travels 14 kilometers in 9 minutes at a constant speed. How far will the cyclist travel in 27 minutes?
Show worked solutionHide worked solution for example 4.09
Recognize. The time is three times as long, so the distance must also triple.
Enter: (14/9)*27
Work. The exact rate calculation is (14/9)(27)
Answer: 42 kilometers.
Check. The units cancel: (km/min)(min)
Avoid the trap. More digits in a final display do not make an answer more accurate if the input rate was already rounded incorrectly.
4.10. Use the context to choose the integer direction
Each van holds at most 16 people. What is the least number of vans needed for 450 people?
Show worked solutionHide worked solution for example 4.10
Recognize. The number of vans is an integer, and total capacity must be at least 450.
Enter: 450/16
Work. The quotient is 28.125. Twenty-eight vans are insufficient, so choose the next integer, 29. This is a minimum-capacity problem, not ordinary rounding to the nearest integer.
Answer: 29.
Check. 28(16) = 448 < 450, while 29(16) = 464 ≥ 450. The neighboring integer check proves minimality.
Avoid the trap. Rounding 28.125 to 28 leaves two people without seats. The inequality determines the direction of adjustment.
4.11. Report the percent number rather than its decimal multiplier
Of 48 tiles, 18 are blue. If p% of the tiles are blue, what is p?
Show worked solutionHide worked solution for example 4.11
Recognize. The fraction is 18/48, but the variable p names the percent number.
Enter: 100*(18/48)
Work. 18/48 = 3/8 = 0.375. Multiplying by 100 gives p
Answer: Enter 37.5.
Check. 37.5% of 48 is 0.375(48)
Avoid the trap. An entry of .375 would be correct if the question asked for the probability of selecting a blue tile, but not when it asks for p in p%. Do not include the percent sign in the field.
4.12. Use the coordinates to calculate the actual target
The system y = 2x + 1 and x + y = 19 has solution (x, y). Find 2x + y.
Show worked solutionHide worked solution for example 4.12
Recognize. The requested result is an expression of the solution, not either coordinate alone.
Enter: y=2*x+1
Enter: x+y=19
Enter: 2*6+13
Work. The intersection is (6, 13). Substitute these coordinates into the requested expression: 2x + y = 2(6) + 13 = 25. Record the point before closing the graph so its coordinates are not confused.
Answer: 25.
Check. 13
Avoid the trap. Both 6 and 13 are useful intermediate results, but neither answers the question. Read the final target again after the graph has done its work.
4.13. Distinguish nearby roots from a double root
How many distinct real solutions does x2 − 2x + 0.999999 = 0 have?
Show worked solutionHide worked solution for example 4.13
Recognize. The constant is close to 1 but is not 1. Rounding it changes the solution count.
Enter: y=(x-1)^2-0.000001
Work. Completing the square gives (x − 1)2
Answer: 2 distinct real solutions.
Check. For either root, (x − 1)2 = 0.0012 = 0.000001. In contrast, (x − 1)2
Avoid the trap. An apparently touching graph in a broad window is not proof of a repeated root. Preserve all given digits before making an exact count.
4.14. Do not turn two agreements into an identity
The expressions x2 + 1 and 3x − 1 agree at x = 1 and x = 2. Are they equal for every real x?
Show worked solutionHide worked solution for example 4.14
Recognize. Two numerical matches can be intersections of different functions rather than evidence of an identity.
Enter: 0^2+1
Enter: 3*0-1
Work. At x
Answer: No; x
Check. The algebraic difference explains both the agreements and the failure. It is not the zero polynomial.
Avoid the trap. Testing answers is useful for eliminating a false identity. Proving an identity requires a valid general argument, not a handful of successful substitutions.
4.15. A tiny residual can still conceal a completely wrong root
A student tests x = 0 in x2 = 0.0001 and says the error is so small that 0 is the positive solution. Evaluate the claim.
Show worked solutionHide worked solution for example 4.15
Recognize. Closeness must be judged relative to the target and the mathematical task. Exact equality is not the same as a small residual.
Enter: sqrt(0.0001)
Work. The positive root is 0.01 because (0.01)2
Answer: The claim is false; the positive solution is 0.01.
Check. 0.01 × 0.01
Avoid the trap. Do not apply an arbitrary residual threshold such as “less than 0.001 means correct.” A fixed absolute tolerance is not a proof of exact equality and can erase all the meaningful detail in a small-scale problem.
Check the scale, not just the last few digits
Candidate x | Computed x2 | Residual x2 − 0.0001 |
|---|---|---|
0 | 0 | −0.0001 |
0.01 | 0.0001 | 0 |
−0.01 | 0.0001 | 0 |
Transfer habit
The residual test identifies both signed roots, but the word positive selects only one. A check must retain the problem’s qualifier as well as the equation. Numerical closeness, exact equality, and satisfaction of every condition are different claims.
Section synthesis: exactness, approximation, and entry
These are three different stages. Derive an exact relationship when possible; calculate an approximation only when useful; then follow the numeric-entry directions. Restrictions belong to the original problem, and the requested quantity determines which number should reach the answer field.
4.6 Section exit check
Work without the lesson open. Choose a method, show enough reasoning to check the result, and record any tool or interpretation error. These questions include tool-decision drills as well as mathematical problems.
Before checking the solutions
Name one question where a manual method was shorter, one place where calculator setup needed care, and one check that would catch a plausible wrong answer. If you cannot name an independent check, return to the relevant worked example.