Confidence can be graded while a decision is binary
The curator challenges the idea that enough evidence suddenly licenses complete belief, then asks how uncertain beliefs can guide definite choices. The two original dialogues and both sets of scenarios remain in place, with revisions distinguishing evidential confidence, practical acceptance, and the consequences of acting.
Read This First
If this page feels abrupt, start here
These links provide the wider frame, earlier distinction, or branch map that makes the current page easier to enter.
-
Mapping Belief to Evidence
Start here if the current page feels compressed: Mapping Belief to Evidence gives the broader frame before the argument narrows into the present pressure.
-
What is Belief?
In the route “Truth and Inquiry: How Belief Answers to Reality,” this page lands better after What is Belief?, where the setup has already been clarified.
Read This Next
If the page clicked, continue here
These are not just nearby pages. They are the strongest next moves if you want the pressure of this page to keep unfolding.
-
Dangers: Cognitive Biases
In the route “Truth and Inquiry: How Belief Answers to Reality,” Dangers: Cognitive Biases is the next useful move because it sharpens what this page leaves open.
-
Belief/Evidence Graphic
Belief/Evidence Graphic keeps the same branch pressure in view but turns it from a different angle.
-
Extraordinary Claims
Extraordinary Claims keeps the same branch pressure in view but turns it from a different angle.
Prompt 1: Rational belief is a degree of belief that maps to the degree of the relevant evidence. Therefore there is no “adequate” degree of evidence at which an epistemic switch goes from off to on, right?
What adequate evidence can and cannot mean
ChatGPT response · editorial edition
Yes—if “belief” means degree of confidence, evidence does not cross a universal threshold that turns uncertainty into complete certainty. Confidence should respond to the total relevant evidence and background information. But “adequate” can still mean adequate for a specified purpose, such as acting or provisionally accepting a claim; that need not mean assigning it probability 1. Bayesian reasoning makes graded updating explicit: the effect of new evidence depends on how expected it was under competing possibilities, not on a simple linear quantity called the amount of evidence. One decisive observation can produce a large update. The curator’s central distinction is between an evidentially warranted degree of confidence and an unwarranted jump to full belief.
Claude response · editorial edition
Your objection identifies the mistake in treating a threshold as a license for certainty. A person can be more or less confident in a proposition, and that confidence should track evidential support. Ordinary yes/no acceptance and a yes/no decision can coexist with uncertainty; neither has to erase the underlying degree of belief.
Some key points about rational, evidentiary belief:
1) Requiring certainty before assigning any confidence confuses “not certain” with “impossible.” Giving an uncertain proposition probability zero is itself an extreme judgment. Even with a mathematical proof, confidence that one has understood and checked it is distinct from the validity of the deduction.
2) Degrees of confidence run between certainty that a proposition is false and certainty that it is true. An intermediate judgment is not a failure to believe rationally; it can be the most accurate expression of what the evidence supports.
3) Confirming evidence raises confidence when it favors the proposition over relevant alternatives; disconfirming evidence lowers it. Repetition of the same report is not automatically new independent support.
4) Different background information or defensible modeling assumptions can produce different assessments. That does not make every disagreement equally rational: people should examine the source of their difference, and cannot justify arbitrary numbers merely by calling them personal standards.
5) No universal “adequate evidence” threshold converts a fallible claim into certainty. A threshold for action or practical acceptance answers a different question and should be explained in relation to its purpose.
The central discipline is responsiveness to evidence, not endlessly changing one’s mind or pretending to know an exact percentage. Sometimes a range or a carefully qualified comparison expresses warranted confidence better. Keep the strength of the claim separate from the stakes of the decision.
Prompt 2: Create a hypothetical dialogue between an epistemology professor and a student who holds to the “epistemic switch” notion in which evidence must reach a certain level before belief and triggers full belief rather than mapping to the degree of the evidence.
Two dialogues about the epistemic switch
ChatGPT response · editorial edition
Professor: Good morning! I heard you discussing an interesting view on belief and evidence. Could you elaborate on your “epistemic switch” theory?
Student: Sure, Professor. I believe that for any proposition, there must be a threshold level of evidence that, once reached, justifies full belief in that proposition.
Professor: Does “full belief” mean treating the claim as certain, or accepting it for a purpose while still admitting a chance of error?
Student: It’s somewhat arbitrary, but essentially it’s the point where the evidence is strong enough to compel belief, rather than mere consideration.
Professor: Being convinced enough to proceed can make sense. But why should crossing that point erase the remaining uncertainty?
Student: I think it simplifies decision-making. If the evidence isn’t sufficient, we withhold belief; if it is, we commit fully.
Professor: Suppose your confidence falls from 80% to 65%, while your practical threshold is 60%. You may still act, but would you really describe the evidence as equally convincing?
Student: In that scenario, the belief remains as the evidence still surpasses the threshold.
Professor: Your decision could remain unchanged while your confidence decreases. Scientific inquiry also distinguishes provisionally using a conclusion from regarding it as infallible.
Student: That does seem more aligned with a continuous evaluation process, but doesn’t it complicate matters, always adjusting belief levels?
Professor: It requires care, but not a fresh calculation every minute. Update when information changes the case; a repeated rumor or irrelevant detail need not move your confidence.
Student: So, you suggest belief should be more fluid, adjusting in intensity as evidence changes?
Professor: Yes. A dimmer captures degrees better than an on-off switch, though the evidence can justify a large change as well as a small one. The analogy does not supply the correct setting.
Student: I see your point, but isn’t there a risk of constantly fluctuating beliefs? How do we ever make decisions if our beliefs are always in flux?
Professor: Compare the consequences of the available actions at your present confidence. If a precaution costs one unit and would prevent a loss of ten with probability 20%, its expected benefit is two units. Under those simplified assumptions it is worth taking, without believing that the loss will certainly occur.
Student: That makes sense. I suppose that allows for a more nuanced approach to both everyday decisions and scientific conclusions.
Professor: Exactly. In that example the precaution is rational while the event remains unlikely. Changing the costs could change the decision without changing the probability.
Student: I’ll need to think more about this. It seems like a more realistic approach to handling evidence and belief.
Professor: It’s always good to reflect on these concepts. Remember, the goal of epistemology is not just to understand what belief is, but also how we should believe responsibly based on the evidence we have.
Claude response · editorial edition
Professor: Welcome to Epistemology 301. Today we’ll discuss the relationship between evidence and belief formation. Alex, can you start us off with your view?
Alex: Sure, Professor. I believe there is a threshold of “adequate evidence” that, once crossed, flips a mental switch to fully believing a claim. Until the evidence reaches that level, I remain unconvinced.
Professor: When you say “fully,” do you mean certainty, or enough confidence to accept the claim for a particular purpose?
Alex: Well, the evidence has to be overwhelmingly convincing – leave no reasonable doubt. Only then is belief rationally justified.
Professor: “No reasonable doubt” need not mean no possibility of error. More fundamentally, why should falling short of certainty prevent you from assigning any confidence at all?
Alex: Maybe, but I’d rather be certain than risk believing something false based on insufficient evidence.
Professor: Wanting to avoid error is sensible. But treating every uncertain claim as impossible would also create errors. We need degrees of confidence that acknowledge both possibilities.
Alex: What do you mean?
Professor: You might regard one explanation as plausible and another as very unlikely without treating either as certainly true or false. Evidence can change those judgments by different amounts.
Alex: So you don’t think there’s a clear belief threshold?
Professor: There is no universal point at which evidence creates certainty. You may use a threshold for practical acceptance, but keep track of the uncertainty that remains after crossing it.
Alex: But how do you avoid believing something based on flimsy evidence?
Professor: Compare how well the evidence fits the claim and its alternatives, taking account of source reliability and background information. A weak clue may warrant only a small change—or none if it was equally expected either way.
Alex: I see what you’re saying. Belief exists on a spectrum linked to evidentiary support.
Professor: Exactly. The problem is the leap from sufficient-for-a-purpose to certain. You can give a definite answer or choose an action while acknowledging a fallible, graded judgment.
Alex: That makes sense. I’ll have to rethink my view of belief as an all-or-nothing epistemic switch.
Professor: Keep asking two questions: how strongly does the evidence support the claim, and what should I do given that support? The second also depends on consequences and alternatives.
Prompt 3: I have also seen confusion about making binary decisions when certainty is sub-absolute. Provide 3 scenarios in which one’s confidence in the outcome of a particular choice can be at 20%, yet that choice remains rational.
Three choices at 20% confidence in each response
ChatGPT response · editorial edition
Here are three hypothetical choices with a stipulated 20% probability of a specified favorable outcome. The probability is an assumption for the examples, not a reported medical or financial estimate. To show that an action can be rational, we must also specify its costs and alternatives.
- High Reward with Low Risk: A researcher can run a preliminary laboratory study with a 20% chance of identifying a useful drug candidate. Suppose success has value 20 on the project’s evaluation scale, the study costs 1 regardless of outcome, failure has no further cost, and the next-best use has net value 0. The expected net value is 0.2 × 20 − 1 = 3. Pursuing the study is rational under these assumptions, while confidence in success remains 20%. This is a research-allocation example, not permission to expose patients to an untested treatment.
- Lack of Better Alternatives: A rescue team can attempt one of two searches before an opportunity closes. One has a 20% chance of finding survivors; the other has 10%. Assume equal resource costs, equal risks to rescuers, the same number of people helped if successful, and no useful third option. The 20% search is rationally preferable under those assumptions. Highest success probability alone would not settle the choice if danger or consequences differed.
- Strategic Diversification in Investment: In a hypothetical small investment, success has probability 20% and returns 10 units including the original stake; failure returns zero, and the stake costs 1. Expected net gain is 0.2 × 10 − 1 = 1. Someone who can bear the loss and has no better use for that small allocation may reasonably choose it. Diversification can limit exposure to a particular failure, but does not by itself make an unattractive bet rational; correlated losses and the person’s attitude toward risk still matter.
Each example supplies a reason for acting despite likely failure: favorable consequences relative to cost, or a better prospect than the available alternatives. A positive expected value is an average across possible outcomes, not a guarantee about the one outcome that will occur.
Claude response · editorial edition
These are three hypothetical decision models with an assumed 20% chance of the stated outcome. They illustrate how an action can be rational under uncertainty; the numbers do not report actual treatment, business, or climate-policy performance.
- Medical Decision: Suppose a patient faces a choice between a treatment with a 20% chance of survival to a specified time and an alternative with a much lower chance. If the burdens, possible harms, and likely quality of life are acceptable to that patient, and no better option exists, choosing treatment can be rational. The outcome must be defined and the comparison based on the patient’s circumstances; 20% alone does not decide the matter.
- Business Investment: Suppose a small pilot project costs 2 units and has a 20% chance of producing a benefit worth 20 units, with no further loss on failure. Its expected net value is 0.2 × 20 − 2 = 2. A decision maker able to bear the loss could rationally proceed if competing uses are less valuable. Calling a startup “high reward” without estimating the payoff and downside would not establish that conclusion.
- Environmental Policy: Suppose a proposed pilot intervention has a 20% chance of preventing damage valued at 100 units, costs 5 units, and has negligible additional harm. Its expected net benefit is 0.2 × 100 − 5 = 15. Implementation can be rational if feasible alternatives offer less benefit. These are stipulated values for the example, not a climate-science forecast; side effects, distribution of costs, and opportunity costs must be included in a real comparison.
A binary choice need not reflect binary confidence. The action can change when the consequences or available alternatives change, even if the evidence-based probability stays at 20%. The expected-value calculations make the assumptions visible; where outcomes are not well represented by one numerical scale, the comparison also needs an explicit account of the decision maker’s priorities.
Prompt 4: Provide 4 scenarios that model how one can update their degree of belief up or down as new confirming or disconfirming evidence arrives.
Four updating scenarios in each response
ChatGPT response · editorial edition
The following four scenarios are numerical illustrations, not estimates from real studies. Let H be the stated claim and E the new evidence. Posterior odds equal prior odds multiplied by P(E given H) / P(E given not-H), the likelihood ratio. Convert a probability p to odds p/(1−p), then convert odds o back to probability o/(1+o). The stipulated likelihoods below make the updates checkable. In real work, justifying those likelihoods is part of the task. See Gelman and colleagues on Bayesian statistics and modelling.
- Clinical Trial Results:
- Initial Belief: H is that a new drug provides a specified benefit over a comparator in a defined population. For illustration, the prior probability is 50%.
- New Evidence: A controlled efficacy study produces a prespecified favorable result. Assume its probability is 70% if H is true and 30% if H is false. This is not merely a reassuring phase-one safety result; the FDA distinguishes the purposes of clinical research phases.
- Updated Belief: Prior odds 1 multiplied by 0.7/0.3 give odds 7/3, hence probability 70%. The favorable result raises confidence without establishing certainty or deciding treatment suitability.
- Tech Product Launch:
- Initial Belief: H is that a smartphone will reach a defined market-share target by a specified date. The illustrative prior is 60%, or odds 3/2.
- New Evidence: Early sales are weak. Suppose such results have probability 20% if the target will be reached and 45% if it will not.
- Updated Belief: Multiply 3/2 by 0.2/0.45 to obtain odds 2/3, or probability 40%. Weak sales favor missing the target; a supply interruption might require a different model and likelihood.
- Archaeological Hypothesis:
- Initial Belief: H is that this site was the location of a particular battle. The illustrative prior is 30%, or odds 3/7.
- New Evidence: Excavators find a specified combination of dated weapons and their spatial arrangement. Suppose that pattern has probability 70% at the battle site and 20% at a non-battle site. Merely finding compatible weapons would not justify these numbers.
- Updated Belief: The likelihood ratio is 3.5. Multiplying prior odds 3/7 by 3.5 gives odds 3/2, or probability 60%. The alternative explanation matters: artifacts equally common at ordinary settlements would produce little or no update.
- Climate Change Prediction:
- Initial Belief: H is that a specified temperature measure will exceed a defined baseline by at least 2°C within fifty years. In this purely hypothetical model the prior probability is 80%, or odds 4; this is not a real climate projection.
- New Evidence: A specified emissions pattern is observed. Assume the model gives it probability 45% conditional on H and 20% conditional on not-H. The future policy assumptions and the temperature baseline must remain explicit.
- Updated Belief: The likelihood ratio is 2.25; prior odds 4 become 9, or probability 90%. An observed emissions increase alone does not dictate this exact update—the stipulated model does.
These examples hold each proposition fixed and explain why the new evidence changes its probability. The numbers are not interchangeable measures of enthusiasm. A real update must also check data quality, competing explanations, and whether the same evidence has already been counted.
Claude response · editorial edition
Here are four further scenarios with an initial judgment, an upward update, and a later reassessment. The original response assigned exact percentages without a model to support them. Qualitative changes are more honest here; the preceding response shows how exact numbers can be justified when likelihoods are supplied.
- Belief in Psychic Abilities
Initial belief: A particular claimant’s ability to predict hidden targets remains unestablished.
New evidence: A friend reports accurate predictions. If reliable and genuinely unexpected under ordinary explanations, that report could slightly increase confidence; selective recollection may instead explain it.
Later evidence: Adequately powered, well-controlled tests of the same claim show chance-level results. Confidence falls to the extent that those results would be unlikely if the claimed ability existed. A vague anecdote and a controlled test need not carry equal weight. - Belief in the Net Benefit of a New Drug
Initial belief: Early trials make a particular treatment’s overall benefit plausible for a specified population.
New evidence: Larger controlled trials report the prespecified benefits and measured harms, strengthening that judgment.
Later evidence: Credible reports suggest a serious adverse effect. They warrant investigation and may lower confidence in net benefit, depending on frequency, severity, and causation. They do not, merely by being side effects, disprove efficacy; benefit and harm are different propositions. - Belief in a Paranormal Interpretation of a Video
Initial belief: The claim that this video records a paranormal event has low support.
New evidence: An apparently anomalous image may initially raise interest and slightly increase confidence if ordinary explanations seem less likely.
Later evidence: Verified editing records show that the apparent event was inserted. The video no longer supports that interpretation. This directly undermines the claim about this recording, not by itself every possible paranormal claim. - Belief in Human-Caused Climate Change
Initial belief: A reader has high confidence that human activities are the main cause of recent global warming, based on the converging physical evidence.
New evidence: An independent analysis strengthens the attribution if its result is more expected under human forcing than relevant alternatives.
Later challenge: A few dissenting claims about natural cycles do not automatically reduce confidence. A downward update would require evidence that actually weakens the attribution or exposes a flaw in supporting analysis. Count evidential content and independence, not dissenting voices. IPCC synthesis and assessment of the evidence.
An update can be upward, downward, or effectively zero. First specify the proposition, then ask whether the new information favors it over alternatives. Avoid changing from “effective” to “safe,” or from “this video is genuine” to “all paranormal phenomena exist,” halfway through an example.
Prompt 5: Create a 10-item quiz on the entire thread above.
Two ten-item quizzes and answer keys
ChatGPT response · editorial edition
Quiz: Understanding Rational Belief and Evidence
- What is meant by “rational belief” in the context of epistemology?
- Explain the concept of an “epistemic switch” as discussed in the dialogue.
- How does the professor in the dialogue challenge the student’s “epistemic switch” notion?
- In the scenarios provided, identify one where the decision is rational despite only a 20% confidence due to high potential rewards.
- What model of belief adjustment does the professor advocate as more reflective of real-world inquiry?
- How is belief updated in the scenario involving the archaeological hypothesis?
- In the tech product launch scenario, how does new evidence affect the company’s confidence in the product’s market success?
- Why does diversification alone fail to justify the hypothetical investment with a 20% chance of success?
- Why does the climate scientist update the probability of temperature rise in the prediction scenario?
- Why does a favorable controlled efficacy result support a different claim from a reassuring early safety result?
Answers:
- Rational confidence should respond to the total relevant evidence and background information, without an unsupported jump to certainty.
- The “epistemic switch” is the idea that belief turns from off to on once evidence surpasses a certain threshold, akin to a binary switch.
- The professor separates practical acceptance or action from certainty and uses a dimmer to illustrate degrees of confidence.
- The preliminary laboratory study: expected benefit is 0.2 × 20 = 4 units and cost is 1, giving expected net value 3 under the stated assumptions.
- Evidence-responsive, graded confidence; updates may be large or small, and the dimmer analogy alone does not determine their size.
- The assumed evidence likelihoods are 70% under the battle-site claim and 20% under its alternative. Their ratio 3.5 turns prior odds 3/7 into 3/2, raising probability from 30% to 60%.
- Weak sales have assumed probabilities 20% under success and 45% under failure; multiplying prior odds 3/2 by 0.2/0.45 gives posterior odds 2/3, or 40%.
- Diversification does not repair an unfavorable payoff. The example also specifies a 10-unit success return, 1-unit stake, affordable loss, and no better alternative; these make the expected net gain 1 unit.
- In the hypothetical model, the emissions evidence has a likelihood ratio of 2.25, turning odds 4 into 9 and probability 80% into 90%. Those are stipulated model values, not an actual climate estimate.
- An efficacy study tests a defined benefit against a comparator. Evidence about tolerability or early safety does not by itself establish that benefit, and benefit does not by itself establish acceptable overall harm.
Claude response · editorial edition
Here is a 10-item quiz on the concepts covered in our discussion:
- According to the view presented, is there a binary “on/off” switch where belief goes from 0 to 100% once a certain evidence threshold is crossed?
- How should a rational mind adjust its degree of belief as new evidence emerges?
- Can choosing an action be rational when confidence in its success is only 20%, and does that make success more likely?
- Give one example in which a 20% chance of a desired outcome supports acting once consequences and alternatives are specified.
- True or false: A rational mind should demand absolute certainty before accepting any degree of belief.
- What key factor determines whether a degree of belief is reasonable or not?
- Can different background information or defensible model assumptions explain different confidence judgments without making arbitrary disagreement rational?
- If genuinely new evidence favors a claim over its alternatives, how should confidence change?
- If genuinely new evidence favors the alternatives, how should confidence change?
- Should the goal be certainty in every claim, or confidence warranted by the evidence?
Answers:
- No
- Update according to what the new evidence supports relative to alternatives, including little or no change when it adds no relevant information.
- Yes, acting can be rational; no, the favorable consequences do not increase the evidence-based probability of success.
- For example, the hypothetical pilot costs 2 units with a 20% chance of a 20-unit benefit, giving expected net value 2 if the loss is affordable and alternatives are worse.
- False
- The total relevant evidence, its quality and independence, and justified background assumptions.
- Yes. The source of the difference still needs examination; a personal standard is not a license for any chosen probability.
- Increase
- Decrease
- Confidence warranted by the evidence, expressed with no more precision than the assessment supports.
Prompt 6: Provide 15 discussion questions relevant to the content above.
Two sets of fifteen discussion questions
ChatGPT response · editorial edition
- How does graded confidence differ from practical acceptance of a claim, and can both play a legitimate role in inquiry?
- Discuss the implications of adopting an “epistemic switch” model in everyday decision-making.
- What are the potential downsides of maintaining a belief system that adheres to the “epistemic switch” notion?
- How might continuous belief adjustment, as proposed by the professor, be implemented in practical scenarios like business or healthcare?
- Compare and contrast the epistemic switch model with the continuous adjustment model in terms of flexibility in response to new evidence.
- In the clinical trial scenario, how does updating beliefs based on new evidence align with scientific methods?
- Discuss how the strategic investment example reflects rational decision-making despite low probability of success. What does this say about risk management?
- In the archaeological example, why does the frequency of similar artifacts at other kinds of site matter? How could counting dependent findings as independent distort the update?
- Evaluate the effectiveness of using a dimmer switch analogy for belief adjustment in explaining the process to someone unfamiliar with the concept.
- How does the belief updating process in the tech product launch scenario reflect the challenges companies face in dynamic markets?
- Discuss the role of pessimistic and optimistic biases in adjusting beliefs when new evidence contradicts previous expectations.
- How might cultural or psychological factors influence one’s willingness to adjust beliefs in light of new evidence?
- How should demanding standards for consequential decisions be distinguished from a claim to certainty?
- What assumptions would be needed to justify the hypothetical climate-projection update, and how should its uncertainty enter a policy decision?
- How can educators use the concept of belief adjustment to teach critical thinking skills in the classroom?
Claude response · editorial edition
Here are 15 discussion questions related to the concepts covered:
- What are the potential pitfalls of requiring an overly high evidential bar before accepting any degree of belief?
- Can you think of any beliefs for which absolute certainty may be a reasonable standard? Why or why not?
- How might personal biases or motivated reasoning influence one’s assessment of “adequate evidence”?
- In what types of domains or decisions is it most crucial to calibrate beliefs accurately to the evidence?
- Are there situations where it could be rational to hold a very low degree of belief, say 5-10%, despite lacking strong disconfirming evidence?
- How should the costs of a false positive or false negative affect action thresholds without simply changing confidence to suit the stakes?
- How do differences in available evidence across subjects affect warranted confidence, and how is this distinct from setting a threshold for practical acceptance?
- What roles do background assumptions, explanatory power, and theoretical virtues play in rational belief revision?
- How can one avoid getting stuck with an intransigent belief that doesn’t update even as disconfirming evidence mounts?
- Are there beliefs so deeply held that no amount of contrary evidence could realistically dislodge them? Is this ever rational?
- Should emotional or moral factors like hope, fear, or ethical concerns ever influence one’s degree of belief?
- How might the stakes or consequences of being wrong affect the reasonability of holding a belief tentatively?
- Is it possible for two people to rationally hold very different degrees of belief given the same evidence? Under what conditions?
- How does the difficulty in assigning precise probabilistic confidences impact rational belief formation?
- In areas of great evidential uncertainty, how can one formulate and act on rational belief without falling into paralysis?
Future Branches
Where this page naturally expands
Nearby pages in the same branch include Belief/Evidence Graphic, Extraordinary Claims, Preponderance of Evidence?, and Pragmatic Considerations vs Epistemic Assessments; those links are not decorative, but suggested continuations where the pressure of this page becomes sharper, stranger, or more usefully contested.