How can I decide what evidence would change my assessment of an online claim?
Quick answer
Before looking for more information, write down your current assessment and confidence, then name what evidence would strengthen it, weaken it, or leave it unchanged. Make the criteria specific enough to apply consistently: describe the kind of evidence, what it would need to show, and what would count against the claim. Set these rules before you see the next result, and revise them only for a stated reason.
The question, the details, the next step.
I see an online claim and want to check it without just collecting things that agree with me. How do I start deciding what evidence would actually change my mind?
Start by separating your current view from the test you will use. Write the claim in one sentence, then record your provisional assessment and confidence in plain language. For example, you might write, “I currently think this is more likely true than not, but I am not certain.” That is a snapshot, not a promise to keep believing it.
Next, ask: “If the claim were false, what might I expect to find? If it were true, what would I expect to find?” This helps you look for evidence in both directions. Avoid criteria like “a convincing article” or “a trustworthy person says so”: they do not explain what observation would change your assessment. Instead, describe the evidence you would need to see and how it would bear on the exact claim.
How specific should those criteria be? I don't want to rule out useful evidence just because I didn't predict its exact form.
Make the criteria specific about the point they must establish, but flexible about the form evidence can take. For example, if a post claims that an event happened on a particular date, a useful criterion might be: “A record with a clear date and a traceable connection to the event would strengthen this; a reliable record placing it elsewhere would weaken it.” The exact record could vary, but the question it must answer is set in advance.
You can also write down what would be insufficient: repetition of the same claim without new support, evidence about a different date, or a source that does not show how it knows. Treat those as limits on what the information establishes, not proof that the claim is false. If you are unsure how to assess a piece of evidence, mark it “unclear” rather than forcing it into true or false.
Can you give me a worksheet that prevents me from changing the rules after I find something I like?
Use this before searching further. Keep it short enough that you can compare it with what you later find:
Claim: [one precise sentence] My current assessment: [for example, likely, uncertain, or unlikely] Confidence: [low, medium, or high, with a brief reason] Evidence that would strengthen it: [what it would need to show] Evidence that would weaken it: [what it would need to show] Evidence that would not settle it: [repetition, unrelated information, or another limit] What I will do with mixed evidence: [for example, lower confidence and note what remains unresolved]
Worked example, using a made-up claim: “The community meeting was moved to Thursday.” Current assessment: “Uncertain.” Strengthen: “A dated notice from the organizers, clearly referring to this meeting, says Thursday.” Weaken: “A dated notice from the organizers says the meeting remains on its original day.” Not enough by itself: “Several posts repeat Thursday but do not identify where the information came from.” This example illustrates a planning method; it does not establish anything about an actual meeting.
What if I find mixed or unexpected information, or realize my original test was too narrow?
Apply your written criteria first, then record what the new information does and does not show. Evidence may raise or lower your confidence without settling the whole claim. Note uncertainties, conflicting details, and any assumption you used; you do not have to force a final verdict.
If you need to change a criterion, write down the reason and keep the original version visible. A fair reason could be noticing that your test addressed only one part of the claim. Then state the revised test and apply it to evidence on both sides, not only to the item you just found. This makes the update understandable rather than quietly moving the goalposts. Your assessment can remain provisional, and a clear “I don't know yet” is a valid outcome.
A practical checklist
Write the claim as one specific sentence before searching further.
Record your current assessment and a brief reason for your confidence level.
Describe what would strengthen the claim and what would weaken it.
Name evidence that would not settle the question and why.
Apply the same criteria to evidence on both sides; label unclear or mixed results.
If you revise a criterion, record why and retain the earlier version.
A few more useful answers
Do I need to decide exactly how confident I am?
No. A plain-language label such as “uncertain” can be enough. The useful part is recording your starting point so you can notice whether new evidence changes it.
What if no available evidence meets my criteria?
Keep the assessment provisional and note what remains unknown. Not finding a suitable test does not, by itself, establish that the claim is true or false.
Can I change my criteria after I start checking?
Yes, if you identify a real gap or mistaken assumption. Record what changed and why, then apply the revised criteria consistently rather than only to evidence you favor.