+ - 0:00:00
Notes for current slide
Notes for next slide

Yes/No Debate

Understand Your Disagreement

yesnodebate.org

1 / 29

Outline

  1. The Problem
    • Classic discussion format
    • Aumann's agreement theorem
  2. The Rules
    • An example run
    • Example debate
  3. The Debate(s)
    • Find your belief(s) to debate on
    • Debate in pairs
  4. The Feedback
    • Questions

Estimated duration: 90 min

2 / 29

Intro

  • Georg Jähnig

    • Less Wrong Berlin since 2015
    • interests: Disagreement techniques, Double crux
  • Yes/No Debate

    • since 2018
    • live workshops at
      • LW Berlin
      • European Less Wrong Community Weekend
      • Czech EA
    • online debates at reddit.com/r/YesNoDebate
3 / 29

The Problem

4 / 29

Sounds familiar?

  • Discussing for a long time and still
    • no (big) change of mind
    • no (big) learnings
5 / 29

Sounds familiar?

  • Discussing for a long time and still
    • no (big) change of mind
    • no (big) learnings
  • happens even when both are curious and willing to understand
5 / 29

Sounds familiar?

  • Discussing for a long time and still
    • no (big) change of mind
    • no (big) learnings
  • happens even when both are curious and willing to understand
  • likely because:
    • we like to talk about our favourite arguments / what convinced us
    • but that's not necessarily what the other cares about / what might convince them
5 / 29

Sounds familiar?

  • Discussing for a long time and still
    • no (big) change of mind
    • no (big) learnings
  • happens even when both are curious and willing to understand
  • likely because:
    • we like to talk about our favourite arguments / what convinced us
    • but that's not necessarily what the other cares about / what might convince them
  • communication / discussion unfortunately seen as
    • space for the speaker
    • not as service for the listener
5 / 29

Classic format: "I talk, you talk"

  • A and B get their speaking time (hopefully the same)
6 / 29

Classic format: "I talk, you talk"

  • A and B get their speaking time (hopefully the same)
  • while A speaks, B hopefully listens
6 / 29

Classic format: "I talk, you talk"

  • A and B get their speaking time (hopefully the same)
  • while A speaks, B hopefully listens
  • when then B speaks, B hopefully also addresses what A said
6 / 29

Classic format: "I talk, you talk"

  • A and B get their speaking time (hopefully the same)
  • while A speaks, B hopefully listens
  • when then B speaks, B hopefully also addresses what A said
  • ➡️ no built-in checks
  • ➡️ risk of talking at cross-purposes
  • ➡️ risk of no / too weak alignment
6 / 29

Classic format: "I talk, you talk"

  • A and B get their speaking time (hopefully the same)
  • while A speaks, B hopefully listens
  • when then B speaks, B hopefully also addresses what A said
  • ➡️ no built-in checks
  • ➡️ risk of talking at cross-purposes
  • ➡️ risk of no / too weak alignment

The fix: Put in the checks

  • ➡️ questions!
6 / 29

Classic format: "I talk, you talk"

  • A and B get their speaking time (hopefully the same)
  • while A speaks, B hopefully listens
  • when then B speaks, B hopefully also addresses what A said
  • ➡️ no built-in checks
  • ➡️ risk of talking at cross-purposes
  • ➡️ risk of no / too weak alignment

The fix: Put in the checks

  • ➡️ questions!
  • make sure they get asked
  • make sure they get answered
6 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
    • Answer briefly.
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
    • Answer briefly.
  • ↪ Ask Yes/No questions
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
    • Answer briefly.
  • ↪ Ask Yes/No questions
    • Do you agree that few people die from the vaccine?
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
    • Answer briefly.
  • ↪ Ask Yes/No questions
    • Do you agree that few people die from the vaccine?
    • If yes, does this mean that the vaccine is safe?
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
    • Answer briefly.
  • ↪ Ask Yes/No questions
    • Do you agree that few people die from the vaccine?
    • If yes, does this mean that the vaccine is safe?
    • about relevant facts and conclusions
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
    • Answer briefly.
  • ↪ Ask Yes/No questions
    • Do you agree that few people die from the vaccine?
    • If yes, does this mean that the vaccine is safe?
    • about relevant facts and conclusions
  • ↪ Go through your argument tree
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
    • Answer briefly.
  • ↪ Ask Yes/No questions
    • Do you agree that few people die from the vaccine?
    • If yes, does this mean that the vaccine is safe?
    • about relevant facts and conclusions
  • ↪ Go through your argument tree
    • until you see a difference
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
    • Answer briefly.
  • ↪ Ask Yes/No questions
    • Do you agree that few people die from the vaccine?
    • If yes, does this mean that the vaccine is safe?
    • about relevant facts and conclusions
  • ↪ Go through your argument tree
    • until you see a difference
    • ↪ this difference = a new disagreement
7 / 29
I should take the Covid vaccine.
Covid is dangerous. The vaccine is safe.
Many people die from Covid. Few people die from the vaccine.
I should not take the Covid vaccine.
?
  • Ask questions
    • Answer briefly.
  • ↪ Ask Yes/No questions
    • Do you agree that few people die from the vaccine?
    • If yes, does this mean that the vaccine is safe?
    • about relevant facts and conclusions
  • ↪ Go through your argument tree
    • until you see a difference
    • ↪ this difference = a new disagreement

(➡️ Double Crux)

7 / 29

Aumann's agreement theorem

  • Robert Aumann (*1930)
    • mathematician, game theory
  • If you know what I know & we're both rational, we must agree.
8 / 29

Aumann's agreement theorem

  • Robert Aumann (*1930)
    • mathematician, game theory
  • If you know what I know & we're both rational, we must agree.
  • Same information & Same reasoning → Same conclusions
8 / 29

Aumann's agreement theorem

  • Robert Aumann (*1930)
    • mathematician, game theory
  • If you know what I know & we're both rational, we must agree.
  • Same information & Same reasoning → Same conclusions
  • Same input & same code → same output
8 / 29

Aumann's agreement theorem

  • Robert Aumann (*1930)
    • mathematician, game theory
  • If you know what I know & we're both rational, we must agree.
  • Same information & Same reasoning → Same conclusions
  • Same input & same code → same output

↪ If I disagree with someone, at least 1 of these is true:

8 / 29

Aumann's agreement theorem

  • Robert Aumann (*1930)
    • mathematician, game theory
  • If you know what I know & we're both rational, we must agree.
  • Same information & Same reasoning → Same conclusions
  • Same input & same code → same output

↪ If I disagree with someone, at least 1 of these is true:

  • I lack (relevant) information.
  • I am not rational.
8 / 29

Aumann's agreement theorem

  • Robert Aumann (*1930)
    • mathematician, game theory
  • If you know what I know & we're both rational, we must agree.
  • Same information & Same reasoning → Same conclusions
  • Same input & same code → same output

↪ If I disagree with someone, at least 1 of these is true:

  • I lack (relevant) information.
  • I am not rational.
  • They lack (relevant) information.
  • They are not rational.
8 / 29

The Rules

9 / 29

10 / 29

  • Bert: "People should be allowed to carry guns in public."
10 / 29

  • Ana: "Should people be allowed to carry rifles?"
  • Bert: "Yes."
11 / 29

  • Ana: "Should people be allowed to carry hand grenades?"
  • Bert: "No."
12 / 29

  • Bert: "Should people be allowed to carry knives?"
  • Ana: "Depends. Yes for small knives (maybe blades <10cm). No for blades >20cm."
13 / 29

  • Bert: "So people shall not carry hand grenades, while the police have them?"
  • Ana: "False premise: The police do not have hand grenades."
14 / 29

  • Ana: "Do more people die from guns than from drugs?"
  • Bert: "I don't know."
15 / 29

Questions about the rules?

16 / 29

Caveats: When to use & when not

17 / 29

Caveats: When to use & when not

Yes/No debate works when:

  • talking with 1 other person
  • you have a clear starting point:
    • a statement that you disagree about
  • you both believe
    • there is an objective truth about the belief
    • that can be found using correct reasoning and maximum information
  • both are willing to change their mind, at least partly
  • where Scout Mindset is allowed
17 / 29

Caveats: When to use & when not

Works (probably) not at:

  • (public) debates where it is
    • not about information exchange between participants
    • but about representation of your belief
  • and you may not change your mind (in public)
  • where Soldier Mindset is expected
18 / 29

An example debate

It is acceptable to campaign for veganism while eating meat myself.

19 / 29

What to ask?

  1. Check for agreement with underlying claims:
    • Do you agree that many people die from Covid?
20 / 29

What to ask?

  1. Check for agreement with underlying claims:
    • Do you agree that many people die from Covid?
  2. Check for definitions / same understanding:
    • With "Covid vaccine", do you mean all vaccines, incl. non-mRNA ones?
20 / 29

What to ask?

  1. Check for agreement with underlying claims:
    • Do you agree that many people die from Covid?
  2. Check for definitions / same understanding:
    • With "Covid vaccine", do you mean all vaccines, incl. non-mRNA ones?
  3. "Whatabout" questions are encouraged:
    • Would you also recommend getting the flu vaccine?
20 / 29

What to ask?

  1. Check for agreement with underlying claims:
    • Do you agree that many people die from Covid?
  2. Check for definitions / same understanding:
    • With "Covid vaccine", do you mean all vaccines, incl. non-mRNA ones?
  3. "Whatabout" questions are encouraged:
    • Would you also recommend getting the flu vaccine?
  4. "Why" workaround – probe for an answer:
    • Is one of your reasons to not get vaccine the lack of long-term data?
      (If not, feel free to tell me the actual reason.)
20 / 29

What to ask?

  1. Check for agreement with underlying claims:
    • Do you agree that many people die from Covid?
  2. Check for definitions / same understanding:
    • With "Covid vaccine", do you mean all vaccines, incl. non-mRNA ones?
  3. "Whatabout" questions are encouraged:
    • Would you also recommend getting the flu vaccine?
  4. "Why" workaround – probe for an answer:
    • Is one of your reasons to not get vaccine the lack of long-term data?
      (If not, feel free to tell me the actual reason.)
  5. "Can you" trick:
    • Can you give me an example?
      (If yes, feel free to do so.)
20 / 29

What to ask?

  1. Check for agreement with underlying claims:
    • Do you agree that many people die from Covid?
  2. Check for definitions / same understanding:
    • With "Covid vaccine", do you mean all vaccines, incl. non-mRNA ones?
  3. "Whatabout" questions are encouraged:
    • Would you also recommend getting the flu vaccine?
  4. "Why" workaround – probe for an answer:
    • Is one of your reasons to not get vaccine the lack of long-term data?
      (If not, feel free to tell me the actual reason.)
  5. "Can you" trick:
    • Can you give me an example?
      (If yes, feel free to do so.)
  6. Lay out your whole reasoning – but step-by-step:
    • Covid causes many deaths, correct?
    • From this follows it is dangerous, correct?
20 / 29

The Debate

21 / 29

Find ideas you'd like to debate on

  • list of EA-related ideas:
22 / 29

Find ideas you'd like to debate on

  • list of EA-related ideas:
  • your own ideas
    • add an elaboration in 2-3 sentences
    • belief tree
    • falsification criteria (what would change my mind?)
22 / 29

Get matched

  1. pick a memory card
  2. find the matching person
  3. compare your ideas
  4. pick an idea to debate
23 / 29

Debate

24 / 29

Your feedback

  • How was it?
  • Could you understand your counterpart's belief?
  • Did you update your belief?
25 / 29

Rinse & repeat

  • get matched again
  • and debate
  • feedback
26 / 29

Insights from previous debates

  • Asking is harder than answering
    • crafting a question forces you to realize what actually makes you believe what you think:
      • What are the relevant facts for you?
      • In what way do they lead to your belief?
27 / 29

Insights from previous debates

  • Asking is harder than answering
    • crafting a question forces you to realize what actually makes you believe what you think:
      • What are the relevant facts for you?
      • In what way do they lead to your belief?
    • Put yourself into your partner’s mind
      • remember what they have answered before
      • come up with a reasonable follow-up question.
27 / 29

Insights from previous debates

  • Asking is harder than answering
    • crafting a question forces you to realize what actually makes you believe what you think:
      • What are the relevant facts for you?
      • In what way do they lead to your belief?
    • Put yourself into your partner’s mind
      • remember what they have answered before
      • come up with a reasonable follow-up question.
  • in spoken debates: Asking is harder than in written ones
    • because: more time
27 / 29

Insights from previous debates

"It was surprisingly good to have a focal point to respond to. Even if they posted a wall of text explaining their position, the question was the only thing I felt required to address, so it took less mental energy to debate than it would have taken in a different format."

– debater from reddit.com/r/YesNoDebate

28 / 29

Yes/No Debate more

29 / 29

Outline

  1. The Problem
    • Classic discussion format
    • Aumann's agreement theorem
  2. The Rules
    • An example run
    • Example debate
  3. The Debate(s)
    • Find your belief(s) to debate on
    • Debate in pairs
  4. The Feedback
    • Questions

Estimated duration: 90 min

2 / 29
Paused

Help

Keyboard shortcuts

, , Pg Up, k Go to previous slide
, , Pg Dn, Space, j Go to next slide
Home Go to first slide
End Go to last slide
Number + Return Go to specific slide
b / m / f Toggle blackout / mirrored / fullscreen mode
c Clone slideshow
p Toggle presenter mode
t Restart the presentation timer
?, h Toggle this help
Esc Back to slideshow