Collaborative Truth-Seeking

post by Gleb_Tsipursky · 2016-05-04T23:28:22.268Z · LW · GW · Legacy · 17 comments

Summary: We frequently use debates to resolve different opinions about the truth. However, debates are not always the best course for figuring out the truth. In some situations, the technique of collaborative truth-seeking may be more optimal.

 

Acknowledgments: Thanks to Pete Michaud, Michael Dickens, Denis Drescher, Claire Zabel, Boris Yakubchik, Szun S. Tay, Alfredo Parra, Michael Estes, Aaron Thoma, Alex Weissenfels, Peter Livingstone, Jacob Bryan, Roy Wallace, and other readers who prefer to remain anonymous for providing feedback on this post. The author takes full responsibility for all opinions expressed here and any mistakes or oversights.

 

The Problem with Debates

 

Aspiring rationalists generally aim to figure out the truth, and often disagree about it. The usual method of hashing out such disagreements in order to discover the truth is through debates, in person or online.

 

Yet more often than not, people on opposing sides of a debate end up seeking to persuade rather than prioritizing truth discovery. Indeed, research suggests that debates have a specific evolutionary function – not for discovering the truth but to ensure that our perspective prevails within a tribal social context. No wonder debates are often compared to wars.

 

We may hope that as aspiring rationalists, we would strive to discover the truth during debates. Yet given that we are not always fully rational and strategic in our social engagements, it is easy to slip up within debate mode and orient toward winning instead of uncovering the truth. Heck, I know that I sometimes forget in the midst of a heated debate that I may be the one who is wrong – I’d be surprised if this didn’t happen with you. So while we should certainly continue to engage in debates, we should also use additional strategies – less natural and intuitive ones. These strategies could put us in a better mindset for updating our beliefs and improving our perspective on the truth. One such solution is a mode of engagement called collaborative truth-seeking.


Collaborative Truth-Seeking

 

Collaborative truth-seeking is one way of describing a more intentional approach in which two or more people with different opinions engage in a process that focuses on finding out the truth. Collaborative truth-seeking is a modality that should be used among people with shared goals and a shared sense of trust.

 

Some important features of collaborative truth-seeking, which are often not present in debates, are: focusing on a desire to change one’s own mind toward the truth; a curious attitude; being sensitive to others’ emotions; striving to avoid arousing emotions that will hinder updating beliefs and truth discovery; and a trust that all other participants are doing the same. These can contribute to increased  social sensitivity, which, together with other attributes, correlate with accomplishing higher group performance  on a variety of activities.

 

The process of collaborative truth-seeking starts with establishing trust, which will help increase social sensitivity, lower barriers to updating beliefs, increase willingness to be vulnerable, and calm emotional arousal. The following techniques are helpful for establishing trust in collaborative truth-seeking:



Here are additional techniques that can help you stay in collaborative truth-seeking mode after establishing trust:


Of course, not all of these techniques are necessary for high-quality collaborative truth-seeking. Some are easier than others, and different techniques apply better to different kinds of truth-seeking discussions. You can apply some of these techniques during debates as well, such as double crux and the reversal test. Try some out and see how they work for you.


Conclusion

 

Engaging in collaborative truth-seeking goes against our natural impulses to win in a debate, and is thus more cognitively costly. It also tends to take more time and effort than just debating. It is also easy to slip into debate mode even when using collaborative truth-seeking, because of the intuitive nature of debate mode.

 

Moreover, collaborative truth-seeking need not replace debates at all times. This non-intuitive mode of engagement can be chosen when discussing issues that relate to deeply-held beliefs and/or ones that risk emotional triggering for the people involved. Because of my own background, I would prefer to discuss poverty in collaborative truth-seeking mode rather than debate mode, for example. On such issues, collaborative truth-seeking can provide a shortcut to resolution, in comparison to protracted, tiring, and emotionally challenging debates. Likewise, using collaborative truth-seeking to resolve differing opinions on all issues holds the danger of creating a community oriented excessively toward sensitivity to the perspectives of others, which might result in important issues not being discussed candidly. After all, research shows the importance of having disagreement in order to make wise decisions and to figure out the truth. Of course, collaborative truth-seeking is well suited to expressing disagreements in a sensitive way, so if used appropriately, it might permit even people with triggers around certain topics to express their opinions.

 

Taking these caveats into consideration, collaborative truth-seeking is a great tool to use to discover the truth and to update our beliefs, as it can get past the high emotional barriers to altering our perspectives that have been put up by evolution. Rationality venues are natural places to try out collaborative truth-seeking.

 

 

 

17 comments

Comments sorted by top scores.

comment by caelhasse · 2016-05-30T05:25:36.655Z · LW(p) · GW(p)

Not to disagree with anything in particular I would like to make a case for for another option for seeking truth that is highly undervalued these days: thorough non-discussion and non-collaboration.

The search for good hypotheses can be very difficult. Often breakthroughs require deep conceptual insights. Consider for example Special and General Relativity, interpretations of probability, and I would argue Quantum Theory and artificial general intelligence are in need of such things. Collaboration--even good collaboration--has at least two problems in regard to deep conceptual insight:

  1. These insights may take years of thought and much energy maintaining focus for such a long period of time. Keeping in touch with a discussion can impose a large cost in focus, energy and time.

  2. Discussion and collaboration require communication but that can only occur to a greater or lesser extent when concepts and meaning of language used is roughly settled upon. Novel conceptual insights require by definition a change in concepts and meaning. These changes often cannot easily be communicated without a large amount of work outside of the discussion.

In order to seek truth we must consider the kinds of answers we expect might be necessary. If we consider normal methods and concepts are appropriate and we just need a lot of brainpower, then collaboration can be great. If however we need new concepts, an individual approach may be more appropriate.

Replies from: Gleb_Tsipursky
comment by Gleb_Tsipursky · 2016-05-30T16:35:31.398Z · LW(p) · GW(p)

Right on for individual insight! The Collaborative Truth-Seeking strategy is only for cases when you disagree with someone and want to figure out the best approach for going forward to get at the truth.

comment by SquirrelInHell · 2016-05-18T02:27:35.377Z · LW(p) · GW(p)

I like this a lot. A lot of similar thoughts here.

I think the biggest issue is not coming up with a list of techniques etc., but with taking care to explicitly set a frame for interaction which is different from the "default" (i.e. debating with all its pitfalls), and having it register with everyone on a deep enough level.

As the biggest hurdle to success, I'd identify not a lack of tools or rationality skills, but having enough training/awareness to remember to stick to the frame throughout the interaction.

Replies from: Gleb_Tsipursky
comment by Gleb_Tsipursky · 2016-05-18T03:07:02.169Z · LW(p) · GW(p)

having enough training/awareness to remember to stick to the frame throughout the interaction.

Yeah, awareness is key, as is the emotional trust, which is fundamental to helping be emotionally invested enough to make the awareness easier.

comment by buybuydandavis · 2016-05-05T11:40:13.302Z · LW(p) · GW(p)

Yet given that we are not always fully rational and strategic in our social engagements, it is easy to slip up within debate mode and orient toward winning instead of uncovering the truth.

To be fully rational is to orient toward winning.

Me, I'm not fully rational. I'm a moron. I typically do what you suggest instead - orienting toward truth (epistemic truth). It's taken me decades to realize the foolishness of that, but it is still my natural inclination.

-- Recovering Truthaholic

Replies from: Dagon, Diadem, Gleb_Tsipursky
comment by Dagon · 2016-05-05T16:31:58.076Z · LW(p) · GW(p)

To be fully rational is to orient toward winning.

Keep in mind that "winning" has a specific meaning here that's different from the colloquial. It doesn't mean winning debates or winning contests, it means guiding your experiences to the world-state you prefer. And if this isn't pretty deeply tied to truth-seeking, you probably have pretty trivial terminal goals.

Replies from: Lumifer
comment by Lumifer · 2016-05-05T19:00:32.613Z · LW(p) · GW(p)

it means guiding your experiences to the world-state you prefer

What does this mean? The straightforward interpretation is "reshape the world to your liking".

And if this isn't pretty deeply tied to truth-seeking, you probably have pretty trivial terminal goals.

Counterexample: election debates.

In general, sometimes you want to figure out the truth, but sometimes you need to remove roadblocks. In the latter case winning doesn't have much to do with truth-seeking and that does not imply the triviality of the terminal goals.

Replies from: MrMind, Dagon
comment by MrMind · 2016-05-06T09:56:34.553Z · LW(p) · GW(p)

Counterexample: election debates.

Uhm... you still need to know what truly persuade potential electors. In a formula:

truth-seeking =/= truth-telling

Replies from: Lumifer
comment by Lumifer · 2016-05-06T14:30:25.491Z · LW(p) · GW(p)

you still need to know what truly persuade potential electors

Yes, but you don't find it in a debate with your opponent.

There is time to figure out what to do, and there is time to just do it.

comment by Dagon · 2016-05-05T19:40:28.078Z · LW(p) · GW(p)

reshape the world to your liking

is a fair restatement, but doesn't capture MWI and my model of decisions as anthropic measurement rather than universe mutation. Everything possible actually happens; your choices are just a selector/cause of which timeline your observer finds itself in.

Figuring out the truth of election outcomes (your expected experiences conditional on different actions you take and the outcomes that occur) seems fairly important to me. My current estimate on the topic is that my debating or voting will have almost no impact on my future experiences. And getting correction and updates if that is NOT true would be extremely valuable.

Replies from: SquirrelInHell, Lumifer
comment by SquirrelInHell · 2016-05-18T02:22:32.148Z · LW(p) · GW(p)

Everything possible actually happens

This statement is vague, but if you mean something broad (i.e. all that you can imagine and more), I certainly don't think this is a consequence of MWI.

Maybe I don't know something, but the statement that "everything possible actually happens" seems to me like a collation between MWI and fairy tales/poor science fiction.

Please correct me if it's me who is ignorant.

comment by Lumifer · 2016-05-06T02:32:16.223Z · LW(p) · GW(p)

but doesn't capture MWI

Do you claim that accepting MWI is a necessary part of rationality and/or do you claim that there is empirical difference between an MWI world and a Copenhagen world?

Figuring out the truth of election outcomes

I should have been more clear: I meant debates between candidates, e.g. debates between candidates for the presidency of the United States. Clearly you want to win such a debate rather than truth-seek, and clearly your goals aren't exactly trivial.

Replies from: Dagon
comment by Dagon · 2016-05-06T14:24:20.611Z · LW(p) · GW(p)

Sorry to bring in MWI - it is how I model actions and decisions, but it's not necessary to the conversation.

you want to win such a debate

Agreed, and I was unclear above. Many times you want to "win" by convincing people to follow you, even if you are encouraging untruth in them. You still benefit by knowing the truth, as it will help you manipulate them. I'd argue that this drifts from rationality to ethics pretty quickly, but you're absolutely right: the point of debate may not be rational truth-seeking in the first place.

comment by Diadem · 2016-05-05T16:00:34.141Z · LW(p) · GW(p)

Very droll.

But define winning. In many situations, finding the truth is winning.

For example take global warming. Maybe I'm lobbyist for big oil and for me winning means making sure no one takes global warming seriously. But even then knowing the facts is still in my interest. So if I'm amongst fellow lobbyists who I trust it is in my interest to take an open, truth seeking approach. This will help me identify the strong and weak points in my opponents' arguments. It will help in formulating distractionary strategies. Etc. I will just have to make sure no one records the meeting and then leaks it.

comment by Gleb_Tsipursky · 2016-05-05T17:57:26.606Z · LW(p) · GW(p)

I agree that there are definitely situations where orienting toward the truth is not winning, although they are rare. The technique here is specifically for use in the vast majority of situations when orienting toward the truth is optimal.

comment by Alia1d · 2016-05-06T03:35:15.469Z · LW(p) · GW(p)

When you are

striving to avoid arousing emotions that will hinder updating beliefs and truth discovery

And otherwise being diplomatic where do you draw the line between that and motte-and-baileying them or otherwise being rhetorically manipulative?

When I'm talking with a view very different from my view, if I offer a watered down version of my view (that I still believe is true) so that there will be less inferential distance, am I being collaborative or deceptive? I fine this question particularly troublesome on the internet where it's hard to build up a deep understanding of someone's position.

Replies from: Gleb_Tsipursky
comment by Gleb_Tsipursky · 2016-05-06T17:40:58.864Z · LW(p) · GW(p)

Yeah, this is a tough one. I think the key is to share your intent with your collaborators. Use Tell Culture, explain your uncertainties and your desire to avoid triggering problematic emotions, and work with her/him to figure out the best path forward.