Posts
Comments
This is both interesting and (I think) an important thing to know about science: plans and strategies are systematic, but discoveries sometimes are and sometimes aren't. In particle physics, the Omega baryon and Higgs boson were discovered in deliberate hunts, but the muon and J/psi were serendipitous. The ratio might be about half-and-half (depending on how you count particles).
Thinking about this, I have two half-answers, which may be leads as to why sweetener discovery might be discovered by serendipity, even though there are systematic searches for new drugs.
- Discovery depends, to a great degree, on your detector, and I don't think there's a better detector of sweetness than the ones in our mouths. Presumably, searches through virtual (not synthesized) molecules can be faster, and if the identification algorithm can accurately predict activation of the sweetness receptor, then it could outperform detection by taste only because it's faster than synthesis. But virtual drug discovery is still an open problem, still under development...
- Maybe there are, in nature, only a few sweet molecules, and they were discovered early. Going through the list of artificial sweeteners you mentioned, below are the discovery dates. When were most of the systematic drug searches? Did it cover this timespan, which seems to be in the early and mid-20th century?
- Saccharin: 1897
- Cyclamate: 1937
- Aspartame: 1965
- Acesulfame potassium: 1967
- Sucralose: 1976
(This suggestion also has an analogy with particle physics: hundreds of particles were discovered in the 1950's because accelerators had just been invented that could illuminate the strong-force mass range, which has rich phenomenology. At the current frontier, though, there are very few particles.)
Other comments in the comments section that sound quite likely to me are: (1) perhaps the very sweet compounds could be smelled, which prompted chemists to try tasting them (@mako-yass), and (2) maybe some of these origin stories are scientific folklore (@d0themath). Scientists, who are very concerned to get the description of physical reality right, are surprisingly cavalier about describing their own history in an accurate way.
This story from the perspective of the Thing did get into the notion of what it would be like to be an amorphous consciousness (and how odd it is that Earthlings aren't). It's still a little different, though, from the trajectory of being human and then realizing what it's like to be multi-human. A version with Pod People would be a different kind of story...
Cool! I'll read that one, too, thanks!
What I was thinking about with the pod people was their group mentality. (After all, it has long been considered a metaphor for communism.) I'd like to see someone imagine—or do it myself—the poddified people not as soulless outer shells of their former selves, but as themselves, "melted" into a group consciousness. As an example of something similar, the Buffy the Vampire Slayer episode, "The Wish" did an excellent job showing characters who remained themselves, but as evil versions of themselves, as vampires.
In the Invasion of the Body Snatchers and its remakes, the reason the poddified people are hard to distinguish from their former selves is because they're good at mimicry. They were only pretending to be their former selves. However, if one person's consciousness really isn't distinct from another's in a fundamental way, just by a much thinner channel of communication than that between the parts of one's brain, then thickening the channel of communication between people by telepathy would probably feel like a kind of awakening—realizing that there are all these other parts of you that had been hidden until now. These people would probably talk and act as they did in the Body Snatcher movies: they'd tell the anti-pod antagonists that there's nothing to fear from poddification, that they haven't lost anything, they've only gained a wider consciousness, etc., while the antagonists recoil in horror because it's a threat to their individuality. Whenever someone is poddified, they change their mind not because they've been overcome, but because now they, too, see what they've been missing.
Personally, I can't say which side I'd be on. It would be underwhelming for the author of this remake to just reverse the moral (individualism is bad; all is one, baby!). It is horrific to think of one's personality melting into a larger brain. Also, the end-state of that is sopolistic: there would be only one consciousness, with no one to talk to. (But then again, wanting to talk to others is wanting to thicken the connections between bits of consciousness, so that's the same thing again.)
Although G.K. Chesterton wildly misunderstood other cultures and was triumphalist about his own, I've always rather liked this image from The Romance of Orthodoxy (1908):
The oriental deity is like a giant who should have lost his leg or hand and be always seeking to find it; but the Christian power is like some giant who in a strange generosity should cut off his right hand, so that it might of its own accord shake hands with him.
What this "nuclear consciousness" mental model doesn't have is an account of knowing someone without being that someone. But then, is there such a thing?
That's why I'd like to see a rewrite of the Body Snatchers: to explore that idea, even if it doesn't come to a solid conclusion.
But if that observer is in the universe, then there's more in the universe than just the circle.
I was examining this universe from the outside. We can't actually do that, though we act as though we do in the physical sciences. (One idea in the physical sciences that takes seriously the fact that experimenters are a part of the universe they observe is superdeterminism, and it's one of the possible loopholes for Bell's Inequality.)
Panpsychism! (Sort of!) But I guess that makes sense, since panpsychism is trying to make sense of divisibility of consciousness, too.
I will read it, thanks!
Sorry that I didn't notice your comment before. You took it the one extra step of getting kinetic and rotational energy in the same units. (I had been trying to compare potential and rotational energy and gave up when there were quantities that would have to be numerically evaluated.)
Yeah, I follow your algebra. The radius of the ball cancels and we only have to compare and . Indeed, a uniformly solid sphere (an assumption I made) rolling without sliding without change in potential energy (at the end of the ramp) has 29% rotational energy and 71% linear kinetic energy, independently of its radius and mass. That's a cute theorem.
It also means that my "physics intuition trained on similar examples in the past" was wrong, because I was imagining a "negligible" that is much smaller than 29%. I was imagining something less than about 5% or so. So the neural network in my head is apparently not very well trained. (It's been about 30 years since I did these sorts of problems as a physics major in college, if that can be an excuse.)
As for your second paragraph, it would matter for solving the article's problem because if you used the ball's initial height and assumed that all of the gravitational potential energy was converted into kinetic energy to do the second part of the problem, "how far, horizontally, will the ball fly (neglecting air resistance and such)?" you would overestimate that kinetic energy by almost a third, and how much you overestimate would depend on how much it slipped. Still, though, the floppy track would eat up a big chunk, too.
Sorry—I addressed one bout of undisciplined thinking (in physics) and then tacked on a whole lot more undisciplined thinking in a different subject (AI alignment, which I haven't thought about nearly as much as people here have).
I could delete the last two paragraphs, but I want to think about it more and maybe bring it up in a place that's dedicated to the subject.
It might not matter in the grand scheme of things, but my comment above has been on my mind for the last few days. I didn't do a good job of demonstrating the thing I set out to argue for, that effect X is negligible and can be ignored. That's the first step in any physics problem, since there are infinitely many effects that could be considered, but only enough time to compute a few of them in detail.
The first respondent made the mistake of using the challenger's intentions as data—she knew it was a puzzle that was expected to be solvable in a reasonable amount of time, so she disregarded defects that would be too difficult to calculate. That can be a useful criterion in video games ("how well does the game explain itself?"), it can be exploited in academic tests, though it defeats the purpose to do so, and it's useless in real-world problems. Nature doesn't care how easy or hard a problem is.
I didn't do a good job demonstrating that X is negligible compared to Y because I didn't resolve enough variables to put them into the same units. If I had shown that X' and Y' are both in units of energy and X' scales linearly with a parameter that is much larger than the equivalent in Y', while everything else is order 1, that would have been a good demonstration.
If I were just trying to solve the problem and not prove it, I wouldn't have bothered because I knew that X is negligible than Y without even a scaling argument. Why? The answer physicists give in this situation is "physics intuition," which may sound like an evasion. But in other contexts, you find physicists talking about "training their intuition," which is not something that birds or clairvoyants do with their instincts or intuitions. Physicists intentionally use the neural networks in their heads to get familiarity with how big certain quantities are relative to each other. When I thought about effects X and Y in the blacked-out comment above, I was using familiarity with the few-foot drop the track represented, the size and weight of a ball you can hold in your hand, etc. I was implicitly bringing prior experience into this problem, so it wasn't really "getting it right on the first try." It wasn't the first try.
It might be that any problem has some overlap with previous problems—I'm not sure that a problem could be posed in an intelligible way if it were truly novel. This article was supposed to be a metaphor for getting AI to understand human values. Okay, we've never done that before. But AI systems have some incomplete overlap with how "System 1" intelligence works in human brains, some overlap with a behavioralist conditioned response, and some overlap with conventional curve-fitting (regression). Also, we somehow communicate values with other humans, defining the culture in which we live. We can tell how much they're instinctive versus learned by how isolated cultures are similar or different.
I think this comment would get too long if I continue down this line of thought, but don't we equalize our values by trying to please each other? We (humans) are a bit dog-like in our social interactions. More than trying to form a logically consistent ethic, we continually keep tabs on what other people think of us and try to stay "good" in their eyes, even if that means inconsistency. Maybe AI needs to be optimized on sentiment analysis, so when it starts trying to kill all the humans to end cancer, it notices that it's making us unhappy, or whimpers in response to a firm "BAD DOG" and tap on the nose...
This looks a lot like a typical high school/college freshman physics problem, and I guess the moral of the story is that it leads us to think that we should solve it that way. But if you were to work it out,
I think the ball's rotational energy would be a much smaller number than the gravitational potential energy of falling a few feet. The rotational energy of a solid sphere is , where and are the mass and radius of the ball and is the angular velocity of rotation. Meanwhile, the gravitational potential energy is , where . There are some quantities whose values we don't know, like , but looking at the set-up, I seriously doubt that rotational energy, or lack thereof because the ball doesn't stick to the track, is going to matter.
Fun fact: Galileo didn't drop weights off the Leaning Tower of Pisa; he rolled balls down slopes like this. He completely ignored/didn't know about rotational energy, and that was an error in his measurements, but it was small enough to not change the final result. He also used his heartbeat as a stopwatch.
I think the biggest effect here is the bendy track. It's going to absorb a lot (like ) of the energy, and can't be ignored. Alison uses the questioner's motives as data ("Calculating the effect of the ramp’s bendiness seems unreasonably difficult and this workshop is only meant to take an hour or so, so let’s forget that."), which she shouldn't.
Wow! That looks like a great book. Although one can find out by following the links you provided, I'd like to tell everyone here that the book is available for free on the author's website (PDF, epub, mobi).
They're similar-sounding questions, but different.
- "Do I have a headache when I'm not noticing it?" is a question about the definition of a headache. One definition is in the physical reality-box: a headache is neurological state that can be detected by a scientific instrument. Another definition is in the subjective reality-box: a headache is what I feel—I'm the only one who can say whether or not I have a headache. Some people deny that subjective reality is a kind of reality, and for them, the only real thing that can be called a headache is the one that could be detected by a scientific instrument. I'm asserting that the subjective reality is real, too, in a way that is neither superior to nor inferior to the physical reality. I thought that a headache (and maybe pain in general) would be a good example because imagine if you said, "I am in pain," and a doctor examined you, then declared, "No, you're wrong. You are not in pain." The doctor might say, "I can find no cause for your pain," or even "There is no physical cause for your pain" (a very strong statement!), but "You are not in pain" sounds like it fails a basic definition of what it means to be in pain.
- "Does an unheard falling tree make a sound?" could be about the limits of scientific induction if the "sound" you mean is physical waves in the air. Based on our scientific understanding, we strongly expect mechanical disturbances to make waves, even if we don't observe them. But if "sound" is the subjective experience of hearing sound, then it's the same doubling I referred to above: the vibrating air is one thing, the quale of hearing sound is another.
- "Does an automobile that will no longer automatically mobilize itself still an automobile?" is a different kind of question. That's related to but different from the ship of Theseus, about recognizing composite objects by form or function. If the mass of atoms can't be used to do what cars do—drive—then it seems we have no business calling it a car, but this particular mass of atoms previously worked as a car. Similarly, you could ask if it's still a car between times when it's being driven, since not having gasoline go through the engine makes it temporarily immobile, just as a car on blocks could be temporarily immobile, could be permanently immobile, depending on its future. Sure, there are philosophical questions there, but they're different questions from the one I was trying to raise.
Interesting: I've had the same thought and did the same experiment, though it wasn't a tooth removal, but some tooth-drilling that I was assured would not be touching a nerve. The normal anesthesia would have been local Novocaine, and I hate how Novocaine feels for the rest of the day. (So it was a choice between two sensations, over two different time periods.) Without the Novocaine, it was like a distant, dull pounding, like falling on a bone, which can be managed. I did this more than once, but my current dentist argued more strongly against it and I acquiesced rather easily.
The main thing I was worried about was controlling my body—I didn't want to flail and disrupt the dentist.
Just like you (and Celia Green) said about the preparation involved, I'd make a distinction between unexpected pain and expected-and-prepared-for pain. You can affect how you feel about a dentist visit, but not a sudden, stabbing pain in the back. (That may be a System-1, System-2 thing.) I've also found that I can relax into something cold—sitting on a stone in winter—but not something hot—being near a fire. We can choose to modify our will about some things, but others are too low-level and force themselves upon us from below.
(Which is part of the topic of "mind breaks down into smaller pieces" that I'm thinking about.)
I understand the softness of categories, and I don't mind that you would use the available data to not put me in the Christian box. Some things that you don't see are that I engage in Catholic practices, like going to mass (which is precisely why I canned an earlier draft and I'm writing again now).
If I gave the impression that Jesus is an iteration in general improvement of morality, then I mischaracterized my belief and my community's: we believe that Jesus is God—whatever that means. I have to add the "whatever that means" because it seems like a doctrine that deliberately confounds logic, like the bit about Buddha here, when paired with Christians' transcendent notion of God. If we thought of gods as giants who lived on Mt. Olympus, then one of them becoming physical like Zeus-the-swan wouldn't be a problem, but we go out of our way to describe God as being more like Plato's Zeus, which is everything that a limited, embodied, human being isn't. Catholics emphasize saints as evidence of continuing improvement, and the apostles are often portrayed as not understanding what was happening, but Jesus (and Mary) are untouchable.
On the other hand, I look at stories like Matthew 15:27, in which a Canaanite woman appears to teach Jesus about tolerance—at the beginning of the story, it seems like he didn't know. Most people I talk to say that it was like Socratic questioning—he really did know—but maybe the divine part of him is that he caught on and accepted the correction? While God-as-hypostatic perfection can't learn and improve (being outside of time), God-as-a-human being can and this is what it looks like? That sort of consideration is in the "whatever that means" phrase I used above.
Okay, now on the point about not mentioning heaven: not many people that I know do. Whereas I had to clarify that we follow the Jesus-is-God doctrine—quite heavily, it's a frequent topic—I usually only hear about heaven at funerals. While I'm sure that the people around me believe in it as "consciousness does not extinguish at death," the subject of heaven and hell come with a heavy dose of "this terminology/imagery is metaphorical." They'd be quick to point out that heaven (and hell) is not a "place" and I think some popes have made comments about hell being a state and not a place. (In particular, I remember one from the 90's, but that would be a few popes ago.)
You're right that the 2 Thessalonians letter sounds like demons eating your guts, and anything in the canonical set of books is considered as writing inspired by God (with or without their authors' understanding)—it doesn't matter that the writer claims to be Paul and might have not been Paul. (Attributing works to your group's founder seems to have been more common in the ancient world. I think it's not controversial that there were three "Isaiahs.")
Two things about that, though: Catholics don't put equal weight on everything in the Bible—they're all above a certain threshold of importance, but not equally important—and there's no actual fire and brimstone imagery in it, mostly just about being "shut out," the kind of imagery that Jesus used, for instance, in the wise and foolish virgins parable (Matthew 25). Meanwhile, a lot of material that didn't make it into the Bible but was influential in the early church did have more viscerally imagined rewards and punishments after death. It was an idea that was in the air at the time in Judaism (except for the Sadducees), and only got a little bit into the canonical Bible.
So, clearly, Catholics would hold that there's some kind of good and bad afterlife, and most of what I've heard has that you'll either be "with God" or "not," and not being with God is the bad thing in itself, irrespective of any gut-eating demons. Depictions of heaven and hell like C.S. Lewis's The Great Divorce are popular. (Napoleon Bonaparte is all alone in a huge mansion, repeating to himself that it was everyone else's fault...)
As for "No one comes to the Father except through me," I had never connected that to the afterlife before; it has always seemed more like a general coming-to-Jesus saying (in life, for the sake of living, not specifically the afterlife).
It is the case (my impression, which would be interesting to verify with a survey because it's an easy-to-ask question) that Catholics believe that there are non-Christians "with God" after death, i.e. in heaven. Even if they have to weasel out of some suggestively worded biblical passages (e.g. "good people who don't acknowledge Christ are mystically going to the Father through Jesus"), or not even try to explain it (e.g. "God will figure it out/above my pay grade"), there's a strong cultural current against making God look mean. Or a trickster, as you said in your original question.
Personally—maybe you'll consider me even less of a Christian because of this—I don't see an afterlife as something that happens to us as individuals. When there is talk about what heaven is like—hypostatic union, non-glass darkly—it doesn't seem like much psychological continuity with one's living ego. I'm not quite the person who inhabited this body 20 years ago, since my mind has changed a lot and what defines a person apart from their mind? So if we become outside-of-time, in-union-with-God, experiencing reality in a totally different way, how is that even me? Even following standard doctrine, the vision of heaven seems to have been exalted to such a degree that it's no longer relevant: what I recognize of what I am will die when my body dies, and maybe something mystical that I don't recognize goes off and does something else. But these are my own private musings (which I might change or maybe feel I have a better understanding of later) and not representative of Catholics or Christians in general.
Thank you for this response! (I have a few more books to add to my reading list.) Your post from 13 years ago is a very good explanation, too.
Ironically, though:
Here's an experiment for everyone to try: think it good to eat babies. Don't merely imagine thinking that: actually think it.
I have heard of an indigenous Australian tradition in which children were carefully, reverently turned into a blood-soup and consumed by the community (read in a book years ago, but there's this online). And I do try to imagine what it's like to live in this way. (I don't think they considered it a normal, everyday thing to eat babies, but that the emotional shock had a power that could perhaps be used as a kind of magic.)
But I get your point; it's like what I've been calling "degree of undeniableness." (Budziszewki compares it to 2 + 2 = 4 and you compare it to observing that a red thing is red: logical deduction and physical observation can be denied, but it's difficult to do so.) It's very hard for me to agree that it's good to eat babies. Even in the above-mentioned culture, I think it might have been a struggle, an aspect of society that was tossed as soon as they saw other ways of living. Maybe it's not so much about what human attitudes exist—which covers a lot of extremes—as what's easy to maintain and what gets tossed as soon as it's recognized as not necessary.
(It's not lost on me that the previous paragraph applies to all attitudes, not just ethics, but also smiling universes.)
A quibble: arguments against God in the gaps are arguments against God as an explanation of some physical phenomena. "Does the universe have a face?" (poetically speaking) is not a gap that could ever be discovered by experiment.
As you (and Yudkowsky, and eventually Hofstadter) rightly point out, there isn't a universally compelling foundation to logic or reasons for things in general. In Reality and reality-boxes, I called the unifying feature among the uses of the word "reality" as a "degree of undeniableness," since anything can be flat-out denied, it's just harder to do so with some things than with others.
That all is fine when we're talking about metaphysics that doesn't connect with any physical measurements, but what I'd really like to know is how—without grounding—we can determine what to do. That is, how to conclude, even for one's self, that one action is wrong and another is right (which happens every time we do even the most trivial of actions).
That's why I was interested in the universe having a face, for the cosmos to have opinions about human actions. I've said elsewhere in this comment thread that I'm not very keen on that argument anymore because the mere existence—posited existence—of true good and true bad doesn't help when our only access to ideas of good and bad are our feelings. It seems that when we're deciding to act, we're only pitting one set of feelings (e.g. social duty) against another (e.g. personal desires). I seem to be back to Emotivism when it comes to meta-ethics and I'm wondering if there's a way to be convinced otherwise.
Have you ever been stuck debugging code and made a breakthrough by explaining it to someone else, even if they weren't following what you're saying? I think that's happened here, so thanks for asking me the question!
The religious community I'm in is not keen on proving the physical reality of miracles, the way that some will put a lot of effort into explaining, for instance, how and why the sun stayed still in the sky when Joshua prayed for it. (My community would quickly call something like that mythological.) The miracles that my community does assert—I was wrong when I said that they don't assert any miracles—are not an affront to physical evidence, they're an affront to logic.
Saying "affront to logic" makes it sound bad, but these are statements that are not supposed to be logical—that's not their social purpose. (Wrong "language game," as Wittgenstein put it.) The positions taken on Jesus's resurrection and the Eucharist, as described above, are not illogical but antilogical: they're constructed in such a way as to make analysis impossible, on purpose. We didn't just not notice that we're saying "the Eucharist is physically body and blood" and also "materially, it's bread," which is an obvious contradiction, in the same way that "Tell me you're X without telling me you're X," is an impossible imperative—it can't be the same "tell" in both cases.
I've previously noticed this about the Trinity. Most of the early heresies were trinitarian, and it was the most reasonable-sounding theories that were rejected as heresies. One mainstream statement is, "The Father is not the Son, the Son is not the Spirit, and the Spirit is not the Father, but the Father is God, the Son is God, and the Spirit is God." That deliberately breaks the transitivity of the word "is," so it's not an equivalence relation. If you ask someone about the logic of that, they'll remind you it's a mystery, which puts it in a category of things that are not allowed to be figured out; they're intended for contemplation.
This is sounding to me like a koan. Zen koans are also supposed to be contemplated but not solved. In mainstream Buddhism (broader than Zen), I came across this astonishing statement, that none of the following are true about the Buddha after his death:
- The Buddha exists.
- The Buddha does not exist.
- The Buddha exists and does not exist.
- The Buddha neither exists nor does not exist.
Just as the trinitarian formulation breaks transitivity, the above breaks the law of excluded middle. Or maybe not "breaks," since it's possible to have logical systems in which a relation is not transitive and the law of excluded middle is not used in proofs, but the people who think about these things are not in a hurry to replace them with formulations that are logically sound. That's clearly not the point.
So it's antilogical, which renders moot the question of whether it's consistent with physical reality. That's why my initial impression was, "No, they/we don't believe in physical miracles."
Right, as far as I know. Years ago, someone confided in me (I'm not saying who) that they experienced a perceptual miracle: something they could see that no one else could see. That kind of miracle is consistent with physical facts—it's a subjective decision to conclude whether the vision is meaningful or not.
I once asked at that Faith and Reason study group "if angels have backs." That is, if Mary is seeing Gabriel talking to her, whether only as much as she needs to see is manifested—namely, the front. Everyone else was of the opinion that this was beside the point, as in it doesn't really matter. I conceded that we'd never know, anyway.
Maybe I'm overstating this lack of belief in miracles: nearly all Christians, liberal Catholics included, believe that Jesus rose from the dead, which you'd think is a physical event—blood flowing again, muscles moving, etc. On the other hand, it's an odd sort of body to be appearing and disappearing, passing through locked doors, being unrecognized or recognized at will, etc. I've never understood how eating fish is supposed to prove that he's not a ghost when he passed through a locked door in the same scene. This doesn't go against physical fact, it just confuses the issue for me. I don't know quite what is meant by "alive again."
And to really clinch the oddness of the language, nearly all Catholics, liberal Catholics included, believe that the Eucharist "physically" becomes the body and blood of Jesus, while also being indistinguishable from bread at all physical levels—they will say that microscopes and chemical analysis would reveal gluten, not muscle and red blood cells. These can't be statements in the same reality-box, the first use of "physically" (quoted above) must be in an interpretive sense like the sense in which I interpret the material tubes hanging off my hands as "my" fingers. That's a choice of interpretation that can neither be confirmed nor denied by any experimental measurements—experimental measurements only conclude that these fleshy tubes are made of cells and bones and such, I'm the one who calls it part of my body. That's what I'm assuming my co-religionists believe about the Eucharist because the direct statement is not contrary with fact, it's contrary to logic.
Actually, in all cases when I ask about this, the response I get is along the lines of "that's beside the point," i.e. the metaphysics of miracles isn't a subject of interest. It is the case that my community is equally unconcerned with claims for physical miracles, like real blood coming out of a statue-Mary's eyes or something. There are other groups who are very focused on things like that, and this isn't one of them.
As a statement about "What is the most fundamental type of thing?", it can't be justified by deduction or an appeal to observation the way that a statement about a particular physical thing in the universe can be. Like, if you want to find out why phosphorescent rocks glow, you can look at them under microscopes, experiment with them chemically, apply theories of molecular structure taken from other observations, etc. But if you ask things like, "Do phosphorescent rocks glow for any reason at all?" "Is nature comprehensible?" "Does it all resolve to mathematics at root, or something else?", those sorts of questions are not answerable by deduction and/or observation because they're about the applicability of deduction and/or observation. We—our culture, over the past few hundred years—chose to make the unexplained leap to think of matter in mathematical/scientific ways, affording it no agency of its own, no "vis viva," no "it just wants to," "there's a nature spirit," etc. I believe that was a good choice (I'm a physicist, after all); I think that the insight the mathematical and physical sciences appears to provide (which is a feeling) is connected to a real, objective world on the other side of our perceptions. But we can't call that leap rational.
In the above, I was talking about another assumption one can make about Everything (is "cosmos" a good word?), more generally than the physical universe itself. The idea that Everything exists at all for a thought-like reason—intention—is not more or less justified than for no reason, or out of logical necessity (what would that logical necessity argument be, and why is the argument itself necessary?), or various other things philosophers have come up with. It's the subject matter that makes this undecidable, the fact that we're trying to point to Everything. Any position you could have on that is a leap.
Sometimes, when person A leaps one way and person B leaps another way, A thinks B just hasn't understood or conceptualized A's position. That isn't necessarily the case. I was fully willing to see the cosmos as a pointless absurdity (I had read a lot of Camus), and when I saw that my wife's idea that the cosmos was intended by a mind makes sense, too, I thought, "I can go with this." In fact, it seemed to solve a problem, providing objectivity to ethics, why we should do any specific thing instead of some other specific thing.
As I said later, I'm now less enthusiastic about the "opinions of the cosmos → objective ethics" argument because it doesn't connect with how we can know that a particular action is good or bad: we're still going with our feelings. Knowing that there is a correct choice but not knowing if our feelings align with that correct choice is not helpful. By analogy, I could posit the existence of a particle in the physical universe that has exactly zero influence on any of the particles that give us sense-perceptions. Maybe it's true that that particle exists, but it's not useful for the theory.
So yes: it's an unexplained leap, this is subject matter for which nothing is possible except unexplained leaps, I brought it in because I thought it could give an account of actions being good or bad, but in the end, it effectively doesn't.
I was answering a question, and I took it out of the comments stream to keep from derailing that stream. But perhaps doing that made it more visible, which is not what I had intended.
It seems that religion is just an off-limits topic here, regardless of whether it seems like it might be relevant in some conversation. At the very least, I'll never bring it up again.
I'm still Catholic. I was answering your question and it got long, so I moved it to a post: Answer to a question: what do I think about God's communication patterns?
I think it would be more correct to say that a focus on believing particular assertions is a fairly recent trend in religion, encompassing the past millennium or two, but really picking up in the last few centuries.
It happened in or between Christianity and Islam (as isusr points out), and they probably both influenced each other. For example, Protestant Christianity focuses a lot more on a holy book than Catholicism and Orthodox Christianity, but in a way that resembles Islam's veneration of the Quran: citing verses to prove points. Since then, Catholics and Orthodox have also stepped up their focus on the Bible. There's a lot of cross-pollination.
In the last century or so, religious statements have been presented as a kind of alternate-science (e.g. Young Earth science), presumably to respond to an apparent threat, but this is a very new way of taking about religion. There were biblical literalists (and non-literalists) throughout Christian history, but ancient theologians would probably accuse these people of missing the point.
Meanwhile, religions with only recent sustained contract with Christianity and Islam (past half-millennium) and religions that preceded them focus a lot more on practice, i.e. ritual and social behaviors. Some belief is implicit (e.g. why leave offerings for gods or ancestors if you don't think they exist in a form that would benefit from the offerings?), but they are much less the focus.
And even more deeply than door-to-door conversations, political and religious beliefs spread through long-term friend and romantic relationships, even unintentionally.
I can attest to this first-hand because I converted from atheism to Catholicism (25 years ago) by the unintended example of my girlfriend-then-wife, and then I saw the pattern repeat as a volunteer in RCIA, an education program for people who have decided to become Catholic (during the months before confirmation), and pre-Cana, another program for couples who plan to be married in the church (also months-long). The pattern in which a romantic relationship among different-religion (including no-religion) couples eventually ends up with one or the other converting is extremely common. I'd say that maybe 90% of the people in RCIA had a Catholic significant other, and maybe 40% of the couples in pre-Cana were mixed couples that became both-Catholic. What this vantage point didn't show me was the fraction in which the Catholic member of the couple converted away or maybe just got less involved and decided against being married Catholic (and therefore no pre-Cana). I assume that happens approximately as often. But it still shows that being friends or more than friends is an extremely strong motivator for changing one's views, whichever direction it goes.
Since it happened to me personally, the key thing in my case was that I didn't start with a clear idea of what Catholics (or some Catholics, anyway) actually believe. In reading this article and the ones linked from it, I came to Talking Snakes: A Cautionary Tale, which illustrates the point very well: scottalexander quoted Bill Maher as saying that Christians believe that sin was caused by a talking snake, and scottalexander himself got into a conversation with a Muslim in Cairo who thought he believed that monkeys turned into humans. Both are wild caricatures of what someone else believes, or at least a way of phrasing it that leads to the wrong mental image. In other words, miscommunication. What I found when I spent a lot of time with a Catholic—who wasn't trying to convert me—was that what some Catholics (can't attest for all of them) meant by the statements in their creed isn't at all the ridiculous things that written creed could be made to sound like.
In general, that point of view is the one Yudkowsky dismissed in Outside the Laboratory, which is to say that physical and religious statements are in different reality-boxes, but he dismissed it out of hand. Maybe there are large groups of people who interpret religious statements the same way they interpret the front page of the newspaper, but it would take a long-term relationship, with continuous communication, to even find out if that is true, for a specific individual. They might say that they're biblical literalists on the web or fill out surveys that way, but what someone means by their words can be very surprising. (Which is to say, philosophy is hard.) Incidentally, another group I was involved in, a Faith and Reason study group in which all of the members were grad students in the physical sciences, couldn't even find anyone who believed in religious claims that countered physical facts. Our social networks didn't include any.
Long-term, empathic communication trades the birds-eye view of surveys for narrow depth. Surely, the people I've come in contact with are not representative of the whole, but they're not crazy, either.
You might not be able to wiggle it enough to get what you want (depending on what you want), but you need to be able to wiggle it, yes.
Given the way "A causes B" is used in everyday speech and among philosophers, it seems that it needs to have some notion of "if A, then B" (with a possible addition of "is more likely"). To use "casual" to mean "deterministic" would be confusing—different enough, anyway, that this usage needs to be called out as unrelated, to avoid confusion. "Smoking causes cancer" is not deterministic (some smokers are lucky) and includes the idea that not smoking is a possibility.
I know there's the wildly different usage of "to cause" in relativity to mean "is before, with time-like separation," and that is also terribly confusing. It should be called out more.
I had seen Tegmark's four multiverses before, but relating it to this is something I hadn't considered. The first level of multiverses, with different initial conditions but the same laws, is a lot like how I understand Pearl's ensemble of possible worlds.
As for the universe being a mathematical structure, that seems to be pretty much what physicists assume by default. The formulations of string theory that I've seen (casually—I've never worked in that area) replace the space-time manifold with a non-geometric matrix, making it math all the way down.
Even if it is math all the way down, I would consider physical reality to be a different thing from mathematical reality because the physical fact is which mathematical structure is actual. The same way that Chalmers calls consciousness a "further fact" above and beyond material brains, the fact of which mathematical structure is the one that is our world, as opposed to just being logically possible, is a further fact above and beyond the mathematical possibilities.
If you replace "true" with "accurate," what does "accurate" mean?
I would have thought that "accurate" means that the distance between the model result and the true result is small, so it contains a notion of truth and a notion of distance.
I wasn't intending to take a side in utilitarianism/consequentialism; I just meant that, ultimately, a decision is made from intuition. It can't be deductive all the way down.
Okay, I take the word "should" to refer to a spectrum with ethics on one end (strong "should") and aesthetics on the other (weak "should"). It's possible that this is a wider use of the word "ethics" or "aesthetics" as others would have. Maybe those other things people are thinking about don't lie on a linear spectrum?
So, for example, when you're doing an algebra problem, "you should subtract the same amount from both sides of the equation, not just one side," is a choice to stay within the rules of algebra. Not doing so leads to less interesting results (everything being "equal" to everything else). I'm not sure whether that's closer to the ethics end or the aesthetics end; maybe it depends on whether the math is pure or applied.
But getting back to my meaning in that paragraph, the Sequences had a large section on ethics, and choosing to be rational comes through the text as a strong imperative. And then, having opinions on a "should" statement (whether you call it "ethics" or not) comes from beyond-experimental reasoning, because (by David Hume), an "is" does not imply a "should."
This is a good example of needing to watch my words: the same sentence, interpreted from the point of view of no-free-will, could mean the complex function of biochemical determinism playing out, resulting in what the human organism actually does.
What I meant was the utility function of consequentialism: for each possible goal , you have some preference of how good that is , and so what you're trying to do is to maximize over . It's presupposing that you have some ability to choose instead of , although there are some compatibilist views of free will and determinism that blur the line.
My point in that paragraph, though, is that you might have a perfectly rational machinery for optimizing , but one has to also choose . The way you choose can't be by optimizing over . The reasons one has for choosing also can't be directly derived from scientific observations about the physical world, because (paraphrasing David Hume), an "is" does not imply an "ought." So the way we choose , whatever that is, requires some kind of argumentation or feeling that is not derivable from the scientific method or Bayes' theorem.
Okay, I just did a deep-dive on the AI alignment problem and the Singularity on Wikipedia, and it will take me a while to digest all of that. My first impression is that it seems like an outlandish thing to worry about, but I am going to think about it more because I can easily imagine the situation reversed.
Among the things I came across was that Eliezer was writing about this in 1996, and predicted
Plug in the numbers for current computing speeds, the current doubling time, and an estimate for the raw processing power of the human brain, and the numbers match in: 2021.
GPT-3 has some tens to hundreds of billion parameters and the human brain has 86 billion neurons, and I know it's hand-waving because model parameters aren't equivalent to human neurons, but—not bad! On the other hand, we're seeing now what this numerical correspondence translates to in real life, and it's interestingly different than what we I had imagined. AI is passing the Turing test, but the Turing test no longer feels like a hard line in the sand; it doesn't seem to be testing what it was intended to test.
No one knows how to solve it, and it's likely only rationalists could.
Understanding what, exactly, human values are would be a first step toward expressing it in AI. I hadn't expected meta-ethics to get so applied.
...
You know what's really odd? The word "singularity" appears only 33 times in the Sequences, mostly as "when I attended the Singularity Summit, someone said..." and such, without explanation of what it was. Most of the references were in the autobiographical section, which I didn't read as deeply as the rest.
No, but I can see how it may be necessary. I guess I've been lucky that so far my interests have aligned with jobs that pay well enough for it to not be an issue—I'm sure some fields are more constrained than others. I didn't think that this would apply to programming, though. (That's my field, too.)
I don't know why I get these Less Wrong articles in my email, but I read this one because of a startling premise: choosing a job based on its monetary value as an investment. I don't suppose there's anything wrong with that, it's just a bit mind-blowing for me. Maybe culture shock? But if so, what culture is this?
Making judgments with limited information is a thing, and what you say about asymmetric loss functions makes total sense. (In other words, I'm on board with the point you were trying to make with this article.) It's just the idea of applying it to choosing a job, with total dollars earned as an optimization function that surprises me. Maybe that's what you meant by
Fortunately, I chose Wave for other reasons.
The "other reasons" are probably the reasons I would generally think of, such as whether the things you get to work on are interesting, how much self-direction you get or want, what you think should change in the world and whether the job makes an impact in that area, how it fits into the rest of your life, like the length of the commute, etc.