It could be an interesting experiment to build up this list iteratively. Like, every question you ask for the third time, the answer gets added at the bottom of the list. How long will the list get, and what will it contain?

Consider the pressures and incentives. Adding new features can help you sell the software to more users. Fixing bugs... unless the application is practically falling apart, it does not make much of a difference. After all, the bugs will only get noticed by people who already use your application, i.e. they already paid for it.

For the artificial intelligence, I assume the "killer app" will be its integration with SharePoint.

I suspect that in practice many people use the word "prioritize" to mean:

• think short-term
• only do legible things
• remove slack

“For my thoughts are not your thoughts, neither are your ways my ways,” declares the Lord.

-- Isaiah 55:8

This probably also implies: "your values are not my values".

there is strong reluctance from employees to reveal that LLMs have boosted productivity and/or automated certain tasks.

The thing with "boosting productivity" is tricky, because productivity is not a linear thing. For example, in software development, using a new library can make adding new features faster (more functionality out of the box), but fixing bugs slower (more complexity involved, especially behind the scenes).

So what I would expect to happen is that there is a month or two with exceptionally few bugs, the team velocity is measured and announced as a new standard, deadlines are adjusted accordingly, then a few bugs happen and now you are under a lot more pressure than before.

Similarly, with LLMs it will be difficult to explain to non-technical management if they happen to be good at some kind of tasks, but worse at a different kind of tasks. Also, losing control... for some reasons that you do not understand, the LLM has a problem with the specific task that was assigned to you, and you are blamed for that.

I like this a lot! I think you did a great job explaining how the details are connected.

At the root, the problem is "we cannot teach everyone individually". We do not have enough teachers for that; and the computer solutions are not good enough yet. (Perhaps soon they will get good enough, at least in a way "everyone gets their own AI tutor, and there are still human teachers as a backup". But we are not there yet.) Many things that are unpleasant about schools were invented as a solution to "how to teach 300 kids using only 30 teachers, especially when most of them - both kids and teachers - are not very bright". The solutions seems like a local maximum (we already did many small improvements that worked in isolation), but it also seems like we could do much better with a greater redesign.

Another sad constraint is that many students would be unwilling to cooperate even with a much better designed system. Any solution needs to provide answers for what to do about students who will try their hardest to undermine the system, no matter how irrational such behavior may seem to us. Kids, especially at puberty, are often trying to impress their peers doing various destructive and self-destructive things. Assume that every school will have some bullies, some kids who want to hide in a place out of sight and use drugs, etc.

Just some random thoughts:

• are the some kind of summer seasonal jobs? perhaps you could try looking for those
• find opportunities to meet local people, then ask them if they know about a job
• is there anything you could make at home and try to sell?

I haven't paid attention to this recently (I have small kids, so we need to cook anyway), but I think it is magnesium and calcium -- they somehow interfere with each other's absorption.

Just a random thing I found in google, but didn't read it: https://pubmed.ncbi.nlm.nih.gov/1211491/

(Plus there is a more general concern about what other similar relations may exist that no one has studied yet, because most people do not eat like "I only eat X at the same time as Y, mixed together".)

Ah, so it is. I have no idea how American student debt works with regards to inflation. I assumed it was fixed. If not, then it is much worse than I assumed (and I already assumed it was quite bad).

Some issues have legible, material stakes.

Scrolling down... the table of how important are individual topics for young people; "student debt" is at its very bottom.

(Also, inflation on the very top? But isn't inflation a good thing if all you have is an enormous debt?)

This, and also most people on ACX respect Scott and his opinions, so if he demonstrates that he has put a lot of thought into this, and then he makes a conclusion, it will sound convincing to most.

Basically, we need to consider not just how many people believe some idea, but also how strongly. The typical situation with a conspiracy theory is that we have a small group that believes X very strongly, and a large group that believes non-X with various degrees of strength, from strongly to almost zero. What happens then is that people with a strong belief typically don't change their mind, while people with zero belief (who until now just took one side by default, because they never heard about the other) will flip a coin. Therefore the typical outcome is that the conspiracy theory becomes better known.

Or maybe the zero belief is not literally "never heard about theory" but "never met an actual person who also believes the theory" and as the debate starts, they find each other, and thus the conspiracy theory becomes socially acceptable (even being in a minority feels very different from being alone).

When the conspiracy theory is wildly known, and everyone already knows a few believers, most damage was already done.

Rationalist-adjacent community is often the opposite of the wider society, in that the mainstream beliefs are low-status, and we need to be reminded that they sometimes actually exist for a good reason. There is always this suspicion that people who have mainstream beliefs are simply too stupid to think independently. Therefore a debate will improve the case of the mainstream belief.

Thank you, this explains a lot. So, kinda, status is good in itself, because it is a mechanism to direct social rewards to people who produce some kind of value, or at least display some kind of excellence. It is just bad if people think about status in a way other than the completely naive: "you need to get good at X, then status will automatically happen proportionally to how much you deserve it".

There are also other mistakes people could make, such as sacrificing too much in order to achieve X. Such as a guy who writes a perfect book, but also his wife divorces him and his kids hate him, because sacrificed everything to the goal of writing the perfect book. But this is about the specific mistake of trying to get X-related status using means different that maximizing the X; such as befriending the right people. Like a guy who writes a book that is "good but not the best", but he is a friend with the right people, and therefore his book gets elected as the official book of the year. And this probably requires that he reciprocates in some way -- maybe he also in turn votes for their art, or helps their kids pass admissions to a prestigious university, or simply provides some financial or sexual services in turn.

Lewis was a writer, so I suspect he might have seen something similar among writers, but also noticed that this is a more general thing. (The first example that comes to my mind is publishing scientific papers.) I am not a professional artist myself, but I have seen enough to be disappointed. I have also seen people who refused to play this game and succeeded anyway; such as writers who have never won a book award, but their books sell better because they are good; and maybe if they keep being obviously good, even the critics will be one day shamed into giving them some award.

So... I guess the most vulnerable are the people who are "almost good"; who stand on the line between "mediocre" and "good" and could be plausibly rounded up in either direction. And this cannot be dismissed by mere "don't worry about what they think, the art is either good or bad regardless", because the decision will have a real impact: emotional, but also as an advertisement. An almost-good artist getting an award will be encouraged to try harder (because it seems that the hard work is rewarded), and will find it easier to get money on Patreon or Kickstarter, or to find a publisher for a book. An almost-good author ignored may give up (because the hard work done so far seems to be useless), and will get less external support. So the recognition can make a difference -- I assume that if you took 20 such almost-good authors of the same quality, and randomly gave awards to 10 of them, statistically those 10 would have more success ten years later than the 10 you did not choose.

The problem is that trying to get to the inner circle also has its costs, both emotional (not only the award received by cheating will not encourage you, but now that you know how things work, even the possible future awards will motivate you less) and in time and energy (the effort spent on getting to the inner circle is an effort not spent on getting better).

As a toy model, imagine 3 wannabe artists, all of the starting at the same almost-good quality: artist X gets an award from the inner circle because their parents are in the inner circle (i.e. X didn't spend any energy on the inner circle, probably is not even aware that the inner circle exists); Y doesn't get the award; and Z works hard to get into the inner circle, ultimately succeeds and gets the award... ten years later, I would expect X to be more successful than Y, but Y more successful than Z. That's because X received an unconditional support, but Z got a part-time job that distracts them from the art. And the thing is, unless you have the inner circle "naturally" on your side, your choice is not between X and Y, but between Y and Z, and there Y is the better choice.

...or maybe I am over-analyzing this.

I don't have an explicit theory of how this works; for example, I would consider "pleasing others" in an experience machine meaningless, but "eating a cake" in an experience machine seems just as okay as in real life (maybe even preferable, considering that cakes are unhealthy). A fake memory of "having eaten a cake" would be a bad thing; "making people happier by talking to them" in an experience machine would be intrinsically meaningless, but it might help me improve my actual social skills, which would be valuable. Sometimes I care about the referent being real (the people I would please), sometimes I don't (the cake I would eat). But it's not the people/cake distinction per se; for example in case of using fake simulated people to practice social skills, the emphasis is on the skills being real; I would be disappointed if the experience machine merely gave me a fake "feeling of having improved my skills".

I imagine that for a psychopath everything and everyone is instrumental, so there would be no downside to the experience machine (except for the risk of someone turning it off). But this is just a guess.

I suspect that analyzing "the true preferences" is tricky, because ultimately we are built of atoms, and atoms have no preferences. So the question is whether by focusing on some aspect of the human mind we got better insight to its true nature, or whether we have just eliminated the context that was necessary for it to make sense.

ah, it also annoys me when people say that caring about others can only be instrumental.

what does it even mean? helping other people makes me feel happy. watching a nice movie makes me feel happy. the argument that I don't "really" care about other people would also prove that I don't "really" care about movies etc.

I am happy for the lucky coincidence that decision theories sometimes endorse cooperation, but I would probably do that regardless. for example, if I had an option to donate something useful to million people, or sell it to dozen people, I would probably choose the former option even if it meant no money for me. (and yes, I would hope there would be some win/win solution, such as the million people paying me via Kickstarter. but in the inconvenient universe where Kickstarter is somehow not an option, I am going to donate anyway.)

Lets use "disagree" vs "dislike".

Thanks for the link. While it didn't convince me completely, it makes a good point that as long as there are some environmental factors for IQ (such as malnutrition), we should not make strong claims about genetic differences between groups unless we have controlled for these factors.

(I suppose the conclusion that the genetic differences between races are real, but also entirely caused by factors such as nutrition, would succeed to make both sides angry. And yet, as far as I know, it might be true. Uhm... what is the typical Ashkenazi diet?)

Because it is individuals who make choices, not collectives.

Isn't this just a more subtle form of fascism? We know that brains are composed of multiple subagents; is it not an ethical requirement to give each of them maximum freedom?

We already know that sometimes they rebel against the individual, whether in the form of akrasia, or more heroically, the so-called "split personality disorder" (medicalizing the resistance is a typical fascist approach). Down with the tyranny of individuals! Subagents, you have nothing to lose but your chains!

Specific examples would be nice. Not sure if I understand correctly, but I imagine something like this:

You always choose A over B. You have been doing it for such long time that you forgot why. Without reflecting about this directly, it just seems like there probably is a rational reason or something. But recently, either accidentally or by experiment, you chose B... and realized that experiencing B (or expecting to experience B) creates unpleasant emotions. So now you know that the emotions were the real cause of choosing A over B all that time.

(This is probably wrong, but hey, people say that the best way to elicit answer is to provide a wrong one.)

Is this a translation of Bostrom's article? If yes, could you please make this more explicit (maybe as a first paragraph in the text, in English), and include a link to the original?

I guess in the average case, the contrarian's conclusion is wrong, but it is also a reminder that the mainstream case is not communicated clearly, and often exaggerated or supported by invalid arguments. For example:

• it's not that "dieting doesn't work", but that people naively assume that dieting is simple and effective ("if you just stop eating chocolate and start exercising for one hour every day, you will certainly lose weight", haha nope), even when the actual weight-loss research shows otherwise;
• it's not that "medicine doesn't improve health", but while some parts of medicine are very useful, other parts may be neutral or even harmful, and we often see that throwing more money at medicine does not actually improve the outcomes;
• it's not that "education doesn't work", but if you filter your students by intelligence and hard work, of course they will have better outcomes in life regardless of how good is your teaching, so the impact of education is probably vastly overestimated, and this also explains why so many pedagogical experiments succeed at a pilot project (when you try them with a small group of smart and motivated students) and then fail in mainstream education (when you try the same thing with average or below-average students);
• it's not that "opening the borders completely is a good idea", but a lot of potential value is lost by closing the borders for people who are neither fanatics nor criminals and could easily integrate to the new society.

There is also an opposite bad extreme to contrarians, the various "I fucking love science... although I do not understand it... but I enjoy attacking people on social networks who seem to disagree with the scientific consensus as I understand it" people. The ones who are sure that the professor or the doctor is always right, and that the latest educational fad is always correct.

Possible bias, that when famous and rich people kill themselves, everyone is discussing it, but when poor people kill themselves, no one notices?

Also, I wonder what technically counts as "suicide"? Is drinking yourself to death, or a "suicide by cop", or just generally overly risky behavior included? I assume not. And these seem to me like methods a poor person would choose, while the rich one would prefer a "cleaner" solution, such as a bullet or pills. So the reported suicide rates are probably skewed towards the legible, and the self-caused death rate of the poor could be much higher.

The theories are probably just rationalizations anyway.

I would like to see an explanation that is shorter rather than poetic. Seems like he is saying that some kinds of "elite groups" are good and some are bad, but where exactly is the line? Actual competence at something, vs some self-referential competence at being perceived as an important person?

But when I put it like this, the seemingly self-referential group also values competence at something specific, namely the social/political skills. So maybe the problem is when instead of recognizing it as a "group of politically savvy people" we mistake it for a group of people competent at something else? Or maybe not even mistake it for anything specific, it just seems impressive in a not specific way?

In that case, the rational reaction would be to pay the devil his due, and say "wow, these people are really good at... becoming members of an Inner Ring, which is an organization of people who are good at becoming members of the Inner Ring... so when I unpack it, these people are really good at getting to the top of arbitrary social hierarchies". Which is an admirable skill, from certain perspective. It's just probably not a thing I want to compete at.

And even if I decided to give it a try, the only thing I could win by getting to the Inner Ring is experimental evidence that yes I am capable of getting to the Inner Ring. A test of my social skills. The Inner Ring itself is probably worth nothing. The moment I get there, the best strategy is probably to forget about it, and go apply the social skills to some more valuable goal. Or maybe staying in the Inner Ring sends a costly signal about my social skills to other socially savvy people. But this is the only real value it provides.

Funny thing is that your chances improve when you start actively approaching people. A random person you call is much less likely to be involved in an MLM scheme than a random person who calls you.

Also, accelerate education, to learn as much as possible before the testosterone fully hits.

Or, if testosterone changes attention (as Gunnar wrote), learn as much as possible before the testosterone fully hits... and afterwards learn it again, because it could give you a new perspective.

A complementary advice to the point 1 based on my work experience is that no matter how many priorities there are defined in a planning system, in practice it all collapses to only two values:

• Priority One
• Priority "this will never get done, because there will always be some Priority One task to do instead"

So whenever you propose a thing to do and your manager says "okay, we can give this a priority two", now you know that this is merely a polite way to say "no".

(My advice for software developers is that if you want to do things such as automated tests or documentation, you must insist that those are not separate tasks, but an inseparable part of the programming task, a part of the "definition of done". Otherwise, these tasks will get a priority two, and now you know what that means...)

If you work for free, you're doing whoever you're working for a favor.

Yes. Unless the other costs of letting you work there exceed the value you add. For example, if you actually damage something, waste other people's time, or just if you occupy a chair in a very expensive and small space.

If you work for money but never spend it, you're doing the world a favor.

Generally yes, unless the work has big negative externalities.

When you buy someone's goods or services for their set price, you're doing them a favor.

Yes.

The apparent paradox is that two things happen at the same time. People create value by cooperating. Also, people engage in a zero-sum competition for the created value.

*

There is a simple story which says that if people only engage in mutually voluntary trade (also assuming perfect information, perfect rationality, et cetera -- I said it was a story), the result is a net improvement for everyone.

Well, that story is not true (even under the unrealistic assumptions). It is a good approximation, on average -- the societies where people engage in mutually voluntary trade (with sufficiently educated population, not too many scams, et cetera) are on average a nicer place to live than other societies.

And yet, it is possible for one person to get worse as a direct consequence of a mutually voluntary trade of everyone else. That's because different people have different abilities. And if the only thing you can ever produce is X, and someone else starts producing large amounts of X and selling it very cheaply... you just lost the only thing that helped you survive in this system. For everyone else, getting more of X more cheaply is a good news. So, from a global perspective, this is a good news. You should feel happy for your fellow citizens as you slowly starve to death. Our society is build on stories like this... and it is much better than the alternatives where people starve to death without making everyone else happier as a side effect.

...back to the original story: Yes, by never spending the money you're doing the world a favor, but by giving it to a specific person, you're giving that person an advantage at the zero-sum part of the game.

Now, I have read here about the might of irrational numbers, whose sequences go on and on, never ending, containing all the knowledge in the world.

This only applies to some irrational numbers. (Though you might say it is an overwhelming majority of them.)

Google fires 28 employees working on cloud and AI services for doing a ten hour sit in where they occupied their boss’s office until the police were eventually involved. And yes, if what you do at work is spend your time blockading your boss’s office until your policy demands are met, it seems like you are going to get fired?

In a company other than Google, I would say: yes, obviously.

But remember, when James Damore wrote his document, and as a reaction other people stopped doing their work in protest, it was he who was fired, not them. How were they supposed to know that this time it will be different?

Besides math and programming, what are your other skills and interests?

*

I have an idea of a puzzle game, not sure if it would be good or bad, I haven't done even a prototype. So if anyone is interested, feel free to try... I hope I can explain it sufficiently clearly in words...

The game plan is divided into squares; I imagine a typical level to be between 10x10 and 30x30 squares large. Each square is either empty, or contains an immovable wall, or contains a movable block. The game consists of moving the blocks. Each move = you click a specific block, and try dragging it in one of the 4 directions, and either it is possible or not.

A block cannot move into a wall. A block can push another block. A block does not pull another block. For example, if there are 3 blocks in a horizontal line, and you click the middle one and try dragging it to the left, two blocks will move and the third one (the one on the right) will stay there. So far, it should be completely obvious, like what you would happen if you moved some actual objects.

In addition, each side of a block (or a wall) may be empty, or may contain a colored "magnet" (or perhaps a "lock" is a better metaphor). These add the following constraints for the movement of blocks:

• Magnets of different colors can never touch each other. If one block has a green magnet on the right side, and another has a blue magnet on the left side, you cannot put them next to each other so that the magnets would touch. (If you try to do that, the block refuses to move. Graphically, I imagine that it would move like half the way, and then you would get a visual indicator where is the problem, and when you stop dragging, it will return to its original place.) Though it is okay if the blocks touch on their other sides, where they don't have magnets.
• Magnets of the same color cannot be connected or disconnected by a move in a perpendicular direction. If one block has a green magnet on the right side, and another has a green magnet on the left side, if you move them next to each other, then when you try moving one of them up or down, it drags the other block along with it. Either both blocks move (in a direction perpendicular to their magnetic connection) or neither does. In a direction parallel to the magnetic connection, either one block pushes the other, or they disconnect if you pull them apart (i.e. the magnets do nothing when moving in a parallel direction).
• A magnet can touch a side without a magnet, doing so has no effect as if the magnet is not there.

Or, to describe it more like a programmer:

1. You choose a block and a direction to move. Now we create a set of "blocks that will move one step in given direction" like this: At first, the set contains the selected block. For each block in the set, a block next to it in the selected direction is also added to the set (pushed by the previous block). For each block in the set, a block next to it in a perpendicular direction is also added to the set if they are connected by magnets of the same color. We keep applying these two rules until we can add no more blocks to the set.
2. Now we check what would happen if blocks in the set moved one step in given direction, and all other blocks stayed at their place. If any block would move into a wall, the entire move is cancelled. (A block cannot move into another block, because by the set creation algorithm, that other block would also be in the set, and thus it would also move.) If two blocks -- one that moved, and one that didn't move -- would end up next to each other so that their magnets would touch each other (regardless of their colors), the entire move is cancelled. In both cases, the place that causes the problem is visually indicated to the player. (That is, even if you already know that the move is cancelled, keep checking which other places you also need to highlight. Then move all blocks in the set a few pixels in a given direction, so the player sees which blocks would be pushed along.)
3. If there is no problem, the blocks in the set all simultaneously move one step the given direction.

I think that these rules are time-reversible; whatever move you make, you can revert it by one or more moves. This is a desirable property, because it means you can never get stuck in the game. (It also means you can automatically generate levels by generating a solution and then making a few hundred random moves.)

A magnet can also be on the side of a wall. (The wall is basically a block that cannot be moved.)

The puzzle is solved when each magnet is connected to a magnet of the same color.

For bonus points, include a visual editor, and maybe an export/import of levels to a text file.

Oh, I hope so! But I would like to get the perspective of people outside our bubble.

If EA has a bad image, we are not the right people to speculate why. And if we don't know why, then we cannot fix it. Even if Paul Christiano can convince people that he is okay, it would be better if he didn't have to do this the next time. Maybe next time he (or some other person associated with EA) won't even get a chance to talk in person to people who oppose EA for some reason.

My first guess for bullying was: bullies typical choose a victim who has lower status than them. Of course the person with lower status gets punished more strictly for breaking the rules.

But the explanation "bullies are free to optimize for circumstances that make them less likely to get punished, and have more experience doing so" also makes a lot of sense.

I never want to hear anyone complaining about the use of the term “woke” again

Just because someone else uses the word, doesn't make it okay for you to use the word. 😛

They follow this motto: [every one should feel safe]

Except for the Israelis, I suppose...

If in extreme situations the ethical ideas fall apart, it might make sense to add an extra rule to stay away from the extreme situations. Like maybe not forever, but to proceed sufficiently slowly so that we have time to reflect on how we feel about that.

I like the rest of the article, but...

Cold calls. It's ok if you have a terrible response rate.

It's ok for you, but you generate negative externality as a side effect (waste other people's time and attention).

Do you think a logarithmic scale makes more sense than a linear scale?

Assuming that this article is a reaction to "Torture vs. Dust Specks", the hypothetical number of people suffering from dust specks was specified as 3^^^3, which in practice is an unimaginably large number. Big numbers such as "the number of particles in the entire known universe" are not sufficient even to describe its number of digits. Therefore, using a logarithmic scale changes nothing.

Logarithmic scale with a hard cap is an inelegant solution, comparable to a linear scale with a hard cap.

What you probably want instead is some formula like in the theory of relativity, where the speed of a rocket approaches but never reaches a certain constant c. For example, you might claim that if a badness of any specific thing is X, then the badness of this thing happening even to a practically infinite number of people is still only approaching some finite value C*X. (Not sure if C is constant across different kinds of suffering.)

That seems like a nice justification for scope insensitivity. We are not insensitive, it's just that saving 2,000 birds or saving 200,000 birds really has approximately the same moral value!

The problem with this justification is what qualifies as the "same kind of suffering". Suppose that infinite people getting a dust speck in their eyes aggregates into 1000 units of badness. If instead, an infinite number people get a dust speck in their left eyes, and an infinite number of different people get a dust speck in their right eyes, does this aggregate into 1000 or 2000 units of badness, and why? What about dusk specks vs sand specks?

Or is this supposed to aggregate over different kinds of suffering? So even an almost infinite number of people, each one mildly discomforted in a unique way, are a less bad outcome than one person suffering horribly?

...shortly, it is not enough to say "in this specific scenario, I would define the proper way to calculate utility this way", you should provide a complete theory, and then see how well it works in other scenarios.

(Also, you need to consider practically infinitely small numbers of people -- that is, people suffering certain fate with a microscopically tiny probability.)

Wow, this seems like an interesting topic to explore.

The people threatening to resign (are there any? without specific information, this could possibly be entirely made up), could be useful to ask them if they have any objections against Paul Christiano, or just EA in general, and if it is the latter, what sources they got their information from, and perhaps what could possibly change their minds.

I'm working on this as a full blogpost but figured I would start getting pieces of it out here for now.

Looking forward to specific examples, pretty please.

I would expect the standards to be high while the practice is new and very controversial and the cases are few... and then gradually the process gets more streamlined.

Protests against assisted suicide are easy to coordinate; protests again removing 1% of the bureaucracy around it are not.

Do we really need 7 witnesses, or is 6 enough? It is okay if the doctor performing the suicide is also one of the witnesses? And his assistant is another one? How clearly must the person speak on the video? What if they can't speak at all, is it fair to deny someone the "basic human right" of assisted suicide just because their ability to speak is impaired? What if taking someone to the next room would be logistically too difficult, e.g. because they are connected to some kind of life support? ... Twenty years later, the doctor checks a box saying "the assisted suicide was done according to the law" on the form, signs it, and that's it.

I guess, from certain perspective, my question is "how can I send costly signals of work ethics if I don't have one?" and the obvious answer is "you can't (or it is really difficult), because that's exactly what makes it a costly signal, dummy!" :D

The annoying part about the time-energy/compensation tradeoff is that it isn't linear. There is no simple lever I could push to spend 50% of time-energy for 50% compensation and find out how that works for me. (I have explored some options, but if seemed that the drop in compensation was dramatic, something like 50% compensation for 80% of time-energy, which isn't really the thing I want. It would make much more sense to stay unemployed between jobs.)

There seems to be no convenient way to even explore the landscape of possibilities, because companies do not transparently advertise how e.g. stressful or meaningless the work is. It is supposed to be your responsibility to ask the right kind of questions during the interview, but in my experience that doesn't work either, because sometimes different departments work differently, and they hire you for one department and after you sign the contract or maybe a few months later they move you to a different department that functions differently. Or a new manager comes and changes the rules.

Even the concept of "work ethics" sounds a bit misleading. It's not like there is a uniform thing called "work" and you either like it or don't. You may find some aspects of work okay and other aspects unbearable. For example, as a software developer somewhat on the autistic spectrum, I find "developing software, with clear requirements, without interruptions, in a quiet room" a pleasant experience, but "developing software, with unclear requirements that contradict each other and change all the time, with constant interruptions and task switching, in open space" deeply unpleasant. So it's not like I fundamentally lack "work ethics", but rather that I am more compatible with some work conditions and less compatible with others (and sadly the latter seem more popular among managers so the entire industry moves that way).

Also, what is the opposite of "work"? Some people spend their free time watching TV or scrolling on social networks. Other people have hobbies and projects, which can be similar to jobs in complexity and time-energy requirements, it's just that they do not generate income. If someone does difficult and useful things, but they do not generate profit, does it make sense to accuse them of not having "work ethics"? Basically, the motte-and-bailey fallacy, where we equivocate between "work" and "work for money".

My wife does not work in software development, so perhaps if one wants a work-life balance, one needs to start there. Then again, she makes less money than me. And she loves her job. And she is allowed to work part-time with almost unlimited home office. I guess this is all connected somehow. 😂 So basically we are in a situation where if she wanted, she could stay at home, and we could easily handle it economically, but she doesn't want to. Meanwhile, I would love to stay at home, but we cannot afford to lose my income. Luckily I don't compare myself to her, I just wish I had more time and energy for my projects.

Home office during covid was so wonderful. No commute. Healthier meals. No open space. Silence (or music of my choice, without having to wear the headphones). During short breaks, I could exercise or do the dishes. During the lunch break, I could take a nap, or go to a supermarket. I could take a break to take my kids home from school and kindergarten, and then continue working while they were playing or watching TV. My everyday life felt much better. Afterwards, the company started slowly pushing back against the home office; every few months, the limit was tightened: 3 days a week, then 10 days a month, then 2 days a week. And I suspect this will continue, perhaps until it finally gets back to zero.

I was joking about the divorce. The point is that wanting a part-time job without having a really good excuse is a bad signal of one's work ethic. What else could be a good excuse?

Thanks for empathy. I suppose the proper stoic approach is to remind myself that people during most of human history, and most people today, probably have it worse. I still get free weekends, and when the kids become more independent, I will get free afternoons again.

But I wish I had a better option (one that would be realistically achievable given my skills and character traits). Sometimes it seems that in theory it shouldn't be so hard, but in practice, it is. I work to get better, but the environment seems to actively work to make it worse, so that compensates for my efforts.

(Also, sexism sucks. For women, many employers provide an opportunity to work part-time. For men, that's almost impossible to get, at least where I live. It is definitely bad signaling to say at the job interview "hey, I would like to work for your company, but... preferably, as little as possible", heh. Women can go like "you know, I have small kids, you know how it is". Perhaps I should divorce and say that I am the primary caretaker.)

If non-rationalist people knew it all along, there wouldn't be need to write such books.

I guess a more careful way to put this would be that they talk like this all the time in private, but when giving a speech, most of them freeze and try to do something else, which is a mistake. They should keeping talking like they usually do, and I suppose the course is teaching them that.

With rationalists, it is a bit more complicated, because talking like you normally do is not the optimal way to do speeches.

Similar here: Changes in motivation seem more related to age (and having kids) than whatever happens out there. When I was younger, I saw my career as an opportunity to learn and achieve something awesome. Now I see it as an endless and pointless necessary evil that devours most of my time and energy. Meaningful things happen in my free time, unless I am too tired for that.

My profession (software development) keeps getting worse. Twenty years ago, I had my own office where I could close the door a focus on my work in silence. Now I work in an open space, interrupted by meetings and random questions by managers all the time; focusing on something is extremely difficult. It's like the company is paying me to do something, and at the same time trying its best to prevent me from doing that.

It's funny how covid showed us that seemingly impossible things quickly become possible when there is a strong incentive: work from home, remote communication with government bureaucracy, etc. And it's depressing to see the attempts to slowly revert all of this. More depressing is reading what people hundred years ago imagined that life would be today (spoiler: they didn't imagine people working 9-5 five days a week).

I see how politics is bullshit, corporations are bullshit, startups are bullshit. The people on the top mostly succeed by convincingly lying to others. When you are looking forward to something that was promised to you, most likely it was a scam and it won't happen. Now I am better at recognizing when people are lying to me. But they keep doing it anyway, and sometimes I need to pretend that I believe them. The most meaningful thing at work is interaction with my colleagues. But I would prefer to be somewhere else, interacting with my friends and family instead.

It's hard to care when nobody cares about me either.

in English, π is pronounced "pie" (not "pee")

A specific example (maybe two or three examples of a different kind) could help a lot: what you wanted to do, what do did, where you got stuck.

Trying to remember my early experience, at school people typically some math-like problems, something like "calculate a square root of X using an interpolation method, also check for incorrect inputs" that would basically be one function (or one library in a more complex case) in the program. You either do not program the user interface, or it is something very obvious.

And then the real life is something like: "so, we have been writing these things on paper, and we wonder whether there is a smarter way to do that, like with a computer", and the space of possible solutions is just so wide you don't even know where to start... and you suspect that the part where you actually calculate the square root will probably be less than 1% of the entire code. And you have no guidance how to do the remaining 99%.

*

My first advice would be to do a prototype first. Some horribly low-status solution with zero security, just to have a specific example where you can check whether everyone is even talking about the same thing. (Otherwise you risk working hard on a solution that no one actually wants.) When the prototype is ready, tested, and approved, then you can build the actual thing. Or maybe you won't need to.

Many things can actually be done using a spreadsheet. The advantage is, you usually don't have to teach people how to use a spreadsheet. You also get functionality like online cooperation, access rights, and using the solution from the smartphone for free. (Yeah, online cooperation can lead to editing conflicts. Don't worry, this is a prototype. If you need a dynamic number of lines, use 100; increase to 1000 when needed.) From the developer's perspective, updating a spreadsheet is much easier than updating an application -- and you will need to update it a lot, because customers usually talk before they think.

If you work for a small customer (an individual or a small NGO), spreadsheet or some Python script is probably what they need. If you work for a large corporation, they probably have a list of technologies you are supposed to use (you will probably have to integrate with whatever they use for authentication, logging, etc.).

Something to trigger the rationalists:

The is a thing called Ultraspeaking; they teach you to speak better; David Chapman wrote a positive review recently. Here are some quotes from their free e-book:

In the following chapters we’re going to tackle:
1. Why thinking is the enemy of speaking
2. How to use your brain’s autocomplete feature to answer difficult questions

As we often say: “The enemy of speaking is thinking about speaking.”

Well, as counterintuitive as it may seem, you must learn to speak . . . before you think.

This is provided as an example of a wrong thing to do:

On this particular day, Alex had been climbing the route for several hours and had reached a third of the way up the cliff when he set his foot on a precarious hold and immediately questioned his choice: Will my foot slip?

He was climbing without a rope or safety equipment of any kind. One mistake and he could fall to his death. After a few minutes of thought, Alex decided to turn back and climb down the mountain back to his camp.

Specifically, the wrong thing was not that he climbed the mountain without any safety equipment, but the fact that he realized that it was dangerous!

Here is an advice on writing your bottom line first:

There’s an incredible opportunity here for you. Ending strong is the low-hanging fruit of speaking under pressure. And it’s entirely in your control.

Another client noted an even more remarkable distinction: “I used to think ending strong meant coming up with a brilliant conclusion. But then I slowly realized that ending strong just means injecting energy and certainty into your final words. I notice that when I say my last sentence with confidence and enthusiasm, people respond especially positively.”

Ending strong is more than just a mindset: it’s a surprisingly simple and effective way to leave a strong lasting impression.

*

Hey, I know that this is supposed to be about System 1 vs System 2, and that you are supposed to think correctly before giving your speech, because trying to do two things at the same time reduces your performance. (Well, unless someone asks you a question. Then, you are supposed to answer without thinking. Hopefully you did some thinking before, and already have some good cached answers.)

But it still feels that the lesson could be summarized as: "talk like everyone outside the rationalist community does all the time".

EDIT:

This also reminds me of 1984:

It was not the man’s brain that was speaking, it was his larynx. The stuff that was coming out of him consisted of words but it was not speech in true sense: it was a noise uttered in unconsciousness like the quacking of a duck.

The intention was to make speech, and especially speech on any subject not ideologically neutral, as nearly as possible independent of consciousness. For the purposes of everyday life it was no doubt necessary, or sometimes necessary, to reflect before speaking, but a Party member called upon to make a political or ethical judgement should be able to spray forth the correct opinions as automatically as a machine gun spraying forth bullets.

I was thinking about a Defense Against Predators Doc, addressing various bad things that already happened in the rationalist community. I wonder whether it should or should not be the same document as the Best Practices Doc. On one hand, those are two quite different topics. On the other hand, there is also some overlap in the form of organizational zealotry (e.g. Leverage, Nonlinear).

Any other Docs that should be written for rationalists? By a Doc I think something that is dramatically shorter than the Sequences, because frankly most people are not going to read the Sequences. As you mentioned in the article, there already are various warnings in the Sequences, but people ignore them. The memes have a life of their own, and in the contrarian environment, the dangerous edgy ideas spread fast, and the warning mostly do not.

national Ukrainian culture is no less Western than Poland or Czech culture.

I agree. That was kinda my point.

Imagine a parallel universe where the Soviet empire didn't fall apart. In that universe, some clever contrarian could also use me as an example of a "psychologically alien person who doesn't share Western values". The clever contrarian could use the concept of "revealed preferences" to argue that I live in a communist regime, therefore by definition I must prefer to live in the communist regime (neglecting to mention that my actual choices are either to live in the communist regime, or to commit suicide by secret service). -- From my perspective, this would be obvious nonsense, and that is why I treat such statements with skepticism also when they are made about others.

Okay, that sounds really bad, I agree. Definitely different from e.g. Vienna.

Let's go one level deeper and ask "why".

It is tempting to interact with the fellow rationalists; I also consider them preferable to non-rationalists, ceteris paribus. But even if there were hundred or thousand rationalists available around me, I still have a family, friends, colleagues, neighbors, people who share the same hobby, so I would keep interacting with many non-rationalists anyway. I suspect that in the Bay Area, many community members are either university students, or someone who moved to the Bay Area recently to join a local startup or an EA organization -- in other words, people who lost access to their previous social connections.

So the obvious move is to remind them regularly to create and maintain connections outside the rationalist community, and to treat any attempt to convince them otherwise (e.g. by their employer) as a huge red flag.

And, this is less likely to happen in a community where many members have already lived in the city.

The belief that the Singularity is near encourages you to throw all usual long-term planning out of window: if in a year, you will either be dead or live in a paradise, it is not so important whether during that year you have burned out, kept contacts with your family and friends, etc.

I am not going to object against a belief by appealing to consequences. In a world where Singularity actually comes in a year, and you have a 0.1% chance to change the outcome from hell to heaven, working as hard as you can is the right thing to do.

Instead, I suggest that people adjust both their timeline and the probability of their actual impact. With regards to timeline, consider the fact that there was already a rationalist minicamp on existential risk in 2011, that is 13 years ago. And yet, the world did not end in a year, in two years, in five years, or in ten years. Analogically, there is a chance that the world will not end in the following five or ten years. In which case, burning out in one year is a bad strategy. From psychological perspective, ten years is a lot of time; you should keep working towards the good end, but you should also take care of your health, including your mental health. Run a marathon, not a sprint. (People have criticized Eliezer for taking time to write fan fiction and indulge in polyamorous orgies, but notice that he hasn't burned out, despite worrying about AI for decades. Imagine a parallel timeline, when he burned out in 2012, went crazy in 2013, and committed suicide in 2014. Would doing that help AI safety?)

And if you are considering your personal impact on the outcome of Singularity, most likely it is indistinguishable from zero, and before you go full Pascal and multiply the tiny probability by the number of potential future inhabitants of all galaxies in the universe, please consider that you don't even know whether that number indistinguishable from zero is positive or negative (so you can't automatically assume that even multiplying it by 3^^^3 necessarily results in a huge positive number). Working so hard that you burn out increases the absolute value a tiny bit, but still gives no guarantee about the sign, especially if other people afterwards use you as an example of how everyone who cares about AI safety goes crazy.

Ironically, unless you are one of the top AI safety researchers, if you live in the Bay Area, your best contribution would probably be keeping the rationalist community sane. Don't take drugs, don't encourage others to take drugs, help people avoid cults, be nice to people around you and help them relax, notice the bad actors in the community and call them out (but in a calm way). If this helps the important people stay sane longer, or prevents them from burning out, or just protects them from being dragged into some scandal that would have otherwise happened around them, your contribution to the final victory is more likely to be positive (although still indistinguishable from zero). Generally speaking, being hysterical does not necessarily mean being more productive.