Posts

Magnitudes: Let's Comprehend the Incomprehensible! 2024-12-01T03:08:46.503Z
Just admit that you’ve zoned out 2024-06-04T02:51:27.594Z
Why I got the smallpox vaccine in 2023 2023-10-02T05:11:41.249Z

Comments

Comment by joec on Magnitudes: Let's Comprehend the Incomprehensible! · 2024-12-02T22:10:11.121Z · LW · GW

One example of a web of interrelated facts that I have concerns molecular simulations, with bold/italic denoting things that I have in my anki deck, or would make good cards.

One interesting thing about moleculaes bouncing around is that a nanosecond, which sounds really short, is actually a decently long time. Consider that molecules at room temperature are typically moving at about the speed of sound (340 m/s) and a typical chemical bond length is about 0.1 to 0.2 nanometers. This means that a typical molecule (if nothing bumps into it) will go 1700-3400 bond-lengths in a nanosecond! Of course, molecules in liquid, which are jammed pretty close together, won't move that far without interruptions- they'll bump into each other, switch direction and bump into others many times over the course of a nanosecond. This means that the typical timestep (the  when integrating the differential equations of motion) for a molecular dynamics simulation has to be much shorter. In practice, for a molecular dynamics simulation that simulates all the atoms of a system,  is about a femtosecond. With these timesteps, it becomes possible to simulate about a microsecond of simulation time per day of all atoms of a medium-sized protein moving around on a modern GPU like an A40. This is a big reason for why we can't just simulate a protein folding to crack the protein folding problem. Protein folding takes about a second or on the order of a million GPU-days if you were to simulate it.

Comment by joec on Magnitudes: Let's Comprehend the Incomprehensible! · 2024-12-02T21:37:39.394Z · LW · GW

One thing that's useful for me is to draw analogies. For instance, the earth is about as big compared to the kilogram as benzene ( kg) is small.

Comment by joec on Magnitudes: Let's Comprehend the Incomprehensible! · 2024-12-02T21:29:32.976Z · LW · GW

That's true. The specific energy of antimatter is also actually double the "maximum" if you don't count the mass of the matter (1 gram of antimatter + 1 gram of air produces about 2 grams worth of energy). Funny enough, this is analogous to combustion fuel. The reason combustion fuel (on the order of 50 MJ/kg for most hydrocarbons) seems to be able to store much more energy than, say a high explosive (on the order of 5 MJ/kg) is because high explosives contain their own oxidizers, while combustion fuel uses the air as an oxidizer.

Comment by joec on You should consider applying to PhDs (soon!) · 2024-12-01T03:37:11.823Z · LW · GW

I'll have to push back on this. I think if there's one specific program that you'd like to go to, especially if there's an advisor you have in mind, it's good to tailor your application to that program. However, this might not apply to the typical reader of this post.

I followed a k strategy with my PhD statements of purpose (and recommendations) rather than an r strategy. I tailored my applications to the specific schools, and it seemed to work pretty decently well. I know of more qualified people who were rejected from a much higher proportion of schools who spent much less time on each application. 

(Disclaimer: this is all anecdotal. Also, I was applying for chemistry programs, not AI)

Comment by joec on Generative ML in chemistry is bottlenecked by synthesis · 2024-09-19T20:22:03.999Z · LW · GW

Another way to assess the efficacy of ML-generated molecules would be through physics-based methods. For instance, binding-free-energy calculations which estimate how well a molecule binds to a specific part of a protein can be made quite accurate. Currently, they're not used very often because of the computational cost, but this could be much less prohibitive as chips get faster (or ASICs for MD become easier to get) and so the models could explore chemical space without being restricted to only getting feedback from synthetically accessable molecules.

Comment by joec on If AI is in a bubble and the bubble bursts, what would you do? · 2024-08-20T21:50:29.221Z · LW · GW

If this happens, it could lead to a lot of AI researchers looking for jobs. Depending on the incentives at the time and the degree to which their skills are transferable, many of them could move into safety-related work.

Comment by joec on It's time for a self-reproducing machine · 2024-08-08T01:20:08.733Z · LW · GW

I really like this idea, especially the part about doing it on Baffin Island. A few questions/comments/concerns

  1. During the winter, the polar ice cap expands to the point that Baffin Island is surrounded by ice. This makes shipping things to and from the island difficult for a large part of the year. I also imagine most people don't want to be there during the winter to check up on things. Do you imagine things progressing more slowly during the winter because of this?
  2. Looking at the climate data for Baffin island and comparing mean daily maximum in July and mean daily minimum in January, it looks like there's a range of about 40 Celsius, which seems significant (and over a range pretty different from what most engineers are used to building for). Do you expect this will interfere with the equipment? Will the Autofacs need some kind of temperature control?
  3. Do you have any ideas for how to deal with defective/broken AutoFacs? My first thought is that you could automatically disassemble them, throw away the defective parts and use the working parts to build new Autofacs. There's probably something more clever.
  4. Will the AutoFacs be able to clean themselves or fix the other normal, small things that worsen performance as machinery operates? If so, how?
Comment by joec on Just admit that you’ve zoned out · 2024-06-10T02:18:08.468Z · LW · GW

Do you do this during conversation or just during lectures? I feel like I should perhaps start doing this in lectures, although I might feel some qualms about recording a speaker without permission. 

Comment by joec on Just admit that you’ve zoned out · 2024-06-10T02:15:58.741Z · LW · GW

Interesting! Have you noticed that people repeat more or less than the past 20 seconds when you request that they repeat the past 20 seconds? I feel like I would find that more difficult to accurately measure 20 seconds of conversation than if someone told me to repeat everything I said after <particular talking point>. I don't think the difficult gap is huge, though, and I'm not sure if this is the case for most people.

Comment by joec on Just admit that you’ve zoned out · 2024-06-05T01:33:58.552Z · LW · GW

I struggle with this frequently. Of course, in many cases I waltz into a talk where (I think that) the rest of the audience knows more than me, and in those cases I don't say anything. The best solution I've seen is to first build up a ton of social credit and then ask tons of questions. I've seen a few cases of fancy professors asking very basic questions that I was too afraid to ask, and knowing that nobody thought they were stupid afterwards.

If you feel like you're in danger of giving this talk at the beginning, it might be best to explicitly say at the beginning that you encourage all questions, even if they're naive. I recall going to a talk where the speaker did this twice, lots of people asked questions, and I learned that the axes of a graph meant something different than I first assumed.

On the weirder side of solutions, you could try classically conditioning yourself not to take embarrassment so poorly. If you're a sugar fiend, bring some candies to a talk and eat one for each question you ask.

I also struggle with the fact that sometimes during a talk, I zone out and don't know whether the speaker already answered the question I have, precisely because I was zoned out when they might have answered the question. In this case, I tend not to ask the question, since I don't want to take the time away from other people listening to the talk.

Comment by joec on Just admit that you’ve zoned out · 2024-06-05T01:09:13.332Z · LW · GW

Yeah, this sounds very reasonable. However, in a situation where the speaker won't take offense, I think specifying the reason for why you requested to repeat something could be nice. Sometimes people take "could you repeat this" to mean "could you summarize the last few minutes" or "I didn't understand, could you explain in more detail". Of course, this is a pretty minor cost, and it's better to ask someone to repeat things without saying why than to not ask at all.

Comment by joec on Is there software to practice reading expressions? · 2024-04-24T19:46:33.734Z · LW · GW

I think with a decent training set, this could make a pretty nice Anki deck. The difficulty in this would be getting the data and accurate emotional expression labels.
A few ideas:

1. Pay highschool/college drama students to fake expressions. The quality of the data would be limited by their acting skill, but you could get honest labels.

2. Gather up some participants and expose them to a variety of things, taking pictures of them under different emotional states. This could run into the problem of people misreporting their actual emotional state. Learning with these might make the user more susceptible to deception.

3. Screenshot expressions from movies/videos where the emotional state of the subjects are clear from context.

Comment by joec on Is there software to practice reading expressions? · 2024-04-24T19:35:35.014Z · LW · GW

How did you do this? Did you simply ask yourself "how does this person feel" in a social context? Did you get feedback through asking people how they felt afterward? If so, how do you deal with detecting states of mind that others are unlikely to openly admit (e.g. embarrassment, hostility, idolization)?

Comment by joec on Notes from a Prompt Factory · 2024-03-11T18:27:20.199Z · LW · GW

Wow, this story is disturbingly well-written. While there aren't any explicit references to slavery, I can't help but be reminded of Frederick Douglass's description of Mr. Severe and Mr. Gore, two spiteful and vicious overseers at a plantation.

Continuing with this, I'm also reminded of Douglass's argument that slavery had a terrible effect not only on the slaves but on the slaveowners and overseers too. Specifically, that it somehow awakened a brutality in many of them that otherwise wouldn't be there. I wonder if this story's narrator would have been just as cruel if he never had this kind of power over others.

I'm also now somewhat concerned about the higher-order effects/social risks of people having absolute power over AIs, even if the AIs don't suffer. Even access to an AI which only appears to suffer might bring out a kind of cruelty in some people that they otherwise wouldn't have known they were capable of.

Comment by joec on Why I got the smallpox vaccine in 2023 · 2023-10-02T19:55:46.649Z · LW · GW

I both think and hope that you're right and a smallpox outbreak could be easily contained, but I'm not confident enough in this to be unconcerned. If large amounts were released to overwhelm the system, this could cause a lot of death, particularly in urban areas. I would be particularly concerned if I lived in a crowded slum/favela, because I imagine smallpox could rapidly spread through the populace before quarantine efforts could do much. 

Another thing is that smallpox symptoms appear flu-like for the first several days of the infection. During this period it's quite contagious. It's plausible that, in the case of smallpox being released, people will assume it's just a respiratory illness ("Whew, looks like I tested negative for Covid!") and spread it before the characteristic pustules appear and the authorities react. (Disclaimer: I am not an epidemiologist, merely a concerned citizen)

Comment by joec on Why I got the smallpox vaccine in 2023 · 2023-10-02T19:44:49.314Z · LW · GW

According to the CDC, vaccination lasts 3-5 years, with protection waning after that. How fast the protection decreases is not entirely clear, especially on the scale of decades, but I did find this Scientific American article claiming that mortality rates were reduced from 52% among the unvaccinated to 1.5% for those vaccinated within ten years and to 11.5% for those vaccinated between 10 and 20 years prior in a study. This article suggests that vaccination during infancy reduced the mortality rate to under 5% for 30 years, and the mortality rate for vaccinated individuals was never above half that for unvaccinated individuals of the same age range. Similarly, mild cases of smallpox are far more common among infected vaccinated individuals than unvaccinated individuals. All this is to suggest that vaccination confers some kind of lifelong protection, at least statistically.

As for the difficulty, I would like to emphasize that this was very easy for me to do. Getting the appointment and vaccine took about 2 hours, and they were completely free. The swelling was a tad annoying but not too bad.