Posts

What is complexity science? (Not computational complexity theory) How useful is it? What areas is it related to? 2020-09-26T09:15:50.446Z
Classification of AI alignment research: deconfusion, "good enough" non-superintelligent AI alignment, superintelligent AI alignment 2020-07-14T22:48:04.929Z
Why take notes: what I get from notetaking and my desiderata for notetaking systems 2020-05-29T21:46:10.221Z
Is there software for goal factoring? 2020-02-18T19:55:37.764Z
Hard Problems in Cryptocurrency: Five Years Later - Buterin 2019-11-24T09:38:20.045Z
Philip's Shortform 2019-09-14T12:30:37.482Z
Reneging prosocially by Duncan Sabien 2019-06-18T18:52:46.501Z
How to determine if my sympathetic or my parasympathetic nervous system is currently dominant? 2019-05-31T20:40:30.664Z
AI Safety Prerequisites Course: Revamp and New Lessons 2019-02-03T21:04:16.213Z
Fundamentals of Formalisation Level 7: Equivalence Relations and Orderings 2018-08-10T15:12:46.683Z
Fundamentals of Formalisation Level 6: Turing Machines and the Halting Problem 2018-07-23T09:46:42.076Z
Fundamentals of Formalisation Level 5: Formal Proof 2018-07-09T20:55:04.617Z
Fundamentals of Formalisation Level 4: Formal Semantics Basics 2018-06-16T19:09:16.042Z
Fundamentals of Formalisation Level 3: Set Theoretic Relations and Enumerability 2018-06-09T19:57:20.878Z
Idea: OpenAI Gym environments where the AI is a part of the environment 2018-04-12T22:28:20.758Z

Comments

Comment by philip_b (crabman) on The power of finite and the weakness of infinite binary point numbers · 2024-04-20T08:55:30.177Z · LW · GW

Please go, study math fundamentals properly, and then come back. What you wrote doesn't make much sense.

Comment by crabman on [deleted post] 2024-01-22T13:26:37.628Z

I think this last edit is bad.

Comment by philip_b (crabman) on johnswentworth's Shortform · 2023-12-27T15:33:47.267Z · LW · GW

Is there any "native" textbook that is pragmatic and explains how to use bayesian in practice (perhaps in some narrow domain)?

Comment by philip_b (crabman) on Wireheading and misalignment by composition on NetHack · 2023-10-29T13:46:03.278Z · LW · GW

Did the model randomly stumble upon this strategy? Or was there an idea pitched by the language model, something like "hey, what if we try to hallucinate and maybe we can hack the game that way"?

Comment by philip_b (crabman) on PortAudio M1 Latency · 2023-10-12T17:20:46.731Z · LW · GW

Are you able to play sounds using other programs (e.g. open a YouTube video in the background) while getting great latency in reaper or in something similar to reaper?

Comment by philip_b (crabman) on PortAudio M1 Latency · 2023-10-12T05:47:57.756Z · LW · GW

I've been thinking of buying an M1 MacBook because everyone says that Apple's sound system is great and works out of the box correctly with low latency and no problems, unlike Windows+Wasapi, Windows+ASIO, and Linux. I want to use it for music stuff without an external audio interface. How true is this and would you recommend it?

Comment by philip_b (crabman) on luciaquirke's Shortform · 2023-10-12T05:45:00.562Z · LW · GW

You says Vast.AI is the "most reliable provider". In my experience, it's an unreliable mess with sometimes buggy not properly working servers and non-existent support service. I will also say the same about runpod.io. On the other hand, lambdalabs had been very reliable in my experience and has a much better UX. The main problem with LambdaLabs is that nowadays it happens pretty often that it has no available servers.

Comment by philip_b (crabman) on Revisiting the Manifold Hypothesis · 2023-10-02T14:35:26.336Z · LW · GW

This sounds similar to whether a contemporary machine learning model can break a cryptographic cipher, a hash function, or something like that.

Comment by philip_b (crabman) on The Lightcone Theorem: A Better Foundation For Natural Abstraction? · 2023-05-15T04:39:15.631Z · LW · GW

Can you formulate the theorem statement in a precise and self-sufficient way that is usually used in textbooks and papers so that a reader can understand it just by reading it and looking up the used definitions?

Comment by philip_b (crabman) on [Linkpost] GatesNotes: The Age of AI has begun · 2023-03-22T08:37:29.478Z · LW · GW

I have a kinda-unrelated question. Does Bill Gates write gatesnotes completely himself just because he wants? Or is this a marketing/pr thing and is written by other people? If it's the former, then I want to read it. If it's the latter, I don't.

Comment by philip_b (crabman) on Johannes C. Mayer's Shortform · 2022-12-15T16:16:27.906Z · LW · GW

Do you mean "What do you want me to do" in the tone of voice that means "There's nothing to do here, bugger off"? Or do you mean "What do you want me to do?" in the tone of voice that means "I'm ready to help with this. What should I do to remedy the problem?"?

Comment by philip_b (crabman) on Basic building blocks of dependent type theory · 2022-12-15T15:58:11.234Z · LW · GW

I have recently read The Little Typer by Friedman and Christiansen. I suspect that this book can serve as an introduction similarly to this (planned, so far) sequence of posts. However, the book is not concise at all.

Comment by philip_b (crabman) on Jailbreaking ChatGPT on Release Day · 2022-12-02T15:36:33.695Z · LW · GW

Are those instructions for making a Molotov cocktail and for hotwiring a car real? They look like something someone who's only seen it done in movies would do. Same question for methamphetamine, except that recipe looks more plausible.

Comment by philip_b (crabman) on Refactoring Myself: 4 Years Later · 2022-11-20T22:01:39.568Z · LW · GW

Thanks for writing this update! I think your English skills have improved a lot.

Comment by philip_b (crabman) on Help Me Refactor Myself I am Lost · 2022-11-15T19:39:20.023Z · LW · GW

I've just read your previous two posts. I, too, will be interested to read another post of yours.

Comment by philip_b (crabman) on The Alignment Community Is Culturally Broken · 2022-11-13T22:37:00.244Z · LW · GW

I am (was) an X% researcher, where X<Y. I wish I had given up on AI safety earlier. I suspect it would've been better for me if AI safety resources explicitly said things like "if you're less than Y, don't even try", although I'm not sure if I would've believed them. Now, I'm glad that I'm not trying to do AI safety anymore and instead I just work at a well paying relaxed job doing practical machine learning. So, I think pushing too many EAs into AI safety will lead to those EAs suffering much more, which happened to me, so I don't want that to happen and I don't want the AI Alignment community to stop saying "You should stay if and only if you're better than Y".

Actually, I wish there were more selfish-oriented resources for AI Alignment. Like, with normal universities and jobs, people analyze how to get into them, have a fulfilling career, earn good money, not burn out, etc. As a result, people can read this and properly analyze if it makes sense for them to try to get into jobs or universities for their own food. But with a career in AI safety, this is not the case. All the resources look out not only for the reader, but also for the whole EA project. I think this can easily burn people.

Comment by philip_b (crabman) on Consider Taking Zinc Every Time You Travel · 2022-11-13T14:08:28.787Z · LW · GW

I still take these zinc lozenges when I suspect that I might fall with a common cold. I feel like they help me somewhat. Maybe my colds have been shorter since I've started taking Zinc but I'm not sure. I haven't been tracking any data explicitly. I guess I'm gonna be taking Zinc for common cold as long as I don't get further evidence about it not working.

Comment by philip_b (crabman) on The Slippery Slope from DALLE-2 to Deepfake Anarchy · 2022-11-05T15:04:36.714Z · LW · GW
Comment by philip_b (crabman) on Writing Russian and Ukrainian words in Latin script · 2022-10-25T21:47:07.375Z · LW · GW

Perhaps you can just use the international phonetic alphabet?

Comment by philip_b (crabman) on Baby Monitor with Delay · 2022-10-03T16:36:05.313Z · LW · GW

I don't know how to square that with the idea that one shouldn't ignore their crying kids. I have no idea how kids' crying at night works. Is it possible that a parent should just suck it up and come and comfort the baby every time they cry? Maybe you can comfort her since she's crying but not give her the reward of soothing her until she falls asleep? Is it possible that she cries at night because she's doesn't get enough cuddles during the day or because the room looks scary or something like that? I don't know enough about the situation and I don't have any kids of my own and don't have any practical experience of dealing with them. Maybe you can be there with her in her sleeping room when she cries but still make it so that she learns to self-soothe and put herself to sleep? Like, idk, stay with her but don't rock her to sleep or something like that.

Comment by philip_b (crabman) on Baby Monitor with Delay · 2022-10-03T15:22:02.566Z · LW · GW

Ok, I don't know more than that about addressing children's crying. I just thought that ignoring it is (almost always?) bad but I'm not sure.

Comment by philip_b (crabman) on Baby Monitor with Delay · 2022-10-03T14:54:12.217Z · LW · GW

I'm not sure how to read this; where are you on the continuum from "I heard it's bad" to "I read all the papers and came to a deep considered view"?

I also thought so when I read your post. I'm at the "The book 'The Boy Who Was Raised as a Dog' says so" point. The book is not about sleep in particular, it's about psychological trauma in childhood, especially the one obtained from neglect.

Also, I think this might cause the child to develop either an avoidant attachment style (there's no point in crying or asking others for help, they won't come anyway).

Comment by philip_b (crabman) on How do I find tutors for obscure skills/subjects (i.e. fermi estimation tutors) · 2022-09-16T11:35:31.842Z · LW · GW

I also don't know how to find tutors for narrow subjects. For instance, I would like a little bit of tutoring about

  • panoptic segmentation
  • dependent types

but I don't know how to find one.

Comment by philip_b (crabman) on Encultured AI Pre-planning, Part 2: Providing a Service · 2022-08-20T22:23:10.078Z · LW · GW

The link to the next post in this post is broken.

Comment by philip_b (crabman) on Announcing Encultured AI: Building a Video Game · 2022-08-20T22:14:50.840Z · LW · GW

Is this the beginning of Friendship is Optimal?

Comment by philip_b (crabman) on Dwarves & D.Sci: Data Fortress · 2022-08-07T13:12:40.387Z · LW · GW

What role do I, the data scientist dwarf, have?

Comment by philip_b (crabman) on Unifying Bargaining Notions (1/2) · 2022-07-26T00:26:43.662Z · LW · GW

In the first part, the two respective properties of the two definitions of chaaness you mentioned apply after rescaling and shifting of utility functions is done, right? I.e., the properties actually say "after rescaling and shifting the points, if you move the Pareto-frontier points for a player up, they should get more utility" and "untaken options are irrelevant if you don't change the scale after removing them". Now, I don't see why these properties are interesting and what they correspond to in real life. In contrast, if they applied before rescaling and shifting, then they would be quite interesting. So, can you please elaborate why they are interesting as they are and what they actually mean as they are?

Comment by philip_b (crabman) on Carrying the Torch: A Response to Anna Salamon by the Guild of the Rose · 2022-07-06T17:24:22.329Z · LW · GW

I just want to say that your described solution to "Problem 1: Differentiating effective interventions from unfalsifiable woo" suggests to me that your curriculum would be mostly useless for me, and maybe for many other people as well, because it won't go deep enough. I think either I've already gotten everything I can get from shallow interventions "like better nutrition, using your speaking voice more effectively, improving your personal financial organization, emergency preparedness, and implementing a knowledge management system", or they were never that good in the first place. Personally, I am focusing on psychotherapy right now. It's unfortunate that it consists mostly of borderline-unfalsifiable woo but that's all we've got.

Comment by philip_b (crabman) on D&D.Sci June 2022: A Goddess Tried To Reincarnate Me Into A Fantasy World, But I Insisted On Using Data Science To Select An Optimal Combination Of Cheat Skills! · 2022-06-04T11:58:55.083Z · LW · GW

My solution:

I choose Radiant Splendor and Enlightenment simply because out of all champions with personality like mine, it had the highest win frequency. And it even has a solid number of samples - 244. Basically, I narrowed down the dataset to only rows with the same personality like mine. Perhaps I could get some more info from other rows, but that would require spending more time.

Comment by philip_b (crabman) on D&D.Sci June 2022: A Goddess Tried To Reincarnate Me Into A Fantasy World, But I Insisted On Using Data Science To Select An Optimal Combination Of Cheat Skills! · 2022-06-04T11:03:57.620Z · LW · GW

Does the order of the two skills matter? Of course, I can check this from data, but perhaps you'd be willing to just answer this straight away so that I won't have to.

Comment by philip_b (crabman) on Another Calming Example · 2022-06-04T10:36:17.989Z · LW · GW

I am glad to hear that.

Comment by philip_b (crabman) on D&D.Sci June 2022: A Goddess Tried To Reincarnate Me Into A Fantasy World, But I Insisted On Using Data Science To Select An Optimal Combination Of Cheat Skills! · 2022-06-04T10:14:59.161Z · LW · GW

Can I choose to get a god partner?

Comment by philip_b (crabman) on Another Calming Example · 2022-06-04T10:05:05.146Z · LW · GW

Not clear to me why we should think of these as different. We care about the effect on the kid, right?

I suppose that when I think about the situation when you only pretend not to understand them, I imagine something like a strict dad telling his son "Pull yourself together, you wimp!". While if you actually don't understand them, then I imagine a cooperative conversation between the two of you, where you not understanding them while they are crying is an obstacle both of you would like to overcome.

Comment by philip_b (crabman) on Another Calming Example · 2022-06-03T21:15:33.525Z · LW · GW

Would you feel differently if it was actually the case that I was bad at understanding kids who are currently crying?

Yes, of course.

So the approach I've generally taken is to talk to kids and help them solve the problems they say they have. This generally seems to work pretty well?

This sounds good! However, another thing that matters is whether you give off a "you're only allowed to give respectable reasons for your feelings" vibe.

Btw, I wanna say that I enjoy reading your parenting posts a lot.

Comment by philip_b (crabman) on Another Calming Example · 2022-06-03T11:48:29.455Z · LW · GW

I don't like this. It looks like you pressured the kid to stop crying and just hide their feelings ("I told them that I couldn't understand and asked if they could speak normally").

Also, it seems unlikely to me that the kid's real reason for getting upset was that "they were worried the pasta was going to run out and they would still be hungry after dinner". But still, I observe that this is what the kid said. From this I infer that either you, in this situation, or the kid's social environment, before this situation, pressured the kid into generating fake but socially acceptable explanations of their feelings. I don't like it that people often have to generate fake but socially acceptable explanations of their feelings, even with close people. At least, if you're a very close person to this kid who acts as his guardian.

Comment by philip_b (crabman) on Best open-source textbooks (goal: make them collaborative)? · 2022-05-07T18:27:58.558Z · LW · GW

Mathematical Components - a textbook on formal proofs using Coq with MathComp library.

Comment by philip_b (crabman) on What DALL-E 2 can and cannot do · 2022-05-04T16:34:08.806Z · LW · GW

"A screenshot of the Wikipedia home page, Halloween version" please.

Comment by philip_b (crabman) on A method of writing content easily with little anxiety · 2022-04-08T22:58:25.253Z · LW · GW

I suspect that after doing this enough times, you will internalize that generating words like this leads to them being published under your name and thus your filters will adapt and make this way of writing anxiety-inducing too.

Comment by philip_b (crabman) on Replacing Karma with Good Heart Tokens (Worth $1!) · 2022-04-01T09:21:27.085Z · LW · GW

There is an inconsistency in the formatting of (simulated) user feedback. Some are formatted as Username: "XXX", e.g.

Anna Salamon: "I can imagine a world where earnest and honest young people learn what's rewarded in this community is the most pointed nitpick possible under a post and that this might be a key factor in our inability to coordinate on preventing existential risk".

while others are formatted as Username said "XXX", e.g.

Eliezer Yudkowsky said "To see your own creation have its soul turned into a monster before your eyes is a curious experience."

Comment by philip_b (crabman) on What are the best elementary math problems you know? · 2022-03-30T11:41:05.896Z · LW · GW

Yes, indeed.

Comment by philip_b (crabman) on What are the best elementary math problems you know? · 2022-03-29T11:43:33.987Z · LW · GW

Is the following a correct reformulation of your problem?

Say that a magician's pure strategy is a function on finite bitstrings which returns either "go on" or "stop" with a positive integer and a frequency of zeros.

A magician's mixed strategy is a probability distribution over magician's pure strategies. (Btw, I'm not sure what kind of sigma-algebra is suitable here.)

A player's mixed strategy is a probability distribution over infinite bitstrings.

A magician's mixed strategy together with a player's mixed strategy define, in the obvious way, a probability distribution over outcomes "magician wins" (i.e., the magician's prediction was within 1%) and "player wins".

You're claiming that there is a magician's mixed strategy s.t. for every player's mixed strategy, magician wins with probability at least 0.99.

Comment by philip_b (crabman) on What are the best elementary math problems you know? · 2022-03-25T10:47:12.277Z · LW · GW

I've formalized this problem in Coq with mathcomp. Yeah, idk why I decided to do this.

From mathcomp Require Import all_ssreflect.
Set Implicit Arguments.
Unset Strict Implicit.
Unset Printing Implicit Defensive.

Definition hats_assignment : Type := nat -> bool.

Definition policy_of_one_person (n : nat) : Type :=
  {policy : hats_assignment -> bool &
   forall ha : hats_assignment,
     let ha' := fun m => if m == n is true then ~~ (ha m) else ha m
     in policy ha == policy ha'}.

Definition strategy : Type :=
  forall n : nat, policy_of_one_person n.

Lemma ex_good_strategies :
  exists s : strategy, forall ha : hats_assignment, exists N : nat, forall n : nat, n >= N ->
    (projT1 (s n)) ha == ha n.
Proof.
Admitted.

If you want to solve it, you need to replace Admitted. with an actual proof.

Comment by philip_b (crabman) on What are the best elementary math problems you know? · 2022-03-25T09:16:33.226Z · LW · GW

Do people have common knowledge of an ordering of all of them?

Comment by philip_b (crabman) on Ukraine Post #5: Bits of Information · 2022-03-21T18:21:41.239Z · LW · GW

Today I have attended Kolmogorov seminar, an online math seminar that's usually held in Russian, but sometimes is held in English, organized by two professors of Lomonosov Moscow State University. There, they complained that their German colleagues have refused to give their upcoming talks because the seminar is associated with Russia, the agressor in the war. I'm annoyed that things like this happen. But this particular case will probably not be a big problem because the organizers plan to just remake the seminar and make it hosted (as if that means anything given that it's online) by a French university with which one of the organizers is affiliated.

Comment by philip_b (crabman) on The Long Long Covid Post · 2022-02-10T23:53:03.352Z · LW · GW

A rationalist friend of mine told me that the severity of covid increases significantly with the amount of virus particles inhaled. Is this the case? If yes, this might give us reason to use some cheap precautions some more - if not collectively, then on an individual level.

Comment by philip_b (crabman) on Vanessa Kosoy's Shortform · 2022-02-01T23:50:33.527Z · LW · GW

I'm not sure what you mean by CDT- and EDT-style counterfactuals. I have some guesses but please clarify. I think EDT-style counterfactual means, assuming I am a bayesian reasoner, just conditioning on the event "TAI won't come", so it's thinking about the distribution P(O | TAI won't come).

One could think that the CDT-counterfactual you're considering means thinking about the distribution P(O | do(TAI doesn't come)) where do is the do operator from Judea Pearl's do calculus for causality. In simple words, this means that we consider the world just like ours but whenever someone tries to launch a TAI, god's intervention (that doesn't make sense together with everything we know about physics) prevents it from working. But I think this is not what you mean.

My best guess of what counterfactual you mean is as follows. Among all possible sets laws of physics (or, alternatively, Turing machines running which leads to existence of physical realities), you guess that there exists a set of laws that produces a physical reality where there will appear a civilization approximately (but not exactly) like hours and they'll have a 21-st century approximately like hours, but under their physical laws there won't be TAI. And you want to analyze what's going to happen with that civilization.

Comment by philip_b (crabman) on How would you learn absolute pitch? · 2022-01-30T03:24:15.701Z · LW · GW

Since you suspect that your proposed scheme is cheating, I've come up with another cheating scheme which you can employ in most situations to avoid needing absolute pitch. Remember what approximate notes your lowest and highest singing frequencies are. Then when you want to identify a note, hum or quietly sing one of them or both and compare the note you want to identify with them.

Comment by philip_b (crabman) on You Can Get Fluvoxamine · 2022-01-19T06:42:00.192Z · LW · GW

As for other countries, in Russia fluvoxamine is by prescription only, but I guess it's not controlled very strictly, since it's easy to visit a few pharmacies until one of them seels it to you even though you say you forgot your prescription list at home.

Comment by philip_b (crabman) on School Daze · 2022-01-14T18:29:32.876Z · LW · GW

So, I don't know the first thing about American education, so I wonder, can a parent just let their kid stay at home, skip school and do whatever the kid wants while all this crap is happening? If yes, why aren't they doing it if things are this bad?

Comment by philip_b (crabman) on The best curriculum for every goal · 2022-01-09T12:47:52.062Z · LW · GW

A better type signature would be (List<resource>, List<goal-state>, List<prerequisites>). An even better type signature would be a directed acyclic graph where nodes are skills or knowledge areas, edges are dependencies, parentless nodes are prerequisites, childless nodes are end goals, and each non-prerequisite node has a list of resources associated with it.