Posts

What's keeping concerned capabilities gain researchers from leaving the field? 2022-05-12T12:16:00.630Z

Comments

Comment by sovran on The self-unalignment problem · 2023-04-19T23:29:14.745Z · LW · GW

This post is really really good, and will likely be the starting point for my plans henceforth

I was just starting to write up some high level thoughts to evaluate what my next steps should be. The thoughts would've been a subset of this post

I haven't yet had time to process the substance of this post, just commenting that you've done a better job of putting words to what my feelings were getting at, than I expect I myself would have at this stage

Comment by sovran on Evolution provides no evidence for the sharp left turn · 2023-04-15T07:01:11.341Z · LW · GW
Comment by sovran on Ugh fields · 2023-02-21T08:51:40.874Z · LW · GW

Scott Alexander wrote a solid follow up to this piece last year. 

TLDR; the brain obviously wishes to avoid pain, but not at the cost of like, avoiding thinking about painful things at all costs. 

Like, you don't want to be eaten by a lion, so you avoid doing things that lead to you being eaten by lions. 

But this pain avoidance shouldn't compromise on your epistemics; you shouldn't go so far to avoid pain as to avoid thinking about lions at all. this doesn't work. 

This is potentially also what's going on with ugh fields. avoiding thinking about painful thoughts, as an overextension of pain-avoiding mechanisms of the brain. 

 

Thinking about ugh fields in this way helps me actually confront them far more reliably.

Comment by sovran on Why Are Bacteria So Simple? · 2023-02-08T09:22:42.757Z · LW · GW

wait so is a viable strat re: antibiotic resistant infections to just go a while without any antibiotics, then restart? granted, the patient needs to survive, and ideally not spread the infection to others, but still. Is this a documented action suite?

Comment by sovran on so you think you're not qualified to do technical alignment research? · 2023-02-07T08:53:43.086Z · LW · GW

as is said in some of the recommended resources at the bottom of my intro to AI doom and alignment

This link is broken

here's the correct link https://www.lesswrong.com/posts/T4KZ62LJsxDkMf4nF/a-casual-intro-to-ai-doom-and-alignment-1

Comment by sovran on I hired 5 people to sit behind me and make me productive for a month · 2023-02-05T05:33:12.207Z · LW · GW

feels unlikely

Comment by sovran on Wider Default Audio Player in Chrome? · 2022-12-12T04:50:08.593Z · LW · GW

This post seems better suited to twitter. If this LW post was for a signal boost, I'd suggest at least posting on twitter in parallel, and linking to that on all your posts. 

Comment by sovran on K-types vs T-types — what priors do you have? · 2022-11-04T21:59:54.012Z · LW · GW

also, in the correct contrarian cluster, atheism is listed twice.

Comment by sovran on [deleted post] 2022-10-25T12:07:26.259Z

Temporarily gaining status is very doable though; there are many communities where I believe I’m high status, but i don’t tend to interact with them much. Some of them would be a good fit for me if I were in OP’s position. 

Comment by sovran on "Should" considered harmful · 2022-08-26T22:06:09.490Z · LW · GW

"should"s kinda cripple me. a lot. so far, this has possibly been the most useful post in the replacing guilt sequence. 

Comment by sovran on What's keeping concerned capabilities gain researchers from leaving the field? · 2022-05-17T02:35:58.665Z · LW · GW

Researchers aren't exactly fungible; replacing a skilled researcher with a new hire would still slow down progress. given how many people want to help, but have no idea how to help, this is a gap in the market worth filling. 

Comment by sovran on What's keeping concerned capabilities gain researchers from leaving the field? · 2022-05-13T13:52:06.738Z · LW · GW

Not everyone concerned about safety is looking to leave. The concerned have three options: stay and try to steer towards safety, continue moving on the current trajectory, or just leave. Helping some of those who’ve changed their mind about capabilities gain actually get out is only a net negative if those people staying in the field would’ve changed the trajectory of the field. I simply don’t think that everyone should try help by staying and trying to change. There is absolutely room for people to help by just leaving, and reducing the amount of work going into capabilities gain. Different paths will make sense for different people. There’s space to support both those researchers who’re trying to steer towards safety, and those who just want out. I’ve seen a lot of work towards the former, but almost none towards the latter. I want to speak to concerned researchers so that I can begin to better understand which individual researchers should indeed just leave, and which should stay.

I really don’t think the problem is overdetermined.

Comment by sovran on Ugh fields · 2022-05-06T00:54:41.706Z · LW · GW

That's an old blog, he's currently active on https://members.themindhackersguild.com/ and https://theeffortlessway.com/ 

Comment by sovran on What an actually pessimistic containment strategy looks like · 2022-04-27T12:09:10.045Z · LW · GW

For anyone interested in working on this, you should add yourself on this spreadsheet. https://docs.google.com/spreadsheets/d/1WEsiHjTub9y28DLtGVeWNUyPO6tIm_75bMF1oeqpJpA/edit?usp=sharing

It's very useful for people building such an organisation to know of interested people, and vice versa.

If you don't want to use the spreadsheet, you can also DM me and I'll keep you in the loop privately. 

If you're making such an organisation, please contact me. I'd like to work with you. 

Comment by sovran on What an actually pessimistic containment strategy looks like · 2022-04-27T12:01:33.356Z · LW · GW

For anyone else also interested, you should add yourself on this spreadsheet. https://docs.google.com/spreadsheets/d/1WEsiHjTub9y28DLtGVeWNUyPO6tIm_75bMF1oeqpJpA/edit?usp=sharing

It's very useful for people building such an organisation to know of interested people, and vice versa.

If you don't want to use the spreadsheet, you can also DM me and I'll keep you in the loop privately. 

If you're making such an organisation, please contact me. I'd like to work with you. 

Comment by sovran on What an actually pessimistic containment strategy looks like · 2022-04-27T10:56:19.327Z · LW · GW

Top researchers are not easy to replace. Without the 0.1st percentile of researchers, progress would be slowed much more than 0.1%