LessWrong 2.0 Reader

When it comes to Ziz, the articles that discuss her seem to leave out her interpretation of decision theory from explaining actions.

Ziz seem to engage in some reasoning based on her understanding of timeless decision theory that suggests cooperating with police is bad to the extent that she closed her eyes and didn't respond and let the police carry her out of her flat instead of just going along with the police. 

Starting a shoot-out with the police when the police tries to arrest you is likely similar, if trying to arrest you means getting shot game theory plus timeless decision theory reasoning suggests that would disincentize the police from arresting you. 

They seem to do things that provide no causal benefit for themselves because they believe that they are doing some acausal trade. 

To share something that might be non-public: Pasek was very much into letting timeless decision theory drive him even before he became in contact with Ziz. Pasek might have been the person with whom I talked deeply who was taking timeless decision theory the most seriously.

"This isn't right. This isn't even wrong."

Here you go: https://chatgpt.com/share/67a34222-e7d8-800d-9a86-357defc15a1d

What would the stock market post-AGI (or whatever you want to call it) look like? I really wonder if its worth investing in stock right now. I wonder if we can expect a huge market crash when most economic value is concentrated on one or two companies, or unlisted companies. That would basically drain the entire stock market, and doesnt sound entirely unrealistic. 

Another option of course is that the stocks explode since the companies produce so so much value. I am sceptical of that. The question is - can we trust the superrich to keep the stock market up or will they jump ship once they notice AI might take over? How will we notice before the average business man notices? Once the superrich jump ship and dump all their stocks because AIs can create their own companies that can do everything better, my savings in form of stock would mean... not much. 

So is it better to just save "raw money"? Or something inbetween, some part as normal money and some as stock, which one should be quick to dump once AI hits a certain point? I wonder what your thoughts are on this, I havent found a discussion about it on here, though I am sure it exists. 

Actually, the Zizians' version of the story is that MIRI/CFAR called the cops.

Yes, Ziz does make that claim. 

https://docs.google.com/document/d/1CJPdj0eBg-lII9KKkCAImxkg7x4-Kc4XxfrZTnVfS5c/edit?tab=t.0 is an account from Elizabeth from CFAR about what happened that day and it states:

I informed the team that I thought Ziz and some other people had arrived. The venue staff member assured us that the venue could handle it, and I think that the venue staff had called the police. 

As far as I remember (it's been while since I read through all the information), there were children who attended a previous event at the location that were inside of the location when Ziz and her crew showed up. Then the person responsible for the venue called the cops. Ziz at al were charged with false imprisonment for preventing the children from leaving. That collateral damage is quite inconvenient for Ziz's narrative of the situation. 

True!

Useless knowledge should neither be learned nor compressed, as both takes cognition.

Don't spend all your time compressing knowledge that's not that useful to begin with, if there are higher value things to be learned.

An extreme test of how much you trust a persons intention is to consider whether you would upload them, if you could. Then they would presumably be the only (speed) superintelligence.

Give me a dojo.lesswrong.com, where the people into mental self-improvement can hang out and swap techniques, maybe a meetup.lesswrong.com where I can run better meetups and find out about the best rationalist get-togethers. Let there be an ai.lesswrong.com for the people writing about artificial intelligence.

Yes! Ish! I'd be keen to have something like this for the upcoming aisafety.com/stay-informed page, where we're looking like we'll currently resort to linking to https://www.lesswrong.com/tag/ai?sortedBy=magic#:~:text=Posts%20tagged%20AI [? · GW] as there's no simpler way to get people specifically to the AI section of the site.

I'd weakly lean towards not using a subdomain, but to using a linkable filter, but yeah seems good.

I'd also think that making it really easy and fluid to cross-post (including selectively, maybe the posts pop up in your drafts and you just have to click post if you don't want everything cross-posted) would be a pretty big boon for LW.

The way I put that may have been overly obscure

But I've come to refer in my mind to the way the brain does chunking of information and noticing patterns and parallels in it for easier recall and use as just Compression. 

Compression is what happens when you notice that 2 things share the same structure, and your brain just kinda fuses the shared aspects of the mental objcts together into a single thing. Compression = Abstraction = Analogy = Metaphor. Compression = Eureka moments. And the amazing thing is the brain performs cognition on compressed data just as fast as on original data, effectively increasing your cognitive speed.

For example, I think there's large value in merging as much of your everyday observational data of humans as feasible together into abstracted psychology concepts, and I wanna understand models like BigFive (as far as they're correct) much better on intuitive levels.