Comment by habryka4 on Voting Weight Discussion · 2019-02-17T02:21:45.673Z · score: 2 (1 votes) · LW · GW

This one broke for me a few times :/

I actually also think the UI design and feedback mechanisms are a lot worse, so I would recommend that people still use the old one.

Comment by habryka4 on Major Donation: Long Term Future Fund Application Extended 1 Week · 2019-02-17T00:05:54.592Z · score: 10 (2 votes) · LW · GW

As a reminder, here are the main interests of the Fund:

We are particularly interested in small teams and individuals that are trying to get projects off the ground, or that need less money than existing grant-making institutions are likely to give out (i.e. less than ~$100k, but more than $10k). Here are a few examples of project types that we're open to funding an individual or group for (note that this list is not exhaustive):
+ To spend a few months (perhaps during the summer) to research an open problem in AI alignment or AI strategy and produce a few blog posts or videos on their ideas
+ To spend a few months building a web app with the potential to solve an operations bottleneck at x-risk organisations
+To spend a few months up-skilling in a field to prepare for future work (e.g. microeconomics, functional programming, etc).
+ To spend a year testing an idea that has the potential to be built into an org.

This round, due to our much larger budget, I am also interested in applications above $100k in funding. Here are some more examples of things that I would be excited about (though I can’t speak for the other fund members):

Major Donation: Long Term Future Fund Application Extended 1 Week

2019-02-16T23:30:11.243Z · score: 42 (10 votes)
Comment by habryka4 on New York Restaurants I Love: Breakfast · 2019-02-14T22:41:17.671Z · score: 2 (1 votes) · LW · GW


Comment by habryka4 on Has The Function To Sort Posts By Votes Stopped Working? · 2019-02-14T19:15:12.041Z · score: 2 (1 votes) · LW · GW

You can sort posts by score by going to the all-posts page and sorting by "top".

Comment by habryka4 on Individual profit-sharing? · 2019-02-13T22:51:40.031Z · score: 3 (2 votes) · LW · GW

I've also thought about this, and would also be interested in seeing examples of this. I would also be interested in someone talking about the legal obstacles to doing this in the U.S. or Europe.

Comment by habryka4 on Reframing Superintelligence: Comprehensive AI Services as General Intelligence · 2019-02-13T22:48:34.637Z · score: 13 (6 votes) · LW · GW

Promoted to curated: I think the linked document is one of the most interesting things to be written in AI Alignment in the last year, and this is the best summary and commentary of it that currently exists. Quality wise, I think everything that I have to say has already been covered by the other commenters, but I overall found reading the linked document, as well as this summary, to be quite helpful in my thinking about AI Alignment, though I also disagree with large parts of it (However, I am not at the research level, and so have a harder time judging how useful it would be for the people who are spending even more time thinking about AI Alignment).

Thanks a lot for writing this summary, and thanks a lot to Eric for all the work he is doing.

Comment by habryka4 on Coherent behaviour in the real world is an incoherent concept · 2019-02-13T06:24:16.426Z · score: 16 (3 votes) · LW · GW

My interpretation of Eliezer's position is something like: "If you see an intelligent agent that wasn't specifically optimized away from goal-directedness, then it will be goal-directed". I think I could restate arguments for that, though I remember reading about a bunch of stuff related to this on Arbital, so maybe one of the writeups there gives more background.

Comment by habryka4 on [deleted post] 2019-02-13T02:29:51.650Z

Important note: You might lose unsaved comments or posts that are open at the time of the final transition, so I recommend not keeping edits open for super long in the next hour or so (though we can restore them, if you ping us on Intercom).

Comment by habryka4 on Open Thread February 2019 · 2019-02-12T16:40:09.589Z · score: 3 (2 votes) · LW · GW

Yep, seems true to me. I am all in favor of weird exploratory stuff on LW.

Comment by habryka4 on Minimize Use of Standard Internet Food Delivery · 2019-02-11T22:10:09.049Z · score: 13 (7 votes) · LW · GW

Ah, I see. Yeah, I am also not a counterfactual customer who would have ever called them. Before the onset of "standard internet food delivery" I never ordered food, and in the absence of the convenience of that system, would just stop ordering food from any of the restaurants. As such, I am happy to subsidize and give a lot of money to food delivery companies, which seem to actually have created a highly valuable service to me (more so than any individual restaurant ever has for me).

Comment by habryka4 on Minimize Use of Standard Internet Food Delivery · 2019-02-11T06:13:45.573Z · score: 14 (5 votes) · LW · GW

I am somewhat confused by this. I personally much prefer delivery to going out to restaurants, and I don't see why we shouldn't expect a market of delivery food at equally sustainable prices to show up. It seems like on the margin a restaurant is not going to make a loss on delivery food (because if they would, why would they offer it), and I am not a counterfactual customer who would have ever visited their in-person location (except for the very few restaurants that are close-by enough to walk to in 5 minutes).

I would love for most restaurants to drastically reduce the number of their seats and all the other stuff that they can save by prioritizing delivery food, and it seems like I would be defecting on everyone who has similar preferences to me, by sustaining a market of overpriced food that is subsidizing people who go out to restaurants and need all the seating and decorations and stuff.

Comment by habryka4 on The Case for a Bigger Audience · 2019-02-10T01:44:47.893Z · score: 6 (3 votes) · LW · GW

I think it's already a bit more scalable than what we had before, but I was mostly referring to a future version of the Q&A system, after we added some more related question functionality, and made it so that people notice questions for longer than they stick around on the frontpage, and some way to keep track of major open questions.

Comment by habryka4 on The Case for a Bigger Audience · 2019-02-10T00:36:19.313Z · score: 6 (5 votes) · LW · GW

My current position is that sometime around now, or maybe in the next two or three months, is the time to experiment with getting more core engagement and generally reaching a broader audience. Q&A in particular is something that I can imagine productively scaling to a larger audience, in a way that actually causes the contributions from the larger audience to result in real intellectual progress.

Ben summarized a lot of my general thoughts on this, but overall I think I agree with a good chunk of your sentiment. I think all the four things you list seem like good things to try, though I am kind of holding off on doing them until I feel more comfortable with the scalability of our intellectual progress machine.

Comment by habryka4 on The Case for a Bigger Audience · 2019-02-10T00:34:40.049Z · score: 4 (2 votes) · LW · GW

Yeah, I do think having a simple non-anonymous upvoting option is promising. I wonder whether we can make it a simple extension of the strong-upvoting system (maybe have some kind of additional button show up when you strong-upvoted something, that allows you to add your name to it, though I can imagine that getting too complicated UI-wise).

Comment by habryka4 on Why we need a *theory* of human values · 2019-02-08T23:04:33.428Z · score: 14 (7 votes) · LW · GW

Promoted to curated: You've written a lot of good posts about AI Alignment and related problems, but most of them are a bit too inaccessible to curate, or only really make sense when read together with a lot of other posts. And besides that, I think this post is one of the best and most important ones that I think you've written in the last year, and that I've found to clarify some of my thoughts on this topic, so I think it made sense to curate it.

Thanks a lot for all the work that you are doing, and I hope this post can serve as a good starting point for people who are interested in reading more of your research.

Comment by habryka4 on Spaghetti Towers · 2019-02-05T22:06:38.188Z · score: 8 (4 votes) · LW · GW

Promoted to curated: I've wanted to curate this for a while, mostly because it introduces a concept in a nice and concise way, while also connecting it to existing concepts and scientific disciplines. I've also found the images pretty useful and good, and I do think we have a lack of images, and see this as a good example of low-effort images increasing the quality of a post by a lot.

Comment by habryka4 on Constructing Goodhart · 2019-02-04T20:14:13.668Z · score: 2 (1 votes) · LW · GW

Fixed the LaTeX for you. You were in WYSIWYG editor mode, where you type LaTeX by pressing CTRL/CMD and 4 at the same time.

Comment by habryka4 on How to stay concentrated for a long period of time? · 2019-02-03T05:28:26.486Z · score: 6 (8 votes) · LW · GW

My inner Scott Alexander is screaming: "Have you considered you have ADHD? Have you considered you should take ADHD medicine?"

My inner Scott Alexander does not have a medical degree, and I don't know to what degree I endorse this as advice, but it seemed like the obvious hypothesis on the table. I know of a lot of people who have been helped by ADHD medicine.

Comment by habryka4 on Masculine Virtues · 2019-01-30T23:03:19.632Z · score: 8 (5 votes) · LW · GW

I think the situation where you are currently playing soccer, because it's a common sport, and if you would stop doing that you would revert to a sedentary lifestyle, isn't that rare. I've multiple times had the experience that most of my exercise was coming from some kind of hobby, or a constraint of my work-environment (such as being able to walk to work), and that I've reverted to being almost fully sedentary when that hobby or constraint went away, despite attempts at doing plain-exercise or picking up different hobbies.

I do agree, that on the macro-scale, over the course of multiple years, one should be able to find a stable source of exercise that doesn't come with potential head injuries. My comment was more directed at avoiding negative short-term changes in people's lifestyles.

Comment by habryka4 on Masculine Virtues · 2019-01-30T21:51:26.609Z · score: 11 (5 votes) · LW · GW

While I agree with this, the consequences of a largely sedentary lifestyle on cognitive performance are also pretty significant, and human motivation is fickle. I am not sure how the calculus turns out, but if you find that the only thing that makes you exercise is playing soccer, then I would probably recommend that you keep playing soccer (while also trying to minimize your use of heading in your soccer strategy).

Comment by habryka4 on Book Trilogy Review: Remembrance of Earth’s Past (The Three Body Problem) · 2019-01-30T19:53:28.074Z · score: 2 (1 votes) · LW · GW

Edit note: I made some lines headings to make it play nicer with the Table of Contents. Happy to change it back if you are bothered by that.

Comment by habryka4 on The Question Of Perception · 2019-01-30T01:35:51.708Z · score: 2 (1 votes) · LW · GW

Usually contracting whitespace helps clean up a lot of formatting glitches that people accidentally introduce, but agree that it's sometimes annoying. I think you should be able to get around it by creating empty paragraphs with whitespace characters in it, or alternatively you could make additional use of dividers.

Comment by habryka4 on The Question Of Perception · 2019-01-30T01:33:10.615Z · score: 2 (1 votes) · LW · GW

Yep, sure! I only wanted to be helpful!

Comment by habryka4 on The 3 Books Technique for Learning a New Skilll · 2019-01-29T21:09:57.307Z · score: 7 (4 votes) · LW · GW

Oh, no. Sorry. I didn't intend to make any point. I just thought that having additional examples would be really valuable for this post, and wanted to incentivize people to post them.

Comment by habryka4 on Attacking enlightenment · 2019-01-29T21:06:42.615Z · score: 2 (1 votes) · LW · GW

Interesting. Maybe also relevant for Kaj's current sequence?

Comment by habryka4 on The Question Of Perception · 2019-01-29T21:05:26.465Z · score: 2 (1 votes) · LW · GW

Also: Sorry, this post ended up in our spam-review queue and it took us a few hours to get around to approving it. This means this post just became publicly visible at the top of the frontpage.

Comment by habryka4 on The Question Of Perception · 2019-01-29T21:01:56.048Z · score: 2 (1 votes) · LW · GW

Mod note: Made the post an actual link-post and replaced the dots with our dividers. Let me know if you want me to change it back.

Comment by habryka4 on Río Grande: judgment calls · 2019-01-27T23:54:33.332Z · score: 4 (2 votes) · LW · GW

Random guess: That's where the post was written.

Comment by habryka4 on "AlphaStar: Mastering the Real-Time Strategy Game StarCraft II", DeepMind [won 10 of 11 games against human pros] · 2019-01-25T00:20:27.329Z · score: 3 (2 votes) · LW · GW

Is at least one.

Comment by habryka4 on Starting to see 2 months later · 2019-01-23T21:18:29.899Z · score: 3 (2 votes) · LW · GW

(Mod note: Made this a normal post instead of a question, since that seemed more in line with the intention. Also, cleaned up some of the formatting.)

Comment by habryka4 on The 3 Books Technique for Learning a New Skilll · 2019-01-23T02:52:13.957Z · score: 17 (6 votes) · LW · GW

I would offer $20 to anyone who can give examples for the three different books in an area, that they actually read, up to a maximum of $60. (e.g. three books in Linear Algebra, or three books in carpeting, or three books about programming).

Comment by habryka4 on Vote counting bug? · 2019-01-23T01:01:37.677Z · score: 2 (1 votes) · LW · GW

Oh, the second one seems important. Will fix that ASAP.

The first one makes sense, and should be relatively easy to fix, though it might require resyncing our search database.

Comment by habryka4 on Vote counting bug? · 2019-01-23T01:00:35.621Z · score: 2 (1 votes) · LW · GW

Yep, that seems like a bug. It requires some minor changes in architecture to fix, so it might take a bit longer than the smallest bugs.

Comment by habryka4 on The Pavlov Strategy · 2019-01-18T08:13:37.149Z · score: 3 (2 votes) · LW · GW

Promoted to curated: I think this post both communicates a set of important concepts, while also building on past concepts that have been discussed on LessWrong. I think this kind of game-theory is pretty valuable as an intuition pump for a large variety of environments and problems.

Presentation wise, I think the sequences of of agent-behaviors was a bit hard for me to follow, and while I think I was still able to follow the core points without them, finding some way to make them more intuitive or annotate them more would be valuable.

EA Funds: Long-Term Future fund is open to applications until Feb. 7th

2019-01-17T20:27:17.619Z · score: 31 (11 votes)
Comment by habryka4 on Open Thread January 2019 · 2019-01-16T03:10:36.863Z · score: 5 (3 votes) · LW · GW

Welcome! :)

I really liked reading your comments on the recent post about Kuhn, and would be interested in hearing more of your thoughts on related topics, And if you ever have any questions or problems with the site, feel free to ping us here or on Intercom!

Comment by habryka4 on What are the open problems in Human Rationality? · 2019-01-14T18:07:00.409Z · score: 8 (4 votes) · LW · GW

I know of a lot of people who continued studying and being interested in the forecasting perspective. I think the primary reason why there has been less writing from that is just that LessWrong was dead for a while, and so we've seen less writeups in general. (I also think there were some secondary factors that also contributed, but that the absence of a publishing platform was the biggest)

Comment by habryka4 on Open Thread January 2019 · 2019-01-13T21:38:46.251Z · score: 4 (2 votes) · LW · GW


A lot of people really enjoy Scott Alexander's writing. We have a compilation of the best of his writing here.

A lot of people also really enjoy Harry Potter and the Methods of Rationality, which you can find here.

Another good way of discovering good posts is to go to the all-posts page and sort by "top" which shows you all historical posts sorted by karma. You can find that page with that sorting activated here.

Comment by habryka4 on What is a reasonable outside view for the fate of social movements? · 2019-01-12T23:20:38.718Z · score: 9 (3 votes) · LW · GW

Ah, cool. That makes sense and is quite sad.

Comment by habryka4 on Why is so much discussion happening in private Google Docs? · 2019-01-12T20:29:08.232Z · score: 4 (2 votes) · LW · GW

I think it's both somewhat of a bug that can be fixed (and I think we've made progress on this in the last year), and just a reality of public communication. I think there is a hierarchy of conversational modes that are more collaborative but require more and more trust among the participants (as Raemon mentioned in his answer), and that conversations usually end up at something close to the lowest level for which there is enough trust among all pairs of participants, which means that any large audience will usually imply a less collaborative communication style.

I think there are some ways around this, and I think the karma system is one of those (by increasing the weight more mutually trusted members have in the conversation, while not fully blocking out newcomers), but it's overall a hard problem and it's not clear to me that it can be solved completely with technical solutions.

Comment by habryka4 on Visualizing the power of multiple step selection processes in JS: Galton's bean machine · 2019-01-12T20:09:31.233Z · score: 6 (3 votes) · LW · GW

Does anyone have examples of multi-stage selection processes, that behave like the one modelled here?

I assign significant probability to Gwern having a list of these already and I just wasn't able to find it, but if there isn't a list, then I will probably just create a new top-level question asking for examples.

Comment by habryka4 on What are questions? · 2019-01-11T01:41:59.497Z · score: 2 (1 votes) · LW · GW

Cleaned up some of the formatting, let me know if I broke anything in doing so.

Comment by habryka4 on What are questions? · 2019-01-11T01:39:45.298Z · score: 2 (1 votes) · LW · GW

Mod Note: Moved a bunch of comments to the answer section. Ping me if you want it moved back.

Comment by habryka4 on What is a reasonable outside view for the fate of social movements? · 2019-01-11T00:18:00.395Z · score: 2 (1 votes) · LW · GW

Yep, send me a PM with payment details.

Comment by habryka4 on Reframing Superintelligence: Comprehensive AI Services as General Intelligence · 2019-01-10T19:19:45.583Z · score: 2 (1 votes) · LW · GW

I also just went in and appended some random URL parameters to the URL to avoid the duplication filter for now.

Comment by habryka4 on Latex rendering · 2019-01-10T17:51:51.563Z · score: 2 (1 votes) · LW · GW

Oh, I see, you use the markdown editor.

In that case, I don't think there is currently an easy way to preview it. I will add an issue to our GitHub and see whether I can get around to that soon. Seems good to throw an error when you try to save a post with invalid LaTeX.

Comment by habryka4 on Latex rendering · 2019-01-10T03:13:36.494Z · score: 2 (1 votes) · LW · GW

Hmm, I think it depends a bit. Do you have a link to a post in which there is LaTeX that displays properly in the editor, and doesn't display properly in the post?

Comment by habryka4 on Meditations on Momentum · 2019-01-09T18:57:12.355Z · score: 2 (1 votes) · LW · GW

Woops, "implies" is not equal to "is equivalent to". My bad.

Comment by habryka4 on Which approach is most promising for aligned AGI? · 2019-01-08T03:03:16.891Z · score: 4 (2 votes) · LW · GW

Mod edit note: Made this into a question for you. You created it as an ordinary post.

Comment by habryka4 on What exercises go best with 3 blue 1 brown's Linear Algebra videos? · 2019-01-08T00:04:05.884Z · score: 4 (2 votes) · LW · GW

Huh, interesting. I will check that out sometime.

Comment by habryka4 on What is a reasonable outside view for the fate of social movements? · 2019-01-07T22:32:47.777Z · score: 1 (2 votes) · LW · GW

(The NIST randomness beacon doesn't appear to be down to me)

Reinterpreting "AI and Compute"

2018-12-25T21:12:11.236Z · score: 32 (8 votes)

[Video] Why Not Just: Think of AGI Like a Corporation? (Robert Miles)

2018-12-23T21:49:06.438Z · score: 17 (3 votes)

Is the human brain a valid choice for the Universal Turing Machine in Solomonoff Induction?

2018-12-08T01:49:56.073Z · score: 21 (6 votes)

EA Funds: Long-Term Future fund is open to applications until November 24th (this Saturday)

2018-11-21T03:39:15.247Z · score: 38 (9 votes)

Switching hosting providers today, there probably will be some hiccups

2018-11-15T19:45:59.181Z · score: 13 (5 votes)

The new Effective Altruism forum just launched

2018-11-08T01:59:01.502Z · score: 28 (12 votes)

Introducing the AI Alignment Forum (FAQ)

2018-10-29T21:07:54.494Z · score: 88 (29 votes)

Upcoming API changes: Upgrading to Open-CRUD syntax

2018-10-04T02:28:39.366Z · score: 16 (3 votes)

AI Governance: A Research Agenda

2018-09-05T18:00:48.003Z · score: 27 (5 votes)

Changing main content font to Valkyrie?

2018-08-24T23:05:42.367Z · score: 25 (4 votes)

LW Update 2018-08-10 – Frontpage map, Markdown in LaTeX, restored posts and reversed spam votes

2018-08-10T18:14:53.909Z · score: 24 (10 votes)

SSC Meetups Everywhere 2018

2018-08-10T03:18:58.716Z · score: 31 (9 votes)

12 Virtues of Rationality posters/icons

2018-07-22T05:19:28.856Z · score: 49 (22 votes)

FHI Research Scholars Programme

2018-06-29T02:31:13.648Z · score: 34 (10 votes)

OpenAI releases functional Dota 5v5 bot, aims to beat world champions by August

2018-06-26T22:40:34.825Z · score: 56 (20 votes)

Announcement: Legacy karma imported

2018-05-31T02:53:01.779Z · score: 40 (8 votes)

Using the LessWrong API to query for events

2018-05-28T22:41:52.649Z · score: 12 (3 votes)

April Fools: Announcing: Karma 2.0

2018-04-01T10:33:39.961Z · score: 118 (37 votes)

Harry Potter and the Method of Entropy 1 [LessWrong version]

2018-03-31T20:38:45.125Z · score: 21 (4 votes)

Site search will be down for a few hours

2018-03-30T00:43:22.235Z · score: 12 (2 votes) URL transfer complete, data import will run for the next few hours

2018-03-23T02:40:47.836Z · score: 69 (20 votes)

You can now log in with your LW1 credentials on LW2

2018-03-17T05:56:13.310Z · score: 30 (6 votes)

Cryptography/Software Engineering Problem: How to make LW 1.0 logins work on LW 2.0

2018-03-16T04:01:48.301Z · score: 23 (4 votes)

Should we remove markdown parsing from the comment editor?

2018-03-12T05:00:22.062Z · score: 20 (5 votes)

Explanation of Paul's AI-Alignment agenda by Ajeya Cotra

2018-03-05T03:10:02.666Z · score: 55 (14 votes)

[Meta] New moderation tools and moderation guidelines

2018-02-18T03:22:45.142Z · score: 104 (36 votes)

Speed improvements and changes to data querying

2018-02-06T04:23:20.693Z · score: 32 (7 votes)

Models of moderation

2018-02-02T23:29:51.335Z · score: 58 (14 votes)

RSS Feeds are fixed and should be properly functional this time

2018-01-30T00:47:58.791Z · score: 12 (4 votes)

Notification update and PM fixes

2018-01-25T01:06:42.589Z · score: 24 (5 votes)

Sorry for being less around, will be back soon

2017-11-21T20:40:14.509Z · score: 16 (4 votes)

11/07/2017 Development Update: LaTeX!

2017-11-07T11:06:58.012Z · score: 29 (10 votes)

Moved from Moloch's Toolbox: Discussion re style of latest Eliezer sequence

2017-11-05T02:22:48.471Z · score: 18 (11 votes)

10/28/17 Development Update: New editor framework (markdown support!), speed improvements, style improvements

2017-10-28T09:59:07.667Z · score: 25 (7 votes)

10/25/17 Development update: View-tracking & database fixes

2017-10-25T12:33:56.589Z · score: 20 (6 votes)

Continuing the discussion thread from the MTG post

2017-10-24T02:20:22.980Z · score: 17 (5 votes)

10/20/17 Development Update: HTML pasting, the return of the bullets and bugfixes

2017-10-20T08:31:25.396Z · score: 9 (2 votes)

10/19/2017: Development Update (new vote backend, revamped user pages and advanced editor)

2017-10-19T09:09:06.061Z · score: 21 (7 votes)

Activated social login, temporarily deactivated normal signup

2017-10-14T03:59:11.873Z · score: 16 (3 votes)

10/10/2017: Development update ("autosaving" & Intercom options)

2017-10-10T19:15:12.804Z · score: 9 (2 votes)

10/05/2017: Development update (performance & styles)

2017-10-06T07:22:36.777Z · score: 11 (3 votes)

Speed & Performance is our current top priority

2017-09-27T23:36:25.321Z · score: 34 (18 votes)

LW 2.0 Site Update: 09/22/17

2017-09-23T10:10:10.594Z · score: 15 (6 votes)

LW 2.0 Strategic Overview

2017-09-15T03:00:07.826Z · score: 47 (47 votes)

Welcome to Lesswrong 2.0

2017-06-18T17:23:02.272Z · score: 24 (15 votes)

LessWrong 2.0 Feature Roadmap & Feature Suggestions

2017-06-17T22:18:41.162Z · score: 15 (11 votes)