Announcing AlignmentForum.org Beta

post by Raemon · 2018-07-10T20:19:41.201Z · LW · GW · 35 comments

Contents

35 comments

We've just launched the beta for AlignmentForum.org.

Much of the value of LessWrong has come from the development of technical research on AI Alignment. In particular, having those discussions be in an accessible place has allowed newcomers to get up to speed and involved. But the alignment research community has at least some needs that are best met with a semi-private forum.

For the past few years, agentfoundations.org has served as a space for highly technical discussion of AI safety. But some aspects of the site design have made it a bit difficult to maintain, and harder to onboard new researchers. Meanwhile, as the AI landscape has shifted, it seemed valuable to expand the scope of the site. Agent Foundations is one particular paradigm with respect to AGI alignment, and it seemed important for researchers in other paradigms to be in communication with each other.

So for several months, the LessWrong and AgentFoundations teams have been discussing the possibility of using the LW codebase as the basis for a new alignment forum. Over the past couple weeks we've gotten ready for a closed beta test, both to iron out bugs and (more importantly) get feedback from researchers on whether the overall approach makes sense.

The current features of the Alignment Forum (subject to change) are:

We’ve currently copied over some LessWrong posts that seemed like a good fit, and invited a few people to write posts today. (These don’t necessarily represent the longterm vision of the site, but seemed like a good way to begin the beta test)

This is a fairly major experiment, and we’re interested in feedback both from AI alignment researchers (who we’ll be reaching out to more individually in the next two weeks) and LessWrong users, about the overall approach and the integration with LessWrong.

35 comments

Comments sorted by top scores.

comment by Dagon · 2018-07-11T14:20:07.512Z · LW(p) · GW(p)

On one hand, I hate that there's now even more explicit status stratification on LW. Only special moderator-approved people get the omega tags and votes. This sucks. Please at least hide our lack of worth from us rather than putting it in our face.

From another view, I kind of like the vision (if it becomes that) of LW as an aggregate of a number of special-purpose topics - AI alignment, consciousness philosophy, EA, community-building, etc. Being able to select the topics one is interested in and see them all in one place in one system would be nifty.

comment by ChristianKl · 2018-07-12T21:32:06.485Z · LW(p) · GW(p)

I personally don't really have an interest in contributing to technical AI discussion (it's not my skill set and I won't develop it). As a result it would be great to have an option to hide the posts from the Alignment forum.

comment by clone of saturn · 2018-09-08T08:09:54.641Z · LW(p) · GW(p)

GreaterWrong now has an Alignment Forum view [? · GW].

Replies from: habryka4, Benito
comment by habryka (habryka4) · 2018-09-08T16:55:19.166Z · LW(p) · GW(p)

Awesome, thank you so much!

Replies from: SaidAchmiz
comment by Said Achmiz (SaidAchmiz) · 2018-09-08T17:07:40.194Z · LW(p) · GW(p)

To elaborate a bit—note that Alignment Forum posts are marked, in post listings, with a blue “AF” icon (and you can click that icon to see the view of all Alignment Forum posts).

comment by Gurkenglas · 2018-07-11T16:56:21.628Z · LW(p) · GW(p)

I have a dream that someday, everyone will be able to invent their own karma scores and LW perspectives. The alignment forum would merely be what users can access by applying the "restrict LW to this set of people" tool to the set Ω.

(Ideally, deleted posts being hidden would be merely another disableable filter.)

comment by Chris_Leong · 2018-07-11T07:05:01.927Z · LW(p) · GW(p)

Why are there suddenly so many posts today? Is this due to the imports or is this representative of the volume on Alignment Forum?

Replies from: Benito
comment by Ben Pace (Benito) · 2018-07-11T07:27:55.493Z · LW(p) · GW(p)

It’s neither. The MIRI Summer Fellows programme is currently running, and the participants spent today writing up various ideas that they’d been thinking about, and posting them to the forum. (I visited, chatted with them about what to blog about, goals for the new forum, selfish and pro-social benefits to blogging, etc.) It was an exciting one-off thing, we may try more such writing days in future - I enjoyed reading all the posts, from the longer, puzzling walks, to the short-and-sweet nuggets of technical insight.

The goal for the participants was to gain the affordance to just sit down and turn an idea into a blogpost. I think it was successful.

Replies from: Wei_Dai
comment by Wei Dai (Wei_Dai) · 2018-07-11T08:17:10.798Z · LW(p) · GW(p)

I think it would have been better to space out the posting of the posts more, even if it makes sense to write them up all on the same day. That way each post can receive more attention and discussion, and the authors would get more positive feedback for their efforts.

Replies from: DanielFilan, habryka4, Chris_Leong
comment by DanielFilan · 2018-07-11T18:23:09.856Z · LW(p) · GW(p)

I think that they didn't predict that so many of us would actually write blog posts.

Replies from: Duncan_Sabien
comment by [DEACTIVATED] Duncan Sabien (Duncan_Sabien) · 2018-07-11T18:52:51.797Z · LW(p) · GW(p)

This is correct. Last year we got approximately two.

comment by habryka (habryka4) · 2018-07-12T20:58:37.397Z · LW(p) · GW(p)

I agree with this. One of the considerations pushing towards having them all posted at the same time, is that we wanted to have people comment on each other's posts after they had written their own. I think this ended up happening less, but was definitely a goal.

comment by Chris_Leong · 2018-07-11T11:10:32.329Z · LW(p) · GW(p)

Seconding this. Posting so much at once makes it very hard to digest.

comment by cousin_it · 2018-07-11T08:48:45.103Z · LW(p) · GW(p)

It's good that AF comments are crossposted to LW. What happens if someone replies on LW - does it end up in the AF author's inbox, or should we expect AF authors to mostly ignore LW comments?

Replies from: DanielFilan, Raemon
comment by DanielFilan · 2018-07-11T18:25:24.697Z · LW(p) · GW(p)

However the website evolves, by the typical mind law and noticing the overlapping communities, I predict that most Alignment Forum authors will be interested in and check LessWrong comments, although maybe less interested than Alignment Forum comments.

comment by Raemon · 2018-07-11T09:11:21.189Z · LW(p) · GW(p)

Note: Off the cuff

Figuring out the best approach here is something I think we're still evaluating. Ultimately I think this is going to depend on the average volume of comments on AF posts, and average quality of LW comments on AF posts.

Replies from: Benito
comment by Ben Pace (Benito) · 2018-07-11T20:02:29.298Z · LW(p) · GW(p)

Current feedback was that alignment forum posters wanted it to be easier to find the LW comments. (As Ray says, still evaluating, and this may change with time.)

comment by Vanessa Kosoy (vanessa-kosoy) · 2018-07-21T13:14:14.153Z · LW(p) · GW(p)

Not sure whether this is the right place to voice technical complaints, but. I am unhappy about the handling of LaTeX macros (on which I rely heavily). Currently it seems like you can add macros either as inline equations or as block equations, and these macros are indeed available in the following equations. However, if an equation object contains only macros, it is invisible and seems to be impossible to edit after creation. As a workaround, I can add some text + macros into the same equation object, but this is very hacky. It would be nice if either equation objects with macros would remain visible, or (probably better) there would be a special "header" in each post where I can put the macros. It would be even more amazing if you could load LaTeX packages in that header, but that's supererogatory.

Replies from: vanessa-kosoy, habryka4, vanessa-kosoy
comment by Vanessa Kosoy (vanessa-kosoy) · 2018-09-05T11:59:17.577Z · LW(p) · GW(p)

Another, very serious issue with LaTeX support: When you copy/paste LaTeX objects, the resulting objects are permanently linked. Editing the content of one of them changes the content of another, which is not visible when editing but becomes visible once you save the post. This one made me doubt my sanity for a moment.

Replies from: Raemon
comment by Raemon · 2018-09-05T17:57:18.435Z · LW(p) · GW(p)

Woah. Thanks for pointing that out!

comment by habryka (habryka4) · 2018-07-21T17:24:52.078Z · LW(p) · GW(p)

Huh, I never ran into that problem. This might turn out to not be super easy to fix since we are using an external LaTeX library, but we can give it a try.

Unsure about whether a header is a good idea, since the vast majority of posts on LW don't have LaTeX, and so for them the header field would just be distracting, but we could add something like that only to agentfoundations, which would be fine. I can look into it. Also curious whether other people have similar problems.

Replies from: vanessa-kosoy, vanessa-kosoy, vanessa-kosoy, vanessa-kosoy
comment by Vanessa Kosoy (vanessa-kosoy) · 2018-08-09T12:10:55.002Z · LW(p) · GW(p)

And another problem: if an inline LaTeX object is located in the end of the paragraph, there seems to be no easy way to place the cursor right after the object, unless the cursor is already there (neither the mouse nor the arrow keys help here). So I have to either delete the object and create it again, or write some text in the next paragraph and then use backspace to join the two paragraphs together. This second solution doesn't work if there is also an equation LaTeX object after the end of the first paragraph, in which case you can't use backspace since it would delete the equation object.

Replies from: habryka4
comment by habryka (habryka4) · 2018-08-10T18:32:57.503Z · LW(p) · GW(p)

As a more general solution, we now support LaTeX in markdown formatted posts and comments. So if you run into a lot of problems like this, it might make sense to go to your user settings and activate the comment markdown editor.

Replies from: vanessa-kosoy
comment by Vanessa Kosoy (vanessa-kosoy) · 2018-08-16T15:42:07.394Z · LW(p) · GW(p)

Does it mean you don't want any more bug reports regarding the WYSIWYG LaTeX? Not criticism, just asking.

Replies from: habryka4
comment by habryka (habryka4) · 2018-08-16T16:43:41.358Z · LW(p) · GW(p)

Definitely still interested in bug reports for the WYSIWYG editor.

comment by Vanessa Kosoy (vanessa-kosoy) · 2018-07-27T16:21:33.751Z · LW(p) · GW(p)

Another issue is that it seems impossible to find or find/replace strings inside the LaTeX.

Also, a "meta" issue: in IAFF, the source of an article was plain text in which LaTeX appeared as "$...$" or "$$...$$". This allowed me to write essays in an external LaTeX editor and then copy into IAFF with a only mild amount of effort. Here, the source seems to be inaccessible. This means that the native editor has to be good because there are no alternatives. Maybe improving the native editor is indeed the best and easiest solution. But an alternative solution could be, somehow enabling work with the source.

Replies from: habryka4
comment by habryka (habryka4) · 2018-07-27T20:01:25.871Z · LW(p) · GW(p)

Yeah, we are working on improving the markdown editor to support LaTeX. It isn't ready yet, but should be possible at some point in the next few weeks. (You can turn on the Markdown editor in your account settings)

Replies from: vanessa-kosoy
comment by Vanessa Kosoy (vanessa-kosoy) · 2018-08-02T16:23:51.322Z · LW(p) · GW(p)

That's nice. Another reason it seems important is, some of content of these essays will eventually make its way into actual papers, and it will be much easier if you can copy-paste big chunks with mild formatting afterwards, compared to having to copy-paste each LaTeX object by hand.

comment by Vanessa Kosoy (vanessa-kosoy) · 2018-07-26T13:49:15.620Z · LW(p) · GW(p)

Another issue with LaTeX support: when I mark a block of text that contains LaTeX objects and copy-paste it, the LaTeX becomes an unuseful sort of plain text. I can copy the contents of particular LaTeX object by editing it, but sometimes it is very convenient to copy entire blocks.

Replies from: habryka4
comment by habryka (habryka4) · 2018-07-26T17:04:53.312Z · LW(p) · GW(p)

This is a bit of a silly bug, but you can fix this by copying two whole blocks of text that contain LaTeX in which case the content gets properly copy-paste (and then you can just delete one of them). It's a silly bug in the MathJax framework we are using, that has to do with how copy-pasting of multiple blocks is handled differently than copy pasting of individual lines.

Replies from: vanessa-kosoy
comment by Vanessa Kosoy (vanessa-kosoy) · 2018-07-27T16:51:22.481Z · LW(p) · GW(p)

Thank you, that's very helpful.

comment by Vanessa Kosoy (vanessa-kosoy) · 2018-07-21T20:00:48.162Z · LW(p) · GW(p)

Yes, I was only talking about alignmentforum, naturally.

comment by Vanessa Kosoy (vanessa-kosoy) · 2018-07-21T13:32:16.048Z · LW(p) · GW(p)

Another issue is, it seems impossible to delete anything, whether a comment or a draft? (and I guess it goes for posts too?)

Replies from: habryka4
comment by habryka (habryka4) · 2018-07-21T17:21:40.584Z · LW(p) · GW(p)

You can always move posts back to drafts. We have a plan to add a delete button, but want to make sure there is no way to click it accidentally. If you ping us on Intercom we are also happy to delete posts.

Not deleting comments is intentional, because completely deleting them would make it hard to display the children. You can just edit the content out of them. We are planning to make it so that you can delete your comments that don't have children, but haven't gotten around to it.