Arbital scrape
post by emmab · 2019-06-06T23:11:17.943Z · LW · GW · 23 commentsContents
23 comments
Update: Arbital Scrape V2 [LW · GW]
I've scraped http://arbital.com as the site is unusably slow and hard to search for me.
The scrape is locally browsable and plain HTML save for MathJax.
https://drive.google.com/open?id=1b7dKhOzfMpFwngAeI8efeOzv147Lv_mx
https://emma-borhanian.github.io/arbital-scrape/
If there's interest let me know as I may tidy up and open source my code. edit: working on this
Mirror: www.obormot.net/arbital
23 comments
Comments sorted by top scores.
comment by Said Achmiz (SaidAchmiz) · 2019-06-07T00:35:27.344Z · LW(p) · GW(p)
This is now hosted at https://www.obormot.net/arbital/ .
Replies from: Raemon↑ comment by Raemon · 2019-06-08T04:49:23.494Z · LW(p) · GW(p)
FWIW, I think it'd be helpful if this link were edited into the OP to make viewing more obvious.
Replies from: SaidAchmiz, emmab↑ comment by Said Achmiz (SaidAchmiz) · 2019-06-08T06:42:12.016Z · LW(p) · GW(p)
You may want to post a comment saying this as a top-level reply, so that emmab will be notified of it, yes?
Replies from: Raemon↑ comment by Raemon · 2019-06-08T06:47:54.123Z · LW(p) · GW(p)
Pretty sure he gets notified of all comments on his posts by default
Replies from: SaidAchmiz↑ comment by Said Achmiz (SaidAchmiz) · 2019-06-08T07:45:43.284Z · LW(p) · GW(p)
Wait… really? I thought the notifications were just for top-level comments?? Is that false…?
Replies from: Raemon↑ comment by Raemon · 2019-06-08T16:31:55.023Z · LW(p) · GW(p)
I’m not actually sure and can’t check right now, but I thought so.
Replies from: habryka4↑ comment by habryka (habryka4) · 2019-06-08T17:17:02.486Z · LW(p) · GW(p)
Yeah, notifications are for all comments, not just top-level.
comment by clone of saturn · 2019-06-07T04:23:01.514Z · LW(p) · GW(p)
I've been working on something similar, it should be ready soon-ish.
Replies from: emmabcomment by riceissa · 2019-06-07T03:20:28.092Z · LW(p) · GW(p)
The scrape seems to be missing the Solomonoff induction dialogue, which was available at https://arbital.com/p/solomonoff_induction/?l=1hh (at the moment I just get an error).
ETA (2019-06-28): The new version of the scrape has this page, and can be viewed on the GreaterWrong version.
Replies from: rolandcomment by Smaug123 · 2019-06-07T06:15:45.540Z · LW(p) · GW(p)
Thanks very much for this! I've written a lot of stuff on there (I'm the Patrick Stevens whose name is splatted all over the screenshot). I asked them a year ago (ish) whether I could have a data dump, and they said it was Too Difficult; and I didn't bother scraping it myself. I'm glad you actually went and did something about it!
comment by Said Achmiz (SaidAchmiz) · 2019-06-07T00:24:46.865Z · LW(p) · GW(p)
If there’s interest let me know as I may tidy up and open source my code.
Please do!
comment by Liron · 2019-06-07T01:55:15.424Z · LW(p) · GW(p)
Nice project thanks. It's also consistent with my analysis that Arbital's fancy wiki features never added much value (say, more than +30%) beyond the value that that content would have if published in a pre-existing format and venue.
comment by habryka (habryka4) · 2019-06-07T00:03:48.472Z · LW(p) · GW(p)
This seems good. I remember Said being interested in hosting a static version of the site.
comment by roland · 2019-06-20T12:19:17.262Z · LW(p) · GW(p)
Just a reminder, the Solomonoff induction dialogue is still missing:
https://www.lesswrong.com/posts/muKEBrHhETwN6vp8J/arbital-scrape#tKgeneD2ZFZZxskEv [LW(p) · GW(p)]
Replies from: emmab↑ comment by emmab · 2019-06-25T10:03:48.296Z · LW(p) · GW(p)
See Arbital Scrape V2 [LW · GW]
comment by digital_carver · 2019-07-05T07:23:27.342Z · LW(p) · GW(p)
For the sake of us newbies, could you explain what the site was/is?
Replies from: Raemon↑ comment by Raemon · 2019-07-05T20:11:30.861Z · LW(p) · GW(p)
Arbital Postmortem is the first explanation I can think of.