PredictionBook: Feature Request and Bug Report

post by Jayson_Virissimo · 2012-01-20T09:20:59.786Z · LW · GW · Legacy · 14 comments

Contents

  Introduction
  Feature Request
  Bug Reports
None
14 comments

Introduction

It occurred to me (and ahartell) that it would be convenient if there were a place where we could report bugs and request features for the prediction tracking website PredictionBook. I propose to make this that place. If you post a comment in this thread pointing out a bug or requesting the addition of a new feature, then I will update this article to include that bug or feature.

Disclaimer: This thread isn't a promise that any particular bug will be fixed or feature added.

Feature Request

1. The ability to tag prediction statements to allow sorting by topic.

  (a). Prevent prediction statements that are tagged personal from showing up on the main feed or happenstance.

  (b). Allow users to form groups of "friends" that can follow prediction statements tagged as personal.

2. A voting system or flag button to discourage the use of PredictionBook for advertising purposes (and other types of spam).

3. A threaded comment system for discussing particular prediction statements (this will be much more important as the size of the community grows).

4. A Brier score visible on the user's page.

    (a). Brier scores by topic.

    (b). Brier score over time (say, quarterly).

5. The ability to compare calibration between users.

6. The ability to delete comments (perhaps, for a certain time period after the comment is made).

7. A button on the login page to reset the user's password.

8. An option on the user page to sort by judged/unjudged/upcoming.

9. Display a probability for the prediction statement weighed by the users' calibration scores.

Bug Reports

1. The email notification system appears not to be working.

14 comments

Comments sorted by top scores.

comment by gwern · 2012-01-20T15:45:14.536Z · LW(p) · GW(p)

Ahem: http://github.com/tricycle/predictionbook/issues

Replies from: Jayson_Virissimo
comment by Jayson_Virissimo · 2012-01-21T09:39:18.004Z · LW(p) · GW(p)

Good point. On the other hand, this seems like a better place for discussing the priority or utility of various features than GitHub comments (which seem somewhat clunky since they aren't threaded and are split into many separate chunks for each feature/bug).

Replies from: Jayson_Virissimo
comment by Jayson_Virissimo · 2012-01-22T05:37:33.465Z · LW(p) · GW(p)

Retracted for being a rationalisation. If I had known of that link before you mentioned it, then I wouldn't have felt the need to create this thread.

comment by kilobug · 2012-01-20T10:27:06.649Z · LW(p) · GW(p)

To me the main problem of PB (and why I don't really use it), is that there are so many predictions which are way too personal ("I'll go to the swimming pool next week") so I can't have any real opinion on them without knowing the person, and the predictions which are general-enough to be interesting are lost in the crowd.

So a topic/tag system would definitely be a great addition.

Replies from: None
comment by [deleted] · 2012-01-20T11:44:57.185Z · LW(p) · GW(p)

Personal predictions should be "encouraged" to be kept private.

Replies from: ahartell
comment by ahartell · 2012-01-20T11:49:14.983Z · LW(p) · GW(p)

Would it be rude to start commenting to this effect on personal predictions?

Replies from: None
comment by [deleted] · 2012-01-20T15:28:44.906Z · LW(p) · GW(p)

Perhaps a useful feature here would be the ability to share your (personal) prediction with a specific group of users only.

Replies from: ahartell
comment by ahartell · 2012-01-20T21:03:32.549Z · LW(p) · GW(p)

Yeah. You having said that, I'm imagining a "motivation by prediction" group where you can make personal predictions that won't clutter the main feed but still give a bit more accountability since you won't want to fail in front of your friends.

comment by ahartell · 2012-01-20T11:15:11.587Z · LW(p) · GW(p)

Another request: The ability to delete comments maybe? I'm not sure if this would go against the integrity of a prediction site, but maybe it could be set up such that the comments only remained deletable for like 10 minutes (to fight accidental double posts or typos or whatever). Even a retract button like lesswrong has would be an improvement.

comment by mstevens · 2012-01-20T09:35:12.513Z · LW(p) · GW(p)

I too have observed lack of email notifications, and would like this fixed.

comment by Xece · 2012-01-20T14:53:14.599Z · LW(p) · GW(p)

Option to sort by judged/unjudged predictions.

comment by ahartell · 2012-01-20T11:12:18.896Z · LW(p) · GW(p)

Thanks for posting this. And mentioning me :).

comment by Solvent · 2012-01-20T23:45:22.628Z · LW(p) · GW(p)

I signed up once for predictionbook, but since forgot my password. I haven't found way to recover it, and if I want a new account I need to use another email address. Is there any way around this?