D&D.Sci May 2021 Evaluation and Ruleset

post by abstractapplic · 2021-05-14T11:37:14.328Z · LW · GW · 5 comments

Contents

  Ruleset
    Species
    Days Since Death
    Butchery
    Bidders
      Carver the Butcher
      Alistair the Butcher
      Betty the Necromancer
    Strategy
  Reflections
  Scheduling
None
5 comments

This is a followup to the D&D.Sci post [LW · GW] I made last week; if you haven’t already read it, you should do so now before spoiling yourself.

Here is the web interactive I built to let you evaluate your solution; below is an explanation of the rules used to generate the dataset. You’ll probably want to test your answer before reading any further.


Ruleset

(Note: to make writing this easier, I’m using standard D&D dice notation, in which “4d8+3” means “roll four eight-sided dice, sum the results, then add three”.)

Species

The carcasses brought back by adventurers are 2/13 Yetis, 5/13 Snow Serpents, and 6/13 Winter Wolves.

Days Since Death

The days since each creature’s death is modelled by rolling two d12s, taking the lowest result, and subtracting 1.

(For the rest of this post, let “[DSD]” stand in for “Days Since Death”.)

Butchery

Carver takes a “collect anything the local alchemists might pay for, then carve out all the technically-edible meat you can still access” approach to her vocation.

The amount Carver gains from a Yeti carcass is given by 72+1d6-[DSD]d6, the amount from a Snow Serpent is 20+2d6 (she can’t prepare snakemeat, so all the profit comes from non-degrading components like scales and fangs; ergo, no time effects), and the amount from a Winter Wolf is 25-2*[DSD]+4d6.

Bidders

There are three bidders at a given auction: Alistair, Betty, and - except for today's auction, where you take her place - your employer Carver.

Carver the Butcher

Carver bids 32-2*[DSD]+2d20 on Yeti carcasses, 7+2d10 on Snow Serpent carcasses, and 31-3*[DSD]+2d8 on Winter Wolf carcasses.

Alistair the Butcher

Alistair has a different business model to Carver, focusing on extracting the highest quality cuts and selling them to rich clients; as such, his utility sharply decreases with time since death.

He is very predictable, bidding 55-6*[DSD] for Yetis, 60-20*[DSD] for Snow Serpents, and 50-12*[DSD] for Winter Wolves.

Betty the Necromancer

Betty doesn’t care how long something’s been dead, so long as no-one’s interfered with the body.

She bids 29+1d6 on Yetis, 9+1d8 on Snow Serpents, and 19+1d4 on Winter Wolves.

Strategy

The relevant factors are summarized in these graphs.

In almost all cases where rivals aren’t making bids greater than the Expected Value of the lot to Carver, the EV-maximizing choice is to bid the lowest amount that would guarantee winning the lot. The one exception is with lot #11, where it’s possible to eke out a tiny amount of extra EV by bidding 21 or 22 silver pieces.

Reflections

I aimed to make this entry as straightforward and approachable as I could. From the, uh, comprehensiveness with which it was solved, I think it’s fair to say I succeeded. Congratulations to simon and GuySrinivasan for reaching perfect answers; and then, between them, managing to deduce my entire generation process.

The main problem with this scenario from my point of view is that I once again ended up making a puzzle when I was aiming for a challenge. It’s premised on some Weird Crap (distorting effects of selection bias, auctions against rival agents) but the fact it needs a ‘proper’ solution obligates the Weird Crap to impose itself with a reliability it would never possess in real life (Carver acts implausibly randomly to limit the effect of selection bias, opposing bidders are wind-up toys who don’t know anything you don’t), and so players develop abilities optimized for synthetic problems.

I’m mad about this, but only a little. While my game failed to live up to my standards of quote-unquote-'realism', it succeeded at its primary objectives: being playable, giving players an excuse to practice technical skills, and setting things up for the Bonus Round (which I’m pleased to report is absolutely not a puzzle).

Scheduling

Oh yeah, there’s a Bonus Round. It’s all written up and ready, but I’m delaying it slightly so I can have it both be a week long and end on a weekend; I plan to run it starting next Monday and conclude it the Monday after, unless I get hit by a truck or someone in the comments gives me a reason to use a different time window. Watch this space.

5 comments

Comments sorted by top scores.

comment by simon · 2021-05-15T01:41:40.467Z · LW(p) · GW(p)

The amount Carver gains from a Yeti carcass is given by 70+1d6-[DSD]d6

 

No, I already went over this with GuySrinivasan lol...

line # 89 (carcass # 88): Yeti,0,60sp,60sp,77sp

Anyways, I'm assuming that's a typo there and you meant to put in 72.

Also

60-28*[DSD] for Snow Serpents 

that should be a 20.

 

This one really brought home to me the usefulness of strong (yet correct) priors. 

Assuming that the typo wasn't in the d6, credit to GuySrivinisan for correctly defending the d6 against the weight of evidence for the d5. Also, the insistence on a higher prior probability for age distribution than a weighted average that just happens to be triangular would have.

This puzzle was made a lot easier by the simplicity of the model, e.g. everything was independent from everything else, except for bids and value obtained depending on monster type and days since death which we were primed to expect by the problem, and no hidden variables except the necessary randomness to actually have something to work out. I don't particularly feel like a Bayesian superintelligence though maybe all problems look like this to one sufficiently advanced.

Looking forward to whatever non-puzzle you have in mind for Monday. 

Replies from: GuySrinivasan, abstractapplic
comment by SarahSrinivasan (GuySrinivasan) · 2021-05-15T07:42:56.084Z · LW(p) · GW(p)

Yeah not the superintelligence bit, more like oh with strong priors and not a ton of data you can just discover everything there is to know about the "laws of physics".

comment by abstractapplic · 2021-05-15T08:14:36.104Z · LW(p) · GW(p)

Thanks, yes, you're completely right; I wrote this for an older version of the scenario and forgot to change it. Edited now.

comment by SarahSrinivasan (GuySrinivasan) · 2021-05-14T21:38:32.227Z · LW(p) · GW(p)

I kept getting flashbacks to https://www.lesswrong.com/posts/5wMcKNAwB6X4mp9og/that-alien-message [LW · GW] when reading or writing comments to this one.

Riemann invented his geometries before Einstein had a use for them; the physics of our universe is not that complicated in an absolute sense.  A Bayesian superintelligence, hooked up to a webcam, would invent General Relativity as a hypothesis—perhaps not the dominant hypothesis, compared to Newtonian mechanics, but still a hypothesis under direct consideration—by the time it had seen the third frame of a falling apple.  It might guess it from the first frame, if it saw the statics of a bent blade of grass.

comment by jaspax · 2021-05-15T04:39:28.449Z · LW(p) · GW(p)

I just want to add how much I enjoy reading about these, even though I haven't had the time to actually participate in the puzzle-solving.