How harmful is music, really?
post by dkl9 · 2024-09-17T14:53:25.426Z · LW · GW · 6 commentsThis is a link post for https://dkl9.net/essays/music_experiment.html
Contents
Methods Analysis Results Intention-to-treat analysis None 6 comments
For a while, I thought music was harmful, due largely to pervasive and arbitrary earworms. More recently, I started to find that earworms are ephemeral and lawful. A contrarian belief held like the former for years gets stuck as part of my identity, but maybe I should find the truth.
"Music is harmful" is hard to measure and verify. "Listening to music is harmful" is both easier to measure and more readily useful, for you can make a randomised controlled trial out of it.
Methods
Given that I deliberately listen to music only on rare occasion, it's easy, in my case, to let a column of random booleans in a spreadsheet dictate whether I listen to music each day. Sometimes I forgot to listen to music when the spreadsheet said I should, and sometimes I heard a lot of incidental music on days when the spreadsheet said I should abstain. To account for both cases, I kept a record of whether I actually did listen to music each day. Whether I actually listened to music is the explanatory variable, which ended up 50% correlated (phi coefficient) with whether the random boolean generator said I should.
The response variables are my mood — -1 to 1 — and the song stuck in my head — one of four categories:
- no song (N)
- a song played back deliberately (D)
- a song I heard recently (R)
- any other song (O)
Both response variables were queried by surprise, 0 to 23 times per day (median 6), constrained by convenience.
Analysis
I ran the experiment over 51 days. In all analysis here, I exclude three long intervals (11 days, 5 days, 4 days) of consecutive musical abstention due to outside constraints, leaving 31 days to examine.
Given these measurements, we can find the effects of listening to music by comparing the averages from days with music to those from days without music. It seems plausible that the effects of music lag or persist past the day of listening. Perhaps the better averages to compare would come from
- music days, plus days just after music days, versus
- all other days
What kind of harm do I expect to see from listening music?
- It could worsen my mood.
- It could make earworms play for more of the time, i.e. increase the ratio of D+R+O to N.
- It could make more of my earworms accidental, i.e. increase the ratio of R+O to N+D.
- It could make whatever particular music I listen to show up more often as accidental earworms, i.e. increase the ratio of R to O.
Results
What does my data say about all that?
Music | No music | Music + next day | >1 day since | |
---|---|---|---|---|
Days | 8 | 23 | 16 | 15 |
Average mood | 0.29 | 0.22 | 0.28 | 0.19 |
Total D+R+O | 43 | 140 | 96 | 87 |
Total N | 16 | 39 | 34 | 21 |
Total R+O | 34 | 111 | 77 | 68 |
Total N+D | 25 | 68 | 53 | 40 |
Total R | 3 | 17 | 13 | 7 |
Total O | 31 | 94 | 64 | 61 |
It appears that listening to music, in the short-term:
- makes me a tad happier
- makes earworms play in my mind for slightly less of the time
- makes accidental earworms (as contrasted with deliberate earworms, or mental quiet) play slightly less of the time
- has a weak, ambiguous effect on which songs I get as accidental earworms
Result 1 makes sense, but deserved testing, just to be sure. Results 2 and 3 go against my intuition. I'm less sure what to make of result 4, especially given that it's harder to measure — judging an accidental earworm as "recent" depends on a threshold of recency, which I left ambiguous, and on my memory of what songs I've heard recently, which can mess up on occasion.
Intention-to-treat analysis
If I take the original random boolean in the spreadsheet as the explanatory variable, I get some slightly different results. I did this tabulation later, by suggestion of kqr [LW(p) · GW(p)], so here I have 36 days recorded, instead of 31.
Music | No music | Music + next day | >1 day since | |
---|---|---|---|---|
Days | 17 | 19 | 27 | 9 |
Average mood | 0.2 | 0.25 | 0.25 | 0.2 |
Total D+R+O | 90 | 160 | 155 | 95 |
Total N | 30 | 42 | 52 | 20 |
Total R+O | 73 | 131 | 126 | 78 |
Total N+D | 47 | 71 | 81 | 37 |
Total R | 5 | 19 | 15 | 9 |
Total O | 68 | 112 | 111 | 69 |
Seen this way, the effect of listening to music on my mood is ambiguous, but listening to (intending to listen to) music still decreases how much of the time I get earworms, as well as how much time I get accidental earworms. Listening to music also decreases how much my accidental earworms follow songs I heard recently.
6 comments
Comments sorted by top scores.
comment by Lao Mein (derpherpize) · 2024-09-23T10:54:55.848Z · LW(p) · GW(p)
One of the highest quality-of-life increases I've ever experienced is when I stopped listening to music with sad lyrics. Crazy how long it took me to realize it was lowering my mood in a persistent, motivation-sapping way.
comment by kqr · 2024-09-17T17:33:26.350Z · LW(p) · GW(p)
This analysis suffers from a fairly clear confounder: since you are basing the data on which days you actually listened to music, there might be a common antecedent that both improves your mood and causes you to listen to music. As a silly example, maybe you love shopping for jeans, and clothing stores tend to play music, so your mood will, on average, be better on the days you hear music for this reason alone.
An intention-to-treat approach where you make the random booleans the explainatory variable would be better, as in less biased and suffer less from confounding. It would also give you less statistical power, but such is the cost of avoiding false conclusions. You may need to run the experiment for longer to counterbalance.
It appears that listening to music, in the short-term: [...] makes earworms play in my mind for slightly less of the time
Whenever I suffer from an earworm, my solution has for a long time been to just play and listen to that song once, sometimes twice. For some reason, this satisfies my brain and it drops it. Still counter-intuitive, but you might want to try it.
On a completely separate note:
Both response variables were queried by surprise, 0 to 23 times per day (median 6), constrained by convenience.
How was this accomplished, technically? I've long wanted to do similar things but never bothered to look up a good way of doing it.
Replies from: dkl9↑ comment by dkl9 · 2024-09-19T14:53:56.603Z · LW(p) · GW(p)
there might be a common antecedent that both improves your mood and causes you to listen to music. As a silly example, maybe you love shopping for jeans, and clothing stores tend to play music, so your mood will, on average, be better on the days you hear music for this reason alone.
There might be a common antecedent that both worsens my mood and causes me to listen to music. As a silly example, maybe I hate shopping for jeans, but clothing stores tend to play music, which actually improves my mood enough to outweigh the shopping. That is, confounding could go both ways here; the effect could be greater than it appears, rather than less.
An intention-to-treat approach where you make the random booleans the explainatory variable would be better, as in less biased and suffer less from confounding.
I'll reanalyse that way and post results, if I remember.
How was this accomplished, technically?
I made a script run in the background on my PC, something like
while true:
qt = random(0, INTERVAL)
while time() % INTERVAL < qt:
sleep(1)
announce_interruption()
mood = popup_input("mood (-1 to 1):")
earworm = popup_input("song in head (N/D/R/O):")
save_to_log(time(), mood, earworm)
sleep(INTERVAL - time() % INTERVAL)
The "constrained by convenience" part means that I recorded data when and only when I was at my PC. More reliable would be to run such a script on a device that's with you most of the time, like a smartphone or smartwatch, but I've no such device.
Replies from: kqr↑ comment by kqr · 2024-09-19T15:32:01.300Z · LW(p) · GW(p)
That is, confounding could go both ways here; the effect could be greater than it appears, rather than less.
Absolutely, but if we assume the null hypothesis until proven otherwise, we will prefer to think of confounding as creating effect that is not there, rather than subduing an even stronger effect.
I'll reanalyse that way and post results, if I remember.
Yes, please do! I suspect (60 % confident maybe?) the effect will still be at least a standard error, but it would be nice to know.
I made a script run in the background on my PC, something lik
Ah, bummer! I also have this problem solved for computer time, and I was hoping you had done something for smartphone carriage.
(Note, by the way, that a uniformly random delay is not as surprising as an exponentially distributed delay. Probably does not matter for your usecase, and you might already know all of that...)
Replies from: dkl9comment by basil.halperin (bhalperin) · 2024-09-17T15:52:27.072Z · LW(p) · GW(p)
Very cool!
To deal with the imperfect compliance of the randomization, you could use the "instrumental variables" approach. In this case, since it is (one-sided) noncompliance in an experiment, this amounts to:
- Using all of your data (ie, not subsetting the data to periods in which you complied with randomization)
- Dividing the observed treatment effect by the fraction of time in which you complied (if I understand correctly, this is 0.5)
I emphasize that this is a very simple econometric technique and does not rely on unreasonable assumptions ("Wald estimator" is another search term here).