Posts

Remap your caps lock key 2024-12-15T14:03:33.623Z
You should consider applying to PhDs (soon!) 2024-11-29T20:33:12.462Z
bilalchughtai's Shortform 2024-07-29T18:57:51.169Z
Understanding Positional Features in Layer 0 SAEs 2024-07-29T09:36:40.701Z
Unlearning via RMU is mostly shallow 2024-07-23T16:07:52.223Z
Transformer Circuit Faithfulness Metrics Are Not Robust 2024-07-12T03:47:30.077Z
Me, Myself, and AI: the Situational Awareness Dataset (SAD) for LLMs 2024-07-08T22:24:38.441Z

Comments

Comment by bilalchughtai (beelal) on You should consider applying to PhDs (soon!) · 2024-12-03T16:56:49.471Z · LW · GW

thanks! added to post

Comment by bilalchughtai (beelal) on You should consider applying to PhDs (soon!) · 2024-12-03T09:43:34.012Z · LW · GW

UC Berkeley has historically had the largest concentration of people thinking about AI existential safety. It's also closely coupled to the Bay Area safety community. I think you're possibly underrating Boston universities (i.e. Harvard and Northeastern, as you say the MIT deadline has passed). There is a decent safety community there, in part due to excellent safety-focussed student groups. Toronto is also especially strong on safety imo.

Generally, I would advise thinking more about advisors with aligned interests over universities (this relates to Neel's comment about interests), though intellectual environment does of course matter. When you apply, you'll want to name some advisors who you might want to work with on your statement of purpose.

Comment by bilalchughtai (beelal) on (The) Lightcone is nothing without its people: LW + Lighthaven's big fundraiser · 2024-11-30T22:49:18.386Z · LW · GW

Is there a way for UK taxpayers to tax-efficiently donate (e.g. via Gift Aid)?

Comment by bilalchughtai (beelal) on StefanHex's Shortform · 2024-11-19T23:33:02.487Z · LW · GW

Agreed. A related thought is that we might only need to be able to interpret a single model at a particular capability level to unlock the safety benefits, as long as we can make a sufficient case that we should use that model. We don't care inherently about interpreting GPT-4, we care about there existing a GPT-4 level model that we can interpret.

Comment by bilalchughtai (beelal) on jake_mendel's Shortform · 2024-10-11T13:49:35.953Z · LW · GW

Tangentially relevant: this paper by Jacob Andreas' lab shows you can get pretty far on some algorithmic tasks by just training a randomly initialized network's embedding parameters. This is in some sense the opposite to experiment 2.

Comment by bilalchughtai (beelal) on bilalchughtai's Shortform · 2024-07-30T09:18:04.833Z · LW · GW

I don't think it's great for post age-60 actually, as compared with a regular pension, see my reply. The comment on asset tests is useful though, thanks. Roughly LISA assets count towards many tests, while pensions don't. More details here for those interested: https://www.moneysavingexpert.com/savings/lifetime-isas/

Comment by bilalchughtai (beelal) on bilalchughtai's Shortform · 2024-07-30T09:13:11.828Z · LW · GW

Couple more things I didn't explain:

  1. The LISA is a tax free investment account. There are no capital gains taxes on it. This is similar to the regular ISA (which you can put up to £20k in per year, doesn't have a 25% bonus, and can be used for anything - the £4k LISA cap contributes to this £20k). I omitted this as I was implicitly viewing using this account as the counterfactual.
  2. The LISA is often strictly worse than a workplace pension for saving for retirement, if you are employed. This is because you invest in a LISA post-(income)tax, while pension contributions are calculated pre-tax. Even if the bonus approximately makes up for tax you pay, employer contributions tip the balance towards the pension.
Comment by bilalchughtai (beelal) on bilalchughtai's Shortform · 2024-07-29T18:57:51.259Z · LW · GW

Should you invest in a Lifetime ISA? (UK)

The Lifetime Individual Savings Account (LISA) is a government saving scheme in the UK intended primarily to help individuals between the ages of 18 and 50 buy their first home (among a few other things). You can hold your money either as cash or in stocks and shares.

The unique selling point of the scheme is that the government will add a 25% bonus on all savings up to £4000 per year. However, this comes with several restrictions. The account is intended to only be used for the following purposes:
1) to buy your first home, worth £450k or less
2) if you are aged 60 or older
3) if you are terminally ill

The government do permit individuals to use the money for other purposes, with the caveat that a 25% cut will be taken before doing so. Seems like a no brainer? Not quite.

Suppose you invest  in your LISA. The government bonus puts this up to . Suppose later you decide to withdraw your money for purposes other than (1-3). Then you end up with . That's a 6.25% loss!

So when does it make sense to use your LISA? Suppose further you have some uncertainty over whether you will use your money for (1-3). Most likely, you are worried that you might not buy a home in the UK, or you might want to buy a home over the price of £450k (because for instance you live in London, and £450k doesn't stretch that far).

Let's compute the expected value of your investment if the probability of using your money for the purposes (1-3) is  (which likely means your probability of using it for 1 is also about ). Suppose we invest £. For our investment to be worth it, we should expect at least £ back.

EV = (bonus scenario) + (penalty scenario) = , implying .

So, you should use your ISA if your probability of using it to buy a home (or 2,3) is above 20%. This is surprisingly low! Note further this calculation applies regardless of if you use a cash or stocks and shares LISA. 

I havn't ever seen this calculation written up publicly before so thought it was worth sharing.