Posts
Comments
Wrong link? Looks like this is it https://arxiv.org/abs/2409.06927
Here is my understanding. Is this right?
Incredible!! I am going to try this myself. I will let you know how it goes.
honesty vector tuning showed a real advantage over honesty token tuning, comparable to honesty vector steering at the best layer and multiplier:
Is this backwards? I'm having a bit of trouble following your terms. Seems like this post is terribly underrated -- maybe others also got confused? Basically, you only need 4 terms, yes?
* base model
* steered model
* activation-tuned model
* token cross-entropy trained model
I think I was reading half the plots backwards or something. Anyway I bet if you reposted with clearer terms/plots then you'd get some good followup work and a lot of general engagement.
Hey!!! Thanks for replying. But did you or anyone you know consider chemical cisgenderization? Or any mention of such in the forums? I would it expect it to be a much stronger effect than eg joining the military. Although I hear it is common for men in the military to take steroids, so maybe there would be some samples there.... I imagine taking cis hormones is not an attractive idea, because if you dislike the result then you're worse off than you started.
(Oh and we were still together then. LK has child now, not sure how that affects the equation.)
Thank you! Seems like this bot works quite well for this task
I have used a number of discourse forums and they just feel bad/wrong but I cannot explain why. I would also vote for more of an old-fashioned php BB with a nice theme. Those are always great, even though all my intuitions tell me they seem like they should suck. Shows how little I know.
Eg https://github.com/phpbb/phpbb
Also has styles: https://www.phpbb.com/customise/db/styles/board_styles-12?sid=6245508b90fd3410be19888406fae215
Basically I'm repeating what Said said
If you have a clear metric to judge candidates on (eg engagement on a linkedin ad) then you might be able to do a super effective and quick performance-based hiring method. Shameless plug: https://www.lesswrong.com/posts/3AZkXwcCJZc5CAFQN/how-to-hire-somebody-better-than-yourself
Good luck!
Thanks for the cached explanation, this is similar to what I thought before a few days ago. But now I'm thinking that an older-but-still-youthful mouse would be better at avoiding predators and could be just as fertile, if mice were long lived. So the food & shelter might be "better spent" on them, in terms of total expected descendants. This would only leave the disease explanation, yes?
Where has the "rights of the living vs rights of the unborn" debate already been had? In the context of longevity. (Presuming that at some point an exponentially increasing population consumes its cubically increasing resources.)
Hey thanks much for sharing new info with me. What a nice comment to read. I was sure someone would come by and be pissed and mean as hell, but folks have been engaging in quite good faith.
but I'm more reserved
I think this might point at the central problem with my evidence. People vary in how publicly they live their lives by orders of magnitude. It could be that only 1% of math geniuses are trans women but they post / get views on Twitter 100x more. Or a similar thing in high school and the workplace. Math professors tend to live quiet lives...
Anyway, unfortunately I think this post might be kinda too toxic/hurtful for the average reader to be worthwhile overall (although nobody has mentioned that to me) and I'll probably move it to a pastebin or something.
I think the basic question (whether hormones are fucking or helping your brain long-term) is quite important and deserves a better treatment. I might try to do that eventually.
Any ideas?
They keywords are much appreciated. That second link is only from 2022! I wonder if anybody suggested this in like 1900. Edit: some of the citations are from very long ago
maybe you die young so you don't get your descendants sick
I've always wondered why evolution didn't select for longer lifespans more strongly. Like, surely a mouse that lives twice as long would have more kids and better knowledge of safe food sources. (And lead their descendants to the same food sources.) I have googled for an explanation a few times but not found one yet.
I thought of a potential explanation the other day. The older you get, the more pathogens you take on. (Especially if you're a mouse.) If you share a den with your grandkids then you might be killing them. Also, if several generations live together, then endemic pathogens stick with the clan much longer. This might eventually wipe out your clan if one of the viruses etc has a bad mutation.
If you die before your offspring even hatch then you might not pass them any pathogens. Especially if you swim a mile up a river that's dry 90% of the year. https://youtube.com/watch?v=63Xs3Hi-2OU This is very funny and 1 minute long.
Most birds leave the nest (yes?) so perhaps that's why there's so many long-lived birds.
Although IIRC, bats live a really long time and have a mountain of pathogens.
Anybody know if this explanation is fleshed out somewhere, or know a better explanation?
Not that it matters, but the new version sounds kind of like the author is making a big deal, and the old version sounds like normal press language, to me at least
Yeah I guess that's another prereq. I think you can make up for it some by having good work for people to do. I would rather work on a cool or valuable thing with amateurs than something lame with pros.
This is great!! I've just been using it now, thanks to your pointer.
I don't know if you're a woman, but the women I know have had much more success in politics than the men I know.
Very valuable information! I have never heard of this artificial mucus stuff. Thank you for sharing.
Why do you want to go the FDA route? You think the gene therapy is the most promising?
JITs are very underrated. Bad JavaScript code runs so much faster than bad C code. Sorry you got downvoted.
Excellent additions!
This is so much better than what claude was giving me
Thank you!
Is there a good like uh "intro to China" book or YouTube channel? Like something that teaches me (possibly indirectly) what things are valued, how people think and act, extremely basic history, how politics works, how factories get put up, etc etc. Could be about government, industry, the common person, or whatever.. I wish I could be asking for something more specific, but I honestly do not even know the basics.
All I've read is Shenzhen: A Travelogue from China which was quite good although very obsolete. Also it is a comic book.
I'm not much of a reader so I'm looking for something extremely basic.
I am asking humans instead of a chatbot because all the mainstream talk about China seems very wrong to me and I don't want to read something wrong
My emails are just right.
Thanks for reporting. Would be curious to know if still happening in a week
What? Nobody told me. Where did you learn this
I'm not sure but people seem pretty sensitive about it for some reason. Maybe this is some very very old-fashioned stigma.
Yeah albendazole might be better if you're not a baby or otherwise medically high-risk. I think it's probably good enough that you can give up on parasites being the root cause after trying it for a week. (Rather than being stuck on an endless journey of trying everything like the SIBO, candida, etc self-diagnoses.) The farm where I worked when my symptoms started was in Central Valley in California. The doctors I saw were at Mayo Clinic in Minnesota.
Head felt kind of buzzy and weird for one day
We didn't get colonoscopies, but some worms are pretty hard to see in stool (hence the insensitivity of the tests), so I think they're extra hard to see in a completely empty colon. (Can't find hard data on this.)
As for the survival, these things spread from a couple eggs left in the dry dirt or wherever, so yeah unfortunately 1 day fast usually won't eliminate an infection I'm pretty sure.
It never occurred to me that my problems might be due to worms. I took the dewormers because my butt was itchy one day.
But it should have occurred to me! My symptoms in 2019 started after I was working on this really dirty farm for a bit. Definitely had my face in the dirt plenty.
What was the distillation idea from a year ago?
A tricky thing about feedback on LW (or maybe just human nature or webforum nature):
- Post: Maybe there's a target out there let's all go look (50 points)
- Comments: so inspiring! We should all go look!
- Post: What "target" really means (100 points)
- Comments: I feel much less confused, thank you
- Post: I shot an arrow at the target (5 points)
- Comments: bro you missed
- Post: Target probably in the NW cavern in the SE canyon (1 point)
- Comments: doubt it
- Post: Targets and arrows - a fictional allegory (500 points)
- Comments: I am totally Edd in this story
- Post: I hit the target. Target is dead. I have the head. (40 points)
- Comments: thanks. cool.
Basically, if you try to actually do a thing or be particularly specific/concrete then you are held to a much higher standard.
There are some counterexamples. And LW is better than lots of sites.
Nonetheless, I feel here like I have a warm welcome to talk bullshit around the water cooler but angry stares when I try to mortar a few bricks.
I feel like this is almost a good site for getting your hands dirty and getting feedback and such. Just a more positive culture towards actual shots on target would be sufficient I think. Not sure how that could be achieved.
Maybe this is like publication culture vs workshop culture or something.
I think the tooling/scale is at a point where we can begin the search for "life" (eg viruses, boundaries that repair, etc) in weights during training. We should certainly expect to see such things if the NN is found via evolutionary algorithm. So we can look for similar structures in similar places with backprop+SGD. I expect this to go much like the search for life on mars. A negative result would still be good information IMO.
Was one giant cluster last two times I was there. In the outside area. Not sure why the physical space arrangement wasn't working. I guess walking into a cubby feels risky/imposing, and leaving feels rude. I would have liked it to work.
I'm not sure how you could improve it. I was trying to think of something last time I was there. "Damn all these nice cubbies are empty." I could not think of anything.
Just my experience.
It's hard to grasp just how good backprop is. Normally in science you estimate the effect of 1-3 variables on 1-3 outcomes. With backprop you can estimate the effect of a trillion variables on an outcome. You don't even need more samples! Around 100 is typical for both (n vs batch_size)
This is such a wonderful and kind thing to do!! If there were more people like you!
If it requires big datacenters then I think folks will hear about it and stop it. We're not the only country with a CIA. A datacenter can be destroyed without even killing any people (so less risk of retaliation). Let's hope it requires a big obvious datacenter.
Meanwhile, people were on track to invent new technology at increasing speed every year without the AI's help. Personally, I don't mind it taking 10x longer to reach the stars etc.
Yeah you can kind of stop at "we are already doing natural selection." The devs give us random variation. The conferences and the market give us selection. The population is large, the mutation rate is high, the competition is fierce, and replicating costs $0.25 + 10 minutes.
It would be interesting if someone discovered something like "junk DNA that just copies itself" within the weights during the backprop+SGD process. Would be some evidence that backprop's thumb is not so heavy a worm can't wiggle out. Right now I would bet against that happening within a normal neural net training on a dataset.
Note that RL exists and gives the neural net much more uh "creative room" to uh "decide how to exist". Because you just have to get enough score over time to survive, but any strategy is accepted. In other words, it is much less convergent.
Also in RL, glitching/hacking of the physics sim / game engine is what you expect to happen! Then you have to patch your sim and retrain.
Also, most of the ML systems we use every day involve multiple neural nets with different goals (eg the image generator and the NSFW detector), so something odd might happen in that interaction.
All this to say: The question "if I train one NN on a fixed dataset with backprop+SGD, could something unexpected pop out?" is quite interesting and still open in my opinion. But even if that always goes exactly as expected, it is certainly clear that RL, active learning, multi-NN ML systems, hyperparameter optimization (which is often an evolutionary algorithm), etc produces weird things with weird goals and strategies very often.
I think debate surrounds the 1-NN-1-dataset question because it is an interesting and natural and important question, the type of question a good scientist would ask. Probably only a small part of the bigger challenge to control the whole trained machine.
It's unbelievable how similar/convergent the big LLMs are. Only a slight improvement with 100x compute?? People have much bigger differences with much less variation of the core inputs (eg number of neurons). I wonder what the best explanation is. I can think of a few mediocre explanations.
I wonder how a workshop that teaches participants how to love easy victory and despise hard-fought battles could work
I love this post.
I think you forgot to mention an important prerequisite. It was reasonable to assume the prereq but still worth mentioning I think. You should be looking for the W, for the clear win. It's easy to just fart around and forget you were trying to make something happen. And in real life there are often bigger and clearer wins available than is immediately apparent. Often this takes much time and energy and creativity to see. Often the more important/urgent problem can be easier to solve. People tend to love tricky things and puzzles. It can be hard to learn to love easy victory. Pop the soccer-ball! Stab your opponent in the back while they sleep on Christmas night! Replace your sails with diesel motors! Solve your integral numerically! Use steel instead of wood! — This lesson of course well known here but it's hard to have a consuming conversation or intriguing post about it. I often forget this.
Your writing about how/when/why having all these AIs around goes wrong is exceptionally coherent and sensical and buyable IMO. Do you have much opportunity to preach outside the choir? Do you have late-night TV skills? I think you could have a much much larger platform. And actually get a substantial and correct message across. (Or were you doing lobbying.)
"Unclear on this point" means what you think it means and is not a L I E for a spokesperson to say in my book. You got the W here already
Yeah hurts the chances then. Could get something from an unwashed piece of fruit. I think the ones that do spread person-to-person do so via eggs that make your butt itch; the eggs get on the bedsheets then Bob eats an apple in the morning. I'm still like 50/50 on the parasite hypothesis
Looked for sold online and broad-spectrum. Basically just google.com/search?q=broad+spectrum+dewormer+human . I ate the chocolate one myself. Idk why different parasites would be sensitive to different chemicals or anything. Didn't check user reports at all.
I wonder how well a water cooled stovetop thermoelectric backup generator could work.
This is only 30W but air cooled https://www.tegmart.com/thermoelectric-generators/wood-stove-air-cooled-30w-teg
You could use a fish tank water pump to bring water to/from the sink. Just fill up a bowl of water with the faucet and stick the tube in it. Leave the faucet running. Put a filter on the bowl. Float switch to detect low water, run wire with the water tube
Normal natural gas generator like $5k-10k and you have to be homeowner
I think really wide kettle with coily bottom is super efficient at heat absorption. Doesn't have to be dishwasher safe obviously, unlike a pan.
I guess the vague idea is in the water. Just never saw it stated so explicitly. Not a big deal.