I imagine that part of the difference is because Orcas are hunters, and need much more sophisticated sensors + controls.
I gigantic jellyfish wouldn't have the same number of neurons as a similarly sized whale, so it's not just about size, but how you use that size.
remmelt-ellen on If we had known the atmosphere would igniteJust found your insightful comment. I've been thinking about this for three years. Here are some thoughts expanding on your ideas:
my idea is more about whether alignment could require that the AGI is able to predict its own results and effects on the world (or the results and effects of other AGIs like it, as well as humans)...
In other words, alignment requires sufficient control. Specifically, it requires AGI to have a control system with enough capacity to detect, model, simulate, evaluate, and correct outside effects propagated by the AGI's own components.
... and that proved generally impossible such that even an aligned AGI can only exist in an unstable equilibrium state in which there exist situations in which it will become unrecoverably misaligned, and we just don't know which.
For example, what if AGI is in some kind of convergence basin [LW · GW] where the changing situations/conditions tend to converge outside the ranges humans can survive under?
so we can assume that they will have to be somehow interpreted by the AGI itself who is supposed to hold them
There's a problem you are pointing of somehow mapping the various preferences expressed over time by diverse humans from within their (perceived) contexts – onto reference values. This involves making (irreconcilable) normative assumptions of how to map the dimensionality of the raw expressions of preferences onto internal reference values. Basically, you're dealing with NP-complex combinatorics such as encountered with the knapsack problem.
Further, it raises the question of how to make comparisons across all the possible concrete outside effects the machinery could have against the internal reference values, such to identify misalignments/errors to correct. Ie. just having internalised abstract values is not enough – there would have to be some robust implementation process that translates the values into concrete effects.
I'm very sad I cannot attend at that time, but I am hyped about this and believe it to be valuable, so I am writing this endorsement as a signal to others. I've also recommended this to some of my friends, but alas UK visa is hard to get on such short notice. When you run it in Serbia, we'll have more folks from the eastern bloc represented ;)
remmelt-ellen on If we had known the atmosphere would igniteNo actually, assuming the machinery has a hard substrate and is self-maintaining is enough.
remmelt-ellen on If we had known the atmosphere would ignitewe could create aligned ASI by simulating the most intelligent and moral people
This is not an existence proof, because it does not take into account the difference in physical substrates.
Artificial General Intelligence would be artificial, by definition. In fact, what allows for the standardisation of hardware components is the fact that the (silicon) substrate is hard under human living temperatures and pressures. That allows for configurations to stay compartmentalised and stable.
Human “wetware” has a very different substrate. It’s a soup of bouncing organic molecules constantly reacting under living temperatures and pressures
Here’s why the substrate distinction matters [LW · GW].
brambleboy on Matt Goldenberg's Short Form FeedWhile the broader message might be good, the study the video is about didn't replicate.
arepo on What TMS is likeDid the ringing go away over time, or was it permanent?
towards_keeperhood on Could orcas be (trained to be) smarter than humans?In the wikipedia list, the estimated number of neurons in the neocortex of a blue whale is 5 billion (compared to 43 billion in orcas), even though blue whales are much larger. (Unfortunately the blue whale estimate is just an estimate and not grounded in optical or isotropic fractionation measurements.)
(EDIT: Hm interesting, the linked reddit post mentions 15billion for blue whales. Not sure what is correct.)
gunnar_zarncke on Could orcas be (trained to be) smarter than humans?As I commented [LW(p) · GW(p)] on Are big brains for processing sensory input? [LW · GW] I predict that the brain regions of a whale or Orca responsible for spatiotemporal learning and memory are a big part of their encephalization.
tslarm on Update on the Mysterious Trump Buyers on PolymarketCan't this only be judged in retrospect, and over a decent sample size? If all the markets did was reflect the public expert consensus, they wouldn't be very useful; the possibility that they're doing significantly better is still open.
(I'm assuming that by "every other prediction source" you mean everything other than prediction/betting markets, because it sounds like Polymarket is no longer out of line with the other markets. Betfair is the one I keep an eye on, and that's at 60/40 too.)