Explaining Visual Thinking

post by Teach · 2019-11-01T20:00:54.037Z · LW · GW · 1 comment

This is a question post.

Contents

  Answers
    13 gilch
    3 avturchin
    2 limerott
    1 Michael Pemberton
None
1 comment

One of my students asked me how visual thinking works. As someone who does not think in pictures, I was a bit stumped on how to explain it because I can't simulate visual thinking in my mind (I usually try to conceptualise and simulate things I haven't experienced in order to understand them better). I'm actually really interested now, myself, in understanding the mechanisms of visual thinking, and how it all works.

Are any of you here visual thinkers? How would you explain the way your visual thinking occurs in your mind to someone so they could conceptualise it in terms of both the processes and the sensations?

Answers

answer by gilch · 2019-11-02T01:40:26.197Z · LW(p) · GW(p)

Are you (or is your student) claiming to have aphantasia? If so, you'd have to use something external to hold the image.

Visual thinking is like other kinds of thinking, but using the visual sensory channel. It's a kind of short-term memory with limited capacity.

If you remember the days when we had to look up phone numbers in books, you might have had the experience of loading a seven-digit number into your short-term memory as an auditory loop, speaking it over and over again in your mind's voice (and hearing it in your mind's ear), long enough to dial on the phone. You could actually speak the numbers aloud for a similar effect, but most people don't have to do this to "hear" it. But a moment of distraction, especially an auditory distraction, can cause you to lose that memory.

Visual thinking is the same, but you use your mind's eye instead of ear. It's like having an imaginary whiteboard, but it requires concentration to hold an image, and a moment of distraction can erase it. You're not exactly drawing in lines either (unless you choose to). This whiteboard has limited capacity in the same way your auditory loop has a limited duration. You can choose which parts of the image to focus on, and that can have more detail (just like your real eyes can see things they're looking at directly better than things in the periphery), but if you stop focusing on an area for too long its detail fades and you lose the memory. If you try to exceed your capacity, then the part of the image you refresh might not quite have what was there before, the same way you can accidentally remember the wrong number if you try to keep too long of a string of digits in your auditory memory.

In the same way you can query your long-term memory for the sound of something, by holding the question in your mind until the sound arises (E.g. What rhymes with "muffin"? Or what does a dolphin sound like?), you can query your long-term memory for an image (E.g. What does a dolphin look like?).

And this can be done without using your mind's voice. Perhaps you can use your mind's eye to "read" the text of the question. But you don't even have to use words. You can use the concepts behind the words more directly. And sometimes these concepts are visual, or can have a visual representation. Even kinesthetic concepts have enough of a spacial component that they can be diagrammed visually in a very natural way. Many nouns correspond to visible things, and verbs correspond to visible actions. Holding such an image in memory along with the intention to query memory can cause an answer to arise to consciousness, the same way a query in words can.

The intention to query for a sound is like stopping for a moment to listen, while the intention to query for an image is like stopping to look. You have to make a space for it in your mind in the appropriate sensory channel.

You can also query your subconscious for things you've never seen before. Maybe you don't know what an ichthyosaur looks like, but someone tells you it looks like a dolphin, but with two pairs of fins instead of one. Running a hypothetical query may be enough to produce the image in your mind's eye. If that's not working, you can try to force it by "painting", which takes more effort: If you had a whiteboard (and artistic skill) you could draw a dolphin, and then draw another pair of fins in the pelvic region. You can do the same thing in the mind's eye. Start with a dolphin image, and then while concentrating to keep it refreshed in memory, make a change to it: refresh that part differently on purpose.

comment by Teach · 2019-11-03T22:34:11.830Z · LW(p) · GW(p)

When I say I can't stimulate visual thinking, I more mean the problem solving element - I can construct visual thoughts in my mind with some effort, but I couldn't then work through those visualisations as a primary tool to solve problems. I'm curious as to how that works - do people who do this have a better ability to retain a visualisation in their short term memory, whether innate or practiced? Is there more to it than that?

Replies from: gilch, brad-williamson
comment by gilch · 2019-11-04T03:17:39.770Z · LW(p) · GW(p)

We know from IQ tests that working memory abilities vary. Those with aphantasia can't visualize at all, while others report that not only can they visualize a tiger, they can count its stripes. My visualizations are not that stable. The number of stripes would probably change as I attempt to count them. But visual thinking can be improved with practice, at least in my own experience. Things that took a lot of effort to visualize the first time become simple recall after that. The bigger your bag of tricks, the more likely you can find one that applies to a novel situation.

Visualizations need not be static images. They can have motion as well. I can rotate simple 3-D shapes in my mind, for example. Rotating a cube is pretty easy. I can even do an icosahedron, though that one took some practice. But counting the leaves on a tree would be too difficult, never mind rotating the tree without changing (or glossing over) their number. There are limits to the resolution. You can also do transformations other than rotations, like scales, shears, extrusions, etc. These visualizations are useful in computer graphics and in topology.

In the case of mathematics, I find visualization most useful for generating examples, especially counterexamples. Using the visual query process I described, one can try to query for a shape that meets certain constraints. Sometimes one example (or counterexample) is all it takes to prove a theorem. Sometimes the query produces the example, but sometimes it fails to meet all the constraints and I have to query that part again. Pointing out the part that failed a constraint can bring more examples to mind. You have to give these mathematical objects a visual form to gain the benefits of visual thinking, but there are many morphisms one might try. Besides single examples, you might also be able to enumerate a set of them, or notice a pattern that can be repeated to infinity.

I can generate candidate visualizations much faster in my head than I can draw them on a whiteboard, but then communicating that insight to another person may require a diagram.

A visual thinking riddle: go in one hole and come out three. What am I? I solved this one visually pretty quickly. Try to generate candidate visualizations and see if you recognize the shape.
(Answer: grrfuveg.)

Replies from: limerott
comment by limerott · 2019-11-04T08:06:25.690Z · LW(p) · GW(p)

Do you visualize the icosahedron as one object or do you split it up and consider each separately, but reminding oneself that it is actually one object?

My answer to your visual thinking riddle is: breath in through your mouth and breath out through mouth + nostrils. But I can't decipher your anagram!

Replies from: gilch, gilch
comment by gilch · 2019-11-05T02:46:39.887Z · LW(p) · GW(p)

Do you visualize the icosahedron as one object or do you split it up and consider each separately, but reminding oneself that it is actually one object?

I have looked at a d20 long enough and from enough angles (it's very symmetrical) to have memorized the whole icosahedron, and can visualize it that way, at least as an opaque object from the outside.

But the mnemonic technique of chunking is a valid strategy for visualization. Short-term memories must be "refreshed" or they fade away, but if you juggle too many at once, you'll drop one before you can get back to it. Making each face a chunk would be 20, which is too many. 3-5 chunks is a more reasonable number. My favored decomposition of the icosahedron is into a pentagonal antiprism with pentagonal pyramid caps. That's 3 chunks, and two of them are the same thing. Other decompositions may be useful depending on what you are trying to do.

More complex objects can be visualized as hierarchical decompositions, though not always in their entirety. Recognition is not the same as recall. The resolution of a weak visual memory may be just enough to recognize a new example (but too low to count the faces, say). A really low resolution image is more of a handle than a structure, but it can point you to the memory of the real thing.

comment by gilch · 2019-12-17T05:24:06.919Z · LW(p) · GW(p)

But I can't decipher your anagram!

That's because it isn't an anagram. ROT13 :)

comment by Brad Williamson (brad-williamson) · 2019-11-10T21:31:25.760Z · LW(p) · GW(p)

I'm a visual thinker, and I'd say it's both a blessing and a curse.

Blessing, because, based on my own personal experience, my brain projects a million images per moment, each with their own story, each colliding into the other to fuel a very abstract form of thinking: In other words: the chaos of criss-crossing communications can be be great for creative problem solving/innovating.

Curse, because, again, you have a million thoughts each moment; but, you're only human—you can only process so many at a time. This causes you to forget a lot of important stuff; stuff you really wanted to remember, but can't, as a result of distractions or new thoughts trampling over it.

To be an effective visual thinker, you must always have on hand something to take notes with. Also, you've gotta have your ears listening out for your intuition's voice. I find that when I'm paying close attention to it, it makes sense of what my mind is trying to paint for me. It tells me the words I can use to describe it. Then that notepad, or voice recorder comes out and I make a record of it before I imagine something else that'll suplex it into the ether.

Oh, and a fun fact: If you wanna know if the person you're talking to is a visual thinker, see if they're staring out into the distance or closing their eyes while they're talking. That's a sign that they're trying to communicate something important to them to you, and they don't want the friendly gesture of looking you in your eyes to distract their train of thought.

answer by avturchin · 2019-11-02T12:05:49.849Z · LW(p) · GW(p)

I am bad visual thinker, but I was able to reach much higher performance on dual n back after I found the trick to write down all numbers on an imaginary board.

answer by limerott · 2019-11-01T23:08:21.959Z · LW(p) · GW(p)

Say you have two distinct points x and y. Consider all points whose distance to x is the same as to y. What can you say about the location of these points in terms of the line connecting x and y?

Try to solve any geometry puzzle with only your mind and you will be forced to do visual thinking.

comment by MoreRight · 2021-07-28T12:30:33.926Z · LW(p) · GW(p)

I've never seen any image of any kind in my mind, nor have I experienced any other imagined sense. Visual thinking is merely activity within a region of the brain associated with a visual experience. If you were to shoot a charged particle through your occipital lobe, you may experience it as a flash of light. Those with aphantasia process thought in a different region of the brain that is not associated with the experience of visualization. 

Where that thought takes place will determine the structure and connections within the neural network that processes that information. Most complex neural networks can solve any basic problem, but some structures are more efficient, more accurate, or faster than others. When thought occurs in an atypical structure it can give rise to deficits or strengths. Synesthesia is a common example, but there are also examples of people with "human calculator" like abilities and more. 

When you say visual thinking, visualization is merely an experience and is not necessary to solve multidimensional problems. It is however a very fast and efficient method to do so. Studies which have compared the problem solving abilities of those with aphanatasia and visual thinkers found that those who relied on visualization were faster, but less accurate problem solvers. I'm not a fast problem solver, but I virtually always get the right answer because I solve problems with logic rather than visual intuition. 

This is not visual thinking when you can not use your visual brain. From my perspective, it's just "thinking". 

comment by Teach · 2019-11-03T22:29:07.172Z · LW(p) · GW(p)

So I find I can force myself to visualise that but it would be consistently born of the concept thought first, like "oh that's a line perpendicular to the line between X and y" and then I can paint the graph in my mind. But I don't need to - I can think the concept and then apply it to paper without visualisation and I tend to find that easier.

What intrigues me precisely is visual thinking for problem solving - ie a student who can easily perform arithmetic between graphs by visualising the transformations in their mind rather than doing calculations on paper.

Replies from: limerott
comment by limerott · 2019-11-04T07:51:23.916Z · LW(p) · GW(p)

First of all, if you can solve it without visualization, I think that this is preferable, precisely because it is faster. There is no need to force oneself to visualize everything.

To visualize something, you need to create a map from the formal domain you are studying to visual transformations. In other words, you need to understand "what the formula" mean (or at least one way of looking at them). Do you know what it means visually to multiply one complex number to another? If you don't, you will be stuck doing calculations. If you do, then you can visualize it and quickly come up with the solution.

From my experience, some people naturally tend towards visual thinking, while others don't. But if you consistently try to apply it, it will become natural at some point (it may take some time, don't give up prematurely).

One area where a lot of visual thinking is necessary, but that is relatively easy to visualize, is graph theory. Try to prove that a (connected undirected) graph has an Eulerian cycle (i.e. a cycle that contains every edge exactly once) if and only if all of its vertices have even degree.

answer by Michael Pemberton · 2019-11-14T22:44:26.523Z · LW(p) · GW(p)

Setting aside the psychological and cognitive dynamics for a moment, I'd like to propose that you may be more of a visual thinker than you consider yourself to be. I would also propose that your challenge may not lie in visual thinking but in visual synthesis and visual translation. I'll explain.

1. Consider the first phrase I used, "Setting aside." These words connote a visual of some sort. In fact, language is difficult to use without word pictures that create some sort of visual in our minds. for example, "See what I mean?", "Upstream suppliers", "slower than molasses in January", "like a lead balloon", and "Pie hole." The fact that we can use these word pictures as a verbal shorthand attests to our visual thinking ability. Granted, with a nod to the symbolic interactionists, many of these may be more or less well defined in my mind than yours. They are nevertheless indispensable in our verbal communication.

2. Visual synthesis is a different matter. I believe I understand your challenge here, being somewhat challenged in that way myself. Although we know that we are not really right brain/left brain divided, I'll use those concepts to help explain. The left side of my brain is somewhat dominant. I would prefer to read a math book to a novel. Yet I have become a successful graphic recorder. And it's not due to my art skills. I have learned to hijack the analytical functions for storage and association while I role play a symbolic interaction with my critic committee and come up with a graphic that works. This is very labor intense, high calorie exercise. It costs.

3. Visual translation is another thing. While synthesis takes a significant volume of information and synthesizes it to a graphic, translation does exactly the opposite. Your brain settles on the message you want to communicate, then you must formulate a graphic to represent your thoughts. This is very risky. We often fall short. Further, no single graphic could communicate all that we want. It becomes inaccurate somewhere near the edge of context. Our internal critic committee convinces us that the graphic will fail, but live on in misunderstanding. However, if we use words, we have the opportunity to edit. Edits are cheap! So, with visual translation there is a risk we are loathe to accept. We figure that it may be better to just use good old squishy yet limited range words.

1 comment

Comments sorted by top scores.

comment by Stephen Jones (stephen-jones) · 2019-11-10T20:48:07.464Z · LW(p) · GW(p)

I'm curious about your saying you can't "simulate" visual thinking since visual thinking is remembering a diagram or spatial representation of something and reasoning about things on this mental map.

So, can you imagine a picture of a sailboat? Now, someone uses a visual analogy and suggests that the economy, your life goals, your relationship is like a sailboat. As soon as they start talking about, say, the business climate being the water, wouldn't you start to think ahead (from your mental picture) about what the "wind" would be, how you would tack your "sail" (and what that sail might be) in order to move the "boat" toward your goal?

Your mental model guides your reasoning by letting you use intuition and judgement about the imagined scene. The visual layout helps partition the problem into the interrelated parts, their relationships and mechanisms of interaction.

My example may not be the best one since the difference between a plain-old analogy and a visual analogy is probably that in a really rich example of visual thinking, the spatial relationships, shapes and connections between them are much more essential and informative than my sailboat example. They help you reason about causes and effects and theorize about consequences of imagined changes in a concrete and useful way.