What rationality material should I teach in my game theory course

I am an economics major at Yale and would be very skeptical of a game theory course that deviated too far from the theory of winning at multi-party interactions (game theory) and dealt extensively with the theory of winning in general (rationality). Such a class would almost certainly seem too preachy or too close to the genre of self-help. You, as a professor of the field, would obviously know better than me what areas of rationality or general strategy are traditionally included in the field of game theory -- but I would be very surprised if most of the above links, the bulk of which deal with the optimization of one's time, one's goals, or one's beliefs, would fit well into most Game Theory courses.

This is not to say that I necessarily oppose the practice of using a course title to mislead students about its contents -- rather, I am afraid that exhortations of rationality will fall flat on students who came to learn about Nash Equilibria and think you're trying to tell them how to best live their lives using methods and models beyond the scope of the course.

Newcombe-style problems, including the Prisoner's Dilemma, and the difference between rationality-as-winning and rationality-as-rituals-of-cognition.

Make sure to emphasize that payoffs are in terms of utility, and that when money is used as a payoff, it's meant to be a substitute for utility. This will hopefully prevent people from saying things like "According to game theory, all people care about is money! So game theory is wrong". If your students don't know what utility is, that should be the first thing you teach them, and it may help to give a few reminders over the course of the class.

Precommitment is an interesting aspect of game theory that ties in well with lukeprog's how to beat procrastination.

Of these, The Planning Fallacy might be vaguely appropriate and to a lesser extent The Map is not the Territory, but with that course description I don't see how the others come even close.

It might be a good idea to cover mechanism design. Perhaps not with all its mathematical rigor, but still, the very idea of influencing outcomes by manipulating the environment agents find themselves in is an important tool in a rationalist's toolbox.

How to be Happy and How to Beat Procrastination seem a bit odd for a game theory course. If you're going to include anything like that then I would frame it as "If you use advice Y then it will result in X" rather than "You should do Y because it will lead to X".

I want to include material on how to be rational

Normally, game theory aims to be a purely descriptive discipline. Are you planning on taking a normative/prescriptive approach towards it?