For me, the best test is an oral test. I just schedule 20 minutes of face-to-face time with each student, give them an idea of what sort of questions I will ask, warn them that there will be follow-ups and requests for elucidation, and that their grade will be based on the extent that they know what they're talking about. Since it takes me about that much time to grade a written exam, this system doesn't add to my work and solves my urge to put off grading. I also feel like I'm finally testing what matters, seeing students focus more on this, and I'm giving grades that better reflect their true level of mastery.
I think that what you end up with looks a lot like Fist of the North Star rather than Marvel Comics.
TV Tropes describes the world thusly:
Imagine just how messed up life would be for an ordinary person in a world where all the real power is wielded by a relatively small number of people, and that power is not financial or political, but militaristic. Democratic government is essentially meaningless since no union of ordinary people can stand against the might of a lone Badass. Because everyone knows that violence is the force that drives the wheel of civilization, fights occur constantly, and everyone with a bit of ability wants to claw their way as high up the badass scale as possible, whether for the sake of protecting innocents or enforcing their own will on others. The only genuinely powerful people who have any interest in being in charge are usually megalomaniacs, and sociopaths besides. Governments tend to be either tyrannies, or farcical constructs whose laws can only be adequately be enforced by sympathetic vigilantes and a few Knight Templar civil servants who butt heads with them at every opportunity. Countries are constantly in flux between the two as Evil Overlords are dethroned by good guys, replaced with ineffectual governments, and conquered again by new bad guys. The series... Fist of the North Star. One of the first shonen fighting animes!
Hey, Robin. Has anyone ever done something like: "The existence of super-powered mutants?" I would totally do that if I had such an awesome assignment as the one you're describing. I've actually put a lot of thought into this. If I had more free time, I'd flesh out this imaginary world of mine on paper.
A precise specification might be something like: "The existence of exceptional humans whose powers make the state's monopoly on violence obsolete." I know this is total nerd stuff, but I'm hoping it's welcome on an econ blog.
Many law school exams do this. Exams provide "fact patterns" to which students have to apply the relevant legal rules. Professors often provide outlandish fact patterns that require require a more analytical application of the rules and do not allow for intuiting "reasonable" outcomes that are available in more common place legal settings/disputes. I think it works well to have at least some portion of the testing use this method.
You sure can't teach someone to overcome intuition with training without training them first. Or were you trying to make the point that it can't be done so we shouldn't try?
You might consider the format many law school exams take. A lot of law is taught by the case method - you learn how given legal principles were derived from specific facts, and then how the abstract principles were applied (or adjusted) to different facts.
While that teaching format wouldn't be useful for a lot of economics (it isn't always great for teaching law, either), the typical exam format that arises from it might be: you present a factual situation and require the student to explain the appropriate abstract principle to apply, how to apply it and what the result would then be for the given fact pattern. It doesn't necessarily inspire imagination, but they can't just go with their gut.
This assumes that it's actually possible to teach someone to disregard their intuition. I don't think that's something that you can teach students by lecturing them.
A related problem is that small changes seem to have limited consequences.
You might ask your students to consider a small change with big results: a "butterfly effect". This has the advantage of starting with something that is somewhat realistic while still providing a platform for extrapolation and creative thinking.
The idea is to consider things that are possible, not necessarily things that are likely. History is full of unlikely things. Who would have thought that introducing bananas to Europe would lead to the overthrow of governments and the establishment of banana republics?
If the concepts that you teach don't change the intuitions of students about answering meaningful questions, what good do your concepts do in the first place?What's the point in "teaching" them?
"So to teach (and test) students to really apply economic concepts, it helps to consider concrete changes well outside of their usual range of experience."
The problem I have with this is that "proper" economic theory itself is based on intuition.
For example, economists in the 19th century believed that if the poor got more purchasing power they would just have more children. The 20th century proved poor people weren't having children because they could afford it but because of religious pressure and lack of contraception, something that economists in the 19th century could have known if they had held anonymous polls before they declared their hypothesis the law of the land.
Today it is still true that there are a lot of subjects where 10 different economists will give you 10 different answers.
I think more experimenting and psychological research has to be done in economics and Robin is one of the people who can help us with that. Economics really can't afford to work with models that assume perfectly rational, perfectly informed people anymore.
If people were perfectly rational and perfectly informed then there would be no religious conflicts, advertising wouldn't work and people would collectively refuse taking advantage of mortgage deduction.
It's time to map the biases of the human mind and it's time economists learned to say "I believe" or "probably" before giving a prediction of the future they can by no means be certain of.
"Big Change Paper – Imagine a single big change to our economy, and then use microeconomics to describe the consequences of that change, including whether those changes are good or bad. You might, for example, imagine how things would be changed if people became immortal, if Star Trek style “transporters” were available, if very reliable lie detectors were available, or if no one needed sleep."
There is no right answer to any of these questions (I know they don't have to give a solid answer, just demonstrate a thought process): they depend on the politics, economics and culture of the future: one popular politician or religious leader can influence the thinking of millions of people at any moment. The best one can do is provide a number of possible philosophies (libertarian, religious, socialist, same as today, etc...) that may dominate the future and describe how the societal changes in the questions would play out under those philosophies (using the set of economic principles which have actually been tested in the real world).
1) The partial similarities of two problems can lead one to infer that the abstract model useful for studying one is also useful for studying the other, when in fact the dissimilarities may call for a different model. Actually, this is also a problem with applying non-abstract analogies.
2) Abstract models are still only models, and as such don't account for Murphy's Law and other sources of unforeseen consequences. They are useful, but they are hardly prognosticative (it's a word now).
3) One the biggest challenges I face with undergraduate physics students is getting them to think about the models they're learning in relation to the real world problems those models were designed to explain in the first place. Part of the problem here is that text books place far too little emphasis, IMHO, on applied knowledge.
Do you find econ texts feature the same shortcoming, or is it mainly a lack of imagination on the part of the students that keeps them from making the "real world" leap?
i like to here this good news.. thanks for sharing this.. keep more sharing such a like information.
Career Counseling Programs
For me, the best test is an oral test. I just schedule 20 minutes of face-to-face time with each student, give them an idea of what sort of questions I will ask, warn them that there will be follow-ups and requests for elucidation, and that their grade will be based on the extent that they know what they're talking about. Since it takes me about that much time to grade a written exam, this system doesn't add to my work and solves my urge to put off grading. I also feel like I'm finally testing what matters, seeing students focus more on this, and I'm giving grades that better reflect their true level of mastery.
I think that what you end up with looks a lot like Fist of the North Star rather than Marvel Comics.
TV Tropes describes the world thusly:
Imagine just how messed up life would be for an ordinary person in a world where all the real power is wielded by a relatively small number of people, and that power is not financial or political, but militaristic. Democratic government is essentially meaningless since no union of ordinary people can stand against the might of a lone Badass. Because everyone knows that violence is the force that drives the wheel of civilization, fights occur constantly, and everyone with a bit of ability wants to claw their way as high up the badass scale as possible, whether for the sake of protecting innocents or enforcing their own will on others. The only genuinely powerful people who have any interest in being in charge are usually megalomaniacs, and sociopaths besides. Governments tend to be either tyrannies, or farcical constructs whose laws can only be adequately be enforced by sympathetic vigilantes and a few Knight Templar civil servants who butt heads with them at every opportunity. Countries are constantly in flux between the two as Evil Overlords are dethroned by good guys, replaced with ineffectual governments, and conquered again by new bad guys. The series... Fist of the North Star. One of the first shonen fighting animes!
Hey, Robin. Has anyone ever done something like: "The existence of super-powered mutants?" I would totally do that if I had such an awesome assignment as the one you're describing. I've actually put a lot of thought into this. If I had more free time, I'd flesh out this imaginary world of mine on paper.
A precise specification might be something like: "The existence of exceptional humans whose powers make the state's monopoly on violence obsolete." I know this is total nerd stuff, but I'm hoping it's welcome on an econ blog.
Many law school exams do this. Exams provide "fact patterns" to which students have to apply the relevant legal rules. Professors often provide outlandish fact patterns that require require a more analytical application of the rules and do not allow for intuiting "reasonable" outcomes that are available in more common place legal settings/disputes. I think it works well to have at least some portion of the testing use this method.
You sure can't teach someone to overcome intuition with training without training them first. Or were you trying to make the point that it can't be done so we shouldn't try?
You might consider the format many law school exams take. A lot of law is taught by the case method - you learn how given legal principles were derived from specific facts, and then how the abstract principles were applied (or adjusted) to different facts.
While that teaching format wouldn't be useful for a lot of economics (it isn't always great for teaching law, either), the typical exam format that arises from it might be: you present a factual situation and require the student to explain the appropriate abstract principle to apply, how to apply it and what the result would then be for the given fact pattern. It doesn't necessarily inspire imagination, but they can't just go with their gut.
This assumes that it's actually possible to teach someone to disregard their intuition. I don't think that's something that you can teach students by lecturing them.
Some things are counter-intuitive. Teach them to rely on training, rather than intuition.
A related problem is that small changes seem to have limited consequences.
You might ask your students to consider a small change with big results: a "butterfly effect". This has the advantage of starting with something that is somewhat realistic while still providing a platform for extrapolation and creative thinking.
The idea is to consider things that are possible, not necessarily things that are likely. History is full of unlikely things. Who would have thought that introducing bananas to Europe would lead to the overthrow of governments and the establishment of banana republics?
If the concepts that you teach don't change the intuitions of students about answering meaningful questions, what good do your concepts do in the first place?What's the point in "teaching" them?
"So to teach (and test) students to really apply economic concepts, it helps to consider concrete changes well outside of their usual range of experience."
The problem I have with this is that "proper" economic theory itself is based on intuition.
For example, economists in the 19th century believed that if the poor got more purchasing power they would just have more children. The 20th century proved poor people weren't having children because they could afford it but because of religious pressure and lack of contraception, something that economists in the 19th century could have known if they had held anonymous polls before they declared their hypothesis the law of the land.
Today it is still true that there are a lot of subjects where 10 different economists will give you 10 different answers.
I think more experimenting and psychological research has to be done in economics and Robin is one of the people who can help us with that. Economics really can't afford to work with models that assume perfectly rational, perfectly informed people anymore.
If people were perfectly rational and perfectly informed then there would be no religious conflicts, advertising wouldn't work and people would collectively refuse taking advantage of mortgage deduction.
It's time to map the biases of the human mind and it's time economists learned to say "I believe" or "probably" before giving a prediction of the future they can by no means be certain of.
"Big Change Paper – Imagine a single big change to our economy, and then use microeconomics to describe the consequences of that change, including whether those changes are good or bad. You might, for example, imagine how things would be changed if people became immortal, if Star Trek style “transporters” were available, if very reliable lie detectors were available, or if no one needed sleep."
There is no right answer to any of these questions (I know they don't have to give a solid answer, just demonstrate a thought process): they depend on the politics, economics and culture of the future: one popular politician or religious leader can influence the thinking of millions of people at any moment. The best one can do is provide a number of possible philosophies (libertarian, religious, socialist, same as today, etc...) that may dominate the future and describe how the societal changes in the questions would play out under those philosophies (using the set of economic principles which have actually been tested in the real world).
That's clever. What are some especially good answers students have written?
Three thoughts and a question:
1) The partial similarities of two problems can lead one to infer that the abstract model useful for studying one is also useful for studying the other, when in fact the dissimilarities may call for a different model. Actually, this is also a problem with applying non-abstract analogies.
2) Abstract models are still only models, and as such don't account for Murphy's Law and other sources of unforeseen consequences. They are useful, but they are hardly prognosticative (it's a word now).
3) One the biggest challenges I face with undergraduate physics students is getting them to think about the models they're learning in relation to the real world problems those models were designed to explain in the first place. Part of the problem here is that text books place far too little emphasis, IMHO, on applied knowledge.
Do you find econ texts feature the same shortcoming, or is it mainly a lack of imagination on the part of the students that keeps them from making the "real world" leap?