Published: March 21, 2023
12
78
476

In Jan of this year, @bryan_caplan bet @MatthewJBar that no AI would reliably score an A on his economics midterm exams before 2029. Three *months* later, GPT-4 scores an A.

Image in tweet by Fin Moorhouse
Image in tweet by Fin Moorhouse

@finmoorhouse @Plinz @bryan_caplan @MatthewJBar The whole concept of testing is just such a dinosaur approach to education. The students need to share their goals, and then qualitatively clarify their priorities for what they need to work towards those goals, and the system should help match those needs with the world.

@finmoorhouse @bryan_caplan @MatthewJBar IIRC @bryan_caplan has a good record on these bets. Congrats to the bot and its booster @MatthewJBar

@finmoorhouse @bryan_caplan @MatthewJBar GPT-4 training was finished last summer. Just wasn’t available to us lowly peasants. Make me think what is running inside of Google/NSA for the last few years.

@finmoorhouse @bryan_caplan @MatthewJBar Why the “no small dismay?” I get that he’s out $500, but this seems like one of those win-either-way scenarios.

@finmoorhouse @RichardMCNgo @bryan_caplan @MatthewJBar I feel like this reflects the tendency of academics to vastly overestimate how much their assessments create meaningful differentiation between students, more than it does anything else. Like, it feels like the prof. in question bet the higher ed "party line."

@finmoorhouse @bryan_caplan @MatthewJBar Bet was 5 out of 6 exams. Are those exams in different fields? Or just several similar exams?

@finmoorhouse @bryan_caplan @MatthewJBar Have they resolved the bet?

@finmoorhouse @bryan_caplan @MatthewJBar cutting and pasting from the web is fine, and obviously easy. Refining selections is also easy, which is AI's 'trick' - Humans need tactile experiences for happiness, not ever faster solutions. So we solve things faster. So what?

@finmoorhouse @Dominic2306 @bryan_caplan @MatthewJBar Wtf are you doing sending that stuff to Ukraine...are you trying to kill half our country ...you absolutely disgusting person

@finmoorhouse @Dominic2306 @bryan_caplan @MatthewJBar Since economics is a pseudoscience anyway, who could be surprised? Show us a single economist who has ever got anything correct. Their sole purpose is to produce mumbo-jumbo to 'justify' politicians fucking us around.

@finmoorhouse @Dominic2306 @bryan_caplan @MatthewJBar Could be students are also getting worse? Lazy? 73 seems low. Is curving really a good approach? Just asking.

Share this thread

Read on Twitter

View original thread

Navigate thread

1/13