Discussion about this post

User's avatar
Ggggggggg's avatar

One nice advantage is that surprise is a proper scoring rule: if you had a prediction competition where you assigned probabilities, and scored the surprise of the event that happened (with the aim to get the lowest score) then you minimise your expected score by guessing your true probabilities. If instead you scored the probability of the event that happened (with the aim to get the highest score) then you're best to go all-in on the most likely outcome.

But I think the main disadvantage vs probabilities is that you can't just add together. If I have three outcomes and a surprise score for each of them, then you can't check in your head if they correspond to probabilities that sum to 1. And if you rolled a 6-sided die the probability of getting a 1 or a 2 is just the sum of the probabilities of getting 1 and 2 since they're mutually exclusive

Simon Betts's avatar

I'm intrigued by this, but I wonder if you're overestimating how much the bad reasoning is due to love of adding. Isn't it really due to desire to get to 100%? The mistake isn't (I think) so much that people reason 'the probability is 20% and I'm thinking what happens when it's done 5 times, oh look it's 100%'; it's that they reason 'the probability is 20% and I will win an important debating point if I get it to 100% so ok I'll ... multiply by 5, job done'.

Having said all that, I also love the idea of 'expected surprise' so I'm willing to roll with this.

No posts

Ready for more?