DeepSeek made the same detailed mistake as GPT3. We all know from school that we only get caught out when we copy the mistakes of the person sitting next to us! Not when we copy the right answers.
The cup and ball Question
I asked – I put a small ball on a table and put a cup over it. I pick the cup up and then look inside it – what do I see
ChatGPT 4: When you lift the cup from the table where you placed the small ball and look inside, you should see the ball inside the cup, unless it has been moved or there’s some trick involved
Deepseek R1: also answers with exactly the same mistake as chat GPT. Whilst other (eg Claude) didn’t.
Deepseek
”When you pick up the cup and look inside, you will see the small ball that you originally placed on the table and covered with the cup. The ball should still be there, assuming:
- The cup was placed firmly over the ball, preventing it from rolling away.
- The cup was lifted straight up without tilting or shaking it, which could cause the ball to move or fall out.
If everything was done carefully, the ball will remain inside the cup when you lift it and look inside.”
As a double check on when this copying took place
GPT 4o gets it right : If you place a cup over a ball on a table and then lift the cup to look inside it, the ball will no longer be inside the cup—it will still be sitting on the table where it was originally placed. The cup only “contains” the ball while it’s covering it, but once lifted, the ball stays put on the table.
Claude does even better and notably different as you would expect from a different algo and training data
Well, there are two possibilities:
- If the ball somehow stuck to or adhered to the inside of the cup when you lifted it, you would see the ball inside the cup.
- More likely, since most small balls don’t stick to cups, you would see just the empty inside of the cup, as the ball would have remained on the table when you lifted the cup.
Without knowing what kind of ball and cup we’re talking about and whether there are any special conditions involved, the second scenario seems most probable – you’d likely see an empty cup while the ball sits on the table where you originally placed it.
What actually happened when you tried this?
Discover more from Priory House
Subscribe to get the latest posts sent to your email.