@mistakenotmy@mastodon.social I got curious and tried adding a system prompt to Claude basically saying "always use tools, don't trust yourself, always verify if possible", and then it got it right. They tell the models to act like this because it drives more engagement when they are confident and answer quickly on things that are deemed "trivial". That makes it somehow worse.