I've tried logging out and back into my Apple ID account on my Mac, but some (not all) messages are showing the red exclamation point and "Not Delivered", but when I go to the same thread on my phone the message shows up as delivered. I've also checked some of them with one of the people I was chatting with and they are being delivered.
This behavior started 2 or 3 weeks ago.