A bit more experimentation reveals that it was probably due to Physx. If I have MSAA on, and no Physx, it works fine. If I have Physx on and no MSAA, it works fine. If I switch both on, then it's no problem until I do something (like bump into a moveable object), then it got mental.
Ahh well...