I can see what you mean that if you cause too much concern then mission could be aborted.
As far as caring less goes, stick to what's within your remit. I would voice any concerns, and suggest solutions if possible.
I tend to ask if something is considered to be a significant problem, and so let my manager assess the risk.
If your advice isn't followed up or taken seriously enough, then at least it's not your fault.