Am I a coward, I did nothing and it doesn't sit with me comfortably?

You need to speak to a counselor. Your are beating yourself up over "could have beens". You can't go back and change the past but you can control your future.