If you do not act you are not absolved of morality because you had a choice. You made a choice and your morals were tested.

You hold the opinion that deliberate inaction is an action in itself, that the worth of lives can be quantified and from that conclude that a failure to reduce a loss in life is tantamount to condemning those lives to death. That conclusion is valid under those premises, but the point of the dilemma is that not everybody agrees with those premises.