Maybe it would help if you knew there were more? Or maybe that would make it feel worse, but there are more. It’s a pretty common pattern in language for some reason, called “contronyms.” So literally can mean actually or figuratively, but others include clip (cut off or attach), oversight (to overlook, or to scrutinize closely), sanction (approve something or penalize it), or even fast (moving quickly or still, as in held fast). Context is key, people will adapt as meanings are ever shifting.