All the tags on a case are listed in Case Settings, where you can also delete them.

Open the case and click Case Settings in the left sidebar. The Tags card lists every tag. To add one, see How do I create tags in Case Settings or Case Data?.

Click the x on a tag to remove it from the case.