I’ll say a prayer for your decision. I’m not sure what I would do. Many in my church are similar, but one of the elders is a family physician with a very level head.
One point may be that it’s possible by your staying there, interacting in a loving way, you will counteract their fear. It’s out of fear that they act that way, anyway. It’s definitely harder to stay, and I wouldn’t if you think you or your family are in danger of getting dangerous ideas, or being exposed to Covid unnecessarily by dangerous actions, however,