Once physical access is achieved you have already lost. They can just brute force your brain. A safe is perfectly fine for the usual remote attacker.

There is always the possibility of the end of humanity.