Unicorns and physical realism

It baffles me that it is okay for you to have existent unicorn but not for me to have an existent physical realism. A kind of double standard where your mind can come up with unicorn but I cannot come up with physical realism.