People are allowed to have their private space. However, if this makes your partner uncomfortable - figure out why.

Maybe if you move to an attic, storage space, or other rarely accessed area that will reassure them.

Or, if necessary, offer to show them your memorabilia ONCE, but then the subject needs to be dropped. In which case - get over the embarrassment. we all have stuff that's embarrassing.