One thing most people never even think about could mean you get smaller Social Security payments than you deserve.