Depending on your income, up to 85% of your Social Security benefits may be taxable. There’s a worksheet in IRS Publication 915 that can help determine whether your Social Security is subject to tax or not. However, the easiest way to figure it out is with a Social Security tax calculator, which can help you determine how much will be taxable at your marginal tax rate.