Yes. There is no exemption for paying the Federal Insurance Contribution Act (FICA) payroll taxes that fund the Social Security and Medicare systems. As long as you work in a job that is covered by Social Security, FICA taxes will be withheld from your paycheck.
The same goes if you remain actively self-employed. If your annual net profit from your business is more than $400, you have to pay your share of Social Security and Medicare — as both employer and employee — via the Self-Employed Contributions Act (SECA) taxes you pay with your federal tax return.
Keep in mind
Your work income could lower your benefit if you claimed Social Security before reaching full retirement age (66 and 6 months for people born in 1957 and gradually rising to 67 for those born in 1960 or later). That’s because early filers are subject to Social Security earnings limits, which trigger withholding from benefits if your income exceeds an annual cap (in 2024, it’s $22,320).