Yes, IRS can trace back to your tax return history based on your SSN. Normally, your tax was pre-held by your employer and you file tax return using the W2 form sent from your employer. You can file tax return for the years you didn't file. If you are interested in green card in the future, you'd better do it.