无影响

IRS and INS are two different departments,
IRS does not share information with INS.

Lots of illegal workers pay tax to IRS Now, just hope some days later they will be amnestied.(amnesty may need your good TAX record)

So I think your IRS information does not affect your 申请绿卡.