It is a big deal if it is "reversable" perfusion defect. That means that part of your heart muscle is in ischemic (lack of blood supply) under stress. If let go, it will develop into infarct.
He said it is not damege --- in a way it is true, which means that part of the heart muscle is not dead. But this is not the purpose of this test. There is nothing you can do about a dead area of heart muscle (same thing in brain) but you DO care about ANY reversable defect. Do not do any strenuous activity until you see a cardiologist!!!
By the way, since everyone is talking about thallium poisoning now, they probably administered thallium to you for this test -- don't worry, it is a much much smaller dose.
Good luck to you.