is in your retirement account, you have no choice but to do this. If possible use HELOC instead. In order to be truly self direct, you may need to form a LLC, use ira to invest in llc and become the sole member of llc with check privilege, then you can do anything you want with your ira.