it is called mandamus action
Whenever a federal agency fails to do its job and your interest is injured as a result thereof, you may sue that agency in a federal district court. You don't need to go to Washington DC, but just sue it in the district court having the jurisdiction over where you reside.
However, I would not recommend it. The procedure is kind of complicated and it might take a long time.