Years ago, I had the same problem like you.

I think that is a leadership problem. You need to prove to your boss(directory, program manager...etc) that you can lead a project.

After you get your own project, show your team members that you are the boss. I think confident and knowledgeable are the keys for success.