Be reasonable

If he has something that he doesn't want to tell you, or he somehow does not think he can give you the life he thinks you deserve, he may say that. A man usually doesn't want his first love to know if he is not living well. At least, he is not hurting you. So keep what you have and improve your current relationship may be a better option.