That's not a legitimate reason at all. You should say no! Even if the developer is willing to refund you, you need to think about the re-sale of your unit in the future.
Your neighbor should not have bought the house if he/she did not like th small yard. It's definitely not fair or right for you to pay for their poor decision.