plug these 2 factors into consideration.
1. How long will u own the loan? or , I would say, how long the loan owns you?
It is worth paying anything at front (points or closing cost) only if you are sure you will stick to current loan for years.
2. tax impact. unlike points, your closing cost is not tax deductible. buy down your rate while paying your income tax? what's your net saving? you can do the math!
Are you with me?