just be patient. keep observe your baby and you should be able to tell what causes the fussiness.
i notice my baby couldn't take too much stimulations at a time. for example, if i bring her out to the mall, she would have problems to settle down later on to sleep.
maybe your baby has different situation, just keep observing.