I think that's definably improper, and I don't like he used

"American culture" as an excuse as well. However, since they didn't have sex, and your brother-in-law was around. So you don't have to be too upset and fight with him for this incident. Since that will not help to improve his behavior. Just tell him firmly that you don't appreciate that, and hope this will not happen again.