The material of rusty red sweater looks cheaper, which also effect the richness of the color. The grey may be a little too darker, not very flattery. Lighter, little warm tone gery would make the sweater look more elegant, better quality, and could also soften your look.
Both styles suit a tall person.
I am just trying to help, since myself also prectice minimalism. So quality is always my #1 concern when shopping for cloth. If you don't like what i say, ignor my comments but don't ignor me, hehe... :))