I'm a fan of big pants, but for the top portion... button up, sweater, maybe even throw in a light jacket as a midlayer. Or you could always take it in the elegant, old, costumey direction... Or go for margot tenenbaum with one of those lacoste polo dress things... or just go weird with it and wear all your craziest pieces