The difference is the same as in English: une glace de marrons -- an ice cream made from chestnuts (the main ingredient is chestnuts)
une glace aux marrons -- an ice cream made with chestnuts (chestnuts are not the main ingredient)
This nuance wasn't clear from the lesson above. How does one distinguish 'from' versus 'with' in such cases?