Almond Milk

I just listened to one of the Stop Overeating Q&A videos and Brooke said cream in coffee is fine but definitely no almond milk. I have unsweetened almond milk that has 60 calories per cup and like 2g sugar (from the almonds). Is that ok? I’m allergic to dairy. I do black coffee but don’t see what the issue with unsweetened almond milk is if cream is allowed.