That's what I do because I'm a bit lactose intolerant. I actually prefer the taste of rice milk. Both are high GI sugar hits unfortunately, but I can't stand the taste of milk in coffee.