Yep, all I buy when I go grocery shopping is fruits, vegetables, a few grains and some type of meat. I don't buy deserts or snacks or anything fatty or sugary. Not really because I try to be that healthy, I just genuinely think healthy foods taste better and I like cooking.
I live off of brown rice, chicken breast, bread, peanut butter, and milk. My caloric needs are too high and my budget too low for much of anything else. Take a multivitamin as well.