The extent that neural responsiveness to visual food stimuli is influenced by time of day is not well examined. Using a crossover design, 15 healthy women were scanned using fMRI while presented with low- and high-energy pictures of food, once in the morning (6:30–8:30 am) and once in the evening (5:00–7:00 pm). Diets were identical on both days of the fMRI scans and were verified using weighed food records. Visual analog scales were used to record subjective perception of hunger and preoccupation with food prior to each fMRI scan. Six areas of the brain showed lower activation in the evening to both high- and low-energy foods, including structures in reward pathways (P < 0.05). Nine brain regions showed significantly higher activation for high-energy foods compared to low-energy foods (P < 0.05). High-energy food stimuli tended to produce greater fMRI responses than low-energy food stimuli in specific areas of the brain, regardless of time of day. However, evening scans showed a lower response to both low- and high-energy food pictures in some areas of the brain. Subjectively, participants reported no difference in hunger by time of day (F = 1.84, P = 0.19), but reported they could eat more (F = 4.83, P = 0.04) and were more preoccupied with thoughts of food (F = 5.51, P = 0.03) in the evening compared to the morning. These data underscore the role that time of day may have on neural responses to food stimuli. These results may also have clinical implications for fMRI measurement in order to prevent a time of day bias.