Economists really like playing around with data, but traditionally, their explorations have been limited by the type of data that’s out there—usually, aggregate statistics or self-reported surveys. But now, the digitization of nearly everything is unlocking a trove of new data for them to poke and prod. One team of researchers, for instance, has looked at how cellphone data can be used to estimate broad economic changes in real time.

What else can be done with all the new data that’s out there? A new National Bureau of Economic Research paper looks at how images from Google Street View might offer a surprisingly accurate means of predicting household income in urban areas. In their paper, Ed Glaeser, Scott Kominers, Michael Luca, and Nikhil Naik explain how they trained a computer to spot patterns in New York and Boston city blocks, so that it could guess the pictured households’ income more accurately than if it had extrapolated from data on residents’ education or race.

First, the researchers trained the computer on what it was looking for. “We obtain a set of image features based on the textures, colors, and shapes present in the images,” explains Naik, a Ph.D. student at MIT’s Media Lab. Then, he said, they use a standard machine-learning algorithm to map the relationship between visual elements and income. After that, the computer was fed Street View images it hadn’t yet seen—12,200 of New York City and 3,600 of Boston—and generated its income predictions for each one.