Drawing from conversations with the experts behind Google's projects like the new FieldTrip app and Google Glass as well as some new startups working on augmented reality applications, this article discusses the importance of figuring out what digital content is important enough to be overlaid in our daily physical spaces that will be helpful versus distracting or annoying, and in what manner or medium the information should be displayed.