Offline Efficiency in an Online World