Why do people like fantasy novels? One obvious explanation is that “magic” relaxes the usual constraints on the stories one can tell. Story-tellers can either use this freedom to explore a wider range of possible worlds, and so feed reader hungers for variety and strangeness, or they can focus repeatedly on particular story settings that seem ideal places for telling engaging stories, settings that are just not feasible without magic.
It is widely acknowledged that science fiction is by far the closest literary genre to fantasy. One plausible explanation for this is that future technology serves the same function in science fiction that magic serves in fantasy: it can be an “anything goes” sauce to escape the usual story constraints. So future tech can either let story tellers explore a wider space of strangeness, or return repeatedly to settings that feel particularly attractive, and are infeasible without future tech.
Of course it might be that some readers actually care about the real future, and want to hear stories set in that real future. But the overwhelming levels of implausible unrealism I find in almost all science fiction (and fantasy) suggest that this is a negligible fraction of readers, a faction writers rarely specialize in targeting. Oh writers will try to add a gloss of realism to the extent that it doesn’t cost them much in terms of other key story criteria. But when there are conflicts, other criteria win.
My forthcoming book The Age of Em, tries to describe a realistic future setting in great detail. I expect some of those who use science fiction in order to consume strange variety will enjoy the strangeness of my scenario, at least if they can get over the fact that it doesn’t come packaged with plot and characters. But they are unlikely to want to return to that setting repeatedly, as it just can’t compete with places designed to be especially compelling for stories. My setting is designed to be realistic, and I’ll just have to see how many readers I can attract to that unusual feature.