Since two decades, neuroenhancement is a major topic in neuroethics and still receives much attention in the scholarly literature as well as in public media. In contrast to high hopes at the beginning of the "Decade of the Brain" in the United States and Europe that we subsume under the "pharmacological optimism hypothesis," recent evidence from clinical neuroscience suggests that developing drugs that make healthy people smarter is even more difficult than finding new treatments for patients with mental disorders. However, cognitive enhancing drugs even for patients with impaired intellectual performance have not been successfully developed yet and new drugs that might have a disruptive impact on this field are unlikely to be developed in the near future. Additionally, we discuss theoretical, empirical, and historical evidence to assess whether cognitive enhancement of the healthy is common or even epidemic and if its application will further increase in the near future, as suggested by the "neuroenhancement prevalence hypothesis." Reports, surveys, and reviews from the 1930s until today indicate that psychopharmacological neuroenhancement is a fact but less common than often stated, particularly in the public media. Non-medical use of psychostimulants for the purpose of cognitive enhancement exists since at least 80 years and it might actually have been more common in the past than today. Therefore, we conclude that the pharmacological optimism hypothesis and neuroenhancement prevalence hypotheses have to be rejected and argue that the neuroenhancement debate should take the available evidence more into account.