Discussion about this post

User's avatar
Todd R Johnson's avatar

I have been higher ed since 1980 and a faculty member since 1991. I have never been told in all that time that what matters most is not scientific excellence, but the color of one's skin and the countours of one's ancestry. Sure, there have been national organizations that have set quotas for steering committees and I've seen a small number of papers where the authors battled a bit internally about whether it was ok to say something regarding race, even though it was supported by data, or whether they had to interpret a negative association between race and outcomes as an indication of a bias. Those were all worked out for the best by the time of publication. I also had one grant get a really bad review because one reviewer thought we were not taking equity seriously, even though we did everything we could in the area we were researching. That was probably the worst of my experience. Now that we are seeing anti-DEI laws I am seeing far more distortion of science and restrictions on what gets done.

In my experience, what is most distorting and weakening science are the incentives around papers and grants. Academia has now put papers and grants above excellence in science, at least in fields I work in in healthcare. When the incentive is to get as many grants as possible and publish as many papers as possible, science gets distorted. Why refine a paper when you can publish it and then publish a follow-up later? Why take the time to do a careful causal analysis when you can just do an "associational" study--it is easier, faster, and still accepted at even top journals. I also see a lot of faculty doing stuff and then asking "How can we turn this into.a paper?" which is ok sometimes, but not the frequency with which it is done. I personally have 3-4 student-led papers that have been in the works for over a year that could have been published already, except that unlike most of the faculty I know, I look over all of the code and analysis myself... and I find major problems, problems would never be noticed by reviewers, because they would not get the data or the code. Without both and the complete clinical database that the queries used to extract the data, they have no way of finding the issues. They will look at Table 1 and Table 2, succumb to the Table 2 fallacy, make a few suggestions for revisions and move on.

Expand full comment
Freedom Preetham's avatar

This is a compelling manifesto for a post-journal scientific world. The argument is clear and I agree with all of it. Thinking aloud, it might be worth addressing 'transitional safeguards': how early-career researchers are evaluated without journal proxies, how fields with regulatory constraints (clinical, dual-use, or human-subjects research) adapt, and how permanence, prestige, credit, and discoverability are guaranteed. Including a minimal economic model and practical milestones for the transition would make this feel less like a manifesto and more like an operational guide. I am aware that a single post cannot address all concerns and I am sure there will be more posts providing clear thoughts on how to operationalize beyond the compelling and provocative stand of the first manifesto.

Expand full comment
9 more comments...

No posts