And next you know, someone cites them and concludes that coffee cures cancer.... Or causes it when drunk at exactly or above 41.33456 degrees Celsius or when.you drink more than 4 but less than 3 daily. Or was that chocolate? No! Red wine! It was red wine!
I work on a pretty neglected Neuroimmune illness ME/CFS (hence my username) with really low recovery rates whether treated or untreated (~5%).
And the number of “clinical trials” of things like “Graded Exercise Therapy” or “CBT” or “Acupuncture” or [insert random supplement] that claims to “cure” the condition is so large. Except these trials all rely on subjective outcome measures and none are placebo controlled, oh and ofcourse the results never last in long term followup.
TIL I was ambitious. And here I thought my attitude of, "I can skip these 2 papers and still have a solid C," made me kind of a bum. NOPE! I skimmed so many papers.
Doesn’t work if, like in my line of work, you have to cite specific locations in each paper for data verification. Sci-hub is your friend, when it works
As a scientific researcher I am amazed at everyone being all like "yeah me too."
#WHAT
How you about to be citing something without being 100% sure it actually supports your claim? That shit could easily have a bunch of qualifications you don't know about!
#ALSO
Bruh. If it's worth citing, it's worth reading the whole paper. You might learn something or gain inspiration for future work. Plus, you know, always be learnin, yo.
I was aiding in a peer review and was diligently checking citations and sources to find that the majority of sources used had relevant titles but did not support the claims the author was making... I pointed these out and was removed from reviewing with the professor saying I needed to offer positive comments only ¯\_(ツ)_/¯
I am sorry, but what is wrong with your professor? You were doing exactly what you are supposed to do in a peer review. You should go look for things that are wrong or should be improved and only if the paper can withstand that process, it should be published. Only providing positive comments is really harmful to the scientific process and, in the end, to society.
To be honest, I think I reject more than half of the papers that I review. The rest require major or minor revision. It is not that I have a target or anything for how many I need to reject, it is just that most papers are of such low quality that I cannot do anything else. I think the number of papers I reject is quite normal in my field.
So, not all your comments need to be positive. If there is reason to be positive, you should mention it. And your comments should be constructive and respectful, but definitely not always positive.
In the case you are describing where the authors seem to only have read the titles of the papers, I would definitely reject. This is fraud. You are saying you did a literature study and you did not. So, I would be quite clear about that. I would also be a bit angry that they wasted my time. So, in my opinion, that is how a reviewer should respond in this situation, not with only positive comments.
TBH I don't really care to read the bibliography sections where you recommend 4 or more books or studies from over 2 decades ago because their works laid the groundwork for a hypothesis that you very succinctly proved that there is not enough evidence to declare confidence in even with all your additional primary source data.
But yeah, not the abstract. I agree on that. They've at least gotta open the study.
Sometimes. Sometimes it's an intro sentence that already has 2 citations and just needs a 3rd, and you just find a paper with more measurements and the same conclusions.
Oh, I did not know that. I have been doing it wrong all these years then. Could have been drinking cocktails on the beach instead of reading all these papers.
There was a specific number that was repeated across a lot of papers in my field, always citing the same source.
That source did have the number, but it cited another paper for it, which itself cited yet an older paper. Im not sure where the citations went bad, but that last paper for not actually contain the value everyone waschain-attributing to it.
The number was fortunately still correct though (and people would have noticed pretty quickly if it wasn't).
Is that a situation where you can write up your analysis, report the number as correct... and start getting cited in place of the paper with broken attributions?
My favorite part about Dunning-Kruger is that I see extremely wrong explanations of it all the time. While being wrong isn't exactly what Dunning-Kruger is about, it's usually what those wrong explanations think it's about.
Honestly if the abstract can't deliver a succinct and accurate summary of the findings and their limitations, then it's probably a bad paper that you wouldn't want to cite.
If you have to end every sentence with outliers aside... Then maybe people should understand that they are talking about the norm. Not your fringe anecdotal cases lol.
This is the only way, not enough hours in the day to dedicate to reading everything that is demanded. I gotta have time for lunch and perform my actual job.
This but the first half of the introduction and then the conclusion. I often end up throwing people's citations back in their own face because they clearly only read the title.