In 2024, JMAI reviewers continue to make outstanding contributions to the peer review process. They demonstrated professional effort and enthusiasm in their reviews and provided comments that genuinely help the authors to enhance their work.
Hereby, we would like to highlight some of our outstanding reviewers, with a brief interview of their thoughts and insights as a reviewer. Allow us to express our heartfelt gratitude for their tremendous effort and valuable contributions to the scientific process.
February, 2024
Daniel J Campbell, Thomas Jefferson University, USA
March, 2024
Marco Bombieri, University of Verona, Italy
April, 2024
Steven Smoke, Newark Beth Israel Medical Center, USA
May, 2024
Daniel J. Rubin, Temple University, USA
June, 2024
Valentina Roquemen-Echeverri, Oregon Health & Science University, USA
July, 2024
Thomas F. Heston, Washington State University, USA
August, 2024
Jonathan Soldera, University of South Wales, UK
October, 2024
Sunny Chi Lik Au, Medical Council of Hong Kong, China
November, 2024
Marta Pulido, University of Barcelona, Spain
February, 2024
Daniel J Campbell
Daniel J Campbell, MD, is an Otolaryngology – Head & Neck Surgery resident physician at Thomas Jefferson University in Philadelphia, USA. He has a longstanding interest in surgical education. He has published extensively on the quality and utility of online video education materials for patient education within the field of otolaryngology. His recent investigations explore the interface between patient education and artificial intelligence. Specifically, he has published on the utility and safety of large language models (i.e., ChatGPT, Google Bard, etc.) as it relates to patient surgical education within otolaryngology. Learn more about him here.
In Dr. Campbell’s opinion, peer review acts as the moderator between the investigator and the scientific community. While a constructive review provides the investigators the directions and ways to improve their work to the point where it can be useful to the scientific community, a destructive review, on the other hand, completely shuts down scientific investigation without allowing room for improvement.
“I choose to review for JMAI because I foresee artificial intelligence (AI) as being a cornerstone to the future of medicine. These early investigations into the utility and safety of AI will serve as a cornerstone for more complex and larger scale future investigations,” says Dr. Campbell.
(by Lareina Lim, Brad Li)
March, 2024
Marco Bombieri
Dr. Marco Bombieri is a postdoctoral researcher in Artificial Intelligence at the University of Verona, Italy. He completed his PhD in 2023. His doctoral research delved into extracting procedural knowledge from medical-surgical textbooks automatically. The aim was to leverage this extracted knowledge to automate surgical interventions, utilizing advanced methodologies based on large language models. He focuses his research primarily on natural language processing, particularly within the medical domain, as well as ontologies and knowledge management techniques, all with practical applications in robotics. Connect with him on LinkedIn.
In Dr. Bombieri’s opinion, peer review involves experts in the field critically evaluating research manuscripts before they are accepted for publication, and thus, it plays a crucial role in maintaining the integrity and quality of scientific research. This process helps to identify errors, weaknesses, or biases in the study, assess its significance and novelty, and provide authors with constructive feedback to improve their work. Overall, peer review is essential for maintaining scientific inquiry standards and promoting knowledge advancement within a particular domain.
“Peer review is a dynamic process at the heart of academic discourse,” says Dr. Bombieri. He reckons that what is truly fascinating is the opportunity it offers the researchers to engage deeply in the latest studies, making them not just passive consumers of knowledge but active participants in shaping the quality of academic research. Peer review is an opportunity to critically evaluate colleagues' work, identify strengths and weaknesses, and offer constructive feedback to strengthen research and advance knowledge.
From a reviewer’s perspective, Dr. Bombieri points out that adherence to reporting guidelines is paramount for authors preparing manuscripts. These guidelines serve as standardized frameworks that ensure transparency, reproducibility, and clarity in research reporting. By following these guidelines, authors provide sufficient detail about their methods, results, and interpretations, enhancing the credibility of their work and facilitating the critical appraisal and replication of their findings by other researchers.
(by Lareina Lim, Brad Li)
April, 2024
Steven Smoke
Steven Smoke, PharmD, is an informatics pharmacist at Newark Beth Israel Medical Center in Newark, NJ. He received his Doctor of Pharmacy from Rutgers University and completed a PGY-1 pharmacy residency at Penn Medicine Princeton Medical Center. He previously worked as an antimicrobial stewardship pharmacist for 10 years. He has authored several peer-reviewed publications on antimicrobial pharmacotherapy and artificial intelligence in pharmacy. Connect with him on X @steven_smoke.
In Dr. Smoke’s opinion, reviewers should consider the wide-ranging perspectives of potential readers. This includes experts in the field, researchers from other disciplines, and even the general public. The reviewer's goal is to ensure the paper is clear, concise, and accessible to this wide audience. Additionally, reviewers should ensure the research methods are sound and the conclusions are measured.
From a reviewer’s point of view, Dr. Smoke reckons that transparency is a fundamental principle of science, and sharing data ensures that research is open to scrutiny, allowing for independent validation of results. This not only enhances the credibility of the findings but also enables other researchers to build upon existing work, fostering collaboration and accelerating scientific progress. Furthermore, data sharing promotes reproducibility, which is essential for establishing the robustness and reliability of scientific knowledge. By making their data available, authors contribute to a more open and collaborative research environment, ultimately benefiting the entire scientific community and society as a whole.
Lastly, Dr. Smoke would like to say a few words to all the other reviewers, “I want to express my sincere gratitude for your tireless dedication to advancing scientific progress. The work we do is essential for maintaining the rigor and integrity of research. We play a critical role in ensuring that scientific findings are sound, reproducible, and ultimately contribute meaningfully to our understanding of the world. While our contributions may not always be in the spotlight, know that your expertise and careful scrutiny are invaluable to the scientific community.”
(By Lareina Lim, Brad Li)
May, 2024
Daniel J. Rubin
Dr. Rubin is a Professor of Medicine, Deputy Section Chief and Director of Clinical Research in the Section of Endocrinology, Diabetes, and Metabolism and Interim Co-Director of the Center for Biostatistics and Epidemiology at the Lewis Katz School of Medicine at Temple University. He earned a Master of Science in Epidemiology with a concentration in Biostatistics at the Boston University School of Public Health. His research focuses on predicting and preventing readmissions among people with diabetes as well as inpatient and post-discharge diabetes management. He has conducted a broad range of clinical research, including retrospective cohort studies and clinical trials using qualitative methods, biostatistics, and machine learning. Dr. Rubin has been continuously supported by a variety of funders, including the NIH, the American Diabetes Association, and industry. Connect with him on LinkedIn.
According to Dr. Rubin, peer review serves many purposes in the publication process. First, it improves the accuracy, validity, and quality of research. Second, peer reviewers improve manuscripts and potentially the research itself before publication, inviting authors to consider alternative approaches and language. Third, peer review can filter out lower-quality research, helping journals make decisions about which manuscripts to publish. Fourth, peer reviewers can help hold authors accountable to ethical standards.
In Dr. Rubin’s view, reviewers should consider several points while reviewing papers, such as appropriateness of the manuscript for the journal, interest to readers, likelihood of citation by other authors, the strengths and weaknesses of the research, the clarity of writing, and adherence to ethical standards.
(by Lareina Lim, Brad Li)
June, 2024
Valentina Roquemen-Echeverri
Valentina Roquemen-Echeverri is a third-year PhD candidate at the Artificial Intelligence for Medical Systems (AIMS) Lab within the Department of Biomedical Engineering at Oregon Health & Science University. She holds a B.Sc. in Physics and has industry and academic experience in machine learning and data science. Her research focuses on the creation of glucose dynamics simulators for people living with diabetes using physiology-guided artificial intelligence techniques. She also holds experience in computational cardiology with heart murmurs detection and heart sounds segmentation using machine learning. Learn more about her here.
“Peer review acts as a cornerstone of scientific progress by ensuring the quality, significance, and methodological soundness of research,” says Valentina. She thinks that when a researcher is immersed in an investigation, it is common to overlook some mistakes or methodological problems. Some are easily addressed, while others can invalidate the entire investigation. This is where the peer-review process becomes invaluable. A fresh perspective on the research can identify these mistakes, but it can also validate the significance of the investigation. Peer review ultimately helps ensure the quality and impact of scientific findings.
Valentina reckons that it is important to remember that peer review is a collaborative process. Reviewers act as mentors, guiding researchers to strengthen their work and contribute meaningfully to the scientific community. A reviewer should not be looking for destroying an investigation. Instead, a good reviewer focuses on offering constructive suggestions for improvement, while identifying flaws with objectiveness, critical thinking and open-mindedness. This can involve recommending alternative approaches, clarifying confusing sections, or suggesting additional analyses to solidify the research's foundation.
“While groundbreaking discoveries often grab the spotlight, the meticulous evaluations conducted by reviewers are the bedrock on which those discoveries stand. Reviewer's expertise, objectivity, and commitment to constructive criticism ensure the quality, rigor, and significance of the research that shapes our understanding of the world,” says Valentina.
(by Lareina Lim, Brad Li)
July, 2024
Thomas F. Heston
Dr. Thomas F. Heston is on the clinical faculty at the University of Washington School of Medicine and at Washington State University. His research focuses on blockchain technology, statistical fragility, and generative language models. Currently, he is working on developing alternative metrics of statistical fragility to improve the interpretation of biomedical research results. He is a Fellow of the American College of Nuclear Medicine and the American Society of Nuclear Cardiology. Dr. Heston's recent publications include work on prompt engineering in medical education and the use of large language models in evaluating acute chest pain. His ongoing research aims to contribute to the understanding of statistical and clinical significance in biomedical studies, bridging technology and medical practice. Learn more about him here.
In Dr. Heston’s opinion, the existing peer-review system, while valuable, is constrained by the limited availability of diverse perspectives. A significant challenge arises from the specialized nature of expertise among reviewers. For instance, one reviewer might excel in statistical analysis but lack depth in clinical applications, while another may possess extensive clinical knowledge but have less familiarity with research methodologies. This disparity often results in peer reviews that fail to provide a comprehensive, 360-degree assessment of the research. The issue is further compounded by the typically small number of reviewers assigned to each paper. With only a handful of individuals evaluating the work, their personal biases and areas of focus can have a disproportionate impact on the review's outcome. This limitation means that important aspects of the research might be overlooked or overemphasized, depending on the specific expertise and perspectives of the chosen reviewers. He indicates that one potential improvement would be to implement a more robust post-publication review process. This approach would allow for a wider range of experts and practitioners to contribute their insights and critiques after the initial publication, providing a more comprehensive and ongoing evaluation of the research. Such a system could help balance out the limitations of the initial review, allowing for the identification of overlooked strengths or weaknesses, and fostering a more dynamic and inclusive scholarly discourse. This post-publication review process could complement other potential improvements, such as expanding the initial reviewer pool or implementing multi-stage reviews, ultimately leading to a more thorough and fair assessment of research over time.
“When reviewing papers, it is crucial for reviewers to maintain a balanced and constructive mindset,” says Dr. Heston, who thinks that the primary goal of peer review is not just to critique, but to foster and encourage high-quality research within the scientific community. This requires a dual focus from reviewers, that they must rigorously evaluate the research while also providing encouragement and constructive feedback to the authors. On the evaluation side, reviewers need to carefully assess several key aspects of the research. They should ensure that the fundamental research idea is valid and contributes meaningfully to the field. The methodology employed should be appropriate for addressing the research question at hand. Reviewers must also scrutinize the conduct of the study, confirming that it adheres to rigorous standards and best practices. Finally, the analysis of the data should be thorough and accurately interpreted. However, the manner in which this evaluation is communicated is equally important. Reviewers should strive to provide constructive and encouraging feedback. This approach motivates researchers, particularly those who may be early in their careers or venturing into new areas of study. Constructive feedback not only highlights areas for improvement but also acknowledges the strengths of the work and suggests pathways for enhancement. “By striking this balance, reviewers can contribute to the robustness of published research while also nurturing a positive research culture. This approach encourages more individuals to engage in high-quality research, ultimately advancing the field and benefiting the broader scientific community,” adds he.
(by Lareina Lim, Brad Li)
August, 2024
Jonathan Soldera
Dr. Jonathan Soldera is a gastroenterologist sub-specialized in digestive endoscopy and hepatology. He holds an MSc in Hepatology and a PhD in Pathology, and currently works as a tutor at the University of South Wales, where he contributes to their postgraduate programs in gastroenterology and acute medicine. His research focuses on gastrointestinal diseases, liver pathology, inflammatory bowel disease, acute on chronic liver failure, and the role of advanced endoscopic techniques in diagnosis and treatment. Recently, his work has emphasized the integration of technology, such as virtual reality tools and machine learning in endoscopic training and improving clinical outcomes for patients with liver and digestive diseases. Learn more about him here.
In Dr. Soldera’s opinion, peer review is crucial for enhancing the quality and reliability of scientific papers. It ensures that research is thoroughly evaluated, minimizing bias and inaccuracies, and helping to publish findings that contribute meaningfully to scientific knowledge.
According to Dr. Soldera, an objective review critically assesses the subject matter, the quality of writing, and whether the methodology aligns with the research question and conclusions. To ensure objectivity, he focuses on evaluating whether the study’s aims, methods, and conclusions are coherent and logically connected, avoiding personal biases or assumptions.
Speaking of the heavy burden of being a scientist and doctor, Dr. Soldera says, “I typically allocate time for peer review during weekends or quieter periods when I am on call. It’s an activity I enjoy, and I view it as an opportunity to contribute to the academic community while staying updated on the latest developments in my field.”
(by Lareina Lim, Brad Li)
October, 2024
Sunny Chi Lik Au
Dr. Sunny Chi Lik Au is an Ophthalmology Specialist registered under the Medical Council of Hong Kong. He is also the Distinguished Young Fellow awardee nominated by the College of Ophthalmologists of Hong Kong to Hong Kong Academy of Medicine. He is affiliated to Hospital Authority (HA) Hong Kong East Cluster Ophthalmic Service, and is the Young Achiever awardee of HA Head Office. Specialized in vitreo-retinal diseases, Dr. Au has >100 scientific publications over local and international peer-reviewed journals. He has also conducted >250 peer reviews for >100 journals. His recent research project includes hyperbaric oxygen for central retinal artery occlusion, and this project was named as HORA study. Presentation of the HORA study data brought him numerous awards in Annual Scientific Meeting Hong Kong Ophthalmological Symposium, Asia Pacific Tele-Ophthalmology Society Symposium, and Asia-Pacific Vitreo-retina Society Congress. Publication of HORA study report number 5 is currently under progress. Learn more about him here.
JMAI: What do you regard as a constructive/destructive review?
Dr. Au: Peer review is a critical process in maintaining the quality and integrity of academic research. The goal of review is to improve the work, but not to discourage the authors. A constructive review is one that provides clear and specific feedback, is balanced and fair, respectful and professional, thorough and detailed, as well as offers helpful suggestions. Constructive review comments are specific, pointing out both strengths and weaknesses of the manuscript, recognizing the positive aspects of the work while offering criticism, highlighting what has been done well along with areas that need improvement. Each section should be evaluated critically. A tone that is respectful and avoids personal attacks should be used for constructive review. Also, comments should provide actionable suggestions for improvement, whether they are about the methodology, the clarity of writing, or the interpretation of results, and cover all relevant aspects of the manuscript, including the introduction, methods, results, discussion and references. Each section should be evaluated critically.
On the contrary, a destructive review is typically superficial with only cursory comments or lacks specificity, biased or unfair, disrespectful or personal, focusing only on negative aspects without acknowledging any strengths or suggesting improvements, using a rude or condescending tone, or making personal remarks about the author, and adding in lots of self-citations of the peer reviewer.
JMAI: Is there any interesting story during review that you would like to share with us?
Dr. Au: Once I used 14 hours and 3 days of review time to review for a journal abstracted and indexed in PubMed, PubMed Central, Reference Citation Analysis, China Science and Technology Journal Database, and Superstar Journals Database. However, the authors subsequently decided to withdraw their manuscript from consideration for publication after receiving the reviewers' comments. Although the journal was not renounced, the 2024 edition of Journal Citation Reports® cites the 2023 journal impact factor (JIF) for that journal as 1.0; JIF without journal self cites: 0.9; 5-year JIF: 1.1; JIF Rank: 170/329 in medicine, general and internal; which the journal is not predatory. The authors claimed that their decision was based on the fact that the journal is no longer indexed in the SCI database, which was an important requirement for their research. It was a huge waste of the excellent work of the editorial team, peer reviewers, the time and attention that different parties have been dedicated to the manuscript.
JMAI: Is it important for authors to disclose Conflict of Interest (COI)?
Dr. Au: Yes, it is indeed crucial for authors to disclose any COI. Transparency is a cornerstone of ethical research and publishing, and disclosing COIs helps to maintain trust and integrity in the scientific community. Disclosing COIs allows readers, reviewers, and editors to fully understand any potential biases that might affect the interpretation of the research findings and fairly evaluate the research with an understanding of any underlying interests that might influence the study's design, data collection, analysis, or interpretation. This is particularly significant in non-blinded or single-blinded studies. Researchers with COIs might make decisions (consciously or unconsciously) that align with their interests, which can compromise the objectivity of the research.
COI could influence research from study design, data interpretation, peer review and editorial process, or even reference citations. Authors with COIs might design studies in ways that are more likely to produce favorable outcomes for their interests. Studies with positive results that favor the authors, peer reviewers or editor’s interests might be more likely to be published, while negative results could be underreported. Ultimately, disclosing COIs does not necessarily mean that the research is biased or invalid; it simply ensures that any potential influences are transparent and can be accounted for by readers and reviewers. Proper disclosure allows for a more informed and critical assessment of the research.
(by Lareina Lim, Brad Li)
November, 2024
Marta Pulido
Dr. Marta Pulido obtained her MD and PhD in the University of Barcelona, Spain. She was trained as a Medical Editor at the Section of Scientific Publications, Mayo Clinic, Rochester (Minnesota, USA), being certified in Editing and Writing by the American Association of Medical Writers. She is the Professor of Scientific Communication, Master of Biomedicine, University of Barcelona. She is also Member of the Editorial Board of Medicina Clinica and BMJ Open. With 75 papers published in international journals with impact factor and more than 300 courses/conferences on all aspects of the process of writing and publishing medical articles, she works as a freelance Medical Editor in Barcelona. Learn more about her here.
The qualities a reviewer should possess, according to Dr. Pulido, are scientific knowledge and expertise on the subject to be reviewed, objectivity, education, compromise to serve the journal and other researchers, and punctuality.
To minimize any potential biases during review, Dr. Pulido always tries to do it as best as possible and keeping always in mind that she must help the authors improve their manuscripts. “Simply apply ‘Treat others as you would like to be treated’,” adds she.
Dr. Pulido indicates that data sharing contributes to disseminating science. It is indispensable for systematic reviews, and helps other colleagues to design and perform studies. To her, the attitude of data sharing must be an inherent quality of any researcher.
(by Lareina Lim, Brad Li)