Navigation group

Home banner.

Ice climbing under aurora

Where scientists empower society

Creating solutions for healthy lives on a healthy planet.

9.4 million

2.8 billion

article views and downloads

Main Content

  • Editors and reviewers
  • Collaborators

Male doctor examining petri dish at laboratory while coworker working in background

Find a journal

We have a home for your research. Our community led journals cover more than 1,500 academic disciplines and are some of the largest and most cited in their fields.

Confident young woman gesturing while teaching students in class

Submit your research

Start your submission and get more impact for your research by publishing with us.

Active senior woman concentrating while working on laptop

Author guidelines

Ready to publish? Check our author guidelines for everything you need to know about submitting, from choosing a journal and section to preparing your manuscript.

Smiling colleagues doing research over laptop computer on desk in office

Peer review

Our efficient collaborative peer review means you’ll get a decision on your manuscript in an average of 61 days.

Interior of a library with desks and bookshelves

Article publishing charges (APCs) apply to articles that are accepted for publication by our external and independent editorial boards

Group of international university students having fun studying in library, three colleagues of modern work co-working space talking and smiling while sitting at the desk table with laptop computer

Press office

Visit our press office for key media contact information, as well as Frontiers’ media kit, including our embargo policy, logos, key facts, leadership bios, and imagery.

Back view of man presenting to students at a lecture theatre

Institutional partnerships

Join more than 555 institutions around the world already benefiting from an institutional membership with Frontiers, including CERN, Max Planck Society, and the University of Oxford.

Happy senior old korean businesswoman discussing online project on laptop with african american male colleague, working together in pairs at shared workplace, analyzing electronic documents.

Publishing partnerships

Partner with Frontiers and make your society’s transition to open access a reality with our custom-built platform and publishing expertise.

Welsh Assembly debating chamber, UK.

Policy Labs

Connecting experts from business, science, and policy to strengthen the dialogue between scientific research and informed policymaking.

Smiling African American Woman Talking to Boss in Office

How we publish

All Frontiers journals are community-run and fully open access, so every research article we publish is immediately and permanently free to read.

Front view portrait of African American man wearing lab coat and raising hand asking question while sitting in audience and listening to lecture on medicine

Editor guidelines

Reviewing a manuscript? See our guidelines for everything you need to know about our peer review process.

Shaking hands. African American dark-skinned man touching hands of his light-skinned workmate in greeting gesture

Become an editor

Apply to join an editorial board and collaborate with an international team of carefully selected independent researchers.

Scientist looking at 3D rendered graphic scans from Magnetic Resonance Imaging (MRI) scanner, close up

My assignments

It’s easy to find and track your editorial assignments with our platform, 'My Frontiers' – saving you time to spend on your own research.

FSCI_Hub_Methane-Imperatives_Shindell_Hub-card

Three-step plan to cut overlooked methane emissions could help us stop global warming faster

Methane, the second most important greenhouse gas, has been neglected—but now scientists lay out a new plan and a new tool to cut emissions down to size

winter kayaking in Antarctica, extreme sport adventure, people paddling on kayak near iceberg

Safeguarding peer review to ensure quality at scale

Making scientific research open has never been more important. But for research to be trusted, it must be of the highest quality. Facing an industry-wide rise in fraudulent science, Frontiers has increased its focus on safeguarding quality.

Tom Crowther FFDD promotional banners

Ecopreneur Prof Thomas Crowther to showcase the power of nature-based solutions at Frontiers Forum virtual event

Visionary ecologist and pioneer in reforestation and ecosystem restoration Prof Thomas Crowther will explore the vital role that nature plays in our fight against climate change, at a unique Frontiers Forum virtual event on 11 September.

Remains of the public baths in Pompeii, the famous roman city near Naples (Italy) that was completely destroyed by the eruption of Mount Vesuvius in 79BC.

Pompeii skeleton discovery shows another natural disaster may have made Vesuvius eruption even more deadly

The death of inhabitants of Pompeii during the eruption of Vesuvius in 79CE is mostly attributed to volcanic causes, such as falling ashes and hot gas. This, however, may not be the full picture.

Nasa close-up of astronaut

Dune-inspired upgrade for spacesuits allow astronauts to recycle urine into water

Inspired by the sci-fi series, Dune, Cornell researchers created a prototype novel urine collection and filtration system for spacesuits.

peer reviewed websites journals

What happens when the ocean’s biggest predators start hunting each other? Here are five Frontiers articles you won’t want to miss

At Frontiers, we bring some of the world’s best research to a global audience. But with tens of thousands of articles published each year, it’s impossible to cover all of them. Here are just five amazing papers you may have missed.

This image is a journal's Main Visual. Please do not use it outside journal specific assets. More information in the 'How to use Main Visuals' guide (coming soon).

Five Research Topics on the human impact of population growth

We highlight five Research Topics tackling some of the most urgent issues emerging from our planet's growing population.

Get the latest research updates, subscribe to our newsletter

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Trending Articles

  • Phase III KEYNOTE-789 Study of Pemetrexed and Platinum With or Without Pembrolizumab for Tyrosine Kinase Inhibitor‒Resistant, EGFR -Mutant, Metastatic Nonsquamous Non-Small Cell Lung Cancer. Yang JC, et al. J Clin Oncol. 2024. PMID: 39173098
  • These labs have prepared for a big earthquake - will it be enough? Ikarashi A. Nature. 2024. PMID: 39155315 No abstract available.
  • Epinephrine promotes breast cancer metastasis through a ubiquitin-specific peptidase 22-mediated lipolysis circuit. Zhou Y, et al. Sci Adv. 2024. PMID: 39151008 Free PMC article.
  • Acetate enables metabolic fitness and cognitive performance during sleep disruption. He Q, et al. Cell Metab. 2024. PMID: 39163862
  • Deciphering the causes of sporadic late-onset cerebellar ataxias: a prospective study with implications for diagnostic work. Gebus O, et al. J Neurol. 2017. PMID: 28478596

Latest Literature

  • Cochrane Database Syst Rev (1)
  • J Biol Chem (8)
  • PLoS One (55)
  • Pediatrics (1)
  • Proc Natl Acad Sci U S A (8)

NCBI Literature Resources

MeSH PMC Bookshelf Disclaimer

The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.

Detail of a painting depicting the landscape of New Mexico with mountains in the distance

Explore millions of high-quality primary sources and images from around the world, including artworks, maps, photographs, and more.

Explore migration issues through a variety of media types

  • Part of The Streets are Talking: Public Forms of Creative Expression from Around the World
  • Part of The Journal of Economic Perspectives, Vol. 34, No. 1 (Winter 2020)
  • Part of Cato Institute (Aug. 3, 2021)
  • Part of University of California Press
  • Part of Open: Smithsonian National Museum of African American History & Culture
  • Part of Indiana Journal of Global Legal Studies, Vol. 19, No. 1 (Winter 2012)
  • Part of R Street Institute (Nov. 1, 2020)
  • Part of Leuven University Press
  • Part of UN Secretary-General Papers: Ban Ki-moon (2007-2016)
  • Part of Perspectives on Terrorism, Vol. 12, No. 4 (August 2018)
  • Part of Leveraging Lives: Serbia and Illegal Tunisian Migration to Europe, Carnegie Endowment for International Peace (Mar. 1, 2023)
  • Part of UCL Press

Harness the power of visual materials—explore more than 3 million images now on JSTOR.

Enhance your scholarly research with underground newspapers, magazines, and journals.

Explore collections in the arts, sciences, and literature from the world’s leading museums, archives, and scholars.

This website uses cookies to ensure you get the best experience. Learn more about DOAJ’s privacy policy.

Hide this message

You are using an outdated browser. Please upgrade your browser to improve your experience and security.

The Directory of Open Access Journals

Directory of Open Access Journals

Find open access journals & articles.

Doaj in numbers.

80 languages

134 countries represented

13,712 journals without APCs

20,846 journals

10,447,300 article records

Quick search

About the directory.

DOAJ is a unique and extensive index of diverse open access journals from around the world, driven by a growing community, and is committed to ensuring quality content is freely available online for everyone.

DOAJ is committed to keeping its services free of charge, including being indexed, and its data freely available.

→ About DOAJ

→ How to apply

DOAJ is twenty years old in 2023.

Fund our 20th anniversary campaign

DOAJ is independent. All support is via donations.

82% from academic organisations

18% from contributors

Support DOAJ

Publishers don't need to donate to be part of DOAJ.

News Service

Meet the doaj team: head of editorial and deputy head of editorial (quality), vacancy: operations manager, press release: pubscholar joins the movement to support the directory of open access journals, new major version of the api to be released.

→ All blog posts

We would not be able to work without our volunteers, such as these top-performing editors and associate editors.

→ Meet our volunteers

Librarianship, Scholarly Publishing, Data Management

Brisbane, Australia (Chinese, English)

Adana, Türkiye (Turkish, English)

Humanities, Social Sciences

Natalia Pamuła

Toruń, Poland (Polish, English)

Medical Sciences, Nutrition

Pablo Hernandez

Caracas, Venezuela (Spanish, English)

Research Evaluation

Paola Galimberti

Milan, Italy (Italian, German, English)

Social Sciences, Humanities

Dawam M. Rohmatulloh

Ponorogo, Indonesia (Bahasa Indonesia, English, Dutch)

Systematic Entomology

Kadri Kıran

Edirne, Türkiye (English, Turkish, German)

Library and Information Science

Nataliia Kaliuzhna

Kyiv, Ukraine (Ukrainian, Russian, English, Polish)

WeChat QR code

peer reviewed websites journals

  • Find journals
  • My journals

Register Sign in

Register or sign-in in order to manage your journal lists

Sign in or register to save a journal

To save a journal and create lists, you need to sign in to your Elsevier account.

Find the right journal for your research

Looking for the best journal match for your paper? Search the world's leading source of academic journals using your abstract or your keywords and other details.

Check if you're eligible for open access (OA) savings.

  • All Solutions

scopus-hero

Expertly curated abstract & citation database

About Scopus

Scopus is the largest abstract and citation database of peer-reviewed literature: scientific journals, books and conference proceedings. Delivering a comprehensive overview of the world's research output in the fields of science, technology, medicine, social sciences, and arts and humanities, Scopus features smart tools to track, analyse and visualise research.

As research becomes increasingly global, interdisciplinary and collaborative, you can make sure that critical research from around the world is not missed when you choose Scopus.

“Speed is very important … I can easily identify what I need to know, read it, digest it and move on to the next one.” James, Research Pathologist, Medical Device R&D, Scopus user
“Scopus is very customer-friendly… You get more information from all different fields. It saves a lot of time.” Chris, Head of R&D, Diagnostic Testing, Scopus user
“Scopus informs every phase of the editorial process. I would not want to do this job without it, and I intend to continue using it throughout my career.” William, Professor of Economics, University of Tennessee

More information (in English)

  • Why I would not want to be without Scopus; an editor’s story
  • NASI Scopus Young Scientists Awards 2019

Elsevier.com visitor survey

We are always looking for ways to improve customer experience on Elsevier.com. We would like to ask you for a moment of your time to fill in a short questionnaire, at the end of your visit . If you decide to participate, a new browser tab will open so you can complete the survey after you have completed your visit to this website. Thanks in advance for your time.

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here .

PLOS ONE 

August 7, 2024

PLOS ONE 

An inclusive journal community working together to advance science by making all rigorous research accessible without barriers

Calling all experts!

Plos one is seeking talented individuals to join our editorial board. .

Psychology of emotion

Protocol of the study for predicting empathy during VR sessions using sensor data and machine learning

Kizhevska and colleagues propose a study that uses virtual reality technology to investigate the potential relationship between empathy and corresponding changes in physiological attributes.

Image credit: Fig 2 by Kizhevska et al., CC BY 4.0

Protocol of the study for predicting empathy during VR sessions using sensor data and machine learning

Health Literacy

Teaching methods for critical thinking in health education of children up to high school: A scoping review

Prokop-Dorner and colleagues reviewed educational interventions used in 115 studies on the development of critical thinking regarding health. The interventions focused mainly on lifestyle-related health issues. The authors recommend more detailed reporting and advocate for a reporting checklist to describe health education interventions.

Image credit: Classroom by Victorsteep, Pixabay

Teaching methods for critical thinking in health education of children up to high school: A scoping review

Animal behavior

Facial blushing and feather fluffing are indicators of emotions in domestic fowl ( Gallus gallus domesticus )

Arnould and colleagues investigate emotionality in chickens using changes in facial expressions as an indicator of bird welfare.

Image credit: Fig 2b by Arnould et al., CC BY 4.0

Facial blushing and feather fluffing are indicators of emotions in domestic fowl (Gallus gallus domesticus)

Analysis of changes in the occurrence of ice phenomena in upland and mountain rivers of Poland

Kochanek and colleagues present a study on the number of days with ice for rivers in southern Poland, using existing data from years between 1951-2021. They find decreases of number of days with ice for most measuring stations, with indications that increasing air temperatures of 1°C can result in up to 20 fewer days with ice.

Image credit: Winter River by Larry, CC BY 2.0

Analysis of changes in the occurrence of ice phenomena in upland and mountain rivers of Poland

Editor Spotlight: Retno Asti Werdhani

In this interview, PLOS ONE Academic Editor Retno Asti Werdhani discusses her role as PLOS ONE Academic Editor, her career path to the family medicine and primary care, and her passion in medical education.

Editor Spotlight: Retno Asti Werdhani

Image credit: Dr. Retno Asti Werdhani by Dr. Retno Asti Werdhani CC BY 4.0

Official PLOS Blog

A new Open Science Indicator: measuring study registration

PLOS introduces a new indicator for study registration—also known as preregistration. 

A new Open Science Indicator: measuring study registration

Image credit: OSI by PLOS CC BY 4.0

Editor Spotlight: Laura Patterson Rosa

In this interview, PLOS ONE Academic Editor Laura Patterson Rosa talks about her motivation to act as an Academic Editor in PLOS ONE, her passion for equine research and riding, and the importance of open science.

Editor Spotlight: Laura Patterson Rosa

Image credit: Dr. Laura Patterson Rosa by Dr, Laura Patterson Rosa CC BY 4.0

Life Sciences

DNA barcodes from over-a-century-old type specimens shed light on the taxonomy of a group of rare butterflies (Lepidoptera: Nymphalidae: Calinaginae)

Todisco and colleagues bring new information about this enigmatic group of butterflies

DNA barcodes from over-a-century-old type specimens shed light on the taxonomy of a group of rare butterflies (Lepidoptera: Nymphalidae: Calinaginae)

Image credit: Fig 5 by Todisco et al., CC BY 4.0

Urban transportation

Developing a transit desert interactive dashboard: Supervised modeling for forecasting transit deserts

Choi and Jiao explore transit deserts

Developing a transit desert interactive dashboard: Supervised modeling for forecasting transit deserts

Image credit: Bombardier NGT8 by Mach240390, CC BY 3.0

Philosophy of science

Philosophy leading the way: An interdisciplinary approach to study communication of severe diagnoses

Consolandi combines philosophy and medicine in studying the communication of severe diagnoses in clinical care settings

Philosophy leading the way: An interdisciplinary approach to study communication of severe diagnoses

Image credit: Medical Checkup by Mohamed Mahmoud Hassan CC BY 1.0

Targeted vibratory therapy as a treatment for proprioceptive dysfunction: Clinical trial in older patients with chronic low back pain

Sakai and colleagues report efficacy of vibratory stimulation in treating lower back pain in older patients.

Targeted vibratory therapy as a treatment for proprioceptive dysfunction: Clinical trial in older patients with chronic low back pain

Image credit: Character, Guy, Stand by WolfBlur, Pixabay

Rare cancers

This Collection, curated by Guest Editor Mitesh J. Borad, M.D, highlights research on the biology and epidemiology of rare cancers, and promising approaches for diagnosis and treatment.

Collections

Browse the lastest collections of papers from across PLOS

European Society of Cardiology Congress 2024

Associate Editor Johanna Pruller will be representing PLOS ONE at this conference in London, UK, August 30th - September 2nd 2024.

Conference on Complex Systems 2024

Associate Editor Joanna Tindall will be representing PLOS ONE at this conference in Exeter, UK, September 2nd - 6th 2024

The 10th International Conference on Machine Learning, Optimization, and Data Science

Senior Editor Hugh Cowley will be representing PLOS ONE at this conference in Castiglione della Pescaia, Italy, September 22nd - 25th 2024

Publish with PLOS ONE

  • Submission Instructions
  • Submit Your Manuscript

Connect with Us

  • PLOS ONE on Twitter
  • PLOS on Facebook

Get new content from PLOS ONE in your inbox

SpringerOpen

The SpringerOpen portfolio has grown tremendously since its launch in 2010, so that we now offer researchers from all areas of science, technology, medicine, the humanities and social sciences a place to publish open access in journals. Publishing with SpringerOpen makes your work freely available online for everyone, immediately upon publication, and our high-level peer-review and production processes guarantee the quality and reliability of the work. Open access books are published by our Springer imprint.

Find the right journal for you

Explore our subject areas, learn all about open access.

New Content Item

  • Browse our alphabetical journal list
  • Explore our journals by subject
  • Tips for finding the right journal
  • Find the right journal with our Journal Suggester
  • Find out if open access book publishing is right for you

New Content Item

  • Visit our subject pages covering all subject areas in science, technology, medicine, the humanities and social sciences

© PTter Gudella, iStockphoto

Visit the Springer Author & Reviewer tutorials and learn all about open access, your benefits, mandates, funding, copyright and more in the different interactive tutorials. And take our quiz to test your knowledge!

  • C heck out the free tutorials
  • Take the quiz

Video library

Your browser needs to have JavaScript enabled to view this video

Our video library contains how-to videos, videos on the research we publish and journal videos. 

University Library

Peer Review: An Introduction: Where to Find Peer Reviewed Sources

  • Why not just use Google or Wikipedia?
  • Where to Find Peer Reviewed Sources
  • Where to Get More Help

Need More Help?

Have more questions? Contact Scholarly Communication and Publishing at [email protected]   for more information and guidance.

Ask a Librarian

The Ask a Librarian service for general reference is available during all of the hours when the Main Library is open. Visit the  Ask a Librarian  page to chat with a librarian.

Why is it so hard to find Peer-Reviewed Sources?

It isn't hard to find peer-reviewed sources: you just need to know where to look!  If you start in the right place, you can usually find a relevant, peer-reviewed source for your research in as few clicks as a Google search, and you can even use many of the search techniques you use in Google and Wikipedia.

The easiest way to find a peer-reviewed article is by using one of the Library's numerous databases. All of the Library's databases are listed in the Online Journals and Databases index. The databases are divided by name and discipline.

Departmental libraries and library subject guides have created subject-focused lists of electronic and print research resources that are useful for their disciplines. You can search the library directory  for links to the departmental libraries at the University of Illinois Library, or search library websites by college  if you're not sure which departmental library serves your subject.

Peer-Reviewed Resources for Disciplinary Topics

There are numerous print and digital resources for specific disciplines, areas of study, and specialist fields.  To find research resources and databases for your area, consult the comprehensive directory of LibGuides , the websites of specialist libraries, and above all, contact a librarian for help !

Here are a few major databases for finding peer-reviewed research sources in the humanities, social sciences, and sciences:

  • MLA International Bibliography This link opens in a new window Indexes critical materials on literature, languages, linguistics, and folklore. Proved access to citations from worldwide publications, including periodicals, books, essay collections, working papers, proceedings, dissertations and bibliographies. Use MLA International Bibliography in the NEW EBSCO user interface . more... less... Alternate Access Link
  • Web of Science (Core Collection) This link opens in a new window Web of Science indexes core journal articles, conference proceedings, data sets, and other resources in the sciences, social sciences, arts, and humanities.

A scholarly, multidisciplinary database providing indexing and abstracts for over 10,000 publications, including monographs, reports, conference proceedings, and others. Also includes full-text access to over 5,000 journals. Offers coverage of many areas of academic study including: archaeology, area studies, astronomy, biology, chemistry, civil engineering, electrical engineering, ethnic & multicultural studies, food science & technology, general science, geography, geology, law, mathematics, mechanical engineering, music, physics, psychology, religion & theology, women's studies, and other fields. 

Alternate Access Link  

  • IEEE Xplore This link opens in a new window Provides full-text access to IEEE transactions, IEEE and IEE journals, magazines, and conference proceedings published since 1988, and all current IEEE standards; brings additional search and access features to IEEE/IEE digital library users. Browsable by books & e-books, conference publications, education and learning, journals and magazines, standards and by topic. Also provides links to IEEE standards, IEEE spectrum and other sites.
  • Scopus This link opens in a new window Scopus is the largest abstract and citation database including peer-reviewed titles from international publishers, Open Access journals, conference proceedings, trade publications and quality web sources. Subject coverage includes: Chemistry, Physics, Mathematics and Engineering; Life and Health Sciences; Social Sciences, Psychology and Economics; Biological, Agricultural and Environmental Sciences.
  • Business Source Ultimate This link opens in a new window Provides bibliographic and full text content, including indexing and abstracts for scholarly business journals back as far as 1886 and full text journal articles in all disciplines of business, including marketing, management, MIS, POM, accounting, finance and economics. The database full text content includes financial data, books, monographs, major reference works, book digests, conference proceedings, case studies, investment research reports, industry reports, market research reports, country reports, company profiles, SWOT analyses and more. Use Business Source Ultimate in the NEW EBSCO user interface . more... less... Alternate Access Link
  • << Previous: Why not just use Google or Wikipedia?
  • Next: Where to Get More Help >>
  • Last Updated: Jun 20, 2024 1:47 PM
  • URL: https://guides.library.illinois.edu/peerreview
  • Advanced search
  • Peer review

peer reviewed websites journals

Discover relevant research today

peer reviewed websites journals

Advance your research field in the open

peer reviewed websites journals

Reach new audiences and maximize your readership

ScienceOpen puts your research in the context of

Publications

For Publishers

ScienceOpen offers content hosting, context building and marketing services for publishers. See our tailored offerings

  • For academic publishers  to promote journals and interdisciplinary collections
  • For open access journals  to host journal content in an interactive environment
  • For university library publishing  to develop new open access paradigms for their scholars
  • For scholarly societies  to promote content with interactive features

For Institutions

ScienceOpen offers state-of-the-art technology and a range of solutions and services

  • For faculties and research groups  to promote and share your work
  • For research institutes  to build up your own branding for OA publications
  • For funders  to develop new open access publishing paradigms
  • For university libraries to create an independent OA publishing environment

For Researchers

Make an impact and build your research profile in the open with ScienceOpen

  • Search and discover relevant research in over 95 million Open Access articles and article records
  • Share your expertise and get credit by publicly reviewing any article
  • Publish your poster or preprint and track usage and impact with article- and author-level metrics
  • Create a topical Collection  to advance your research field

Create a Journal powered by ScienceOpen

Launching a new open access journal or an open access press? ScienceOpen now provides full end-to-end open access publishing solutions – embedded within our smart interactive discovery environment. A modular approach allows open access publishers to pick and choose among a range of services and design the platform that fits their goals and budget.

Continue reading “Create a Journal powered by ScienceOpen”   

What can a Researcher do on ScienceOpen?

ScienceOpen provides researchers with a wide range of tools to support their research – all for free. Here is a short checklist to make sure you are getting the most of the technological infrastructure and content that we have to offer. What can a researcher do on ScienceOpen? Continue reading “What can a Researcher do on ScienceOpen?”   

ScienceOpen on the Road

Upcoming events.

  • 15 June – Scheduled Server Maintenance, 13:00 – 01:00 CEST

Past Events

  • 20 – 22 February – ResearcherToReader Conference
  • 09 November – Webinar for the Discoverability of African Research
  • 26 – 27 October – Attending the Workshop on Open Citations and Open Scholarly Metadata
  • 18 – 22 October – ScienceOpen at Frankfurt Book Fair.
  • 27 – 29 September – Attending OA Tage, Berlin .
  • 25 – 27 September – ScienceOpen at Open Science Fair
  • 19 – 21 September – OASPA 2023 Annual Conference .
  • 22 – 24 May – ScienceOpen sponsoring Pint of Science, Berlin.
  • 16-17 May – ScienceOpen at 3rd AEUP Conference.
  • 20 – 21 April – ScienceOpen attending Scaling Small: Community-Owned Futures for Open Access Books .

What is ScienceOpen?

  • Smart search and discovery within an interactive interface
  • Researcher promotion and ORCID integration
  • Open evaluation with article reviews and Collections
  • Business model based on providing services to publishers

Live Twitter stream

Some of our partners:.

Akadémiai Kiadó

peer reviewed websites journals

Reviews of Peer-Reviewed Journals in the Humanities and Social Sciences

We give you the scuttlebutt on academic journals—aiding you in selecting the right journal for publication—in reviews that are sometimes snarky, sometimes lengthy, always helpful. Written by Princeton University graduate students and Wendy Laura Belcher.

  • Journal Article Prize Competitions
  • Journal Disciplines
  • Journals Reviewed
  • Journals Ranking

Identifying the best journal to publish in is not easy. However, it is essential to select correctly, since you can only send your article to one journal at a time, never simultaneously. Based on the advice in Writing Your Journal Article in Twelve Weeks: A Guide to Academic Publishing Success ,  below are some of the ways to find the information you need to make your decision. Here’s how you can find out about:

All journals in your field or discipline.  For brief, online, up-to-date information about journals,  Ulrich’s Periodicals Directory  is the most comprehensive. Do not use the search on the home page, but go to advanced search, select the limiters “Active,” “Journal,” “Academic/Scholarly,” and “ Refereed / Peer-reviewed”   and then enter your keyword (e.g., film, gender, African history). A list of peer-reviewed journals will appear. Under each journal, you can find such information as the journal’s website, publisher, frequency, and a brief review from Magazines for Libraries . Unfortunately, this directory is not free; your library needs to own a subscription to access it.

Journal efficiency (or, gossip about journals) . For detailed information about individuals’ experiences with submitting articles to various journals, including comments on length of backlog and turnaround time, editorial promptness, and peer reviewer helpfulness, see the excellent Humanities Journal Wiki . Not all journals are there, but many are. The entries have to be read with a grain of salt (like any comment system, it is biased toward the negative), but trends in the behavior of the journal can become visible if enough scholars comment.

Journal prestige . Statistical information about which humanities journals are considered better than other journals is not easy to find and is not especially trustworthy. However, two places you can check rankings are the European Reference Index for the Humanities (ERIH)  and the ranking of journals in  JStor alone. You can also check out the meta-list of rankings, Harzing’s  Journal Quality List  (the Harzing 2015 list specifically). which includes many of the websites that provide rankings of journals: outside the United States, many universities compile their own rankings. Academics generally hate humanities lists, see the Guardian article on the topic. The ranking of social science journals can be found in a variety of places, including SCImago , ISI  Journal Citation Reports , and so on.

Journal impact . For information on journals that are cited frequently, use Harzing’s Publish or Perish software. It’s outstanding and free. To find a specific journal’s most cited articles, find its ISSN and insert it in “the Phrase” field.

Acceptance rates . Information about acceptance rates and circulation for peer-reviewed journals in the humanities is often tough to find at their websites. The best source of this information on literary scholarship journals is the MLA Directory of Periodicals , which provides a wealth of other information as well. However, since the information there about acceptance rates and circulation are reported by the journal, these are often slightly inflated. That is, they say their circulation rate is higher than it is and their acceptance rate is lower than it is. MLA doesn’t provide an acceptance rate directly; you have to calculate it by dividing the number of accepted submissions by the number of total submissions (e.g., 40 articles accepted for publication/ 100 articles submitted, equals 40 percent acceptance rate).

Topic trends . The following article analyzed 21,367 scholarly articles in literary journals from 1889–2013 to depict trends in topics over time. “ The Quiet Transformations of Literary Studies: What Thirteen Thousand Scholars Could Tell Us ” by Andrew Goldstone and Ted Underwood in New Literary History (summer 2014).

Our rankings. Using Harzing’s Publish or Perish software, we found the most highly cited articles in specific journals and list those articles on the journal page. We would like to post something here about which journals, therefore, are the most cited, but we haven’t done that yet. It is interesting to note that perhaps the most cited article in the humanities published since 2010 is Homi Bhabha’s two-page (!) introduction to the Simone de Beauvoir special issue in French Politics, Culture and Society , which has been cited 1,182 times.

Questions? Email the webmaster Wendy Laura Belcher.

Share this:

  • Click to share on Facebook (Opens in new window)
  • Click to share on Twitter (Opens in new window)
  • Click to share on Tumblr (Opens in new window)
  • Click to email a link to a friend (Opens in new window)
  • Click to print (Opens in new window)
  • Click to share on Reddit (Opens in new window)

Leave a Reply Cancel reply

You must be logged in to post a comment.

Recent Posts

  • Music and the Moving Image
  • L’Esprit Createur
  • Latino Studies
  • Modern & Contemporary France
  • Ramus: Critical Studies in Greek and Roman Literature

peer reviewed websites journals

Maintenance work is planned from 21:00 BST on Tuesday 20th August 2024 to 21:00 BST on Wednesday 21st August 2024, and on Thursday 29th August 2024 from 11:00 to 12:00 BST.

During this time the performance of our website may be affected - searches may run slowly, some pages may be temporarily unavailable, and you may be unable to log in or to access content. If this happens, please try refreshing your web browser or try waiting two to three minutes before trying again.

We apologise for any inconvenience this might cause and thank you for your patience.

peer reviewed websites journals

Green Chemistry  

peer reviewed websites journals

About Green Chemistry

The home of cutting-edge research on the development of alternative sustainable technologies. Editorial Board Chair: Javier Pérez-Ramírez Impact factor: 9.3 Time to first decision (peer reviewed only): 35 days

Find an article

Find issues by year (1999 - present), journal information.

  • About this Journal
  • People and Contacts
  • Editorial Board
  • Subscription Information
  • Follow   |   

Advertisements

For Authors

  • Why Publish in JAMA
  • Instructions for Authors
  • Submit Your Manuscript
  • Author Reprints
  • Permissions Requests

peer reviewed websites journals

Editor in Chief

peer reviewed websites journals

Kirsten Bibbins-Domingo, PhD, MD, MAS

peer reviewed websites journals

Gregory Curfman, MD

Executive editor.

JAMA , published continuously since 1883, is an international peer-reviewed general medical journal. JAMA is a member of the JAMA Network, a consortium of peer-reviewed, general medical and specialty publications.

Journal Reach. JAMA is the most widely circulated general medical journal in the world, with more than 125,000 recipients of the print journal, more than 2.6 million recipients of electronic tables of contents and alerts, and over 30 million annual visits to the journal's website. JAMA 's reach includes a growing social media presence (more than 1.3 million social media followers [Facebook, X, Instagram, LinkedIn]) and vast international news media exposure.

Frequency of Publication and Access. JAMA is published 48 times per year in print/online issues, and new articles are published every weekday online. Without any author fees, all research articles are made free access online 6 months after publication on the JAMA website. In addition, the online version is freely available or nearly so to institutions in low- and middle-income countries through the World Health Organization's HINARI program.

Editorial Information. JAMA 's acceptance rate is 13% of the more than 10,000 annual submissions and 6% of the more than 5,000 research manuscripts received. JAMA 's Journal Impact Factor is 63.1, among the top 5 journals in medicine and science. For information about JAMA ’s reach and impact, decision and publication timelines, and author services, see below and the JAMA Editorial . For more information on the types of articles published and editorial policies, see the journal's Instructions for Authors .

Editorial Team. The Editor in Chief of JAMA is Kirsten Bibbins-Domingo, PhD, MD, MAS. See the Editors & Publishers for additional information on the journal's Editors and Editorial Board.

JAMA is a member of the International Committee of Medical Journal Editors , cosponsors the International Congress on Peer Review and Biomedical Publication , and is a member of the African Journal Partnership Project and is partnered with the Malawi Medical Journal .

JAMA 's Key and Critical Objectives

Key objective.

To promote the science and art of medicine and the betterment of the public health

Critical Objectives

  • To maintain the highest standards of editorial integrity and quality independent of any special interests
  • To publish original, important, valid, peer-reviewed articles on a diverse range of medical topics
  • To promote and address diversity, equity, and inclusion within the journal and in medical research, clinical care, health policy, and society
  • To foster responsible and balanced debate on important issues that affect medicine, health, health care, and health policy
  • To provide physicians with continuing education in basic and clinical science to support informed clinical decisions and ongoing career development
  • To enable physicians to remain informed in multiple areas of medicine, including developments in fields other than their own
  • To improve health and health care internationally by elevating the quality of medical care, disease prevention, and research
  • To inform readers about the various aspects of medicine and public health, including the cultural, sociopolitical, ethical, legal, environmental, economic, structural, and historical
  • To recognize that, in addition to these specific objectives, JAMA has a social responsibility to improve equity and the total human condition, promulgate truth in science and medicine, and promote the integrity of science
  • To achieve the highest level of ethical medical journalism and to produce a publication that is timely, credible, and enjoyable to read
  • To use technologies to drive innovation and improve the communication of and access to journal content

JAMA ISSN 0098-7484 (Print) ISSN 1538-3598 (Online)

Back to top

Why Publish in JAMA ?

Published since 1883, JAMA offers unparalleled reach and an author-friendly approach from manuscript submission through publication. JAMA reaches physicians, other health professionals, researchers, policy makers, librarians, journalists, and others interested in medicine and public health throughout the world. JAMA provides the following:

Impact and Reach

  • Journal Impact Factor of 63.1, among the top 5 journals in medicine and science
  • Broad reach, with more than 2.6 million recipients of electronic alerts (eTable of Contents and Online First) and more than 1.3 million social media followers (Facebook, X, Instagram, LinkedIn)
  • Over 62 million annual article views and downloads and the largest print circulation of any general medical journal, with more than 125,000 recipients worldwide
  • Extensive press coverage, with over 122,000 media mentions in 2023 and 2024 in outlets such as The New York Times , The Washington Post , The Wall Street Journal , CNN, and the BBC
  • Top Altmetric scores— JAMA published 14 of the top 50 articles among general medical journals
  • Highlights of your article via weekly JAMA issue summary podcasts, audio and video interviews, and visual abstracts

Prompt Decisions and Rapid Publication Timelines

  • Highly selective peer review and editorial evaluation, with 13% acceptance rate of the more than 10,000 annual submissions; 6% acceptance of the more than 5,000 research papers
  • Median time to first decision: 3 days without external peer review; 31 days with review
  • Fast publication: Median time from acceptance to online first publication for research manuscripts, 37 days; 47 days from acceptance to print publication
  • JAMA Express: Expedited peer review and online publication within 4 weeks of submission for late-breaking research to be presented at major scientific meetings and those with time-sensitive findings of major clinical or public health importance.
  • Coordination with meeting presentation:  Opportunity to publish new research simultaneously with your presentation

Author Service

JAMA offers unparalleled reach and an author-friendly approach, from manuscript submission through publication.

  • User-friendly manuscript submission system and process
  • Prompt, expert review and consideration from JAMA 's experienced editors
  • Highest editorial standards followed to improve your accepted manuscript's accuracy, reliability, and readability
  • CME credit available for lead authors who publish in JAMA
  • Opportunity for your work to be augmented with expert illustration, interactive features, video, audio, and visual abstract
  • Display of content on fast, device-responsive website
  • Citations, views, and Altmetric score displayed with every article
  • Free public access: All research articles are freely available 6 months after publication on the JAMA website
  • Deposit to PubMed Central: The journal deposits all published research articles into PubMed Central (PMC) for authors
  • Authors may post accepted research manuscripts in public repositories on or after publication provided that they link to the published article on the journal website
  • JAMA Network advantage: Authors of papers not accepted by JAMA may have the option to have their papers and reviewers' comments automatically referred to one of the JAMA Network Specialty Journals and/or JAMA Network Open
  • Dedicated media team to promote your article to the news media and on social media

Commitment to Equity

  • JAMA Network journals welcome manuscript submissions on equity, diversity, and inclusion (EDI).
  • For more information, see the JAMA Network EDI Editors, Policies, and Topic Collection

For more information, see JAMA's Mission and Objectives and Instructions for Authors .

Submit your manuscript at https://manuscripts.jama.com .

Questions? Contact us at [email protected] or call 312-464-4444.

Updated July 2024

JAMA Network Attendance at Conferences

JAMA Network attends a variety of medical conferences across specialties throughout the world. Learn more

  • Register for email alerts with links to free full-text articles
  • Access PDFs of free articles
  • Manage your interests
  • Save searches and receive search alerts

American Psychological Association Logo

The top 10 journal articles from 2023 examined the effects of social media, CBT for substance use, and the psychology of gig work

APA’s 89 journals published more than 5,500 articles in 2023. Here are the top 10 most read

Vol. 55 No. 1 Print version: page 22

person wearing a hoodie laying down and using a smartphone

1. Looking through a filtered lens: Negative social comparison on social media and suicidal ideation among young adults.

Spitzer, E. G., et al.

Young adults who engage in comparisons to others on social media and thus feel bad about themselves are more likely to think about suicide, this research in Psychology of Popular Media (Vol. 12, No. 1) suggests. Researchers surveyed 456 college students about their frequency of social media use and used scales to assess participants’ tendency to engage in negative social comparison on Instagram and Facebook, suicidal ideation, and thwarted belongingness (i.e., feeling as if lacking connections or meaningful relationships with others). Results indicated that participants who engaged in negative social comparisons were more likely to report suicidal ideation than those who did not. Specifically, on Instagram, those who negatively compared themselves to others the most also showed the highest levels of association between thwarted belongingness and suicidal ideation. These findings suggest the need for limits on social media use and education around its mental health effects. DOI: 10.1037/ppm0000380

2. Self-compassion and women’s experience of social media content portraying body positivity and appearance ideals.

Rutter, H., et al.

The type of social media content women view can affect their self-compassion—how kind to themselves and accepting of their flaws they are—suggests this study in Psychology of Popular Media (advance online publication). In two experiments, a total of 247 women viewed content consistent with appearance ideals (fitspiration body photos; faces with makeup), appearance-neutral content (landscapes), or body-positive content (body-positive body photos, body-positive quotes, faces without makeup). In both experiments, women who viewed content consistent with appearance ideals reported a state of worse self-compassion and worse thoughts about themselves than those who viewed body-positive or appearance-neutral content. Women who already had daily low self-compassion or high disordered-eating symptoms were the most affected by viewing content consistent with appearance ideals. On the contrary, viewing body-positive content increased the state of self-compassion relative to viewing appearance-neutral content. DOI: 10.1037/ppm0000453

3. Reducing social media use improves appearance and weight esteem in youth with emotional distress.

Thai, H., et al.

Reducing smartphone social media use to 1 hour per day might improve body image and weight esteem in youth with emotional distress who are heavy social media users, this study in Psychology of Popular Media (advance online publication) suggests. The researchers randomly assigned 220 participants (ages 17 to 25 who used social media at least 2 hours per day) to either a 4-week intervention in which they limited their social media use to 1 hour per day or to a control condition with unrestricted access to social media. After the 4-week intervention, the group with restricted social media use felt better about their appearance and weight relative to before the intervention, whereas the other group showed no changes. Thus, reducing smartphone social media use appears to be a good method to improve how youths feel about their appearance and weight and could become a component in the prevention and treatment of body image-related disturbances. DOI: 10.1037/ppm0000460

4. Interventions to reduce the negative impact of online highly visual social networking site use on mental health outcomes: A scoping review.

Herriman, Z., et al.

In this review, published in Psychology of Popular Media (advance online publication), researchers identified 39 studies published between 2011 and 2022 that examined how interventions designed to reduce the negative impact of online highly visual social networking site (e.g., Facebook, Instagram) use impact mental health. Most of the studies were conducted on Western adults younger than age 35 and varied widely in terms of the variables assessed, making it difficult to highlight overall conclusions. Nevertheless, results indicate that interventions focused on reducing the exposure to highly visual social media platforms benefited well-being but may also reduce social connectedness. Interventions focused on social media literacy programs may reduce addiction and improve body image. Other interventions that adopted varied psychological approaches did not appear to lead to significant results. The researchers also highlighted the gaps in research that should be addressed to improve the efficacy of such interventions, including a need for interventions that are more guided by psychological theories and assessments of these interventions that are rigorous and include diverse populations. DOI: 10.1037/ppm0000455

5. On the outside looking in: Social media intensity, social connection, and user well-being: The moderating role of passive social media use.

Roberts, J. A., & David, M. E.

According to this study in the Canadian Journal of Behavioural Science (Vol. 55, No. 3) , heavy passive social media use may be linked with a weaker sense of social connection and well-being. In two survey-based studies with 226 participants in the United States, researchers found that passive engagement with social media (viewing social media but not regularly posting or interacting through the platform) was associated with less social connection, lower well-being, and higher stress. In a third, experimental study, with 160 participants, the researchers asked participants to use social media heavily (10 minutes) or lightly (5 minutes) and engage with it actively or passively. The results indicated that heavy social media use had a negative impact on feelings of social connection when used passively but a positive effect when used actively. DOI: 10.1037/cbs0000323

6. Social media usage is associated with lower knowledge about anxiety and indiscriminate use of anxiety coping strategies.

Wolenski, R., & Pettit, J. W.

Social media might not be the best source to learn about anxiety and how to reduce it, this study in Psychology of Popular Media (advance online publication) suggests. Young adults (N=250) responded to an online survey in which they reported their sources of information about anxiety, the strategies they use to cope with anxiety, and their anxiety symptoms and severity. The researchers also tested participants’ knowledge about anxiety. Participants rated the internet (e.g., Wikipedia, medical websites) as their most used information source, followed by friends and family, therapy, and social media. Participants with an anxiety diagnosis or severe symptoms sought information on social media more frequently than the other participants. Across all participants, those who sought information on social media more frequently showed a lower knowledge about anxiety and were more likely to report using both adaptive and maladaptive strategies to reduce anxiety. On the contrary, using the internet was associated with more knowledge about anxiety. These findings suggest the need to promote the dissemination of accurate information about anxiety on social media. DOI: 10.1037/ppm0000456

7. The psychological scaffolding of arithmetic

Grice, M., et al.

In this article in Psychological Review (advance online publication), the authors propose that arithmetic has a biological origin, rather than philosophical, logical, or cognitive basis. This assertion rests on four principles of perceptual organization—monotonicity, convexity, continuity, and isomorphism—that shape how humans and other animals experience the world. According to the authors, these principles exclude all possibilities except the existence of arithmetic. Monotonicity is the idea that things change in the same direction, so that approaching objects appear to expand, while retreating objects appear to shrink. Convexity deals with betweenness, such that the four corners of a soccer pitch define the playing field even without boundary lines connecting them. Continuity describes the smoothness with which objects appear to move in time and space. Isomorphism is the idea of analogy, allowing people to recognize that cats are more similar to dogs than rocks. The authors’ analysis suggests that arithmetic is not necessarily an immutable truth of the universe but rather follows as a natural consequence of our perceptual system. DOI: 10.1037/rev0000431

8. An evaluation of cognitive behavioral therapy for substance use disorders: A systematic review and application of the society of clinical psychology criteria for empirically supported treatments.

Boness C. L., et al.

Cognitive behavioral therapy (CBT) is an empirically supported treatment for substance use disorder (SUD), is the conclusion of this review in Clinical Psychology: Science and Practice (Vol. 30, No. 2) . The researchers reviewed five meta-analyses of the effect of CBT on SUD, but only one had sufficient quality for inclusion to evaluate the size of the effects of CBT. This meta-analysis found that CBT produced small to moderate effects on SUD when compared with minimal treatment (e.g., waitlist, brief psychoeducation) and nonspecific treatment (e.g., treatment as usual, drug counseling). These effects were smaller in magnitude when compared with other active treatments (e.g., motivational interviewing, contingency management). The effects of CBT on SUD tended to diminish over time (i.e., CBT was most effective at early follow-up of 1 to 6 months posttreatment compared with late follow-up of at least 8 months posttreatment). The researchers recommend CBT to be used as an evidence-based approach to SUD but highlight the need for more research to identify patient characteristics that might moderate response to CBT and the best deployment of CBT (e.g., as a standalone or an adjunct intervention). DOI: 10.1037/cps0000131

9. A network approach to understanding parenting: Linking coparenting, parenting styles, and parental involvement in rearing adolescents in different age groups.

Liu, S., et al.

Mothers’ and fathers’ behaviors that promote a sense of family integrity (i.e., coparenting integrity), warmth, and emotional involvement are central components of the parenting network in two-parent families, according to this study in Developmental Psychology (Vol. 59, No. 4) . Researchers used network analysis to explore different facets of maternal and paternal coparenting (e.g., integrity, conflict), parenting styles (e.g., rejection, warmth), and parental involvement (e.g., emotional support, discipline) in two-parent families in China with a total of 4,852 adolescents at different stages of adolescence. They found that maternal and paternal coparenting integrity, warm parenting style, and emotional involvement were key to the parenting network, as indicated by the central spot they occupied in the network analysis. They also found that the expected influence of these characteristics varied for adolescents in different developmental stages—maternal integrity, warmth, and emotional involvement were important throughout adolescence, but paternal integrity, warmth, and emotional involvement were particularly important in early adolescence. The results suggest that supportive parenting might be a prime target for enhancing parenting systems. DOI: 10.1037/dev0001470

10. Seeking connection, autonomy, and emotional feedback: A self-determination theory of self-regulation in attention-deficit hyperactivity disorder.

Champ, R.E., et al.

In this article in Psychological Review (Vol. 130, No. 3) , the authors propose a new framework on the basis of self-determination theory (SDT) for understanding attention-deficit hyperactivity disorder (ADHD) and developing treatment approaches. The researchers suggest that using SDT, which proposes that humans have a natural tendency toward growth and self-actualization, supporting intrinsic motivation and self-organization, can offer a new positive understanding of ADHD and its symptoms. This approach counters the negative characterizations of ADHD; moves beyond symptom reduction and the focus on how ADHD presents motivation, engagement, and self-regulation issues; and instead focuses on potential positive aspects of ADHD and well-being. In addition, the framework highlights the need to help individuals with ADHD better understand how they function, tell the difference between biological and individual needs, and develop self-autonomy and self-regulation skills. According to this SDT approach, treatments that are autonomy supportive and increase self-determination could improve the functioning of individuals with ADHD. DOI: 10.1037/rev0000398

PsycArticles is available by subscription to institutions throughout the world. These are the articles published this year that were downloaded most often between January and September 2023.

Six Things Psychologists are Talking About

The APA Monitor on Psychology ® sister e-newsletter offers fresh articles on psychology trends, new research, and more.

Welcome! Thank you for subscribing.

Speaking of Psychology

Subscribe to APA’s audio podcast series highlighting some of the most important and relevant psychological research being conducted today.

Subscribe to Speaking of Psychology and download via:

Listen to podcast on iTunes

Contact APA

You may also like.

  • Open access
  • Published: 19 August 2024

Immune checkpoint gene signature assesses immune infiltration profiles in bladder cancer and identifies KRT23 as an immunotherapeutic target

  • Dongshan Chen 1 , 2   na1 ,
  • Haoyuan Cao 1   na1 ,
  • Xiang Zheng 1   na1 ,
  • Haojun Wang 1 ,
  • Zengchi Han   ORCID: orcid.org/0009-0004-1544-5229 3 &
  • Wei Wang   ORCID: orcid.org/0000-0003-2642-3338 1  

BMC Cancer volume  24 , Article number:  1024 ( 2024 ) Cite this article

259 Accesses

Metrics details

In the past few decades, researchers have made promising progress, including the development of immune checkpoint inhibitors (ICIs) in the therapy of bladder cancer (BLCA). Existing studies mainly focus on single immune checkpoint inhibitors but lack relevant studies on the gene expression profiles of multiple immune checkpoints.

RNA-sequencing profiling data and clinical information of BLCA patients and normal human bladder samples were acquired from the Cancer Genome Atlas and Gene Expression Omnibus databases and analyzed to identify different expression profiles of immune checkpoint genes (ICGs) after consensus clustering analysis. Based on the 526 intersecting differentially expressed genes, the LASSO Cox regression analysis was utilized to construct the ICG signature.

According to the expression of ICGs, BLCA patients were divided into three subtypes with different phenotypic and mechanistic characteristics. Furthermore, the developed ICG signature were independent predictors of outcome in BLCA patients, and was correlated with the immune infiltration, the expression of ICGs and chemotherapeutic effect.

Conclusions

This study systematically and comprehensively analyzed the expression profile of immune checkpoint genes, and established the ICG signature to investigate the differences in ICGs expression and tumor immune microenvironment, which will help risk stratification and accelerate precision medicine. Finally, we identified KRT23 as the most critical model gene, and highlighted KRT23 as a potential target to enhance immunotherapy against BLCA.

Peer Review reports

Introduction

Bladder cancer (BLCA) is the seventh most common type of malignant tumor worldwide [ 1 ]. Moreover, approximately 549,393 people were newly diagnosed with bladder cancer, and 199,922 patients died of the disease in 2018 [ 2 ]. Besides basic diagnosis based on symptoms and physical exams, exfoliated urothelial cells and cystoscopy are the primary methods of diagnosing bladder cancer, making BLCA one of the most expensive cancers. Approximately 80% of newly diagnosed patients present with non-muscle-invasive bladder cancer (NMIBC), and 10–20% of them will progress and invade the bladder muscle [ 3 ]. Muscular invasive bladder cancer (MIBC) is more prone to lymph node and organ metastasis, and the MIBC survival rate of five-years remains low [ 4 ]. Traditional therapy for bladder cancer mainly includes surgical resection and local or systemic chemotherapy, but the postoperative recurrence and the distant metastasis are difficult to control [ 5 ]. Therefore, it is urgent to develop new detection and treatment strategies to reduce the risk of recurrence and progression.

Although cisplatin-based combination chemotherapy realized the ideal reduction of death risk induced by bladder cancer, chemoresistance is developed and remains one of the chief reasons for cancer recurrence [ 6 ]. Additionally, the age-related and/or disease-related comorbidities may delay or impede the receipt of cisplatin-based perioperative chemotherapy [ 7 ]. As our understanding of the interaction between tumor cells and the tumor immune microenvironment (TIME) deepens, the increasing use of immune checkpoint inhibitors (ICIs) has revealed encouraging clinical efficacy in treatment. Interestingly, compared with other cancers, MIBC is one of the tumors with the highest mutation profiles, while cancers with high mutation burden, such as melanoma and non-small cell lung cancer, respond very well to ICIs [ 8 , 9 , 10 , 11 ]. In the past few decades, researchers had made promising progresses in the treatment of bladder cancer, including ICIs [ 12 ]. For example, a press in 2023 indicated that the combination of cisplatin/gemcitabine with nivolumab demonstrated statistically significant improvements in progression-free survival (PFS) and overall survival (OS) compared to using cisplatin/gemcitabine alone [ 13 ]. At present, the US Food and Drug Administration (FDA) has approved several ICIs for the treatment of cisplatin-ineligible patients and patients with advanced BLCA who progress despite cisplatin-based chemotherapy [ 14 ]. Despite it showed great prospects relative to past therapies, it must be recognized that only a subset of patients achieves long-term durable responses [ 15 ]. A major challenge in the ICIs therapy area is to investigate the mechanism of ICGs in BLCA and to identify patients that may respond to specific immunotherapies.

In the present study, we divided BLCA patients into three ICG clusters and built the ICG signature on the basis of the differentially expressed genes among different clusters to predict progression and outcome of BLCA. Besides, we discussed the correlation of ICG signature with the tumor immune microenvironment, and further investigated the potential mechanisms between ICGs and basic TIME characterizations. Here, our study identifies a new ICG signature to clarified the progress mechanism in bladder cancer and provides potential biomarkers and therapeutic targets.

Overview of genetic changes and expression variations of immune checkpoint genes in BLCA

Among the 412 samples in TCGA-BLCA dataset, 92 samples (about 22.33%) showed ICGs mutations, and KDR showed the highest frequency of mutations (Fig.  1 A). Additionally, waterfall diagram showed that missense mutation and nonsense mutation were the most common mutation types. Through the analysis of the frequency of the copy number variation (CNV) changes, we also found that most of CNV changes of ICGs were concentrated in the gain of copy number, and the gain of CD244, CD48, SLAMF1 and CD160 were the most obvious (Fig.  1 B). The CNV changes of the ICGs on the chromosome were shown in Fig.  1 C. In order to study the tumorigenic mechanism at the expression level, we further analyzed the expression levels of ICGs between normal and tumor samples. 30 ICGs were identified as genes with statistically differential expression finally (Fig.  1 D). Those findings revealed the pathogenesis of BLCA more comprehensively, and may provide guidance for medication guide of ICIs.

figure 1

Survey of genetic changes and expression variations of immune checkpoint genes in BLCA. ( A ) The landscape of mutation profiles of 68 ICGs in 412 bladder cancer patients from TCGA-BLCA cohort. ( B ) The CNV variation frequency of ICGs. red circle: amplified frequency; green circle: missing frequency. ( C ) The location of CNV alteration of ICGs on chromosomes. CNV, copy number variations. ( D ) The expression difference of 68 ICGs between normal and BLCA samples. *** p  < 0.001, ** p  < 0.01, * p  < 0.05

Tumor classification based on the ICGs

After merging the GEO and TCGA databases, we performed the survival analysis to clarify the prognostic implication of these ICGs in BLCA samples. The K-M analysis of all the prognosis related ICGs in the merged cohort was shown in Supplementary Table S1 . In addition, we analyzed the correlation network containing all ICGs of prognostic functions (Fig.  2 A). Based on the expression levels of 53 ICGs, we performed the consensus clustering analysis and divided all samples into three clusters to investigate the relationship between these ICGs and BLCA subtypes (Fig.  2 B). The OS of three subtypes was significantly different ( p  < 0.05). And the survival advantage of cluster C was higher than that of cluster B and A successively (Fig.  2 C). The correlation heatmap demonstrated the expression of ICGs and the clinical manifestations including age, gender, grade and TMN stage of these three different clusters (Fig.  2 D). The result showed that most ICGs expressed highly in cluster C and lowly in cluster B. Then we analyzed immune atlas of ICG clusters and found that activated immune cell infiltration, including the presence of dendritic cells (DCs), macrophages, natural killer cells (NKs), neutrophil, along with activated B, CD4 and CD8 T cells, was abundant in cluster C, which typically indicates significant survival benefits (Fig.  2 E). Finally, the principal component analysis indicated that patients were well divided into three clusters (Fig.  2 F).

figure 2

Tumor classification based on the ICGs. ( A ) The correlation network of all the prognosis related ICGs with correlations of absolute values greater than 0.2. Red indicates positive correlation and blue indicates negative correlation. ( B ) The consensus score matrix of all samples when k = 3 in merged cohorts (TCGA-BLCA, GSE13507 and GSE31684) based on the expression of ICGs. ( C ) OS curves for the three ICG clusters based on 670 patients with BLCA. ( D ) The heatmap of gene expression and clinical correlation among different clusters of BLCA. ( E ) Differential expression of immune cells among the BLCA ICG clusters. *** p  < 0.001, ** p  < 0.01, * p  < 0.05. ( F ) PCA analysis of the different ICG clusters based on the prognosis related ICGs

GSVA and functional enrichment analysis between ICG clusters

We performed GSVA to detect differential pathway activity of these three clusters and provides an intuitive and stable context for assessing biological activity (Fig.  3 A and C). The result showed cluster C was significantly enriched in enrichment pathways related to complete immune activation, including CYTOKINE_CYTOKINE_RECEPTOR_INTERACTION, T_CELL_RECEPTOR_SIGNALING_PATHWAY, B_CELL_RECEPTOR_SIGNALING_PATHWAY, CHEMOKINE_SIGNALING_PATHWAY, NOD_LIKE_RECEPTOR_SIGNALING_PATHWAY, NATURAL_KILLER_CELL_MEDIATED_CYTOTOXICITY and TOLL_LIKE_RECEPTOR_SIGNALING_PATHWAY (Fig.  3 B and C). Surprisingly, compared with cluster B, cluster A was significantly enriched in innate immune cell infiltration including CHEMOKINE_SIGNALING_PATHWAY, T_CELL_RECEPTOR_SIGNALING_PATHWAY, B_CELL_RECEPTOR_SIGNALING_PATHWAY and NATURAL_KILLER_CELL_MEDIATED_CYTOTOXICITY, while the prognosis of the patients in cluster A was significantly worse than that of patients in cluster B (Fig.  3 A). Thus, we suspected that this may be due to the aberrant activity of REGULATION_OF_ACTIN_CYTOSKELETON and ECM_RECEPTOR_INTERACTION signaling pathway.

figure 3

GSVA and Functional Enrichment Analysis Between ICG clusters. ( A - C ) The heatmap of GSVA enrichment analysis among different ICG clusters. Red indicates the active pathway, and blue indicates inhibition pathway. ( A : cluster A vs. cluster B ; B : cluster A vs. cluster C ; C : cluster B vs. cluster C ). ( D ) The Venn plot of intersection DEGs. ( E ) Bubble of GO enrichment analysis. ( F ) Bubble of the top 30 KEGG signaling pathways. BP: biological process; CC: cellular component; MF: molecular function; KEGG: Kyoto encyclopedia of genes and genomes

Subsequently, we determined DEGs among different subtypes and extracted 526 intersecting DEGs for subsequent analysis (Fig.  3 D). GO enrichment analysis and KEGG pathway analysis were then performed to further explore the differences in the functions and pathways of these intersecting DEGs. BPs were mainly enriched in T cell activation, negative regulation of immune system process, leukocyte cell-cell adhesion and regulation of T cell activation. CCs were mainly enriched in external side of plasma membrane, secretory granule membrane, endocytic vesicle and MHC protein complex. MFs were mainly enriched in receptor ligand activity, signaling receptor activator activity, chemokine activity, immune receptor activity and cytokine receptor binding (Fig.  3 E). KEGG were mainly enriched in cytokine − cytokine receptor interaction, phagosome, antigen processing and presentation, Th1 and Th2 cell differentiation and TNF signaling pathway (Fig.  3 F). The results indicated that the intersecting DEGs were clearly correlated with the immunomodulation functions, inflammatory cell chemotaxis and epithelial mesenchymal transition (EMT) related factors.

Tumor classification based on the intersecting DEGs

The Univariate Cox regression analysis was used to analyze the prognostic values of intersecting DEGs in the merged cohort, and a total of 127 genes were considered as genes associated with prognosis (supplementary Table S2 ). We then performed the unsupervised clustering analysis to verify the correlation between these prognosis related intersection DEGs and BLCA subtypes (Fig.  4 A). Based on the highest intragroup correlations and lowest intergroup correlations when k = 2, we classified all BLCA patients into two clusters, and we found that the prognosis of patients from cluster A was significantly better than that of the patients from cluster B (Fig.  4 B). The expression of prognosis related intersection DEGs and the clinical information including age, gender, grade, TNM stage were showed in a heatmap, and we found there were significant expression differences between two clusters and little differences in clinical features (Fig.  4 C). The analysis of ICGs different expression showed that the expression levels of most ICGs were significantly reduced in the cluster A, while expression of CD24 , CD96 , CEACAM1 , TNFRSF14 , TNFRSF25 and VTCN1 were increased significantly in cluster A (Fig.  4 D).

figure 4

Tumor classification based on the intersecting DEGs. ( A ) The consensus score matrix of all samples when k = 2 based on the expression of intersecting DEGs. ( B ) Survival curve for the two clusters. ( C ) Heatmap and the clinicopathologic characters of the two clusters classified by these intersecting DEGs. ( D ) Differential expression of ICGs among the intersecting DEGs clusters. *** p  < 0.001, ** p  < 0.01, * p  < 0.05

Establishment and validation of a ICG signature

The samples in the merged dataset were randomly assigned into training cohort and testing cohort. We performed the least absolute shrinkage and LASSO Cox regression analysis using 127 prognosis related genes in the training cohort to build the 9-gene risk signature (Fig.  5 A). The regression coefficients of the 9 signature genes were shown in Table  1 . The alluvial map was used to visualize the model construction and testing (Fig.  5 B). Furthermore, the risk score of the patients in ICG cluster A was higher than that in ICG cluster B and ICG cluster C in succession (Fig.  5 C), while the patients in genecluster B favored high-risk scores compared to those with in genecluster A (Fig.  5 D). It was obvious to note that increased risk scores were shown to correlate with poor prognosis. Wilcoxon test was applied to investigate the relationship between the expression of these ICGs and BLCA risk subtypes (Fig.  5 E).

figure 5

Establishment of a ICG signature. ( A ) LASSO Cox regression analysis. ( B ) Alluvial diagram showing the changes of ICG clusters, intersecting DEGs clusters, the signature and fustat. ( C ) The ICG signature risk scores in different ICG clusters. ( D ) The ICG signature risk scores in different intersecting DEGs clusters. ( E ) Differential expression of ICGs between low- and high-risk subgroups. *** p  < 0.001, ** p  < 0.01, * p  < 0.05

We divided patients in total, training and testing cohorts into high and low risk groups with median risk score of training cohort. We found that the low group had a clear survival advantage over the high group in total (Fig.  6 A), training (Fig.  6 B) and testing cohorts (Fig.  6 C). The subsequent ROC analysis demonstrated that this ICG signature could reliably evaluate the efficiency of prognosis prediction, and we found that AUC in training cohort was 0.777 for 1-year, 0.709 for 2-year, and 0.706 for 3-year survival (Fig.  6 E). In addition, the signature was respectively validated in the total and testing cohorts (Fig.  6 D and F). The risk scatterplot and heatmap revealed the difference of survival status distribution and model gene expression between low-risk and high‐risk groups in total, training, and testing cohorts (Fig.  6 G and I). Moreover, we observed consistent results in the GSE13507 and GSE31684 dataset (Supplementary Fig S1 ). The 9 ICGs‐related genes forming the signature exhibited distinct expression diverse expression patterns, including five relatively highly expressed genes ( TNFAIP6 , CPVL , SLFN11 , KRT23 and SPRR3 ) and four relatively lowly expressed genes ( CD3D , GBP4 , PLEKHA6 and PPP1R3C ), consistent with the risk coefficient.

figure 6

Validation of the ICG signature. ( A - C ) The KM analysis of the overall survival of the high-risk and low-risk groups in total ( A ), training ( B ) and testing cohorts ( C ). ( D - F ) The ROC analysis to evaluate the predictive efficiency of the ICG signature in total ( D ), training ( E ) and testing cohorts ( F ). ( G - I ) Distribution of the risk scores, survival status, and expression of the nine risk genes in total ( G ), training ( H ) and testing cohorts ( I )

Subsequently, we conducted an in-depth analysis of differentially expressed genes between high-risk and low-risk patient groups, uncovering significant biological disparities between the two groups (Supplementary Fig S2 A and S2 B). Our GO analysis identified several biological processes and cellular compartments where the DEGs are enriched, including collagen fibril organization, extracellular matrix organization, collagen-containing extracellular matrix (Supplementary Fig S2C). The KEGG enrichment analysis identified significant enrichment of pathways related to cytoskeleton organization in muscle cells, ECM-receptor interaction, IL-17 signaling, and protein digestion and absorption in the DEGs (Supplementary Fig S2 D). These findings suggest that the dysregulation of these pathways may contribute to the aggressive behavior of bladder cancer, including increased cell motility, altered ECM-cell interactions, immune evasion, and altered nutrient utilization. Subsequently, we constructed a PPI network of the identified DEGs to identify potential hubs and interactors (Supplementary Fig S2 E). These proteins may play crucial roles in bladder cancer development and could serve as potential therapeutic targets or drug discovery leads.

Evaluation of the ICG signature As shown in Fig.  7 A, the risk scores and all significant factors for prognosis (including age, gender, grade, TNM stage) were integrated into a novel prognostic nomogram to provide a reliable quantitative tool for predicting the prognosis of BLCA patients. The nomogram could effectively predict the 1, 3 and 5 year survival rates of BLCA patients.

figure 7

Molecular characteristics and clinical utility of the ICG signature. ( A ) Nomograph for predicting the overall survival of BLCA patients at 1, 3, and 5 years. ( B ) Correlation heatmap of the levels of infiltration of the immune cells with nine risk genes. ( C ) Distribution of immune scores, stromal scores and ESTIMATE scores in low- and high-risk subgroups. ( D - E ) Differences in the mutational status within the different subgroups. ( F ) Expression difference of the three hot immune checkpoint genes (PD-L1, PD-1, and CTLA4) in different subgroups. ( G ) Box plots of differential chemosensitivity between two subgroups

A comparative analysis between the high- and low-risk groups stratified by our ICG signature revealed notable differences in tumor immune dysfunction and exclusion (TIDE), microsatellite instability (MSI), dysfunction, and exclusion scores. Specifically, the low-risk group exhibited higher TIDE and T-cell dysfunction scores, as well as a lower T-cell exclusion score, indicating a significant variation in the responsiveness to immunotherapy between the two risk groups (Supplementary Fig.  3 A- 3  C). However, there was no discernible difference in the MSI score between the two subgroups (Supplementary Fig. 3D). Subsequently, ROC curve analysis was employed to assess the prognostic superiority of our ICG signature model over the existing TIDE and 18-gene T-cell inflammation signature (TIS) models. The TIDE model evaluates the degree of immune cell dysfunction and exclusion within the tumor microenvironment, while the 18-gene TIS model delves into the expression of a panel of immune-related genes to predict patient prognosis [ 16 ]. Our model demonstrated an AUC value that exceeded those of both the TIDE and 18-gene TIS models (Supplementary Fig. 3E), suggesting that the ICG signature holds the potential to enhance the accuracy of risk stratification and prognosis prediction for bladder cancer patients when compared to the existing methods.

Identification of the immune characteristics and tumor mutational burden (TMB)

Correlation analysis of 9 model genes and invasive immune cell types was used to study the potential impact of ICG signature on BLCA immune microenvironment (Fig.  7 B). Further investigation on the correlation between infiltrating immunocytes and risk scores revealed that risk scores had positive correlations with macrophages M0, macrophages M2, neutrophils, dendritic cells activated, T cells CD4 memory resting and mast cells activated, and risk scores had negative correlations with T cells CD8, T cells regulatory (Tregs), T cells gamma delta, Macrophages M1 and activated T cells CD4 memory (supplementary Fig S4 ). To quantify differences of tumor microenvironment (TME) between high and low-risk groups, ESTIMATE scores were calculated and demonstrated that high-risk group had significantly higher ESTIMATE, stromal, and immune scores compared to low-risk group (Fig.  7 C).

Afterwards, we compared the differences of TMB between different risk subgroups. We found that the frequency of tumor mutation in high-risk group (95.07%) was higher than that in low-risk group (92.57%), and the most common types of mutation were missense mutation and nonsense mutation (Fig.  7 D and E). Next, we determined the top 20 genes with the highest mutation rate in the risk subgroups and found that TP53 was the common mutation gene, with the mutation rates of over 40% in both risk groups.

The role of ICG signature in immunotherapy and chemotherapy

Previous studies have shown that anti PD1/PD-L1 immunotherapy is long-term effective for patients with high TMB status [ 17 ], and only a handful of patients benefit from ICI therapies. Therefore, we further explored the differential expression of most common ICIs, and found that three hot immune checkpoint genes (PD-L1, PD-1, and CTLA4) in the TCGA-BLCA cohort were up regulated in low-risk group, indicating that a better response to immunotherapy (Fig.  7 F). As previously mentioned, combination chemotherapy based on cisplatin is still the first-line treatment standard for locally advanced or metastatic urothelial carcinoma [ 15 ], and methotrexate, docetaxel and paclitaxel were also shown to have significant and curative effect in bladder cancer [ 18 , 19 , 20 ]. Thus, we investigated the role of the risk model in predicting the efficacy of chemotherapy in BLCA patients. We found that high risk patients were inclined to possess lower half inhibition concentration (IC50) of chemotherapy drugs (such as cisplatin docetaxel and paclitaxel), while the sensitivity of the low-risk group to methotrexate was higher than that of the high-risk group (all p  < 0.05, Fig.  7 G). These results suggested that this ICG signature may help in selecting chemotherapeutic drugs and judging the therapeutic effects.

Furthermore, we profiled T cells using single-cell RNA to assess the T cell composition of the tumor environment. Series GSE149652 was downloaded from GEO database and composed of human bladder tumors and non-malignant tissue of 2 standard-of-care-untreated patients (“untreated”), 1 chemotherapy-treated patient (gemcitabine + carboplatin, “chemo”), and 4 anti-PD-L1-treated patients (“anti-PD-L1”). Unsupervised clustering of immune cell infiltration data revealed the presence of T cell components, including CD4 T, CD8 T, Tregs, and NK cells (Fig.  8 A). Next, we assessed the T cell-inflamed and checkpoint gene differences in different treatment groups and found that the T cell-inflamed and checkpoint gene expressions in anti-PD-L1 group were generally higher than those in the other two groups (Fig.  8 B).

figure 8

T cell infiltration pattern. ( A ) SNE plot of total sample cells and T cell infiltration profiles of all samples. ( B ) T cell-inflamed and checkpoint gene differences in different treatment groups. ( C and D ) To further evaluate the importance of these genes for the prognostic contribution of BLCA patients, we performed a random forest analysis of these genes based on risk scores and patient survival status. ( E - F ) The expression difference of KRT23 in different T cell types

To further evaluate the importance of these model genes for the prognostic contribution of BLCA patients, we performed a random forest analysis of these genes based on risk scores and patient survival status and found that the mean decrease Gini of KRT23 was higher in both analyses (Fig.  8 C and D). Immune infiltration analysis revealed that KRT23 expression was negatively correlated with the infiltration of CD8 + T and CD4 + cells in bladder cancer, while positively correlated with the infiltration of dendritic cells and neutrophils, indicating a complex role for KRT23 in shaping the immune microenvironment of bladder cancer (Supplementary Fig S5). Additionally, we mainly analyzed the KRT23 expression in different T cell types and found KRT23 was generally low expressed in T cells, which was similar to the results of data merged by TCGA and GEO database (Fig.  8 E and F).

Knockdown of KRT23 inhibited BLCA Cell proliferation, migration and invasion, and promoted apoptosis

The expression of KRT23 increased in the normal, low grade and high grade samples in the HPA database progressively (Fig.  9 A). Next, we performed RT-qPCR in 4 cell lines, consisting of 3 BLCA cell lines and 1 normal bladder epithelium cell line, and found that KRT23 has a strong expression in the bladder cancer cells (Fig.  9 B). We selected T24 and J82 cells to further verify the importance of KRT23 .

figure 9

KRT23 Knockdown. ( A ) Immunohistochemical analysis of KRT23 in normal, low grade and high grade samples. ( B ) The gene expression levels of KRT23 were evaluated by real-time qPCR. ( C ) The knockdown of KRT23 by siRNA was detected by RT-PCR. ( D ) Cell colony formation assay. ( E ) CCK-8 assay. ( F ) Wound scratch assay. ( G ) Transwell Assay. ( H ) Flow cytometric dot plots. *** p  < 0.01, ** p  < 0.01, * p  < 0.05

To further explore the biological function of KRT23 in BLCA cells, the expression of KRT23 was knocked down in T24 and J82 cells using two different siRNAs. The efficiency of transfection of KRT23 siRNA was verified in mRNA levels (Fig.  9 C). First, we examined the colony formation and proliferative capacity of BLCA cells after KRT23 knockdown. Inhibition of KRT23 expression markedly suppressed the colony formation and cell proliferation (Fig.  9 D and E). Subsequently, we performed the wound healing assay scratch assay and transwell assay, and the results showed that KRT23 knockdown impaired the migration and invasion ability of the T24 and J82 cells (Fig.  9 F and G). The apoptosis rate in the KRT23 knockdown groups of T24 and J82 cells was significantly higher than those in the si-NC groups (Fig.  9 H). To evaluate the correlation between KRT23 and clinical outcome, we detected KRT23 expression in tumor and adjacent tissues of 6 BLCA patients using western blotting, and the results showed that KRT23 was highly expressed in tumor tissues (Fig.  10 A). Those results indicated that KRT23 knockdown inhibited proliferation and promotes apoptosis, and KRT23 plays an important role in the process of promoting tumorigenesis.

figure 10

Knockdown of KRT23 inhibited tumor proliferation in vivo. ( A ) Western blotting analysis was conducted to detect the expression of KRT23 in BLCA tissues and adjacent normal tissues ( n  = 6). ( B ) The tumor volumes were measured at the indicated time points. ( C ) The representative images of tumor. Tumor weight was measured after isolation from the mice. ( D ) IHC of PCNA and Ki67 in the tumors. *** p  < 0.01, ** p  < 0.01, * p  < 0.05. Original blots are presented in supplementary Fig S6

Knockdown of KRT23 inhibited tumor proliferation in vivo

Subsequently, we explored the impact of OGT on tumor formation in mice via a xenograft model. Control (shCtrl) or KRT23 knockdown (shKRT23) T24 cells were injected into the flanks of male nude mice. Compared to the control group, the tumors in KRT23 knockdown were significantly small and light in weight (Fig.  10 B and C). At the end of this experiment, the mice were killed and their tumors were isolated. Immunohistochemistry of tumors showed that PCNA and ki67 were decreased due to the decreased expression of KRT23 (Fig.  10 D), which indicated the inhibitory effect of KRT23 knockdown on tumor proliferation and was consistent with the findings in vitro.

Despite significant advances in monitoring opportunities and unique therapeutic options, the survival of BLCA patients has not significantly changed in the past 30 years [ 21 ]. In view of the high frequency mutations identified by next-generation sequencing [ 22 , 23 ], different biomarkers and therapies will be required to improve patients’ outcome in different clinical application. The effect of perioperative cisplatin-based combination chemotherapy on the survival rate of BLCA patients is still limited [ 24 ]. Currently, with the deepening of the research on immune checkpoint mechanism, immune-checkpoint inhibitors (CPIs) had shown great potential in the treatment of multiple types of malignancies and approved by FDA for first-line metastatic therapy in patients with cis-ineligible and PD-L1positive tumors (i.e., atezolizumab, pembrolizumab) and second-line therapies following failure of platinum-based chemotherapy(i.e., atezolizumab, pembrolizumab, nivolumab, avelumab and durvalumab) [ 24 , 25 , 26 , 27 , 28 ].

Based on reliable evidence from the background of metastatic urothelial carcinoma, CPIs are well tolerated and effective, and are expected to change the foundations of MIBC treatment in the near future [ 29 , 30 ]. Therefore, to discover the ICGs molecular mechanisms underlying the development and progression of BLCA and to improve the prognosis and survival rate of BLCA patients, developing highly accurate, cost-effective, definitive test for diagnosis and surveillance is an urgent need.

This study systematically compared the altered expressions of ICGs between normal and BLCA samples, and analyzed the prognostic value of ICGs in BLCA. A total of 37 of 53 ICGs in merged cohort were associated with the OS of BLCA as shown by K-M survival analysis ( p  < 0.05). Based on the expression of ICGs, the consensus clustering analysis was performed to classify BLCA patients into three clusters. The prognosis of patients in cluster C was significantly better than that in clusters A and B. Stratified analysis of BLCA infiltrated immunocytes revealed innate immune cell infiltration, including the presence of DCs, macrophages, NKs, neutrophil, along with activated B, CD 4 and CD 8 T cells, was abundant in cluster C. It is known that resident innate immune cells provide anti-tumor activity by detecting tumor associated antigens (TAAs) and damage associated molecular patterns (DAMP), which is of vital importance in cancer immune editing [ 31 ]. DCs are the most important antigen-presenting cells, and can process TAA and DAMP and present them to cytotoxic T lymphocytes (CTLs), causing activation and subsequent tumor infiltration [ 32 ]. NK cells can regulate the immune surveillance and clearance of malignant cells, and their presence in the tumor microenvironment is related to better survival and lower progression rates of several solid tumors [ 31 , 33 ]. Besides, an increasing body of evidence suggests that the density of infiltrating T cells and B cells have a positive association with longer OS or disease-free survival (DFS) [ 34 , 35 , 36 ]. Consistently, cluster C was significantly enriched in immune mechanism related pathways. Accordingly, we suspected that the infiltration of immune cells and the activation of immune pathways are important reasons for cluster C to gain survival advantage. To investigate the molecular differences among different clusters, we further identified the DEGs between the different clusters and identified 526 overlapping DEGs. Based on the results of GO and KEGG analyses, we’re convinced that ICGs could increase the activity of the immune system to promote immune-mediated elimination of tumor cells.

Existing literature mainly focuses on the study of single immune checkpoint inhibitors, but there is a lack of research on the gene expression profiles of multiple immune checkpoints. To comprehensively and systematically quantify the pattern of genetic modification of ICGs in individual tumors, we performed the LASSO and Cox analysis of the ICGs genes to establish an independent prognostic model which was well validated in the total and testing cohorts. The ICG signature was further identified as a stable and universally applicable prognostic assessment instrument for BLCA by the ROC curve analysis. Base on the ICG signature and other significant factors for prognosis, we structured nomogram to predict the 1, 3, and 5 year survival rates of BLCA patients.

In our signature, we found 5 of the 9 genes were inflammation related gene or antigen presenting related genes, functioning as significant components in inflammatory process of tumor initiation and progression. Because of the significant and strong association with the infiltrating immune cells, two genes ( CD3D and GBP4 ) were paid special attention. Stratified analysis of BLCA immune microenvironment revealed a significant positive correlation between CD3D and GBP4 and antitumor immune cells (CD4 T cells, CD8 cells and macrophages M1) [ 36 , 37 ], which was consistent with the risk coefficient of these two genes. The delta subunit of the CD3 complex encoded by CD3D gene is involved in T-cell development and signal transduction, which is essential for the initiation of antigen-specific T cell responses to pathogens, autoantigens and tumors [ 38 ]. CD3D defects could result in severe combined immunodeficiency autosomal recessive T-cell-negative/B-cell-positive/NK-cell-positive [ 39 ]. Besides, the expression of CD3D was consistently associated with both RFS and OS of breast cancer (BC), and was also found to be related to the response to neoadjuvant chemotherapy especially in estrogen receptor negative breast cancer, thus potentially identifying individuals responding to chemotherapy [ 40 , 41 ]. Five members ( GBP1 , GBP2 , GBP3 , GBP4 and GBP5 ) of the Guanylate-binding proteins (GBPs) family are the most abundant cellular proteins in response to IFN-γ, suggesting that GBPs may be important components of the innate immunity [ 42 , 43 ]. Increasing evidence suggests that TMB serves as a clinically valuable biomarker for identifying patients who may benefit from immune treatment [ 8 ]. In this study, we found that the frequency of tumor mutation in high-risk group was higher than that in low-risk group, and TP53 was the most common mutation gene. The wild-type TP53 protein plays a crucial role in cell apoptosis and cell cycle regulation following DNA damage. Cells with TP53 mutations can evade apoptosis after DNA damage and transform into cancer cells. Additionally, p53 loss or mutation in cancers can disrupt myeloid and T cell function, enabling immune evasion and advancing cancer progression [ 44 ]. The accumulation of mutant TP53 protein is considered a highly specific marker for malignant tumors [ 45 ]. Therefore, we speculate that the shorter OS and “cold” tumor microenvironment in high-risk BLCA patients may partly be attributed to the heightened TP53 mutations, which exert a specific inhibitory effect on the cancer-associated immune system. However, the mechanisms by which TP53 mutations impact the immune phenotype and prognosis of BLCA require further investigation.

Further investigation on the correlation between infiltrating immunocytes and risk scores revealed that risk scores had positive correlations with macrophages M2, and risk scores had negative correlations with Macrophages M1 and T cells CD8. The infiltrating macrophages in tumors are referred to as tumor-associated macrophages, with their activated forms primarily including two types: M1-type and M2-type macrophages. M1-type macrophages could enhance T cell effector functions through releasing pro-inflammatory signals and presenting antigens. Conversely, M2 macrophages possess immunosuppressive traits, dampening effector T cell proliferation. Consequently, the polarization of M1 macrophages towards the M2 phenotype within the tumor microenvironment plays a critical role in fostering tumor immunosuppression and enabling evasion from immune surveillance, thereby indicating a bleak outlook for cancer therapy [ 46 ]. Together, the above results indicate that patients at high risk often exhibit an immunosuppressive “cold” tumor microenvironment, elucidating their resistance to immune checkpoint therapy.

Given that high tumor mutation burden has been recognized as a predictive biomarker of immune checkpoint blocking response [ 47 ], we explored whether the developed ICG signature could stratify patients according to the sensitivity of patients to ICIs. Our findings showed that three hot immune checkpoint genes (PD-L1, PD-1, and CTLA4) were significantly downregulated in high-risk group, indicating that the signature could provide new ideas for drug design of immune checkpoints. Up to now, cisplatin-based combination chemotherapy regimens, such as methotrexate, vinblastine, doxorubicin, and cisplatin (MVAC), as well as gemcitabine and cisplatin/carboplatin (GC), remain the first-line treatment standard for locally advanced or metastatic urothelial carcinoma, but the optimal chemotherapy regimen has not been definitively established. In this scenario, immunotherapy utilizing checkpoint inhibitors is the preferred second-line option, but paclitaxel or docetaxel can be utilized as second- or later-line chemotherapy and have demonstrated significant and potentially curative effects in bladder cancer [ 19 , 20 ]. In cases where patients are ineligible for immunotherapy or have received checkpoint inhibitors, docetaxel may still be considered as salvage therapy. Several Phase II trials have confirmed the effectiveness of docetaxel in treating metastatic bladder cancer [ 48 ]. Additionally, paclitaxel has shown activity as a standalone agent in urothelial cancer, achieving a 42% response rate in advanced and/or metastatic bladder cancer according to a Phase II trial [ 49 ]. Our study revealed that the ICG signature we developed could directly predict the immunotherapy and chemotherapy response, and facilitate the selection of therapy medications and assessment of treatment efficacy, which may guide more precision therapy for BLCA.

KRT23 was identified as the most critical gene by random forest analysis in this signature. As a newly discovered member of the keratin family, KRT23 belongs to the acidic type I keratins [ 50 ]. Many studies showed that KRT23 expression in tumors has been associated with increased aggressiveness and decreased patient survival in many kinds of cancer, including pancreatic cancer, colorectal carcinoma, breast cancer and hepatocellular carcinoma [ 51 , 52 ]. In ovarian cancer, KRT23 upregulation promoted migration and invasion of cancer cells via EMT by regulating the TGF-β/Smad signaling pathway. Our results demonstrated that KRT23 knockdown impaired proliferation, migration and invasion, and induced the apoptosis of BLCA cells. Previous research has found that KRT23 knockdown increased the secretion of CD8 + T cell-related chemokines (CCL5, CXCL9, and CXCL10), and subsequently promoting the recruitment of CD8 + T cells [ 53 ]. Consistent with this, we observed an inverse correlation between the expression level of KRT23 and the abundance of T cell infiltration. Tumors are typically classified into two categories based on T cell infiltration within the TME: non-inflamed tumors (lacking T cell infiltration) and inflamed tumors (with T cell infiltration) [ 54 ]. Immunotherapy, including immune checkpoint inhibitors (ICIs) such as anti-PD-1, anti-PD-L1 and anti-CTLA-4 therapies, is generally ineffective in non-inflamed tumors due to the absence of T cell immunity. Consequently, inflamed tumors generally respond better to immunotherapy, including ICIs [ 55 , 56 ]. In light of these discoveries, KRT23 emerges as a promising biomarker for predicting immune cell infiltration in tumors and developing novel immunotherapy strategies. However, further biological experiments are needed to clarify the regulatory mechanism and to promote the signature as new anticancer drug targets.

Taken together, this study systematically and comprehensively analyzed the expression profile of immune checkpoint genes in BLCA and their correlation with tumor mutation. In addition, we established the ICG signature to investigate the differences in immune checkpoint expression and tumor immune microenvironment, which will help risk stratification and accelerate precision medicine. Finally, we identified KRT23 as the most critical model gene and highlighted it as a potential target to enhance immunotherapy against BLCA.

Materials and methods

Data source and preprocessing.

Overall RNA sequencing data and clinical information of BLCA patients and normal human bladder samples were obtained from the TCGA data portal ( https://tcga-data.nci.nih.gov/tcga/ ) and GEO database ( https://www.ncbi.nlm.nih.gov/geo/ , ID: GSE13507 and GSE31684). The patient characteristics of the collected patients in TCGA and GEO database were shown in Supplementary Table S3 . Processed single-cell RNA sequencing data came from tumor immune single-cell hub 2 (TISCH2) database ( http://tisch.comp-genomics.org ) based on GSE149652 data from the GEO database [ 57 ]. Moreover, somatic mutation data are downloaded from TCGA database and presented with the mutation landscape by “maftools” package. The Wilcoxon test was applied to identify differentially expressed ICGs. Then, we used univariate Cox regression analysis and Kaplan-Meier survival estimates to extract ICGs associated with prognosis using the R packages ‘survival’ and ‘survminer’ (p-value < 0.05). The correlation of ICGs were visualized by the “igraph” package in the R software ( https://www.r-project.org/ ).

ICG clusters

We screened and identified 68 immune checkpoint genes with the key words of immune checkpoint, immune checkpoint inhibitors, immune checkpoint blockade, and checkpoint blockade in the Pubmed database ( https://pubmed.ncbi.nlm.nih.gov/ ). All of the ICGs were shown in Supplementary Table S4 . We merged BLCA samples of TCGA, GSE13507 and GSE31684 datasets into one train ( n  = 664) to analyze the prognostic value of the ICGs for BLCA. After merging the GEO and TCGA databases, we found that the remaining 53 ICGs were expressed in different datasets. According to 53 ICGs expression level, we performed unsupervised cluster analysis by R package “Consensus Cluster Plus” to explore the underlying molecular subtype between the BLCA patients [ 58 ]. The maximum cluster count (k) was set as 9, and the optimal cluster count value was chosen for further study. Kaplan Meier analysis was used for survival analysis and the Log rank analysis for comparison to evaluate overall survival (OS) differences with ‘survival’ package in R. Principal component analysis (PCA) was displayed to visualize the similarities and differences among grouped clusters. We followed the methods of Ninghong Song1 et al. 2022 [ 59 ].

Gene set variation analysis (GSVA)

GSVA was used to assess changes in pathways and biological process movement among different clusters. We downloaded the “c2.cp.kegg.v7.4.symbols” gene set from the molecular signatures database for GSVA. The adjusted p value less than 0.05 is considered statistically significant.

Distinguish the differentially expressed genes (DEGs) related to ICGs

The differentially expressed genes among different clusters were analyzed with “limma” package, and the venn diagram of the overlapped genes between each cluster was draw by “VennDiagram” package. The significance criteria for selecting differentially expressed genes related to ICGs was set as an adjusted p  < 0.05 and the value of |logFC| > 1. To further explore the biological processes and signal pathways of the intersection genes, Gene Ontology (GO) functions of the overlapping genes and enhanced the Kyoto Encyclopedia of Genes and Genomes (KEGG) pathway were analyzed with the “clusterProfiler” package.

Establishment and validation of the prognostic signature

The relationship between the intersection DEGs and survival was explored by the univariate Cox analysis. The cut-off p -value was set to 0.05, and 127 intersection genes related to survival were screened for further study. All BLCA patients ( n  = 664) were randomly divided to a training cohort ( n  = 332) (50% for identifying the prognostic model) and a testing cohort ( n  = 332) (50% for validating the prognostic model). The LASSO Cox regression model was utilized to minimize overfitting between survival-related genes and to obtain a more concise prognostic genes combination by “glmnet” package. Finally, we construct the 9-gene risk signature based on multivariate Cox regression, and calculated the risk score by multiplying the expression level of each gene by the corresponding regression coefficient. The BLCA samples were assigned into high- and low-risk groups according to the median risk score. The area under the ROC curve (AUC value) obtained from the R package “timeROC” was used to evaluate the diagnostic efficacy of prognostic model. The waterfall map of high- and low-risk group mutation landscape was presented by maftools function. The immunohistochemistry (IHC) staining images of risk genes in normal and BLCA tissues using the same antibodies were analyzed and obtained from the Human Protein Atlas (HPA) database ( http://www.proteinatlas.org/ ).

Assessment of tumor immune microenvironment

CIBERSORT was applied to evaluate the immunocyte infiltration levels of BLCA, and the ESTIMATE algorithm was used to evaluate the immune scores and the stromal scores. We performed correlation analysis on the ICG signature to further reveal the connection with immune cells. In addition, the most common immune checkpoint genes, such as PD-1, PD-L1 and CTLA4, were extracted and evaluated the relevance with ICG signature in TCGA-BLCA dataset.

Drug sensitivity

Using “pRRophetic” package in R, we estimated the chemotherapeutic response determined of the common anticancer drugs by the half-maximal inhibitory concentration (IC50) and compared the difference of chemosensitivity between the high- and the low-risk group.

Cell culture, RT-PCR and siRNA transfection

The immortalized cells of human bladder epithelium (SV-HUC-1) and human BLCA cell line (T24, UMUC3 and J82) were cultured in Ham’s F-12 K (Gibco/BRL, Grand Island, NY), RPMI-1640 medium (HyClone, Logan, UT, USA) and MEM (Gibco/BRL, Grand Island, NY) supplemented with complete medium (10% fetal bovine serum) at 37 °C and 5% CO2. Total RNA was isolated using TRIzol reagent (Invitrogen, Frederick, MD, USA), and cDNA was synthesized using standard techniques. Quantitative RT-PCR analyses were performed using SYBR Green Fast qPCR Mix (ABclonal, RK21203, Wuhan, China) on Prism ® 7500 (Applied Biosystems, California, USA). The KRT23 primers were 5′- CCATGCAGAATCTCAACGAC.

-3′ (sense) and 5′- GGTGTGTGATGTTTTCCTCA-3′ (antisense). The GAPDH primers were 5′- GATGGAGGAGGCTCAGCA − 3′ (sense) and 5′- CTCAGCCAATGGGACCTG − 3′ (antisense).

The sequences of KRT23-target-specifc-siRNA were as follows: siRNA1: 5′-AUGAGAAUGAGCUCUUUCCUC-3′(sense), 5′-GGAAAGAGCUCAUUCUCAUGA-3′(antisense); siRNA2:5′-GGAGGAUAUGAGACAAGAAUA-3′(sense), 5′-UUCUUGUCUCAUAUCCUCCAG-3′(antisense). The shRNA expression vector targeting KRT23 was synthesized based on the sequence of siRNA2. The INTERFERin (Polyplus, Illkirch-Graffenstaden, France) was used to transfect siRNA and vector into cells according to the manufacturer’s instructions.

Proliferation studies

2000 cells per well of T24 and J82 cell lines were seeded in 96-well plates after KRT23 siRNA transfection. The cell viability was determined at 12 h, 24 h, 48 h, 72 h and 96 h. T24 and J82 cell suspension with logarithmic growth phase was inoculated with 1000 cells/well in a 6-well plate. After 2 weeks, the cells were fixed with 4% paraformaldehyde for 20 min and stained with 0.1% crystal violet for 20 min.

Wound scratch assay and transwell assay

After transfected with KRT23 siRNA, the 200 µL eppen-dorf tip was used to scratch the cell plate. The complete medium was then replaced with serum-free medium, and cell migration was observed at 0 h and 48 h with an inverted microscope.

Migration and invasion of T24 and J82 cells was analyzed through the Transwell assay. 3 × 10 4 cells in medium without serum were seeded in the upper chamber of the Transwell apparatus without/with Matrigel (ABW, 0827045, Xiamen, China). Then 500 µL medium with 10% fetal bovine serum (FBS) was added to the lower chamber. The membrane of chamber was fixed for 30 min and stained with 0.1% crystal violet after 24 h.

Apoptosis assay

Apoptosis of T24 and J82 cells were detected using the Annexin V-FITC apoptosis detection kits (Elabscience, E-CK-A211, Wuhan, China). 1 × 10 5 cells in 500 µL1× binding buffer were labeled with Annexin V-FITC (5 µL) and propidium iodide (PI) (5 µL) for 15 min at room temperature in the dark. Specimens were analyzed with a Accuri C6 Plus flow cytometer within 1 h of labeling.

Western blotting

Western blotting was performed as previously studies described [ 60 ]. The following antibodies were used: anti-KRT23 (Abcam, ab156569, 1:1000 dilution) and anti-GAPDH (ABclonal, a19056, 1:50000 dilution).

Tumor tissue preparation

we collected six fresh bladder cancer samples and their paired adjacent normal samples from BLCA patients who underwent radical cystectomy at Beijing Chaoyang Hospital Affiliated Capital Medical University, without any preoperative treatment. The study received approval from the Medical Ethical Committees of the Beijing Chaoyang Hospital Affiliated Capital Medical University. All patients were informed about this study.

Tumor xenograft assay and immunohistochemistry staining

Six-week-old female BALB/c nude mice (Vital River Laboratories, China) were randomly divided into two groups ( n  = 4 per group). Next, 1 × 10 7 KRT23 knockdown (shKRT23 group) and negative control (shCtrl group) T24 cells were subcutaneously injected into the right flank of two groups of mice. All animals were deeply anesthetized before euthanasia to ensure they were unconscious and did not experience pain. All animals were deeply anesthetized before euthanasia to ensure they were unconscious and did not experience pain. Isoflurane was used as the anesthetic, administered through inhalation by placing the animals in an induction chamber and exposing them to 4–5% isoflurane in oxygen for 2–3 min until deep anesthesia was achieved. After confirming deep anesthesia, euthanasia was performed using cervical dislocation, a method that is quick and ensures a humane death. All experimental procedures were approved by the Animal Ethics Committee of Beijing Chaoyang Hospital, Capital Medical University.

IHC staining for PCNA (Boster, BM0104, 1:200 dilution) and ki67 (Abcam, ab16667, 1:500 dilution) was conducted following the manufacturer’s instructions as described in previous study [ 61 ].

Statistical analysis

The Student’s t test was utilized for statistical comparison of paired data, while the ANOVA test for comparison of more than two groups and Pearson’s chi-square tests for comparison of categorical variables. Logarithmic rank test was used to determine the significance of differences in survival curves. Statistical significance was set at p  < 0.05.

Data availability

The datasets analyzed during the current study are available in the TCGA data portal ( https://tcga-data.nci.nih.gov/tcga/ ), GEO database ( http://www.ncbi.nlm.nih.gov/geo , ID: GSE13507 and GSE31684), HPA database ( http://www.proteinatlas.org/ ) and TISCH2 database ( http://tisch.comp-genomics.org/home/ ).

Abbreviations

Bladder cancer

  • Immune checkpoint inhibitors

Immune checkpoint genes

Non-muscle-invasive bladder cancer

Muscular invasive bladder cancer

Food and Drug Administration

Tumor immune microenvironment

Principal component analysis

Gene set variation analysis

Differentially expressed genes

Kyoto Encyclopedia of Genes and Genomes

Gene Ontology

Half-maximal inhibitory concentration

Copy number variation

Guanylate-binding proteins

Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68:394–424.

Article   PubMed   Google Scholar  

Teramoto Y, Jiang G, Goto T, Mizushima T, Nagata Y, Netto GJ, Miyamoto H. Androgen receptor signaling induces Cisplatin Resistance via Down-regulating GULP1 expression in bladder Cancer. Int J Mol Sci. 2021; 22.

Zhang S, Liu Y, Liu Z, Zhang C, Cao H, Ye Y, Wang S, Zhang Y, Xiao S, Yang P, Li J, Bai Z. Transcriptome profiling of a multiple recurrent muscle-invasive urothelial carcinoma of the bladder by deep sequencing. PLoS ONE. 2014;9:e91466.

Article   PubMed   PubMed Central   Google Scholar  

Zhao J, Zhou L, Pan Y, Chen L. A systematic review and meta-analysis of radical cystectomy in the treatment of muscular invasive bladder cancer (MIBC). Transl Androl Urol. 2021;10:3476–85.

Powles T, Bellmunt J, Comperat E, De Santis M, Huddart R, Loriot Y, Necchi A, Valderrama BP, Ravaud A, Shariat SF, van der Szabados B, Gillessen S, et al. Bladder cancer: ESMO Clinical Practice Guideline for diagnosis, treatment and follow-up. Ann Oncol. 2022;33:244–58.

Article   CAS   PubMed   Google Scholar  

Jain P, Kathuria H, Momin M. Clinical therapies and nano drug delivery systems for urinary bladder cancer. Pharmacol Ther. 2021;226:107871.

Sternberg CN, Skoneczna I, Kerst JM, Albers P, Fossa SD, Agerbaek M, Dumez H, de Santis M, Theodore C, Leahy MG, Chester JD, Verbaeys A, Daugaard G, et al. Immediate versus deferred chemotherapy after radical cystectomy in patients with pT3-pT4 or N + M0 urothelial carcinoma of the bladder (EORTC 30994): an intergroup, open-label, randomised phase 3 trial. Lancet Oncol. 2015;16:76–86.

Samstein RM, Lee CH, Shoushtari AN, Hellmann MD, Shen R, Janjigian YY, Barron DA, Zehir A, Jordan EJ, Omuro A, Kaley TJ, Kendall SM, Motzer RJ, et al. Tumor mutational load predicts survival after immunotherapy across multiple cancer types. Nat Genet. 2019;51:202–6.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Goodman AM, Kato S, Bazhenova L, Patel SP, Frampton GM, Miller V, Stephens PJ, Daniels GA, Kurzrock R. Tumor Mutational Burden as an independent predictor of response to Immunotherapy in Diverse Cancers. Mol Cancer Ther. 2017;16:2598–608.

Hodi FS, O’Day SJ, McDermott DF, Weber RW, Sosman JA, Haanen JB, Gonzalez R, Robert C, Schadendorf D, Hassel JC, van den Akerley W, Lutzky J, et al. Improved survival with ipilimumab in patients with metastatic melanoma. N Engl J Med. 2010;363:711–23.

Borghaei H, Paz-Ares L, Horn L, Spigel DR, Steins M, Ready NE, Chow LQ, Vokes EE, Felip E, Holgado E, Barlesi F, Kohlhaufl M, Arrieta O, et al. Nivolumab versus Docetaxel in Advanced Nonsquamous Non-small-cell Lung Cancer. N Engl J Med. 2015;373:1627–39.

Chen X, Xu R, He D, Zhang Y, Chen H, Zhu Y, Cheng Y, Liu R, Zhu R, Gong L, Xiao M, Wang Z, Deng L, et al. CD8(+) T effector and immune checkpoint signatures predict prognosis and responsiveness to immunotherapy in bladder cancer. Oncogene. 2021;40:6223–34.

van Dorp J. The bladder cancer immune micro-environment in the context of response to immune checkpoint inhibition. Front Immunol. 2023;14:1235884.

Patel VG, Oh WK, Galsky MD. Treatment of muscle-invasive and advanced bladder cancer in 2020. CA Cancer J Clin. 2020;70:404–23.

Tran L, Xiao JF, Agarwal N, Duex JE, Theodorescu D. Advances in bladder cancer biology and therapy. Nat Rev Cancer. 2021;21:104–21.

Chen Y, Li ZY, Zhou GQ, Sun Y. An Immune-Related Gene Prognostic Index for Head and Neck squamous cell carcinoma. Clin Cancer Res. 2021;27:330–41.

Zhang B, Wu Q, Li B, Wang D, Wang L, Zhou YL. M(6)a regulator-mediated methylation modification patterns and tumor microenvironment infiltration characterization in gastric cancer. Mol Cancer. 2020;19:53.

Yagoda A, Memorial Sloan-Kettering Cancer Center. Phase-II trials in patients with urothelial tract tumors. Cancer Chemother Pharmacol. 1983;11(Suppl):S9–12.

PubMed   Google Scholar  

Lobo N, Mount C, Omar K, Nair R, Thurairaja R, Khan MS. Landmarks in the treatment of muscle-invasive bladder cancer. Nat Rev Urol. 2017;14:565–74.

Mitin T, Hunt D, Shipley WU, Kaufman DS, Uzzo R, Wu CL, Buyyounouski MK, Sandler H, Zietman AL. Transurethral surgery and twice-daily radiation plus paclitaxel-cisplatin or fluorouracil-cisplatin with selective bladder preservation and adjuvant chemotherapy for patients with muscle invasive bladder cancer (RTOG 0233): a randomised multicentre phase 2 trial. Lancet Oncol. 2013;14:863–72.

Abdollah F, Gandaglia G, Thuret R, Schmitges J, Tian Z, Jeldres C, Passoni NM, Briganti A, Shariat SF, Perrotte P, Montorsi F, Karakiewicz PI, Sun M. Incidence, survival and mortality rates of stage-specific bladder cancer in United States: a trend analysis. Cancer Epidemiol. 2013;37:219–25.

Sjodahl G, Lauss M, Lovgren K, Chebil G, Gudjonsson S, Veerla S, Patschan O, Aine M, Ferno M, Ringner M, Mansson W, Liedberg F, Lindgren D, et al. A molecular taxonomy for urothelial carcinoma. Clin Cancer Res. 2012;18:3377–86.

Seiler R, Ashab HAD, Erho N, van Rhijn BWG, Winters B, Douglas J, Van Kessel KE, van de Fransen EE, Sommerlad M, Wang NQ, Choeurng V, Gibb EA, Palmer-Aronsten B, et al. Impact of Molecular subtypes in muscle-invasive bladder Cancer on Predicting Response and Survival after Neoadjuvant Chemotherapy. Eur Urol. 2017;72:544–54.

Gust KM, Rebhan K, Resch I, Shariat SF, Necchi A. Immune checkpoint inhibition in muscle-invasive and locally advanced bladder cancer. Curr Opin Urol. 2020;30:547–56.

Apolo AB, Infante JR, Balmanoukian A, Patel MR, Wang D, Kelly K, Mega AE, Britten CD, Ravaud A, Mita AC, Safran H, Stinchcombe TE, Srdanov M, et al. Avelumab, an anti-programmed death-ligand 1 antibody, in patients with refractory metastatic urothelial carcinoma: results from a Multicenter, phase ib study. J Clin Oncol. 2017;35:2117–24.

Balar AV, Galsky MD, Rosenberg JE, Powles T, Petrylak DP, Bellmunt J, Loriot Y, Necchi A, Hoffman-Censits J, Perez-Gracia JL, van der Dawson NA, Dreicer R, et al. Atezolizumab as first-line treatment in cisplatin-ineligible patients with locally advanced and metastatic urothelial carcinoma: a single-arm, multicentre, phase 2 trial. Lancet. 2017;389:67–76.

Balar AV, Castellano D, O’Donnell PH, Grivas P, Vuky J, Powles T, Plimack ER, Hahn NM, de Wit R, Pang L, Savage MJ, Perini RF, Keefe SM, et al. First-line pembrolizumab in cisplatin-ineligible patients with locally advanced and unresectable or metastatic urothelial cancer (KEYNOTE-052): a multicentre, single-arm, phase 2 study. Lancet Oncol. 2017;18:1483–92.

Sharma P, Callahan MK, Bono P, Kim J, Spiliopoulou P, Calvo E, Pillai RN, Ott PA, de Braud F, Morse M, Le DT, Jaeger D, Chan E, et al. Nivolumab monotherapy in recurrent metastatic urothelial carcinoma (CheckMate 032): a multicentre, open-label, two-stage, multi-arm, phase 1/2 trial. Lancet Oncol. 2016;17:1590–8.

Resch I, Shariat SF, Gust KM. PD-1 and PD-L1 inhibitors after platinum-based chemotherapy or in first-line therapy in cisplatin-ineligible patients: dramatic improvement of prognosis and overall survival after decades of hopelessness in patients with metastatic urothelial cancer. Memo. 2018;11:43–6.

Gust KM, Abufaraj M, D’Andrea D, Moschini M, Soria F, Shariat SF. Second line immune checkpoint inhibition in urothelial cancer. Transl Androl Urol. 2019;8:414–20.

Daza J, Charap A, Wiklund PN, Sfakianos JP. Role of the Innate Immune System in the Development, Progression, and therapeutic response of bladder Cancer. Eur Urol Focus. 2020;6:650–2.

Kroemer G, Galluzzi L, Kepp O, Zitvogel L. Immunogenic cell death in cancer therapy. Annu Rev Immunol. 2013;31:51–72.

Morrison BJ, Steel JC, Morris JC. Reduction of MHC-I expression limits T-lymphocyte-mediated killing of Cancer-initiating cells. BMC Cancer. 2018;18:469.

Li B, Severson E, Pignon JC, Zhao H, Li T, Novak J, Jiang P, Shen H, Aster JC, Rodig S, Signoretti S, Liu JS, Liu XS. Comprehensive analyses of tumor immunity: implications for cancer immunotherapy. Genome Biol. 2016;17:174.

Li XD, Huang CW, Liu ZF, Jiang LJ, Chen JW, Xie D, Zhou FJ, Lu HM, Liu ZW. Prognostic role of the immunoscore for patients with Urothelial Carcinoma of the bladder who underwent Radical Cystectomy. Ann Surg Oncol. 2019;26:4148–56.

van Wilpe S, van der Gerretsen ECF, de Vries IJM, Gerritsen WR, Mehra N. Prognostic and predictive value of Tumor-infiltrating Immune cells in Urothelial Cancer of the bladder. Cancers (Basel). 2020; 12.

Komohara Y, Jinushi M, Takeya M. Clinical significance of macrophage heterogeneity in human malignant tumors. Cancer Sci. 2014;105:1–8.

Kuhns MS, Davis MM, Garcia KC. Deconstructing the form and function of the TCR/CD3 complex. Immunity. 2006;24:133–9.

Gil J, Busto EM, Garcillan B, Chean C, Garcia-Rodriguez MC, Diaz-Alderete A, Navarro J, Reine J, Mencia A, Gurbindo D, Belendez C, Gordillo I, Duchniewicz M, et al. A leaky mutation in CD3D differentially affects alphabeta and gammadelta T cells and leads to a Talphabeta-Tgammadelta + B + NK + human SCID. J Clin Invest. 2011;121:3872–6.

West NR, Milne K, Truong PT, Macpherson N, Nelson BH, Watson PH. Tumor-infiltrating lymphocytes predict response to anthracycline-based chemotherapy in estrogen receptor-negative breast cancer. Breast Cancer Res. 2011;13:R126.

Gyorffy B, Bottai G, Fleischer T, Munkacsy G, Budczies J, Paladini L, Borresen-Dale AL, Kristensen VN, Santarpia L. Aberrant DNA methylation impacts gene expression and prognosis in breast cancer subtypes. Int J Cancer. 2016;138:87–97.

Cheng YS, Colonno RJ, Yin FH. Interferon induction of fibroblast proteins with guanylate binding activity. J Biol Chem. 1983;258:7746–50.

Britzen-Laurent N, Bauer M, Berton V, Fischer N, Syguda A, Reipschlager S, Naschberger E, Herrmann C, Sturzl M. Intracellular trafficking of guanylate-binding proteins is regulated by heterodimerization in a hierarchical manner. PLoS ONE. 2010;5:e14246.

Blagih J, Buck MD, Vousden KH. p53, cancer and the immune response. J Cell Sci. 2020; 133.

Long J, Wang A, Bai Y, Lin J, Yang X, Wang D, Yang X, Jiang Y, Zhao H. Development and validation of a TP53-associated immune prognostic model for hepatocellular carcinoma. EBioMedicine. 2019;42:363–74.

Guo B, Yang F, Zhang L, Zhao Q, Wang W, Yin L, Chen D, Wang M, Han S, Xiao H, Xing N. Cuproptosis Induced by ROS responsive nanoparticles with Elesclomol and Copper Combined with alphaPD-L1 for enhanced Cancer Immunotherapy. Adv Mater. 2023;35:e2212267.

Chan TA, Yarchoan M, Jaffee E, Swanton C, Quezada SA, Stenzinger A, Peters S. Development of tumor mutation burden as an immunotherapy biomarker: utility for the oncology clinic. Ann Oncol. 2019;30:44–56.

Albany C, Sonpavde G. Docetaxel for the treatment of bladder cancer. Expert Opin Investig Drugs. 2015;24:1657–64.

Lu Z, Yeh TK, Wang J, Chen L, Lyness G, Xin Y, Wientjes MG, Bergdall V, Couto G, Alvarez-Berger F, Kosarek CE, Au JL. Paclitaxel gelatin nanoparticles for intravesical bladder cancer therapy. J Urol. 2011;185:1478–83.

Zhou J, Qian W, Huang C, Mai C, Lai Y, Lin Z, Lai G. Combined targeting of KRT23 and NCCRP1 as a potential novel therapeutic approach for the treatment of triple-negative breast cancer. Gland Surg. 2022;11:1673–82.

Qin Y, Chen L, Chen L. Identification and verification of key cancer genes associated with prognosis of colorectal cancer based on bioinformatics analysis. Zhong Nan Da Xue Xue Bao Yi Xue Ban. 2021;46:1063–70.

Gao X, Yang J. Identification of genes related to clinicopathological characteristics and prognosis of patients with colorectal Cancer. DNA Cell Biol. 2020;39:690–9.

Li X, Cheng Y, Cheng Y, Shi H. Transcriptome analysis reveals the Immune Infiltration profiles in Cervical Cancer and identifies KRT23 as an immunotherapeutic target. Front Oncol. 2022;12:779356.

Gajewski TF. The next hurdle in Cancer Immunotherapy: overcoming the Non-t-cell-inflamed Tumor Microenvironment. Semin Oncol. 2015;42:663–71.

Zemek RM, De Jong E, Chin WL, Schuster IS, Fear VS, Casey TH, Forbes C, Dart SJ, Leslie C, Zaitouny A, Small M, Boon L, Forrest ARR et al. Sensitization to immune checkpoint blockade through activation of a STAT1/NK axis in the tumor microenvironment. Sci Transl Med. 2019; 11.

Li H, Chen J, Li Z, Chen M, Ou Z, Mo M, Wang R, Tong S, Liu P, Cai Z, Zhang C, Liu Z, Deng D, et al. S100A5 attenuates efficiency of Anti-PD-L1/PD-1 immunotherapy by inhibiting CD8(+) T cell-mediated anti-cancer immunity in bladder carcinoma. Adv Sci (Weinh). 2023;10:e2300110.

Oh DY, Kwek SS, Raju SS, Li T, McCarthy E, Chow E, Aran D, Ilano A, Pai CS, Rancan C, Allaire K, Burra A, Sun Y et al. Intratumoral CD4(+) T Cells Mediate Anti-tumor Cytotoxicity in Human Bladder Cancer. Cell. 2020; 181: 1612-25 e13.

Wilkerson MD, Hayes DN. ConsensusClusterPlus: a class discovery tool with confidence assessments and item tracking. Bioinformatics. 2010;26:1572–3.

Zhang X, Wei X, Wang Y, Wang S, Ji C, Yao L, Song N. Pyroptosis regulators and Tumor Microenvironment Infiltration characterization in Clear Cell Renal Cell Carcinoma. Front Oncol. 2021;11:774279.

Zhong B, Cheng B, Huang X, Xiao Q, Niu Z, Chen YF, Yu Q, Wang W, Wu XJ. Colorectal cancer-associated fibroblasts promote metastasis by up-regulating LRG1 through stromal IL-6/STAT3 signaling. Cell Death Dis. 2021;13:16.

Zhao S, Guo W, Li J, Yu W, Guo T, Deng W, Gu C. High expression of Y-box-binding protein 1 correlates with poor prognosis and early recurrence in patients with small invasive lung adenocarcinoma. Onco Targets Ther. 2016;9:2683–92.

Download references

Acknowledgements

Everybody who made a contribution to the research has been listed as an author.

Author information

Dongshan Chen, Haoyuan Cao and Xiang Zheng have contributed equally to this work and share first authorship

Authors and Affiliations

Department of Urology, Beijing Chaoyang Hospital Affiliated Capital Medical University, 8 Gong Ti Nan Road, Chaoyang District, Beijing, 100020, China

Dongshan Chen, Haoyuan Cao, Xiang Zheng, Haojun Wang & Wei Wang

Department of Urology, Qilu Hospital of Shandong University, Wenhuaxi Road #107, Jinan, 250012, China

Dongshan Chen

Department of Urology, The Second Affiliated Hospital of Shandong University of Traditional Chinese Medicine, NO.1 Jingba Road, Shizhong District, Jinan, 250001, China

Zengchi Han

You can also search for this author in PubMed   Google Scholar

Contributions

WW and HZC conceived of and directed the project. CDS, ZX and CHY designed the study. CDS and CHY performed the experiments. WHJ, ZX and CDS collected and analyzed the data. All the authors listed have approved the manuscript that is enclosed for publication.

Corresponding authors

Correspondence to Zengchi Han or Wei Wang .

Ethics declarations

Ethics approval and consent to participate.

The study was approved by the Medical Ethical Committees of Beijing Chaoyang Hospital Affiliated Capital Medical University for human research (approval number 2024-2-21-1), with informed consent obtained from all participating patients. Additionally, the Animal Ethical Committee provided approval for the animal research component (approval number AEEI-2023-275), ensuring ethical standards were upheld across the study.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .

Reprints and permissions

About this article

Cite this article.

Chen, D., Cao, H., Zheng, X. et al. Immune checkpoint gene signature assesses immune infiltration profiles in bladder cancer and identifies KRT23 as an immunotherapeutic target. BMC Cancer 24 , 1024 (2024). https://doi.org/10.1186/s12885-024-12790-w

Download citation

Received : 04 June 2024

Accepted : 09 August 2024

Published : 19 August 2024

DOI : https://doi.org/10.1186/s12885-024-12790-w

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Urinary bladder neoplasms
  • Immunotherapy
  • Tumor microenvironment

ISSN: 1471-2407

peer reviewed websites journals

American Psychological Association

Journal Article References

This page contains reference examples for journal articles, including the following:

  • Journal article
  • Journal article with an article number
  • Journal article with missing information
  • Retracted journal article
  • Retraction notice for a journal article
  • Abstract of a journal article from an abstract indexing database
  • Monograph as part of a journal issue
  • Online-only supplemental material to a journal article

1. Journal article

Grady, J. S., Her, M., Moreno, G., Perez, C., & Yelinek, J. (2019). Emotions in storybooks: A comparison of storybooks that represent ethnic and racial groups in the United States. Psychology of Popular Media Culture , 8 (3), 207–217. https://doi.org/10.1037/ppm0000185

  • Parenthetical citation : (Grady et al., 2019)
  • Narrative citation : Grady et al. (2019)
  • If a journal article has a DOI, include the DOI in the reference.
  • Always include the issue number for a journal article.
  • If the journal article does not have a DOI and is from an academic research database, end the reference after the page range (for an explanation of why, see the database information page ). The reference in this case is the same as for a print journal article.
  • Do not include database information in the reference unless the journal article comes from a database that publishes works of limited circulation or original, proprietary content, such as UpToDate .
  • If the journal article does not have a DOI but does have a URL that will resolve for readers (e.g., it is from an online journal that is not part of a database), include the URL of the article at the end of the reference.

2. Journal article with an article number

Jerrentrup, A., Mueller, T., Glowalla, U., Herder, M., Henrichs, N., Neubauer, A., & Schaefer, J. R. (2018). Teaching medicine with the help of “Dr. House.” PLoS ONE , 13 (3), Article e0193972. https://doi.org/10.1371/journal.pone.0193972

  • Parenthetical citation : (Jerrentrup et al., 2018)
  • Narrative citation : Jerrentrup et al. (2018)
  • If the journal article has an article number instead of a page range, include the word “Article” and then the article number instead of the page range.

3. Journal article with missing information

Missing volume number.

Lipscomb, A. Y. (2021, Winter). Addressing trauma in the college essay writing process. The Journal of College Admission , (249), 30–33. https://www.catholiccollegesonline.org/pdf/national_ccaa_in_the_news_-_nacac_journal_of_college_admission_winter_2021.pdf

Missing issue number

Sanchiz, M., Chevalier, A., & Amadieu, F. (2017). How do older and young adults start searching for information? Impact of age, domain knowledge and problem complexity on the different steps of information searching. Computers in Human Behavior , 72 , 67–78. https://doi.org/10.1016/j.chb.2017.02.038

Missing page or article number

Butler, J. (2017). Where access meets multimodality: The case of ASL music videos. Kairos: A Journal of Rhetoric, Technology, and Pedagogy , 21 (1). http://technorhetoric.net/21.1/topoi/butler/index.html

  • Parenthetical citations : (Butler, 2017; Lipscomb, 2021; Sanchiz et al., 2017)
  • Narrative citations : Butler (2017), Lipscomb (2021), and Sanchiz et al. (2017)
  • If the journal does not use volume, issue, and/or article or page numbers, omit the missing element(s) from the reference.
  • If the journal is published quarterly and the month or season (Fall, Winter, Spring, Summer) is noted, include that with the date element; see the Lipscomb example.
  • If the volume, issue, and/or article or page numbers have simply not yet been assigned, use the format for an advance online publication (see Example 7 in the Publication Manual ) or an in-press article (see Example 8 in the Publication Manual ).

4. Retracted journal article

Joly, J. F., Stapel, D. A., & Lindenberg, S. M. (2008). Silence and table manners: When environments activate norms. Personality and Social Psychology Bulletin , 34 (8), 1047–1056. https://doi.org/10.1177/0146167208318401 (Retraction published 2012, Personality and Social Psychology Bulletin, 38 [10], 1378)

  • Parenthetical citation : (Joly et al., 2008)
  • Narrative citation : Joly et al. (2008)
  • Use this format to cite the retracted article itself, for example, to discuss the contents of the retracted article.
  • First provide publication details of the original article. Then provide information about the retraction in parentheses, including its year, journal, volume, issue, and page number(s).

5. Retraction notice for a journal article

de la Fuente, R., Bernad, A., Garcia-Castro, J., Martin, M. C., & Cigudosa, J. C. (2010). Retraction: Spontaneous human adult stem cell transformation. Cancer Research , 70 (16), 6682. https://doi.org/10.1158/0008-5472.CAN-10-2451

The Editors of the Lancet. (2010). Retraction—Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children. The Lancet , 375 (9713), 445. https://doi.org/10.1016/S0140-6736(10)60175-4

  • Parenthetical citations : (de la Fuente et al., 2010; The Editors of the Lancet, 2010)
  • Narrative citations : de la Fuente et al. (2010) and The Editors of the Lancet (2010)
  • Use this format to cite a retraction notice rather than a retracted article, for example, to provide information on why an article was retracted.
  • The author of the retraction notice may be an editor, editorial board, or some or all authors of the article. Examine the retraction notice to determine who to credit as the author.
  • Reproduce the title of the retraction notice as shown on the work. Note that the title may include the words “retraction,” “retraction notice,” or “retraction note” as well as the title of the original article.

6. Abstract of a journal article from an abstract indexing database

Hare, L. R., & O'Neill, K. (2000). Effectiveness and efficiency in small academic peer groups: A case study (Accession No. 200010185) [Abstract from Sociological Abstracts]. Small Group Research , 31 (1), 24–53. https://doi.org/10.1177/104649640003100102

  • Parenthetical citation : (Hare & O’Neill, 2000)
  • Narrative citation : Hare and O’Neill (2000)
  • Although it is preferable to cite the whole article, the abstract can be cited if that is your only available source.
  • The foundation of the reference is the same as for a journal article.
  • If the abstract has a database accession number, place it in parentheses after the title.
  • Note that you retrieved only the abstract by putting the words “Abstract from” and then the name of the abstract indexing database in square brackets. Place this bracketed description after the title and any accession number.
  • Accession numbers are sometimes referred to as unique identifiers or as publication numbers (e.g., as PubMed IDs); use the term provided by the database in your reference.

7. Monograph as part of a journal issue

Ganster, D. C., Schaubroeck, J., Sime, W. E., & Mayes, B. T. (1991). The nomological validity of the Type A personality among employed adults [Monograph]. Journal of Applied Psychology , 76 (1), 143–168. http://doi.org/10.1037/0021-9010.76.1.143

  • Parenthetical citation : (Ganster et al., 1991)
  • Narrative citation : Ganster et al. (1991)
  • For a monograph with an issue (or whole) number, include the issue number in parentheses followed by the serial number, for example, 58 (1, Serial No. 231).
  • For a monograph bound separately as a supplement to a journal, give the issue number and supplement or part number in parentheses after the volume number, for example, 80 (3, Pt. 2).

8. Online-only supplemental material to a journal article

Freeberg, T. M. (2019). From simple rules of individual proximity, complex and coordinated collective movement [Supplemental material]. Journal of Comparative Psychology , 133 (2), 141–142. https://doi.org/10.1037/com0000181

  • Parenthetical citation : (Freeberg, 2019)
  • Narrative citation : Freeberg (2019)
  • Include the description “[Supplemental material]” in square brackets after the article title.
  • If you cite both the main article and the supplemental material, provide only a reference for the article.

Journal article references are covered in the seventh edition APA Style manuals in the Publication Manual Section 10.1 and the Concise Guide Section 10.1

peer reviewed websites journals

  • Systematic Map Protocol
  • Open access
  • Published: 24 August 2024

What evidence exists relating the impact of different grassland management practices to soil carbon in livestock systems? A systematic map protocol

  • Camille Rousset   ORCID: orcid.org/0000-0002-9251-3959 1 ,
  • Carmen Segura 2 , 9 ,
  • Anina Gilgen 1 ,
  • Marta Alfaro 3 ,
  • Luís André Mendes 4 ,
  • Mike Dodd 5 ,
  • Batnyambuu Dashpurev 6 ,
  • Mike Bastidas 7 ,
  • Julian Rivera 8 ,
  • Lutz Merbold 1 &
  • Eduardo Vázquez 4  

Environmental Evidence volume  13 , Article number:  22 ( 2024 ) Cite this article

Metrics details

Grasslands are essential for providing vital resources in the livestock sector and delivering invaluable ecosystem services such as biodiversity and soil carbon (C) sequestration. Despite their critical importance, these ecosystems face escalating threats from human disturbances, human degradation, and climate change, compromising their ability to effectively stock C. Restoring degraded grasslands emerges as a pragmatic and cost-effective approach to tackling climate change. However, the successful implementation of grassland management toward this goal, faces significant challenges. A systematic mapping approach will help to compile a comprehensive global inventory of studies investigating the impact of differing grassland management practices on soil carbon. In addition, the potential for trade-offs with other greenhouse gas emissions further underlines the value of a systematic assessment. This approach aims to identify knowledge clusters (i.e., well-represented subtopics that are amenable to full synthesis) for potential systematic reviews and pinpoint knowledge gaps requiring further primary research efforts, all contributing to a better understanding of the evidence surrounding this topic.

Following systematic evidence synthesis standards, we developed the question to address in the systematic map protocol using the PICO framework. We established a preliminary search string by combining search terms for the Population (Grasslands), Intervention (management) and Outcome (soil carbon) categories, as well as with one additional group (Study types—to focus on farm and field experiments). We will conduct a comprehensive literature search of relevant peer-reviewed and grey literature using Web of Science, Scopus, CABI platforms, Google Scholar, and specialised websites (e.g., Agrotrop). Searches will be conducted in the English, Spanish, Portuguese, French, German, and Mongolian languages, as per the linguistic capabilities of the research team. The comprehensiveness of the search will be assessed by comparing the literature collected to a test-list of forty relevant articles. The repeatability of the literature screening process will be ensured by a list of inclusion/exclusion criteria and inter-reviewer consistency statistical tests. Data extraction will be organised into four complementary sections (article information, PICO categories, study characteristics, measurable parameters), on which we will perform queries to produce the tables, figures and evidence maps that will compose the systematic map. The results will identify and describe knowledge gaps and clusters.

Globally, grasslands cover about 40% of the Earth’s ice-free surface, and their importance for human livelihood is primarily related to fodder and forage production for the livestock sector [ 1 , 2 , 3 ]. Although livestock production is viewed with increasingly criticism given its greenhouse gas (GHG) emissions, grasslands also contribute to global food and nutrition security [ 4 ], rural livelihood, and supply valuable ecosystem services across a wide range of geological and climatic conditions [ 5 , 6 ]. Grasslands are known to help maintain above and belowground biodiversity, filter water and combat erosion [ 5 , 6 ]. Given that up to 30% of the Earth’s terrestrial C is stored in grasslands [ 7 ], they play a key role in climate regulation; therefore, grassland management strategies have received increasing national and global interest as potential pathways for sequestering C [ 8 , 9 , 10 , 11 ].

Soil C stocks (referring to the mass of carbon in a sample of known bulk density for a nominated depth and commonly restricted to the fraction < 2 mm in size [ 12 ]) under grasslands are very vulnerable to disturbance and degradation from human management [ 13 , 14 ]. These ecosystems can become sinks or sources of CO 2 , depending on multiple variables [ 13 , 15 , 16 ]. Soil organic carbon (SOC) exhibits temporal and spatial variability, being constantly accumulated, decomposed, and mineralized. Although both SOC and soil inorganic carbon (SIC) are present in soils, this paper emphasizes SOC, as it is the primary focus in both scientific and political discussions. Over the past decades, the total area of grassland has decreased while that of arable land has increased, suggesting ongoing conversion of grasslands to croplands [ 17 ]. Concurrently, close to 50% of the world's natural grassland has experienced various degrees of degradation [ 18 ]. Meanwhile, the demand for livestock products, continues to increase, especially in emerging-economy countries [ 19 ]. Less grazing area for greater forage demand has led to an increase in grazing intensity [ 1 , 16 ], ensuing that a noticeable fraction of the world’s grasslands is hosting a livestock population that exceeds local carrying capacity [ 20 ]. This overgrazing as well as other unsustainable grassland management practices (e.g., excessive fertilisation of meadows or biomass removal), can have serious negative impacts for the environment, including negative effects on soil C storage [ 1 , 10 , 13 , 15 ]. A better understanding of the effect of different grassland management practices on soil C stocks can help guide efforts to reverse the grassland degradation trend and preserve the important soil C stocks of the world’s grasslands [ 1 , 13 , 15 , 16 ].

Considering the large area covered by grasslands globally and that approximately 50% of the area is degraded [ 14 ], the potential for C sequestration (referring to the process of capturing and storing atmospheric carbon dioxide in soils) by restoring grasslands offers a very cost-efficient nature-based solution to mitigate climate change [ 12 , 21 ]. Several reviews and studies have shown the potential for changes in grassland management practices—such as rotational grazing, fertilisation, sowing legumes and improved forages or the establishment of silvopastoral systems—to restore degraded grasslands and increase their soil C stocks [ 10 , 11 , 15 ]. In the context of this study, grassland management refers to a range of human-directed practices implemented with the aim of restoring grasslands while simultaneously enhancing forage quantity and quality, as well as soil C stocks. These may be considered as alternatives to current or locally conventional management practice recognised as leading to degradation. Implementing these strategies on a regional and global scale remains problematic because of four main challenges (Fig.  1 ): (i) a lack of robust evidence regarding the effect of grassland management practices on soil C stocks, (ii) uncertainties caused by variation in SOC measurements and the complexity of interactions between edaphoclimatic conditions and management practices, (iii) understudied potential trade-offs with other greenhouse gas (GHG) emissions and other environmental consequences resulting from these practice changes, and (iv) the technical and economic constraints faced by farmers, limiting their adoption [ 10 , 13 , 22 ].

figure 1

Challenges in implementing grassland management strategies at a global scale: Unveiling critical questions for systematic inquiry. The questions to be addressed in the systematic map are underlined in red.

Despite a growing number of reviews and articles on the subject, there is still limited evidence that implementing certain promising practices, such as silvopastoral systems or sowing improved forages or legumes, is positive for increasing soil C stocks in grasslands. For example, the meta-analysis on the topic performed by Conant et al. [ 10 ] included only one, two and seven studies focused on these practices, respectively. In addition, the geographical distribution of evidence supporting the benefit of most of these practices is not evenly distributed. Africa and Asia are under-represented compared with Europe, North America, South America and Oceania [ 10 ]. This is particularly problematic given that Africa and Asia have the highest estimates for potential C storage through grassland restoration [ 13 ]. In the context of a research system where modelling studies are increasingly used, the field studies evidence becomes more critical to address substantial uncertainties in the models [ 8 ].

The second challenge is the large uncertainty in the predicted soil C sequestration potential of various grassland management practices on a global scale, as their effects are highly context dependent [ 10 , 13 , 23 ]. The C sequestration potential of specific practices will depend on climate, soil characteristics, vegetation (i.e. species composition, presence/absence of C3 or C4 grasses, biological nitrogen fixers etc.), intensity of biomass removal, as well as animal stocking densities and the ingested amount of biomass produced [ 7 , 8 , 24 , 25 , 26 ]. This explains why the study scale is often limited to local or subregional scales [ 23 , 27 , 28 , 29 , 30 ], and thus, upscaling to regional and global scales remains challenging [ 31 ]. In addition, the characteristics of management practices are highly site-specific, since what is considered conventional in one situation may be considered alternative in another. Environment and discourse situations can lead to variations in terminology. As an example, the term “silvopastoral systems” encompasses the dehesa or montado ecosystems of Spain and Portugal, as well as the high-density silvopastoral systems planted with rows of Leucaena trees in tropical regions, although their functionality and C sequestration potential are very different [ 29 , 32 , 33 ]. The name used to designate certain practices may also vary from one region or author to another, as there is no scientific standardisation for the name or definition of the practices. This can be the case for rotational grazing strategies which are referred to as “rotational grazing”, “regenerative rotational grazing”, “intensive short-duration rotational grazing”, “cell grazing”, “technograzing”, “mob grazing” or “multi-paddock grazing”, even though the intent of these practices is similar [ 27 , 34 , 35 , 36 ]. This lack of category uniformity needs to be remedied. It is also essential to note that despite the recent efforts made by international organisations to standardise the methods used to assess changes in soil C stocks [ 31 , 37 ] there are still significant divergences in measuring, reporting and verifying these changes, which is also a source of uncertainty.

The third challenge is a better understanding of the potential trade-off with other GHG emissions of soil C sequestration and the proposed changes in management practices. While increased soil C stock resulting from changes in grassland management is generally associated with positive environmental outcomes (C sequestration, improved soil health, climate resilience, among others), it is essential to acknowledge potential challenges and negative consequences. For instance, management strategies affecting SOC cycle are likely to affect soil nitrous oxide (N 2 O) emissions as C and N biogeochemical cycles are strongly interlinked [ 38 , 39 ]. This potential trade-off could offset the climatic benefits of increased soil C stocks. Although many studies and meta-analyses have evaluated the impact of increased soil C on GHG emissions for croplands [ 38 , 39 , 40 , 41 ], studies evaluating the impact of grassland managements on GHG emissions are rare, with the exception of those evaluating the impact of N fertilisation on N 2 O emissions [ 42 , 43 ]. A compilation of the evidence could help to identify clusters of knowledge for certain practices and gaps of knowledge that require further empirical research.

The final challenge to the overall implementation of different grassland management practices lies in the technical and economical constraints that may limit adoption by many farmers [ 10 , 13 , 22 ]. The development of policies and extension services to promote those practices as well as to address the adoption barriers are thus necessary [ 10 ]. Policymakers and stakeholders usually require a comprehensive body of robust evidence to support the development of policies focused on the promotion of grassland management practices that will achieve restoration goals [ 44 ].

Addressing these four challenges (Fig.  1 ), encourages a detailed collation of the available evidence as well as the development of a comprehensive and systematic database considering the types of management practice being studied, and the contexts in which each study has been carried out. This may help to reduce uncertainties about the potential for soil C enhancement in grasslands in certain regions and potential trade-offs, but also highlight other regions or types of practices where evidence is scarce and further studies are needed. To the best of our knowledge, there is currently no comprehensive, systematic, and updated assessment of the existing evidence on the impact of differing grassland management practices on soil C stocks. The review by Conant et al. [ 10 ] is the most comprehensive analysis of existing evidence on the topic to date. However, a sufficient number of articles have been published since this 2017 review, justifying the need for a systematic re-evaluation of the evidence up to the present time. Our objective in this work is not to ascertain the directional impact (positive or negative or neutral) of a practice on soil C. Instead, our focus is on cataloguing the various practices that have been subject to study. Therefore, our approach is a qualitative examination rather than a quantitative assessment of the effects of these practices on SOC.

Objectives of the review

The impacts of grassland management on soil C have been subject to several conventional literature reviews [ 11 , 13 , 15 , 16 , 45 ]. To our knowledge, no study has evaluated these impacts systematically. Therefore, the objective of the forthcoming systematic map is to fill this gap of knowledge, answering the following question:

“What evidence exists relating the impact of different grassland management practices to soil carbon in livestock systems?”

This systematic map aims to (i) identify a comprehensive list of studies around the globe, on the impact of different grassland management practices on soil C, (ii) supply a robust database of studies with their main descriptive information (meta-data) and to ensure open access availability of this resource, (iii) generate an evidence map indicating the location of the existing studies, (iv) create a list of knowledge clusters [ 46 ] of management practices and regions well studied that would be suitable for a full systematic review, and (v) create a list of knowledge gaps of practices and regions underrepresented in studies that warrant further primary research effort. All these outputs will help to understand the existing evidence relating the impact of grassland management practices on soil C.

The PICO (Population, Intervention, Comparison, Outcome) method, a structured approach used in literature reviews to formulate clear research questions, will be used with the following key elements:

Managed permanent grasslands and pastures (including silvo-pastoral systems) distributed worldwide. Unmanaged grasslands not subject to animal husbandry are not included.

Intervention

Any grassland management practices used as alternative to a locally standard/conventional/nominal/common practice adopted in each study for the purpose of restoring grasslands while maintaining or improving forage quantity and quality and/or soil C stocks.

The standard/nominal/common local management practices used for comparison in each study.

Soil C stocks, concentration and related terms (Table  1 and Table S3). While not every article specifically addresses soil C stocks, many studies measure related measurements such as SOC concentration or total C. Similarly, some studies refer to soil health or soil quality, which include different soil properties such as carbon storage. Consequently, we have opted for a broader terminology in our search string to comprehensively cover all aspects of C change related to management practices documented in the literature.

This systematic map has been designed based on the Collaboration for Environmental Evidence Guidelines and Standards for Evidence Synthesis in Environmental Management [ 47 ]. The preparation of this systematic map protocol has been made following the ROSES reporting standards [ 48 ].

Searching for articles

While the primary focus will be on peer-reviewed articles, other forms of literature such as book chapters or conference proceedings will also be considered. The year of publication will not be restricted.

Academic bibliographic databases

The academic bibliographic databases used for this study are listed in Table  2 . The literature search will be mainly done using the subscriptions of the Swiss Consortium. The search string was built up in agreement by all authors of the study. The search string was designed to include three substrings representing the population , intervention and outcome of the PICO question and connected by the Boolean operator “AND” (Table  1 ). The search strings will be adapted to the syntax requirements of each database (Table  2 ). The searches in bibliography databases will be performed in English using the refinement criterion ‘Language’ in the academic databases. Additionally, an initial screening process will be performed on the academic bibliographic platforms to eliminate articles that are clearly irrelevant based on their subject categories. For example, certain articles may have been categorised under art, sociology, or veterinary topics subsequent to the primary search.

To ensure that the systematic map remains up-to-date, several strategies for updating searches will be implemented. First, regular searches will be conducted in relevant databases and repositories to identify newly published literature related to the impact of grassland management practices on soil C. These searches will be conducted at predefined intervals throughout the systematic mapping process. Additionally, automated alerts will be set up in databases and search engines to notify the research team of any newly published articles that meet the inclusion criteria. These alerts will be tailored to specific search terms and filters used in the systematic map protocol.

Grey literature

The search for grey literature will be made using the Google Scholar engine which has been demonstrated to be a useful tool for identifying grey literature [ 49 ]. We will evaluate grey literature in five languages in addition to English, corresponding to the native languages of all contributing authors of this article. This approach aims to include studies that may have been overlooked during the English-language academic database search. Therefore, simplified search strings in English, Spanish, French, German, Mongolian and Portuguese will be used (Table S1). In the case of a very large number of matches, the analysis will be limited to the first 500 hits. We acknowledge the limitation of using only Google Scholar for this grey literature search, as it may not capture all types of grey literature for the different languages tested.

Supplementary searches

The protocol preparation team may contact other relevant researchers and stakeholders to ask for additional literature related to the topic. Furthermore, the bibliographies of some selected papers (particularly reviews and meta-studies) relevant on the topic will be screened aiming to find relevant bibliographies (e.g. snowballing/backward citation searching). Theses and dissertation on the topic will be examined.

Estimating the comprehensiveness of the search

To assess the comprehensiveness of the search, we prepared a list of reference articles that were considered relevant for this systematic map based on the experience of the authors of this article (Table S2). We have checked whether the reference articles were captured by our search strategy both in academic bibliographic databases used and in Google Scholar. Using the mentioned search strings in Table  1 in a preliminary search, articles have been found in both the academic bibliographic databases as well as in Google Scholar, confirming the comprehensiveness of our search.

Article screening, study eligibility criteria and analysis

Both the article screening process and data extraction will be conducted using the Covidence software [ 50 ]. Covidence is a web-based collaboration software platform that streamlines the production of systematic and other literature reviews.

Screening process

Since we anticipate that various search databases may duplicate references, we will first eliminate duplicates using the Covidence software tool which identifies duplicates on the basis of the DOI or title. We will also classify the articles by authors to facilitate the identification of any duplicates that may have been overlooked by the software. Then, the studies selected will be screened to decide their inclusion within the systematic map based on the eligibility criteria described below. The screening will be conducted firstly using to the titles, keywords and abstract of the studies, and secondly, using the full-text. To ensure repeatability of the selection process during the title and abstract screening phases, a subsample of 200 articles will be randomly selected and independently reviewed and tested for consistency of selection by all members of the selection team. If applicable, disagreements in the eligibility criteria will be discussed and clarified to ensure the accurate repeatability of the screening process. This repeatability procedure will be reiterate with another random subset of articles until a repeatability of 95% among all the members is reached. Even when consistency will be sufficient (> 95%), reviewers will discuss and solve the remaining disagreements to ensure a high replicability. Special attention will be given to avoid situations where screening team members, who are authors of articles, review their own work. A similar methodology will be applied during the full-text screening phase, using a subsample adjusted to correspond to 5% of the number of articles validated during the title and abstract screening.

Eligibility criteria

We will screen the studies regarding the population, intervention, comparator, outcome, and study design listed in Table S3.

Eligible population

To be included in the systematic map, studies must evaluate permanent grasslands managed for livestock production (including those that have a woody vegetation component, such as silvopastoral systems). This excludes unmanaged grasslands without human intervention and grasslands managed for biofuel production or recreation. Managed natural grasslands with naturally occurring indigenous grass communities will be included. Grassland-cropping rotations or so called “temporary grasslands” [ 51 ] will be excluded, since the objective of the addition of a grassland phase within the crop rotation schemes is a means to mitigate the environmental impacts of intensive arable cropping systems. Likewise, forests including livestock grazing with the objective of benefitting the forest management as described by Öllerer et al. [ 52 ], will be excluded as the targeted grazing is a means for enhancing forest management rather than an end. Due to the unique carbon dynamics observed in wetlands and peatlands (or mires) in contrast to other grassland ecosystems, they will be excluded from our study [ 53 ]. Grazing systems dominated by woody species will also be omitted from the study (i.e. shrublands, scrublands).

Eligible intervention

As mentioned above, to be included in the systematic map, studies must evaluate any permanent grassland management practices used as alternatives to a locally standard/conventional/nominal/common practice adopted in the studies. These practices should aim to restore grasslands while maintaining or improving forage quantity and/or quality and/or soil C stocks. Whether or not the objective is achieved at the end of the experiment, will have no impact on the selection. This definition combines a variety of practices as the used permanent grassland management practice depends strongly on the context of application. Grassland management practices used with objectives other than livestock production or improving soil health, such as the reclamation of polluted soils or biomass production for energy, will not be included. It is important to emphasise that the management practise should be undertaken with the objective of maintaining or increasing grassland quality and yield, rather than facilitating supplementary planting. In the latter case, the grassland is considered as a service plant, and will not be included in the study. The implementation of grazing exclusion, whether through enhanced management practices such as meadow establishment or through temporary exclusion measures such as rest periods, will be included. However, studies focusing on abandoned grasslands will be excluded.

Eligible comparator

An eligible comparator includes any locally standard/conventional/nominal/common practice grassland used by the authors in the study as a comparator to a specific grassland management practice. We will only consider as a comparator those practices which investigate grasslands, i.e. other comparators such as arable cropping agriculture, forest, abandoned grasslands, park or urban soils will be excluded. In addition, we will consider as a comparator, those grassland management practices performed with a different intensity than the targeted intervention practice. If a study involves a comparison between a grassland system and a crop system (or forest or native ecosystems), along with a comparison to a silvopastoral system or another grassland management, it will be included based on the latter comparison.

Eligible outcome

To be included in the systematic map, the study must report either the soil C stock, C concentration or any other terms mentioned in Table S3, in their abstract, keywords or title. In soil science, agricultural and environmental studies, providing soil C stock, C concentration, or related metrics is common as a description of the soil of study site even when soil C is not the primary outcome objective [ 54 , 55 , 56 ]; however, for this study, we included only studies where soil C is one of the primary focuses, and should therefore be indicated in the abstract, keywords, or title, to keep the review manageable considering our available resources.

Eligible study design and other characteristics

We will include field studies under realistic conditions that provide experimental data. Mesocosm experiments (e.g., lab incubations or pot experiments) will be excluded unless they are part of a combined field study. In this study, modelling-only articles will be excluded from the selected list of publications. Models rely on various data inputs, and the quality and reliability of these inputs can vary widely among studies [ 57 ]. This variability can introduce uncertainty and affect the overall reliability of the systematic map's conclusions.

We will include both the control-impact studies (intervention vs comparator) and the before-after intervention studies (comparing soil carbon over time) if a control is provided to evaluate the change in the soil C. We will accept both studies performed on experimental plots as well as the comparison of real farms. We will not restrict the number of replicates and the study duration. In cases where two or more studies report the same data from the same experiment, we will choose one of the studies and exclude others, except if they provide complementary supporting environmental or management information about the site.

Study validity assessment

An assessment of study validity (in terms of the methods, assumptions or peer-review processes used) will not be performed because the objective of the systematic map is to compile all the existing evidence rather than to assess the quality or validity of the existing data [ 47 ]. However, during the extraction phase, data on the quality of the studies (e.g., study characteristics outlined in Table  3 ) will be gathered and subsequently reported in the systematic map. We will remain open to the possibility of incorporating a validity assessment, especially if deemed beneficial based on the quantity and nature of the studies included.

Data coding and extraction strategy

The meta-data will be extracted, organised and compiled in Excel files for all the relevant selected studies. The data extracted from the articles will be organised into four complementary sections (article information, PICO categories, study characteristics, measurable parameters, Table  3 ), on which we will perform queries to produce the tables, figures and evidence maps that will compose the systematic map. Some variables will be represented as multiple-choice options. The extraction, organisation and compilation will be performed by the co-authors in a subset of the relevant studies included (15 articles), to check the consistency between the co-authors in this process. We will report in the systematic map the repeatability of each of the extracted variables.

Study mapping, presentation and analysis

In the systematic map we will provide answers to the primary question developed in the present protocol and the secondary questions presented in Fig.  1 , in the form of descriptive texts supported by tables, figures and maps. As the table described in the data organisation strategy (Table  3 ) might be further developed during full-text assessment, we will provide all final table structures and contents in the upcoming publication, as well as the final database produced in the frame of this review. Descriptive statistics in R or other open-source software will be used to analyse the results. Among the results, we will include “heat maps” that cross-tabulate two variables and illustrate the quantity of evidence (number of studies) within each cell of the table. These heat maps will explore various combinations of variables, such as types of grassland management practices in relation to the study country or study variables (Table  3 ). Furthermore, an evidence atlas will be generated using study latitude and longitude meta-data and presenting studies on an interactive cartographic map. Detailed information about the articles included/excluded at the different stages of the screening process will be reported, in addition to any eventual modifications to the present protocol. Finally, the detection of knowledge gaps will involve the identification of subtopics that are either unexplored or underrepresented in the literature. For that objective, we will use heat maps or bar plots to highlight these gaps. Subtopics devoid of studies or a small number of studies will be documented. Similarly, the evidence clusters will be identified using heat maps and bar plots, and subtopics with more evidence available will be highlighted.

Availability of data and materials

Data sharing is not applicable to this protocol article as no datasets were generated or analysed during the current study.

Piipponen J, Jalava M, de Leeuw J, Rizayeva A, Godde C, Cramer G, et al. Global trends in grassland carrying capacity and relative stocking density of livestock. Glob Chang Biol. 2022;28:3902–19.

Article   CAS   Google Scholar  

Herrero M, Havlík P, Valin H, Notenbaert A, Rufino MC, Thornton PK, et al. Biomass use, production, feed efficiencies, and greenhouse gas emissions from global livestock systems. Proc Natl Acad Sci USA. 2013;110:20888–93.

Notenbaert AMO, Douxchamps S, Villegas DM, Arango J, Paul BK, Burkart S, et al. Tapping Into the environmental co-benefits of improved tropical forages for an agroecological transformation of livestock production systems. Front Sustain Food Syst. 2021;5:434.

Article   Google Scholar  

Beal T, Gardner CD, Herrero M, Iannotti LL, Merbold L, Nordhagen S, et al. Friend or Foe? The role of animal-source foods in healthy and environmentally sustainable diets. J Nutr. 2023;153:409–25.

Lamarque P, Tappeiner U, Turner C, Steinbacher M, Bardgett RD, Szukics U, et al. Stakeholder perceptions of grassland ecosystem services in relation to knowledge on soil fertility and biodiversity. Reg Environ Change. 2011;11:791–804.

Bengtsson J, Bullock JM, Egoh B, Everson C, Everson T, O’Connor T, et al. Grasslands—more important for ecosystem services than you might think. Ecosphere. 2019. https://doi.org/10.1002/ecs2.2582 .

White R, Murray S, Rohweder M. Pilot analysis of global ecosystems grassland ecosystems. Washington: World Resources Institute; 2000.

Google Scholar  

Dondini M, Martin M, De Camillis C, Uwizeye A, Soussana J-F, Robinson T, et al. Global assessment of soil carbon in grasslands—from current stock estimates to sequestration potential. Rome: FAO Animal Production and Health Paper; 2023.

Lorenz K, Lal R. Soil organic carbon sequestration in agroforestry systems a review. Agron Sustain Dev. 2014;34:443–54.

Conant RT, Cerri CEP, Osborne BB, Paustian K. Grassland management impacts on soil carbon stocks: a new synthesis: a. Ecol Appl. 2017. https://doi.org/10.1002/eap.1473 .

Paustian K, Chenu C, Conant R, Cotrufo MF, Lal R, Smith P, et al. Climate mitigation potential of regenerative agriculture is significant. Washington: Regenerative Agriculture Foundation; 2020.

FAO. Measuring and modelling soil carbon stocks and stock changes in livestock production systems: Guidelines for assessment (Version 1). Livestock Environmental Assessment and Performance (LEAP) Partnership. 2019

Bai Y, Cotrufo MF. Grassland soil carbon sequestration: current understanding, challenges, and solutions. Science. 2022. https://doi.org/10.1126/science.abo2380 .

Bardgett RD, Bullock JM, Lavorel S, Manning P, Schaffner U, Ostle N, et al. Combatting global grassland degradation. Nature Rev Earth Environ. 2021;2021(2):720–35.

Schuman GE, Janzen HH, Herrick JE. Soil carbon dynamics and potential carbon sequestration by rangelands. Environ Pollut. 2002;116:391–6.

Conant RT. Grassland soil organic carbon stocks: status, opportunities, vulnerability. Recarbon Biosphere Ecosyst Global Carbon Cycle. 2012;275:302.

Peeters A. Importance, evolution, environmental impact and future challenges of grasslands and grassland-based systems in Europe. Grassl Sci. 2009;55:113–25.

Gang C, Zhou W, Chen Y, Wang Z, Sun Z, Li J, et al. Quantitative assessment of the contributions of climate change and human activities on global grassland degradation. Environ Earth Sci. 2014;72:4273–82.

Whitton C, Bogueva D, Marinova D, Phillips CJC. Are we approaching peak meat consumption? Analysis of meat consumption from 2000 to 2019 in 35 countries and its rela-tionship to gross domestic product. Animals. 2021;11:3466.

Wolf J, Chen M, Asrar GR. Global rangeland primary production and its consumption by livestock in 2000–2010. Remote Sensing. 2021;2021(13):3430.

Herrero M, Henderson B, Havlík P, Thornton PK, Conant RT, Smith P, et al. Greenhouse gas mitigation potentials in the livestock sector. Nat Clim Chang. 2016;6:452–61.

Bechini L, Costamagna C, Zavattaro L, Grignani C, Bijttebier J, Ruysschaert G. Drivers and barriers to adopt best management practices survey among Italian dairy farmers. J Clean Prod. 2020;245: 118825.

Zhang Z, Hua T, Zhao Y, Li Y, Wang Y, Wang F, et al. Divergent effects of moderate grazing duration on carbon sequestration between temperate and alpine grasslands in China. Sci Total Environ. 2023;858: 159621.

Byrnes RC, Eastburn DJ, Tate KW, Roche LM. A global meta-analysis of grazing impacts on soil health indicators. J Environ Qual. 2018;47:758–65.

Parsons AJ, Thornley JHM, Newton PCD, Rasmussen S, Rowarth JS. Soil carbon dynamics: the effects of nitrogen input, intake demand and off-take by animals. Sci Total Environ. 2013;465:205–15.

Gilmullina A, Rumpel C, Blagodatskaya E, Chabbi A. Management of grasslands by mowing versus grazing—impacts on soil organic matter quality and microbial functioning. Appl Soil Ecol. 2020;156: 103701.

Díaz de Otálora X, Epelde L, Arranz J, Garbisu C, Ruiz R, Mandaluniz N. Regenerative rotational grazing management of dairy sheep increases springtime grass production and topsoil carbon storage. Ecol Indic. 2021;125:107484.

de Almeida LL, Frazão S, Lessa LA, Fernandes TAM, Veloso LA, et al. Soil carbon and nitrogen stocks and the quality of soil organic matter under silvopastoral systems in the Brazilian Cerrado. Soil Tillage Res. 2021;205:104785.

Howlett DS, Mosquera-Losada MR, Nair PKR, Nair VD, Rigueiro-Rodríguez A. Soil carbon storage in silvopastoral systems and a treeless pasture in Northwestern Spain. J Environ Qual. 2011;40:825–32.

Wu GL, Liu Y, Tian FP, Shi ZH. Legumes functional group promotes soil organic carbon and nitrogen storage by increasing plant diversity. Land Degrad Dev. 2017;28:1336–44.

Measuring and modelling soil carbon stocks and stock changes in livestock production systems - Guidelines for assessment. Version 1. Rome: FAO. 2019.

Carlos López-Hernández J, Raj Aryal D, Villanueva-López G, Pinto-Ruiz R, Beatriz Reyes-Sosa M, Hernández-López A, et al. Carbon storage and sequestration rates in Leucaena leucocephala -based silvopasture in Southern Mexico. Agroforest Syst. 2023;98:1–17.

Varsha KM, Raj AK, Kurien EK, Bastin B, Kunhamu TK, Pradeep KP. High density silvopasture systems for quality forage production and carbon sequestration in humid tropics of Southern India. Agrofor Syst. 2019;93:185–98.

Teutscherová N, Vázquez E, Sotelo M, Villegas D, Velásquez N, Baquero D, et al. Intensive short-duration rotational grazing is associated with improved soil quality within one year after establishment in Colombia. Appl Soil Ecol. 2021;159: 103835.

Teague WR, Dowhower SL, Baker SA, Haile N, DeLaune PB, Conover DM. Grazing management impacts on vegetation, soil biota and soil chemical, physical and hydrological properties in tall grass prairie. Agric Ecosyst Environ. 2011. https://doi.org/10.1016/j.agee.2011.03.009 .

Richards C, Lawrence G. Adaptation and change in Queensland’s rangelands: Cell grazing as an emerging ideology of pastoral-ecology. Land Use Policy. 2009;26:630–9.

A protocol for measurement, monitoring, reporting and verification of soil organic carbon in agricultural landscapes. FAO. Rome. 2020.

Lugato E, Leip A, Jones A. Mitigation potential of soil carbon management overestimated by neglecting N 2 O emissions. Nature Climate Change. 2018;8:219–23.

Guenet B, Gabrielle B, Chenu C, Arrouays D, Balesdent J, Bernoux M, et al. Can N 2 O emissions offset the benefits from soil organic carbon storage? Glob Chang Biol. 2021;27:237–56.

Haas E, Carozzi M, Massad RS, Butterbach-Bahl K, Scheer C. Long term impact of residue management on soil organic carbon stocks and nitrous oxide emissions from European croplands. Sci Total Environ. 2022;836: 154932.

Jerray A, Rumpel C, Le Roux X, Massad RS, Chabbi A. N 2 O emissions from cropland and grassland management systems are determined by soil organic matter quality and soil physical parameters rather than carbon stock and denitrifier abundances. Soil Biol Biochem. 2024;190: 109274.

Jones SK, Rees RM, Skiba UM, Ball BC. Influence of organic and mineral N fertiliser on N 2 O fluxes from a temperate grassland. Agric Ecosyst Environ. 2007;121:74–83.

Cardenas LM, Thorman R, Ashlee N, Butler M, Chadwick D, Chambers B, et al. Quantifying annual N 2 O emission fluxes from grazed grassland under a range of inorganic fertiliser nitrogen inputs. Agric Ecosyst Environ. 2010. https://doi.org/10.1016/j.agee.2009.12.006

Haddaway NR, Kohl C, Rebelo Da Silva N, Schiemann J, Spök A, Stewart R, et al. A framework for stakeholder engagement during systematic reviews and maps in environmental management. Environ Evid. 2017;6:1–14.

Whitehead D, Schipper LA, Pronger J, Moinet GYK, Mudge PL, Calvelo Pereira R, et al. Management practices to reduce losses or increase soil carbon stocks in temperate grazed grasslands: New Zealand as a case study. Agric Ecosyst Environ. 2018;265:432–43.

Malpeli KC, Endyke SC, Weiskopf SR, Thompson LM, Johnson CG, Kurth KA, et al. Existing evidence on the effects of climate variability and climate change on ungulates in North America: a systematic map. Environ Evid. 2024;8:13.

Pullin A, Frampton G, Livoreil B, Petrokofsky G. Guidelines and standards for evidence synthesis in environmental management. Version 5.0. 2018.

Haddaway NR, Macura B, Whaley P, Pullin AS. ROSES reporting standards for systematic evidence syntheses: pro forma, flow-diagram and descriptive summary of the plan and conduct of environmental systematic reviews and systematic maps. Environ Evid. 2018. https://doi.org/10.1186/s13750-018-0121-7 .

Haddaway NR, Collins AM, Coughlin D, Kirk S. The role of google scholar in evidence reviews and its applicability to grey literature searching. PLoS One. 2015. https://doi.org/10.1371/journal.pone.0138237 .

Veritas Health Innovation. Covidence systematic review software. Melbourne, Australia. www.covidence.org

Lemaire G, Gastal F, Franzluebbers A, Chabbi A. Grassland-cropping rotations: an avenue for agricultural diversification to reconcile high production with environmental quality. Environ Manage. 2015;56:1065–77.

Öllerer K, Varga A, Kirby K, Demeter L, Biró M, Bölöni J, et al. Beyond the obvious impact of domestic livestock grazing on temperate forest vegetation—a global review. Biol Conserv. 2019;237:209–19.

Charman DJ. Peat and Peatlands. Encyclopedia of Inland Waters. 2009. https://doi.org/10.1016/B978-012370626-3.00061-2 .

McAuliffe GA, López-Aizpún M, Blackwell MSA, Castellano-Hinojosa A, Darch T, Evans J, Horrocks C, Le Cocq K, Takahashi T, Harris P, Lee MRF, Cardenas L. Elucidating three-way interactions between soil, pasture and animals that regulate nitrous oxide emissions from temperate grazing systems. Agric Ecosyst Environ. 2020. https://doi.org/10.1016/j.agee.2020.106978 .

Cubillos AM, Vallejo VE, Arbeli Z, Terán W, Dick RP, Molina CH, Molina E, Roldan F. Effect of the conversion of conventional pasture to intensive silvopastoral systems on edaphic bacterial and ammonia oxidizer communities in Colombia. Eur J Soil Biol. 2016;72:42–50.

Rivera JE, Villegas GO, Serna LP, Chará J. Cattle intensification based on silvopastoral systems with Leucaena leucocephala (Lam) de Wit as a strategy to increase production and mitigate greenhouse gas emissions in the Caribbean region of Colombia. Agroforest Syst. 2024. https://doi.org/10.1007/s10457-024-01000-y .

Smith WN, Grant BB, Desjardins RL, Worth D, Li C, Boles SH, et al. A tool to link agricultural activity data with the DNDC model to estimate GHG emission factors in Canada. Agric Ecosyst Environ. 2010;136:301–9.

Download references

Agroscope co-authors would like to thank the Swiss National Science Foundation for its support of the CarboGrass project (Grant No. 31SL30_214523). Rothamsted Research co-author receives strategic funding from the Biotechnology and Biological Sciences Research Council of the United Kingdom (BBSRC). CS acknowledges support from the Growing Health Institute Strategic Programme [BB/X010953/1; BBS/E/RH/230003B; BBS/E/RH/230003C]. AgResearch co-authors are funded by the Ministry for Primary Industries (MPI), project number 2023-EJPSOILS-CarboGrass-AGR. UPM co-authors are funded by the Spanish Ministry of Science and Innovation through the project number PCI2023-143386. CIAT co-author is founded by The CGIAR Research Initiative on Livestock and Climate. CIPAV co-author is funded by the New Zealand Government to support the objectives of the Global Research Alliance on Agricultural Greenhouse Gases (GRA). KIT co-author is funded by the German Ministry for Education and Research (BMBF) (funding number 031B1396).

Author information

Authors and affiliations.

Integrative Agroecology Group, Research Division Agroecology & Environment, Reckenholzstr. 191, 8046, AgroscopeZurich, Switzerland

Camille Rousset, Anina Gilgen & Lutz Merbold

Net Zero and Resilient Farming. Rothamsted Research - North Wyke. Okehampton, Okehampton, UK

Carmen Segura

AgResearch Ltd, Ruakura Research Centre, 10 Bisley Road, Hamilton, 3214, New Zealand

Marta Alfaro

Departamento de Producción Agraria, ETSIAAB, Universidad Politécnica de Madrid (UPM), Madrid, Spain

Luís André Mendes & Eduardo Vázquez

AgResearch Ltd, Grasslands Research Centre, Private Bag 11008, Palmerston North, 4442, New Zealand

Institute for Meteorology and Climate Research, Atmospheric Environmental Research (IMK-IFU), Karlsruhe Institute of Technology, Garmisch-Partenkirchen, Germany

Batnyambuu Dashpurev

International Center for Tropical Agriculture (CIAT), Km 17 Recta Cali-Palmira, Palmira, Colombia

Mike Bastidas

Centre for Research On Sustainable Agriculture (CIPAV), Cali, Colombia

Julian Rivera

Department of Soil Science and Agricultural Chemistry, University of Granada, Granada, Spain

You can also search for this author in PubMed   Google Scholar

Contributions

CR and EV jointly contributed to the conceptualization of the study and writing the manuscript. CR created the tables and figures presented. All authors collectively contributed to the development of the eligibility criteria section, with specific focus on refining Table S3. All authors provided feedback, which was reviewed and incorporated into the manuscript. All authors approved the original draft and reviewed manuscripts.

Corresponding author

Correspondence to Camille Rousset .

Ethics declarations

Declarations.

The topic of this study was discussed and designed in response to a funding call proposed by the Second External Call of the European Joint Projects: soil, entitled “Managing and mapping agricultural soils for enhancing soil functions and services”. A consortium formed by scientific and researchers from ten institutions worldwide distributed applied to the Topic A “Soil restoration practices and management for alleviating land degradation, supporting agro-ecosystem function and maintaining soil organic carbon stocks” with a project proposal entitled “CarboGrass: Impact of grassland management on soil carbon storage.”

Ethics approval and consent to participate

Not applicable.

Consent for publication

Competing interests.

The authors declare that they have no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1. roses checklist for the systematic map., rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Rousset, C., Segura, C., Gilgen, A. et al. What evidence exists relating the impact of different grassland management practices to soil carbon in livestock systems? A systematic map protocol. Environ Evid 13 , 22 (2024). https://doi.org/10.1186/s13750-024-00345-2

Download citation

Received : 25 March 2024

Accepted : 24 July 2024

Published : 24 August 2024

DOI : https://doi.org/10.1186/s13750-024-00345-2

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Grassland practices
  • Climate change mitigation

Environmental Evidence

ISSN: 2047-2382

peer reviewed websites journals

IMAGES

  1. How to Find Peer-Reviewed Journal Articles in Discovery

    peer reviewed websites journals

  2. What are the best peer-reviewed journals?

    peer reviewed websites journals

  3. Finally UGC Approved Peer-Reviewed Journals for University Faculty

    peer reviewed websites journals

  4. Open Access and Peer-Reviewed Journals for free publication

    peer reviewed websites journals

  5. Peer reviewed journals list PDF: all subjects

    peer reviewed websites journals

  6. Tips for Publishing in Peer-Reviewed Journals: Building Your Research

    peer reviewed websites journals

COMMENTS

  1. Google Scholar

    Google Scholar provides a simple way to broadly search for scholarly literature. Search across a wide variety of disciplines and sources: articles, theses, books, abstracts and court opinions.

  2. Frontiers

    Get the latest research updates, subscribe to our newsletter. Open access publisher of peer-reviewed scientific articles across the entire spectrum of academia. Research network for academics to stay up-to-date with the latest scientific publications, events, blogs and news.

  3. PubMed

    PubMed® comprises more than 37 million citations for biomedical literature from MEDLINE, life science journals, and online books. Citations may include links to full text content from PubMed Central and publisher web sites. ... a systematic review, meta-analysis, and network meta-analysis. Zhao Y, et al. Lancet Oncol. 2024. PMID: 39159630. See ...

  4. JSTOR Home

    Harness the power of visual materials—explore more than 3 million images now on JSTOR. Enhance your scholarly research with underground newspapers, magazines, and journals. Take your research further with Artstor's 3+ million images. Explore collections in the arts, sciences, and literature from the world's leading museums, archives, and ...

  5. Directory of Open Access Journals

    About the directory. DOAJ is a unique and extensive index of diverse open access journals from around the world, driven by a growing community, and is committed to ensuring quality content is freely available online for everyone. DOAJ is committed to keeping its services free of charge, including being indexed, and its data freely available.

  6. Taylor & Francis Online: Peer-reviewed Journals

    Explore journals and articles by subject. Search and explore the millions of quality, peer-reviewed journal articles published under the Taylor & Francis, Routledge and Dove Medical Press imprints. Area Studies.

  7. Home

    Rigorously reported, peer reviewed and immediately available without restrictions, promoting the widest readership and impact possible. We encourage you to consider the scope of each journal before submission, as journals are editorially independent and specialized in their publication criteria and breadth of content. PLOS Biology PLOS Climate

  8. ScienceDirect.com

    3.3 million articles on ScienceDirect are open access. Articles published open access are peer-reviewed and made freely available for everyone to read, download and reuse in line with the user license displayed on the article. ScienceDirect is the world's leading source for scientific, technical, and medical research.

  9. Find a journal

    Elsevier Journal Finder helps you find journals that could be best suited for publishing your scientific article. Journal Finder uses smart search technology and field-of-research specific vocabularies to match your paper's abstract to scientific journals.

  10. Scopus

    Scopus is the largest abstract and citation database of peer-reviewed literature: scientific journals, books and conference proceedings. Delivering a comprehensive overview of the world's research output in the fields of science, technology, medicine, social sciences, and arts and humanities, Scopus features smart tools to track, analyse and visualise research.

  11. Plos One

    Prokop-Dorner and colleagues reviewed educational interventions used in 115 studies on the development of critical thinking regarding health. The interventions focused mainly on lifestyle-related health issues. The authors recommend more detailed reporting and advocate for a reporting checklist to describe health education interventions.

  12. SpringerOpen

    Publishing with SpringerOpen makes your work freely available online for everyone, immediately upon publication, and our high-level peer-review and production processes guarantee the quality and reliability of the work. Open access books are published by our Springer imprint. Find the right journal for you. Explore our subject areas.

  13. Journals

    The home of 500 peer-reviewed journals published by Oxford University Press and learned societies from around the world. Explore journals Get help with access. Publish open access. Read and publish agreements can provide you with transparent, flexible, and inclusive options for open access publishing in OUP journals.

  14. Peer Review: An Introduction: Where to Find Peer Reviewed Sources

    It isn't hard to find peer-reviewed sources: you just need to know where to look! If you start in the right place, you can usually find a relevant, peer-reviewed source for your research in as few clicks as a Google search, and you can even use many of the search techniques you use in Google and Wikipedia.

  15. The New England Journal of Medicine

    The New England Journal of Medicine (NEJM) is a weekly general medical journal that publishes new medical research and review articles, and editorial opinion on a wide variety of topics of ...

  16. Journalism: Sage Journals

    Journalism is a major international, peer-reviewed journal that provides a dedicated forum for articles from the growing community of academic researchers and critical practitioners with an interest in journalism. The journal is interdisciplinary and publishes both theoretical and empirical work and contributes to the social, economic, political, cultural and practical understanding of journalism.

  17. APA and Affiliated Journals

    Browse over 90 peer reviewed journals panning the breadth and depth of psychology, many published in partnership with APA's specialty Divisions and other national and international societies.

  18. ScienceOpen

    Make an impact and build your research profile in the open with ScienceOpen. Search and discover relevant research in over 95 million Open Access articles and article records; Share your expertise and get credit by publicly reviewing any article; Publish your poster or preprint and track usage and impact with article- and author-level metrics; Create a topical Collection to advance your ...

  19. Sage Open: Sage Journals

    SAGE Open. Sage Open is a peer-reviewed, "Gold" open access journal that publishes original research and review articles in an open access format. Accepted articles span the full extent of the social and behavioral sciences and the humanities. View full journal description.

  20. Sociological Research Online: Sage Journals

    Sociological Research Online was launched as the first online-only peer-reviewed Sociology journal in 1996. This enables faster publication times and a range of formats, including giving readers direct access to audio, visual and video data, and thematic … | View full journal description. This journal is a member of the Committee on ...

  21. APA PsycArticles

    A comprehensive and essential database of full-text, peer-reviewed articles published by the APA Journals™ and affiliated journals. Overview. APA PsycArticles is a must-have for any core collection in the social and behavioral sciences providing access to 119 journals and journal coverage dating back to 1894.

  22. Journals Ranking

    Information about acceptance rates and circulation for peer-reviewed journals in the humanities is often tough to find at their websites. The best source of this information on literary scholarship journals is the MLA Directory of Periodicals, which provides a wealth of other information as well. However, since the information there about ...

  23. Journal of Materials Chemistry A

    Materials for energy and sustainability Editor-in-chief: Anders Hagfeldt Impact factor: 10.7 Time to first decision (peer reviewed only): 30 days. Submit your article Opens in new window Information and templates for authors Search this journal. Find an article. Year. Page . Find issues by year (2013 - Present) ...

  24. Green Chemistry Home-The home of cutting-edge research on the

    The home of cutting-edge research on the development of alternative sustainable technologies. Editorial Board Chair: Javier P&#233;rez-Ram&#237;rez Impact factor: 9.3 Time to first decision (peer reviewed only): 35 days

  25. For Authors

    JAMA, published continuously since 1883, is an international peer-reviewed general medical journal.JAMA is a member of the JAMA Network, a consortium of peer-reviewed, general medical and specialty publications.. Journal Reach. JAMA is the most widely circulated general medical journal in the world, with more than 125,000 recipients of the print journal, more than 2.6 million recipients of ...

  26. Public Domain and Paywalled: Journal Articles Authored or Co-authored

    We suggest best practices for journal publishers, as well as possible actions by U.S. government agencies, library organizations, and institutional repositories. The U.S. public domain provides an opportunity to increase the number of peer-reviewed journal articles that are open access.

  27. The top 10 journal articles from 2023 examined the effects of social

    APA's 89 journals published more than 5,500 articles in 2023. Here are the top 10 most read. The top 10 journal articles from 2023 examined the effects of social media, CBT for substance use, and the psychology of gig work

  28. Immune checkpoint gene signature assesses immune infiltration profiles

    Peer Review reports. Introduction. Bladder cancer (BLCA) is the seventh most common type of malignant tumor worldwide . Moreover, approximately 549,393 people were newly diagnosed with bladder cancer, and 199,922 patients died of the disease in 2018 . Besides basic diagnosis based on symptoms and physical exams, exfoliated urothelial cells and ...

  29. Journal article references

    If a journal article has a DOI, include the DOI in the reference. Always include the issue number for a journal article. If the journal article does not have a DOI and is from an academic research database, end the reference after the page range (for an explanation of why, see the database information page).The reference in this case is the same as for a print journal article.

  30. What evidence exists relating the impact of different grassland

    While the primary focus will be on peer-reviewed articles, other forms of literature such as book chapters or conference proceedings will also be considered. The year of publication will not be restricted. Academic bibliographic databases. The academic bibliographic databases used for this study are listed in Table 2. The literature search will ...