University Rankings

What are University Rankings?

University rankings are diverse, imperfect — and influential.

Your university has a unique mission. You and your colleagues work hard to attract the right students, talent, and funding to ensure you can achieve it. You know you are doing a great job. But how do you communicate that to the students, researchers, faculty members (and, in some countries, policymakers and funding agencies) considering your university? They want to understand not only how you are performing but how your performance compares to your peers. Enter the world of university rankings.

Download this guide in PDF format 打開新的分頁／視窗

Rankings are not perfect, but useful

University rankings and league tables are easily accessible and provide a simple way to compare higher education institutions based on similar criteria. But there is always room for improvement, and rankings are often the object of criticism 打開新的分頁／視窗, especially when conflated with reputation.

Due to their limitations, you should not use rankings and league tables as a stand-alone measurement. They are best when used as decision-making tools in conjunction with other indicators and data. We explore this topic further in Are university rankings flawed? 打開新的分頁／視窗

Rankings are many, and not one size fits all

As the IREG Observatory on Academic Ranking and Excellence 打開新的分頁／視窗 notes on their website, ranking organizations should:

Recognize the diversity of institutions and take the different missions and goals of institutions into account. Quality measures for research-oriented institutions, for example, are quite different from those that are appropriate for institutions that provide broad access to underserved communities.

Understand Scopus and SciVal’s role in university rankings.

There are now more than 20 university ranking reports or organizations with a global focus, and even more with a regional or discipline-specific rankings. Each university is unique in its mission and purpose; each ranking has its niche, methodology, data sources and indicator. See “How are rankings calculated 打開新的分頁／視窗” for more detail.

The chart below offers a quick glimpse into the growth in international ranking organizations over time. It includes league tables launched to address the different types of universities and their missions.

Rankings are influential

Rankings are often the go-to resource for students, parents, researchers, potential faculty members, funders, and other bodies seeking an objective insight into your university’s performance and ability.

Why do rankings matter?

Over the past 20+ years, international university rankings have grown in visibility and prominence. They can influence:

• How your government measures research excellence for your institution

• Whether an undergraduate or graduate student (and their parents) opt for your university

• Why a company selects you as a partner

• Whether a funding body invests in research at your university

In "Perspectives on rankings from a young university 打開新的分頁／視窗,” an episode of the Research 2030 podcast 打開新的分頁／視窗, César Wazen, Director of International Affairs, Qatar University 打開新的分頁／視窗, notes his opinion on why rankings matter.

Listen in his own words. 打開新的分頁／視窗

You can hear more of Wazen’s insights in the entire episode 打開新的分頁／視窗. Although rankings are not the sole indicator of your institution’s reputation and academic excellence, they provide a quantitative and popular way to benchmark universities nationally, regionally, and globally.

Rankings increase your university’s visibility 

Since being ranked can increase your university’s visibility and profile, it is a tool to promote your visibility. In turn, rankings help your audiences, e.g., students, potential faculty, potential collaborators and more. Further, being ranked, regardless of your position, can optimize your chances of being selected as a student’s higher education provider of choice.

Why rankings can play a role in attracting international students

Until recently, international students were a valuable income source for many higher education institutions. University rankings have long been a popular tool for those students when choosing where to study, especially given that many don’t have the time or funds to visit an overseas campus before enrolling. For some years, mainland China has been one of the most significant sources of international students. For example, Chinese students make up the largest share (30%) of non-domestic students in the US.

Although COVID-19 and geopolitical tensions may reduce the number of Chinese students opting to study overseas, the country’s dominance of the international student market looks set to continue. According to an article 打開新的分頁／視窗 from QS, nearly half (44%) admit that finding a well-ranked university is crucial to them. High-quality teaching is their most important consideration (60%), closely followed by having a good reputation for their chosen subject (54%). These are two measures covered in the major university rankings.

As we can see in this Universities UK graph, by 2018, the US was the most popular destination for international students, with the UK in second place. However, Australia’s strong growth before COVID-19 had left it ideally placed to take over that number two spot.

But that looks set to change. Many predict that following a tough 2020 for universities, 2021 will likely prove just as challenging, with concerns over COVID-19 and ongoing travel and visa restrictions negatively impacting international student numbers.

And that will hurt university income. This graph by Multirank, an organization that compares universities, suggests that some countries will be harder hit than others, particularly Australia and the UK.

Falling international student numbers also have financial implications for your country or region. For example, in 2019, the Association of International Educators (NAFSA 打開新的分頁／視窗) reported that

...international students studying at US colleges and universities contributed $41 billion and supported 458,290 jobs to the US economy during the 2018-2019 academic year.

In 2020, NAFSA  reported 打開新的分頁／視窗 that during the 2019-2020 academic year, the financial contribution of $41 billion had dropped by 4.4% - a loss of $1.8 billion. The number of supported jobs fell by 9.2%.

Competition for both domestic and international students is rising. Rankings, and your university’s position within them, are likely to play an increasingly important role.

Who publishes University Rankings?

Rankings are developed and published by various organizations, including magazines, newspapers, websites, academics, and governments. Some ranking organizations specialize in world rankings, others in national or regional, and a few do both. This page concentrates on ranking organizations with a global remit and research output focus.

A brief history of global rankings

According to Hazelkorn’s article, “Global science, national research, and the question of university rankings 打開新的分頁／視窗,” in 2003, Shanghai Jiao Tong launched the Academic Ranking of World Universities (ARWU 打開新的分頁／視窗), also known as the Shanghai Ranking. With the economy becoming increasingly global and higher education more international, it was clear that a framework was needed to map, compare, and understand university performance.

From 2003 on, multiple ranking organizations and reports have entered the arena, expanding options into how you can compare Higher Education Institutions with a greater variety in niche reports.

Two examples of this are:

• The QS World Rankings’ University Rankings by Subject 打開新的分頁／視窗 launched in 2011: It considers varying research cultures and publication rates across academic disciplines.

• Times Higher Education’s (THE) THE Impact Rankings 打開新的分頁／視窗 introduced in 2019: It is “a new global university ranking that aims to measure institutions’ success in delivering the United Nations’ Sustainable Development Goals.”

From The Economist:

The rankings race is thus marked by a happy irony. Driven in part by nationalistic urges, it has fostered the growth of a community that knows no borders. Critics are right that governments and universities obsess too much about rankings. Yet the world benefits from the growth of this productive, international body of scholars.

Source accessed July 28, 2020: https://www.economist.com 打開新的分頁／視窗

What are some of the key global ranking organizations, and how do they differ?

Quacquarelli Symonds (QS), Times Higher Education (THE) and Shanghai Ranking (the Academic Ranking of World Universities; ARWU) are considered among the most established and prominent global ranking bodies.

Seven key global ranking reports to know are (in alphabetical order):

• CWTS Leiden Rankings 打開新的分頁／視窗

• Shanghai Rankings (ARWU) 打開新的分頁／視窗

• Times Higher Education World University Rankings 打開新的分頁／視窗

• Times Higher Education Impact Rankings 打開新的分頁／視窗

• QS World University Rankings 打開新的分頁／視窗

• QS World University Rankings by Subject 打開新的分頁／視窗

• US News & World Report: Best University Rankings 打開新的分頁／視窗

You can get a glance into seven major ranking reports in this guide

Download the quick guide 打開新的分頁／視窗

How are universities ranked?

Before we dive into how the rankings organization calculates their rankings, remember they differ significantly in methodology and evolve year to year. They have their limitations and shouldn’t be used in isolation to assess reputation or excellence.

As Lydia Snover, Director of Institutional Research at the Massachusetts Institute of Technology, commented in a Times Higher Education (THE) blog post 打開新的分頁／視窗

Let me be clear: there is no such thing as a perfect university ranking. There is no ‘correct’ outcome as there is no single model of excellence in higher education, and every ranking is based on the available, comparable data, and is built on the subjective judgement (over indicators and weightings) of its compilers.

Why is it important to understand methodologies?

The focus area(s), algorithms and methodologies vary across the growing number of ranking tables and reports produced worldwide. Once you grasp the inner workings, you will understand how your practices and data can impact that ranking’s outcome. We look at this in more detail in Can I influence university rankings 打開新的分頁／視窗?

Where do ranking organizations get their data and information?

All ranking methodologies rely on data inputs from a range of external resources. These often include the three examples listed below. Still, much depends on the niche and focus of that particular league table. Similarly, the weighting and calculations selected for each element will depend on the report’s specific direction.

• Your university’s institutional data and researcher data (based on research output) from bibliometric or citation indexing databases, such as Scopus and SciVal

• Data drawn from university departments such as human resources, student administration, finances

• Reputation surveys conducted with faculty, students, alumni, and employers

Understand Scopus and SciVal’s role in university rankings

Most ranking organizations’ websites offer some detail about their methodology to help you understand their focus and the data and information used to inform their results.

Where can I find information on the calculations and weighting used?

Please see the lists above or download the quick guide 打開新的分頁／視窗.

Are university rankings flawed?

According to critics, the answer is yes! They claim that current systems:

• Are based upon flawed data assumptions

• Negatively impact student school selection

• Exclude data important to students

• Fail to consider the mission of the university

• Stifle individuality and creativity

Why are the university rankings calculations so problematic?

Ellen Hazelkorn, a global rankings researcher, states in the article 打開新的分頁／視窗, University Rankings: there is room for error and ‘malpractice’”, believes university rankings are popular because they are simple. However, “…this is also the main source of criticism.” No single ranking can capture the full depth and breadth of a university’s contributions.

For Hazelkorn, issues include:

• Their lack of objectivity: Ranking organizations determine the indicators and weightings that are most important.

• Their priorities: Most rankings consider attributes for which (internationally) comparable data are available, typically research and reputation. There is little or no focus on other vital areas, such as student and societal engagement or even teaching and learning.

Many feel that rankings rely too much on “proxies,” for example some use factors like the number of Nobel-prize-winning alumni or the value of endowments when determining education quality. Others claim algorithm bias, with some institutions always at the top, including those publishing in English. Others point to the fact that the placement of a university can vary wildly per ranking organization.

Here is Josh Wyner 打開新的分頁／視窗, Founder and Executive Director of the College Excellence Program at the Aspen Institute, discussing rankings that focus on student outcomes.

They don’t typically give colleges rewards for equity: for keeping their doors as open as possible. Nor do they look at how much students grow while they are at college. If… you don’t look at where they enter or how likely they are to achieve those outcomes – given how well-prepared they were and how wealthy they were when they entered college – you may be distorting the picture.

Rankings: what do they mean for universities on a mission?

For mission and value-led organizations, university rankings can be particularly problematic since the principles they use to judge themselves are not in the various calculations. These include open science, equality, diversity and other society-focused agendas. On the Malcolm Gladwell 打開新的分頁／視窗 podcast, Revisionist History, in the episode “Project Dillard 打開新的分頁／視窗,” he speaks with Walter M. Kimbrough, President of Dillard University 打開新的分頁／視窗, a US Historically Black College and University (HBCU). Kimbrough describes his college as one that wants to educate as many people as the can. Yet, the fact that their mission includes teaching an economically disadvantaged lowers their rank. Many ranking organizations actively work with universities and third-party entities to learn, evolve, and adapt their models. As technology, transparency and understanding improve, so will university rankings.

What is the future of university rankings?

Most agree that rankings are here to stay. But will they evolve to address some of the concerns raised in the Are university rankings flawed? 打開新的分頁／視窗 In the future, we expect to see:

• Shifts in methodology in response to Covid-19

• A rise in more focused rankings

• A move beyond traditional measures

• Increasing use of third-party data and AI technologies

The pandemic and global rankings – what will Covid-19 change?

Potentially, quite a lot. Ranking organizations are still considering their response to the pandemic. Some plan to take a fresh look at their methodology to acknowledge the virus’ impact on teaching and learning, collaboration, and international students. Some wonder how to account for the rapid rise in some universities’ publications linked to Covid-related research.

As Elizabeth Gadd of INORMS said in the March 2021 article “Measure what matters: Ranking universities in the age of pandemic 打開新的分頁／視窗,”

What we are finding with all sorts of research evaluation issues is that the pandemic is not going to impact in the next 12 months. It’s going to be impacting over the next ten years.

Some believe the popularity of global rankings may dip as prospective students, faced with potential travel restrictions and a tighter budget, turn to national and regional rankings instead.

Do we need so many university rankings?

The world is changing, and so are universities. Existing rankings organizations have responded with new tables that rank universities by subject area, geographic location, societal contribution, or degree types.

We’ve also seen new organizations dip a toe into the rankings market. The Three University Missions Moscow International University Ranking 打開新的分頁／視窗 claims to be the first to evaluate education, research and interaction with society.

But more indicators and rankings equals more data collection for universities, and countries with fewer resources will suffer, according to rankings expert Richard Holmes 打開新的分頁／視窗 in “Universities in places like Africa will not allocate resources to report data.”

To solve this problem, QS 打開新的分頁／視窗 believes we could see rankers increase their use of third-party data. They may even turn to external organizations “to produce objective and accurate data for analysis.” Using this kind of data could help address the claim that current methodologies often lack transparency. Additionally, by adopting artificial intelligence technologies, for example, natural language processing (NLP), the burden on data collection could decrease.

Is it time to expand the rankings’ indicators?

The previous section, Are university rankings flawed? 打開新的分頁／視窗 makes clear that many believe that rankers should stop focusing on reputation or traditional research metrics and start including other kinds of measures. For example:

• Article usage

• Media and social media mentions,

• Citations in policy or clinical documents

We also expect to see a greater focus on societal contributions. Currently, Times Higher Education (THE) Impact Rankings assesses universities against the United Nations' Sustainable Development Goals (SDGs).

Perhaps the key is to step away from the concept of “ranking” altogether. In the Research 2030 打開新的分頁／視窗 podcast episode "Societal Impact, SDG Research & Universities: A conversation with Professor Aluísio Segurado of University of São Paulo 打開新的分頁／視窗," Segurado, Head of Research at the Brazilian university, suggests taking a more multidimensional approach. He believes this will not only support comparative analysis but help universities identify collaborators.

Listen in his own words. 打開新的分頁／視窗

Can I influence university rankings?

With the correct focus, effort, and tools, you can make sure your ranking accurately reflects your institution. According to Cesar Wazen of Qatar University:

…we included the ranking effort as part of the initiatives and objectives and KPIs of our strategy. We have formed a committee at the institutional level that is called, you know obviously ranking committee and we have a presentation, and it offers some experts in statistics and the fields and research from the college. So basically, a good group of people that are approaching rankings from different perspectives and trying to align the efforts and the excellence the university you know is engaging in and performing in research, and also in teaching with the indicators of the rankings. And I think this is starting to do us good on all levels.

While you may not be able to change your rank directly, there are some steps you can take to make sure your ranking reflects your university.

1. Determine which ranking best fits your needs

2. Stay informed of the methodology

3. Monitor your institution’s progress on strategic initiatives

Since there are many factors that influence rank position, including other universities being added, a change to your position may be the result of these parameters.

Determine which rankings reflect you

There are numerous university rankings in the world. As mentioned in the section, “Who publishes university rankings,” each ranking has its focus and mission. Some examples are:

• THE Young Universities 打開新的分頁／視窗 lists the best universities younger than 50 years.

• THE Impact Rankings 打開新的分頁／視窗 assesses universities against the UN SDGs

• QS Global MBA Rankings 打開新的分頁／視窗 provides a comprehensive list of the best places to study for an MBA

• QS World University Rankings by Subject 打開新的分頁／視窗 covers a total of 51 disciplines

Three of the most popular global rankings are:

• THE World University Rankings 打開新的分頁／視窗

• QS World University Rankings 打開新的分頁／視窗

• ARWU 打開新的分頁／視窗 also known as Shanghai

While their missions are similar, they differ in their methodologies. For example, in 2023, THE ranked the University of Oxford in the first position, while QS ranked Massachusetts Institute of Technology (MIT) and ARWU ranked Harvard University in the top position.

Stay informed of the methodology

Once you have determined which ranking you are focusing on, stay up to date on their methodology and the changes that they make year to year. Some data comes from your university, so this can help you prepare ahead of any deadlines.

Staying informed of the methodology includes understanding the underlying data that the rankers depend on. For example, THE’s methodology includes:

• Data you provide

• Reputation survey data

• Bibliometric data from Scopus & SciVal

Evaluating all the data sources available to you for accuracy can help ensure an accurate rank.

You can also use tools such as SciVal to benchmark your research against your peers.

Monitor your institution’s progress on strategic initiatives

Perhaps the best way of looking at rankings is best summarized by Cesar Wazen from Qatar University when he speaks about rankings and strategy on the Research 2030 podcast 打開新的分頁／視窗. In the podcast Wazen mentions that initially they didn’t care that much about rankings with thoughts such as, “Our mission is to educate and to train Qatari nationals.” Eventually he changed his mind:

We realized that tracking is not only a game to play…but also contains some very interesting indicators that can provide the university with answers on whether where it was doing well and bad and benchmarking it with regional and worldwide competitors.

In reflection, perhaps the question is not “Can I influence the rankings” but “Can I gain valuable insights from the information behind the rankings to strengthen my university overall?"

The bottom line: Will I rise in the rankings?

In summary, many factors contribute to your rank, with varying levers impacting where your university ultimately lands. You may invest time in checking the accuracy of your data, re-evaluating your strategy, or benchmarking your regional and worldwide peers yet not see substantial growth. Achieving a rise in the rankings is not a straightforward path, and there are no guarantees. But, the time you put into understanding and participating in university rankings can lead to a more accurate reflection and deeper understanding of your university overall. To do this, we encourage a two-pronged approach.

1. Make sure the source of bibliometric data for your institution’s research is an accurate reflection. In the case of QS and THE, this data comes from 

   Scopus.

2. Gather deeper insights into the levers driving your university rankings and those of other universities using analytic tools such as SciVal

Download this guide in PDF format. 打開新的分頁／視窗