Logo-aim
Arch Iran Med. 25(4):214-223. doi: 10.34172/aim.2022.37

Original Article

Ranking Universities of Medical Sciences as Public Health Services Provider Institutions in Iran: A Result-Chain Analysis

Nader Jahanmehr 1, 2, * ORCID logo, Arash Rashidian 3, 4, 5, Farshad Farzadfar 6, Ardeshir Khosravi 7, Mohammad Shariati 8, Ali Akbari Sari 3, 4, 5, Soheila Damiri 3 ORCID logo, Reza Majdzadeh 5, 9

Author information:
1Department of Health Economics, Management and Policy, Virtual School of Medical Education & Management, Shahid Beheshti University of Medical Sciences, Tehran, Iran
2Prevention of Cardiovascular Disease Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
3Department of Health Management and Economics, School of Public Health, Tehran University of Medical Sciences, Tehran, Iran
4Department of Global Health and Public Policy, School of Public Health, Tehran University of Medical Sciences, Tehran, Iran
5Knowledge Utilization Research Center, Tehran University of Medical Sciences, Tehran, Iran
6Non-Communicable Diseases Research Center, Tehran University of Medical Sciences, Tehran, Iran
7Center for Primary Health Care Management, Ministry of Health and Medical Education, Tehran, Iran
8Department of Community Medicine, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
9Department of Epidemiology and Biostatistics, School of Public Health, Tehran University of Medical Sciences, Tehran, Iran

*Corresponding Author: Nader Jahanmehr, PhD; Virtual School of Medical Education & Management, Shahid Beheshti University of Medical Sciences, Tehran, Iran. Email: n.jahanmehr@gmail.com

Abstract

Background:

Universities of medical sciences (UMSs) in Iran have geographic catchment areas (normally a province) in which they are responsible for public health services as well as provision of care by public providers. The present study strived to analyze and rank the performance of the medical sciences universities in improving the public health and primary healthcare.

Methods:

Data on 41 indicators on the output (16 indicators), outcome (16 indicators), and impact (9 indicators) levels were extracted from various data sources. Principal component analysis (PCA) was used to calculate the weight for each of the indicators. The score range for each level of performance is between 0 and 1. A score of 1 indicates the highest and a score of 0 indicates the lowest level of performance. Finally, the UMSs were ranked by their scores.

Results:

The national mean performance scores of the UMSs on the output, outcome, impact, and the composite indicator levels were 0.756, 0.641, 0.561, and 0.563, respectively. The results show that the changes in performance scores at different levels of the results chain are remarkable.

Conclusion:

The national mean performance of the UMSs of Iran is not satisfactory. However, there is considerable dispersion in their performance. Designing effective interventions in proportion to the conditions of universities on different levels of the results chain, developing a robust information system, conducting continuous monitoring and evaluation of public health are recommended for balanced improvements in public health and primary healthcare indicators in the country.

Keywords: Factor analysis, Healthcare disparities, Health status disparities, Public health, Primary health care

Copyright and License Information

© 2022 The Author(s).
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Cite this article as: Jahanmehr N, Rashidian A, Farzadfar F, Khosravi A, Shariati M, Akbari Sari A, et al. Ranking universities of medical sciences as public health services provider institutions in iran: a result-chain analysis. Arch Iran Med. 2022;25(4):214- 223. doi: 10.34172/aim.2022.37


Introduction

Due to intrinsic and instrumental characteristics, health is considered as one of the key dimensions of wellbeing and one of the primary requisites for economic growth and social solidarity.1 In the past decades, the key role of health in international development has been acknowledged and numerous attempts have been made to reduce the mortality and morbidity rate, universally or through a focus on specific population subgroups.2 As a result of these attempts, considerable progress has been made in improving health indicators on the global level.3,4 However, the widening gap in health achievements has become a major concern for policy-makers. There are differences in health outcomes across and within countries.1 Various studies, for example, have revealed evidence of the differences in health outcomes in Slovakia,5 the United States,6 Korea,7 Australia,8 China9 and Indonesia.10

Health disparities refer to the differences in health outcomes and their determinants among different population groups defined by social, demographic, environmental, and geographical characteristics.11 Monitoring regional health inequalities is one of the useful actions taken to unveil the geographical differences in health and to develop equity-oriented interventions. To explain the logic of measuring regional disparities, it could be stated that the population residing in a region is under the same conditions, which can directly or indirectly affect its health. These conditions include the inputs and processes of the health system, the availability of other services (e.g. education), local infrastructure, climate, environmental pollution, and local culture. Monitoring regional health inequalities can reveal important evidence that can support targeting by health programs and policies.12 Evidence has revealed inter-provincial and intra-provincial disparities in health indicators in Iran, which are not acceptable.13-17 For instance, despite the increased life expectancy of women in all provinces of Iran, there is a greater than 8.3-year difference across Iranian provinces.13

The difference in design, content, and management of health systems is one of the reasons for the differences in health outcomes.18 Hence, improving the performance of health systems is a priority in the discussions among governments, policy-makers, and healthcare providers around the globe.19 Decision-makers on all levels need to quantify the differences in the health system performance, identify the determining factors, and formulate policies that can improve the results in a variety of settings.18 Furthermore, achieving balanced regional development and reducing non-homogeneity and regional disparities are contingent on the understanding and analysis of the characteristics of each region regarding its position in the entire system.20 Comparable information on the performance of the health system and the principal factors determining the difference in the performances of different systems can also result in scientific health policies at the national and regional levels.18

One of the ultimate means of reducing the health disparities is increasing the quantity and quality of primary health care (PHC) services for the people who are vulnerable due to the effects of a set of health determinants.21 PHC is the first and the most important point of contact between the health system and the public whereby essential, continuous, comprehensive, and coordinated care is provided. These health care services increase the accessibility and quality of care and improve the health outcomes and equity of health outcomes.22 Hence, countries have started developing this sector as an essential element of their economic and social growth.23

In Iran, considerable changes were made in the organizational structure of the health system in 1985 including the establishment of independent regional units, known as Universities of Medical Sciences (UMSs).24 These universities have geographic catchment areas (normally a province) in which they are responsible for public health services as well as provision of care by public providers. Currently, Iran has 63 UMSs and faculties that implement the macro-policies and plans formulated by the Ministry of Health and Medical Education.25 Every UMS has a health deputy responsible for providing the first-level services including public health and primary healthcare.26 The public health deputies that provide health services have similar structures and hierarchies throughout the country and each of them solely provides services to a specific community. The present study strived for investigating the regional disparities in the health achievements related to the performance of the Iranian public health and primary healthcare systems using the results-chain framework. Also, UMSs were ranked based on their performances at different levels of the results chain. The health ranking presented in this study can be used as a catalyst to improve health by focusing on areas requiring improvement. When the media and community leaders are informed of the problem areas, they can approve the health policies and plans based on the provided evidence to improve the health outcomes.27


Materials and Methods

The goal of this applied cross-sectional study was to illustrate and rank the performances of 45 UMSs in Iran, regarding their role in improving public health based on the results-chain framework of their public health deputies and composite measures. To achieve this, the results chain framework proposed by Jahanmehr et al28 was used. A results chain framework shows how the system inputs and processes are reflected in the outputs, outcomes, and impacts. Hence, it can demonstrate the performance of health systems interventions.29 The results chain used in this study was composed of three levels: the output level which focuses on the health services coverage (16 indicators); the outcome level which focuses on health behavior and risk factors (16 indicators); and the impact level which focuses on the mortality and communicable and non-communicable diseases (NCDs) (9 indicators). The performances of universities were evaluated and ranked based on the 2010 data on four levels: output, outcome, impact, and a composite index (i.e. the combination of the three mentioned indices). Data was extracted from various sources includes: the census statistics published by the Iran Statistics Center, the statistical reports by the public health deputy of the Ministry of Health and Medical Education, the vital horoscope indicators, the results of the Multiple Indicator Health and Demographic Survey (IrMIDHS)30 and the results of the national survey of the risk factors of NCDs.31 Details about the selected indicators and the specific source of each of them and their descriptive statistics are presented in Table S1 and S2 in Supplementary file 1. Factor analyses were carried out in STATA 12 to assign weights of indicators. After preparing and assessing data quality, assigning weights to the indicators and ranking of the universities performances were done in the following steps.

Process and Criteria for Selecting the Indicators

By taking the opinion of experts as well as studying the available scientific resources and reviewing the experience of other countries, in meetings held at different times by the research team, after discussing the goals and strategies of the public health deputy of the Ministry of Health and Medical Education and information needs of various stakeholders, areas and indicators for evaluating the performance of public health deputies were selected. Also, the scientific criteria for selecting the indicators in this study were:

  • Covering the areas of activity of the public health deputy

  • Relevance of indicators

  • Availability of information at the university level

  • Measurability of indicators

  • Updates of indicators at different times by reliable sources

Investigating the Basic Assumptions of Analyzing the Fundamental Hypotheses for the Factor Analysis

The Kaiser-Meyer-Olkin (KMO) test was carried out to assess the sampling adequacy to obtain reliable results. The result of this test varies between 0 and 1, with a KMO result higher than 0.5 showing adequacy of data correlation for the factor analysis. In this study, the KMO result was higher than 0.5 at all levels. Therefore, the Bartlett Test of Sphericity was carried out to determine the adequacy of data. If the hypothesis on the lack of correlation among the variables is rejected, the data will be suitable for factor analysis. In all of the factor analyses in this study, the result of Bartlett’s test was significant.

Principal Component Analysis

The weight of the indicators is not the same in measuring the performance of public health deputies, so we used the factor analysis method to measure the weight for each of the indicators. Principal component analysis (PCA) is a practical method for determining the internal weights of a set of indicators to create a composite index. The purpose of this weighting method is to describe the indicators with a set of the most important vertical rotation factors.

Determining the Number of the Primary Factors at Different Performance Evaluation Levels

In terms of the constructing composite indicators handbook,32 three criteria were selected, namely the eigenvalue > 1, the over 10% explanation of the total variance of the dataset by each selected factor, and the over 60% explanation of the total variance of the dataset by the set of factors, as well as the scree plot that was used to select the factors.

Calculating the Indicators’ Weights

The important factors were extracted using the criteria mentioned earlier in the previous step. After extracting the factor loadings of all indicators, varimax rotation of all factors was carried out and the rotated factor loadings were obtained. The factor loadings of all indicators were raised up to the power of two, and the largest result was selected as the weight of the area from the factors for all indicators. The weight calculated for each indicator was multiplied by the variance ratio described by the related factor, and the result was used as the weight of that indicator. To determine the share (%) of each indicator, the indicator weight was converted to the share of one scale (% of 1) and the result was selected as the final weight of that indicator. The different steps of assigning weights to the output, outcome and impact indicators are presented in Tables S3 to S6 in Supplementary file 1. To rank the performances, the weighted sum of each of the three levels, namely the output, outcome, and impact levels, was calculated through a separate factor analysis by repeating the aforesaid steps. The only difference was in the promax rotation at this level. Hence, the final composite index calculated in this study was the result of 41 indicators at different levels of the results chain, which presented a comprehensive image of the performance of universities regarding their role in improving health in different regions of Iran. A composite index is the result of the mathematical combination of a set of indicators into a single number. This index can describe an entire set of indicators.33 Accordingly, some of the potential applications of the composite indices include comparing the health of a population to other populations, monitoring the variations of health in a given population, and identifying and quantifying the public health disparities in a population.34

The Score and Ranking Formula

After assigning weights to all indicators values, the performance score for each university was formed based on the following formula. The score is stated as a decimal.

Performancescoreofeachuniversity=InidicatorvalueofeachuniversitynationalmeanStandarddeviationofalluniversityvalue

Often referred to as a “Z-score”, this score indicates the number of standard deviations a university is above or below the national mean. Universities that have a higher value than the national average will have a positive performance while those with a lower value will have a negative performance. Scores are calculated to three decimal places and, in all performance levels, the highest score that each university can receive is equal to 1 and the lowest score is equal to zero. Where a value for the country overall is not available, the national mean is set at the average value of the universities in each level of result chain performance. Ranking is the ordering of universities according to their performance scores.

Adjustment of Direction in the Indicators

Before performing the analysis, all indicators included in the study were adjusted in the same direction (same sign) in terms of the impact on the result. For this purpose, the indicators that had the nature of a negative effect were converted into positive indicators by making an adjustment through subtracting all observations from the largest observation. By doing this, when interpreting the indicators, an increase in all of them is considered desirable.


Results

The present research was an attempt to evaluate and rank the performances of the UMSs of Iran in improving the public health conditions based on the results-chain of the public health deputies of these universities. Using the chain framework, the performances of the universities were evaluated and ranked at four levels including the output, the outcome, the impact, and the composite index levels. The factor analysis method was used to assign weights to the indicators at each of the four above-mentioned levels. Table 1 shows the weights assigned to each indicator. As seen, in creating the composite index, the highest weight was related to the outcome indicators.


Table 1. Final Weights of the Indicators at the Outcome, Output, Impact, and Composite Indicator Levels
Output Indicators Final Weight Outcome Indicators Final Weight
Neonates weighed at the time of birth 0.165 Prevalence of hypertension 0.021
Percentage of microbiologic quality of drinking water in rural areas 0.067 Prevalence of obesity 0.108
Percentage of microbiologic quality of drinking water in urban areas 0.063 Prevalence of overweight or obesity 0.147
Accessibility of clean drinking water in rural areas 0.014 Prevalence of hypothyroidism in screened neonates 0.016
The percentage of consumers of optimal drinking water resources. 0.126 The rate accurate awareness of HIV prevention in women aged between 15 and 54 years old 0.018
Sanitary disposal of children’s feces 0.016 The percentage of children who are exposed to the smoke of cigarettes at least once a week. 0.062
Percentage of refined iodized salts in public places and food stores 0.008 The percentage of children below the age of 5 suffering from diarrhea 0.074
The percentage of workshops covered by professional health services 0.053 Prevalence of extreme slimness in children below the age of 5 0.044
Percentage of employees covered by occupational examinations 0.011 Prevalence of severe dwarfism in children below the age of 5 years 0.131
Prenatal care coverage (at least two times) 0.029 The rate of exclusive breastfeeding up to the age of 6 years 0.041
Labors carried out in health centers (the public and private sectors) 0.143 The prevalence of low birth weight
Prenatal care provided by educated or trained caregivers 0.053 The percentage of smokers who smoke daily - men 0.018
The ratio of women who have given birth and have received prenatal supplements. 0.025 The prevalence of the low intake of fruit and vegetable 0.039
The coverage of users of contraception devices 0.108 The prevalence of under-activity 0.047
Children aged between 12 and 23 months, who are vaccinated against measles. 0.094 Successful treatment of new pulmonary tuberculosis cases with positive smears 0.008
Accessibility of clean bathrooms in villages 0.037 Bottle feeding 0.065
Impact Indicators Final Weight Composite Indicator Weights Final Weight
Death of neonates below the age of 1 month in every 1000 live births 0.178 Output indicators score 0.334
Death of children below the age of 5 years in every 1000 live births 0.179 Outcome indicators score 0.437
The still birth to live birth ratio in every 1000 births 0.058 Impact indicators score 0.277
The prevalence of diabetes in villagers over the age of 30 years 0.024
The standardized rate of incidence of women’s cancers 0.171
The standardized rate of incidence of men’s cancer 0.148
The total incidence of new tuberculosis cases 0.048
Incidence of measles 0.125
The incidence of malaria 0.065

At the output level, the average performance score of the universities was 0.756, while 65% of the universities gained the scores above average. Zahedan University gained the lowest score (0.009) and the 45th rank, while Qazvin University gained the highest score (0.950) and the first rank among all universities (Table 2).


Table 2. Public Health Scores and Ranks in Regions Covered by the Universities of Medical Sciences
Rank Output- process level Outcome Level Impact Level Composite Index Level
Medical University Score Medical University Score Medical University Score Medical University Score
1 Qazvin 0.950 Shahrud 0.936 Qom 1.00 Ilam 1.000
2 ChaharM & Bakhtiari 0.930 Fasa 0.881 Hormozgan 0.953 Bushehr 0.965
3 Ilam 0.928 Bushehr 0.866 Ilam 0.948 Birjand 0.863
4 Kurdistan 0.916 Gilan 0.848 Zabol 0.931 Gilan 0.840
5 Kashan 0.906 Birjand 0.837 Zanjan 0.893 Golestan 0.819
6 Neyshabur 0.905 Ilam 0.833 Bushehr 0.862 Shahrud 0.787
7 Dezful 0.892 Zabol 0.819 Zahedan 0.858 Ardabil 0.760
8 Gonabad 0.890 Hamadan 0.797 Bojnourd 0.856 ChaharM & Bakhtiari 0.756
9 Isfahan 0.889 Ardabil 0.788 ChaharM & Bakhtiari 0.848 Bojnourd 0.749
10 Golestan 0.885 Mazandaran 0.783 Birjand 0.758 Mazandaran 0.733
11 Bushehr 0.880 Bojnourd 0.779 Golestan 0.767 Azerbaijan-West 0.725
12 Gilan 0.876 Jahrom 0.774 Kohgiluyeh & BoyerA 0.729 Fasa 0.710
13 Sabzevar 0.869 Shahid-Beheshti 0.771 Ardabil 0.726 Hamadan 0.697
14 Zanjan 0.868 Shiraz 0.770 Qazvin 0.685 Lorestan 0.666
15 Markazi 0.867 Iran 0.758 Azerbaijan-West 0.697 Kermanshah 0.641
16 Semnan 0.864 Azerbaijan-Eeast 0.746 Lorestan 0.675 Gonabad 0.637
17 Torbat-Heidariye 0.840 Golestan 0.742 Gilan 0.598 Sabzevar 0.626
18 Mazandaran 0.840 Kermanshah 0.737 Babol 0.538 Shiraz 0.621
19 Azerbaijan-West 0.839 Mashhad 0.709 Mazandaran 0.532 Isfahan 0.606
20 Mashhad 0.835 Azerbaijan-West 0.709 Kermanshah 0.515 Mashhad 0.605
21 Qom 0.825 Gonabad 0.704 Hamadan 0.493 Jahrom 0.600
22 Ahvaz 0.812 Sabzevar 0.700 Kurdistan 0.484 Torbat-Heidariye 0.598
23 Tehran 0.812 Torbat-Heidariye 0.691 Jiroft 0.479 Babol 0.593
24 Birjand 0.810 Lorestan 0.687 Fasa 0.478 Zanjan 0.593
25 Yazd 0.807 Isfahan 0.686 Kerman 0.478 Kurdistan 0.585
26 Hamadan 0.788 Hormozgan 0.675 Rafsanjan 0.478 Azerbaijan-West 0.582
27 Babol 0.780 Babol 0.665 Shiraz 0.477 Hormozgan 0.572
28 Lorestan 0.778 Tehran 0.657 Jahrom 0.472 Shahid-Beheshti 0.525
29 Kermanshah 0.769 Kohgiluyeh & BoyerA 0.634 Shahrud 0.458 Kohgiluyeh & BoyerA 0.524
30 Shahrud 0.756 Zahedan 0.623 Semnan 0.448 Iran 0.519
31 Ardabil 0.753 ChaharM & Bakhtiari 0.603 Ahvaz 0.433 Neyshabur 0.516
32 Iran 0.726 Kurdistan 0.585 Dezful 0.427 Qazvin 0.504
33 Azerbaijan-Eeast 0.721 Jiroft 0.565 Azerbaijan-Eeast 0.422 Semnan 0.502
34 Shahid-Beheshti 0.718 Neyshabur 0.552 Neyshabur 0.402 Qom 0.499
35 Shiraz 0.714 Semnan 0.544 Sabzevar 0.402 Tehran 0.480
36 Fasa 0.700 Ahvaz 0.528 Torbat-Heidariye 0.400 Ahvaz 0.449
37 Jahrom 0.681 Kerman 0.489 Gonabad 0.390 Zabol 0.406
38 Rafsanjan 0.669 Zanjan 0.443 Mashhad 0.384 Kashan 0.327
39 Bojnourd 0.665 Qazvin 0.379 Isfahan 0.352 Jiroft 0.269
40 Kohgiluyeh & BoyerA 0.592 Kashan 0.363 Kashan 0.347 Kerman 0.250
41 Kerman 0.523 Markazi 0.351 Iran 0.232 Dezful 0.245
42 Hormozgan 0.469 Qom 0.319 Shahid-Beheshti 0.229 Markazi 0.239
43 Jiroft 0.443 Dezful 0.245 Tehran 0.224 Zahedan 0.127
44 Zabol 0.015 Yazd 0.161 Markazi 0.215 Yazd 0.033
45 Zahedan 0.009 Rafsanjan 0.104 Yazd 0.215 Rafsanjan 0.000
46 National average 0.756 National average 0.641 National average 0.561 National average 0.563

At the outcome level, the average performance score was 0.641 and 62% of the universities scored above the average. Rafsanjan University gained the lowest score (0.104) and the 45th rank, while Shahrud University gained the highest score (0.936) and the first rank among all of the universities (Table 2).

At the impact level, the average performance score was 0.561 and 37% of the universities gained the scores above average score. Yazd University gained the lowest score (0.215) and the 45th rank, while Qom University gained the highest score (1.00) and the first rank among all of the universities (Table 2).

As for the composite indicator obtained through the compilation of the indicators of the aforementioned three levels, the average performance score was 0.563 and almost 60% of the universities gained the scores above the average scores. Rafsanjan University gained the lowest score (0.00) and the 45th rank, while Ilam University gained the highest score (1.00) and the first rank among all of the universities (Table 2).

Figure 1 shows the dispersion and variations of the scores at all four levels. Shorter vertical lines represent smaller variations and greater similarities between the scores obtained at different levels. The performance scores of some universities such as Ardabil, Birjand, Bushehr, and Golestan universities along with the different levels were very similar; hence, with shorter vertical lines. However, the scores of many universities were different; hence, with a longer vertical line. It can be, therefore, concluded that the variations of scores in relation to each other at different levels were considerable and the universities exhibited different behaviors at different evaluation levels.

aim-25-214-g001
Figure 1.

Variations of the Performance Scores of the Medical Sciences Universities in Iran at Four Performance Evaluation Levels.


The national map of the medical sciences universities of Iran is depicted in Figure 2, based on their scores at the composite indicator level (the scores of universities are also shown on the map). Seemingly, those universities with a smaller area under coverage performed better and gained a higher rank compared to the universities with larger areas under coverage.

aim-25-214-g002
Figure 2.

National Map of the Performance Ranks of the Medical Sciences Universities of Iran.



Discussion

The present study was carried out to measure and rank the performance of the medical sciences universities of Iran, regarding improving the health conditions in their target populations. According to the results, the average performance score of the universities on the composite index was 0.563 in 2010. Although 60% of the universities gained the scores higher than the average score, the performance of the universities is considered as unacceptable in general. Therefore, improving the performance of many of these universities is dependent on strict revision of their policies and plans. Since the indicators included in this study reflect the overall health condition in Iran, the resulting scores indicate the average health condition in this country and the necessity of improving the performance for attaining better results in many indicators. Comparing Iran’s health indicators to other countries confirms this statement. In a study by Lim et al, Iran had the 104th rank among 188 countries after gaining a score of 58 on the health-related sustainable development indicators.35 Also, a study by Shahraz et al indicated that Iran holds the 13th and 12th ranks among the countries in the region regarding health-adjusted life expectancy and age-standardized mortality rate.36 The World Health Organization’s statistics reported that Iran gained the 60th, 149th, 150th, and 153rd ranks among 194 countries regarding the low maternal mortality rate, the under 5 mortality rate, the neonatal mortality rate, and the infants’ mortality rate. As regards the average life expectancy at birth and healthy life expectancy at birth, Iran gained the ranks of 65 and 89, respectively, worldwide.37

The best score on different levels was observed at the output level with an average score of 0.756. This level compromised of several indicators of inclusion in the master plans of the public health deputy, which form the frontline of the services provided by these deputies and are more closely related to the universities’ performances compared to other levels. Therefore, a better condition at this level in comparison with the other levels is not unexpected, and it can be concluded that the management of universities around the globe mainly work on planning and policy-making at this level, therefore gaining satisfactory results because of paying more attention and having specific plans at the coverage indicators level.

The performance scores of universities on the outcome and impact indicators were 0.641 and 0.561, respectively. Hence, the performance of universities at the outcome level was weaker than their performance at the outcome level; however, it was still better than their performance at the impact level. This level revolves around the disease factors, especially NCDs. The results of this study indicated that universities do not perform well in controlling the risk factors of diseases. Despite the considerable advances in controlling contagious diseases, NCDs are still considered as major health problems in Iran. In the past two decades, the rate of mortality caused by these diseases has increased by 14.5%.38 According to the global burden of disease study results in 2017, hypertension, high body mass index, hyperglycemia, tobacco, dietary risks and air pollution accounted for 10.29%, 9.32%, 8.31%, 7.11%, 7.09%, and 5.99%, of the total disease burden in Iran, respectively.39 The results of this study reflected the need for national interventions for controlling the risk factors of NCDs in Iran. In the past years, measures such as designing action plans for controlling and preventing NCDs in 2015, setting up a NCDs committee in the Ministry of Health and Medical Education, designing provincial plans for controlling NCDs, and implementing early screening plans for NCDs risk factors and their treatment at low costs (known as the IrPEN program) have been taken to control NCDs in Iran.40 However, since these actions affect the final public health outcomes with delay, assessing the effectiveness of these actions calls for continuous monitoring and evaluation of the prevalence of the risk factors and the public health achievements in the Iranian society.

Also, the lowest mean and the worst condition were observed at the impact level, which revolves around mortality and communicable and NCDs. This level is substantially influenced by the social determinants of health. Besides, public health is not solely affected by the performance of the health system as numerous factors such as a wide range of social and economic determinants affect the public health.Evidently, UMSs cannot control all of these factors and it is not fair to consider these universities as the only entities responsible for the results of the indicators over which they do not have full control. In fact, provision of healthcare services and equitable access to these services are intermediate factors in improving health outcomes, while differences in political, economic, and environmental conditions; social norms; ethnicity; and income can independently or interactively determine the health of a population. Public health is the ultimate outcome of this complicated network of determinants.36 The performance score at different levels and their similarity to the real results suggest that the model used in this study performed well in the evaluation of the performances of universities.

The study results are also indicative of provincial health disparities in Iran. There was considerable dispersion in the performance of the universities at all levels. The scores at the output level varied from 0.950 in Qazvin to 0.009 in Zahedan. The scores at the outcome level varied from 0.936 in Shahrud to 0.104 in Rafsanjan. The scores at the impact level varied from 1.00 in Qom to 0.215 in Yazd, and finally the scores at the composite index level varied from 1.00 in Ilam to 0.00 in Rafsanjan. Other studies have also indicated the disparities in the risk factors and health outcomes in different parts of this country.15,17,41,42 For instance, Movahedi et al realized that despite the decrease in disparities of some indicators in different villages of Iran, disparity has been a chronic major problem in the healthcare system of this country in recent years. They also concluded that the pattern of disparities in most indicators is repeated. In that study, the desirability of the indicators in the northern and central provinces and their non-desirability in the eastern and southern provinces of Iran were similar to the present research results, which shows a pattern observed for most indicators.15 According to the study by Yazdi and Mahjoob, the rural maternal health indicators in Tehran, Guilan, and Mazandaran provinces were satisfactory. Kohgiluyeh and Boyer-Ahmad and Hormozgan provinces, however, had unsatisfactory indicators, and Sistan and Baluchestan was in a severely unacceptable condition with respect to these indicators.16 However, geographical disparities in health outcomes are not solely limited to Iran. For example, Patrick et al performed a study, which revealed that the health outcomes and the related factors were significantly different in different regions of the United States.27 The study conducted in Japan also showed that despite the success of this country in reducing the mortalities and morbidities caused by many diseases, the progress has been gradual and regional differences have been growing.43 Elimination of these health disparities calls for collaborations among those sectors and organizations that affect the social determinants of health as well as the health sector. Health is an inter-sectoral issue. Besides, the improvement of the health indicators is not solely influenced by the performance of the Ministry of Health and Medical Education. Rather, it is contingent upon collaborations, arrangements, and interactions among all social and economic organizations,44 which have been recently stressed by the World Health Organization and many other international organizations.45 The integration of the primary healthcare interventions and approaches with the structural and policy changes, which was aimed at improving people’s access to the social determinants of health, is considered as one of the most effective means of reducing disparities in health outcomes.46

In agreement with the present study, different indicator levels were given weights in the United States in a health ranking process.47,48 After reviewing the research literature,49,50 we selected the PCA method to assign weights to the indicators, whereas in the study carried out in the United States, the expert opinions served this purpose. Also, confirmatory factor analysis (CFA) would be a proper method besides PCA analysis; so, we recommend it for other studies in the same conditions. One of our assumptions was about the unequal effects of different indicators on public health. Hence, the weights of the outcome, output, and impact indicators were not equal in the process of forming the composite indicator and specific weights were assigned to the aforesaid levels through another factor analysis. Seemingly, assigning weights to different levels can increase the likelihood of accepting the research results. In studies conducted in other countries, the same method was used to separate and assign weights to different performance levels, and to identify the final composite performance indicator.49,50

To make optimal use of financial and human resource investments, the public health decisions are expected to be made evidence-informed, which is substantially dependent on the timely provision of accurate and sound information and data. This information is crucial for improving the effectiveness of the decisions made by policy-makers. Besides, it can be used by front-line health providers to improve the quality and efficiency of the health services.51 In recent years, numerous national surveys have been conducted in Iran on the health and population. These studies include the Multiple Indicator Health and Demographic Survey and the national surveys of the risks of NCDs. Many attempts have also been made to establish a comprehensive information system in the hospital care sector and the primary healthcare system. However, there is a long road to the development of a comprehensive information system in Iran. The flaws in the health information systems in Iran have challenged the continuous monitoring and performance evaluation of the healthcare organizations. The present study was conducted on the 2010 data due to these information shortages and due to the inaccessibility of information in recent years. Hence, serious measures have to be taken to complete and improve the health information system. Another major limitation related to the lack of access to data was that the development of the target population and its socio-economic level are very influential factors that are not adjusted in the model of this study. Unfortunately, much of the data in the country is produced provincially. So, we had to use provincial data instead of university-based data in some indicators. The situation of social and economic indicators of the general public at the provincial level is almost the same. Given that some of our provinces such as Tehran, Fars, Isfahan, etc. have several universities, it is very difficult to separate the social and economic status of people covered by different universities in a province.

In Iran, the health system’s plans and policies are generally developed at the national level. The UMSs generally implement the plans and policies developed by the Ministry of Health and Medical Education and despite the local decisions made based on the provincial conditions, many policies are similarly implemented at all universities.30,52 The classification of the health achievements of universities using a results chain in this study can effectively guide the regional planners to set the scene for balanced health improvements in different regions of Iran. Our findings also suggest that every UMS can observe its performance at each level compared with others as well as the difference between its scores at different results chain levels to plan improvements in its performance based on the results.

Furthermore, the public health ranking presented in this study can help direct the current debates to increase awareness, motivation, and dialogue over the solutions with the aim of improving the health outcomes, laying enormous responsibility towards public health, and establishing multilateral collaborations for better outcomes.27

In conclusion, the average performance of universities in Iran at different levels of the results chain is not satisfactory. However, there are considerable differences in the performances of universities. The difference in the performances of some universities at different results chain levels is also considerable. Hence, each university should adopt a strategy suiting its performance level to improve the health conditions. From the output level to the impact level in the results chain, the scores of performance dropped considerably and the impact indicators were in the worst conditions as compared to other levels. Hence, designing effective interventions in proportion to the conditions of universities on different levels of the results chain, developing a robust information system, conducting continuous monitoring and evaluation of public health, performing periodic rankings, organizing competitions over health among universities, and increasing intersectional collaborations are among the fundamental strategies recommended for balanced enhancement of the health outcomes in Iran.


Supplementary Materials

Supplementary file 1 contains Tables S1-S6. (pdf)

Authors’ Contribution

All authors have contributed to this study. Conception and design (NJ & AR), Acquisition of data (AR & AKh), Analysis and interpretation of data (NJ), Drafting of the manuscript (NJ & SD), Critical revision of the manuscript for important intellectual content (NJ, AR, FF, MSh, AAS & RM), Administrative, technical, or material support (AR & FF). All authors have read and approved the manuscript.

Conflict of Interest Disclosures

The authors have no conflicts of interest.

Ethical Statement

Administrative permissions to access and use the data described in this study were not required.

Funding

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.


References

  1. McGillivray M, Dutta I, Markova N. Health inequality and deprivation. Health Econ 2009; 18 Suppl 1:S1-12. doi: 10.1002/hec.1456 [Crossref] [ Google Scholar]
  2. Buse K, Hawkes S. Health in the sustainable development goals: ready for a paradigm shift?. Global Health 2015; 11:13. doi: 10.1186/s12992-015-0098-8 [Crossref] [ Google Scholar]
  3. Dicker D, Nguyen G, Abate D, Abate KH, Abay SM, Abbafati C. Global, regional, and national age-sex-specific mortality and life expectancy, 1950-2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018; 392(10159):1684-735. doi: 10.1016/s0140-6736(18)31891-9 [Crossref] [ Google Scholar]
  4. Kyu HH, Abate D, Abate KH, Abay SM, Abbafati C, Abbasi N. Global, regional, and national disability-adjusted life-years (DALYs) for 359 diseases and injuries and healthy life expectancy (HALE) for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018; 392(10159):1859-922. doi: 10.1016/s0140-6736(18)32335-3 [Crossref] [ Google Scholar]
  5. Gavurova B, Toth P. Preventable mortality in regions of Slovakia-quantification of regional disparities and investigation of the impact of environmental factors. Int J Environ Res Public Health 2019; 16(8):1382. doi: 10.3390/ijerph16081382 [Crossref] [ Google Scholar]
  6. Minahan J, Valdivieso E, Baker T. Regional health disparities among older adults in the United States. In: Annals of Behavioral Medicine. Oxford: Oxford University Press; 2018.
  7. Park YN. Regional Disparities of Health Status in Korea: Finding from KNHANES (2007-2014). Korea: Department of Urban and Environmental Engineering (Urban Infrastructure Engineering), Graduate School of UNIST; 2017.
  8. Zhao Y, You J, Wright J, Guthridge SL, Lee AH. Health inequity in the Northern Territory, Australia. Int J Equity Health 2013; 12:79. doi: 10.1186/1475-9276-12-79 [Crossref] [ Google Scholar]
  9. Fang P, Dong S, Xiao J, Liu C, Feng X, Wang Y. Regional inequality in health and its determinants: evidence from China. Health Policy 2010; 94(1):14-25. doi: 10.1016/j.healthpol.2009.08.002 [Crossref] [ Google Scholar]
  10. Utomo B, Sucahya PK, Utami FR. Priorities and realities: addressing the rich-poor gaps in health status and service access in Indonesia. Int J Equity Health 2011; 10:47. doi: 10.1186/1475-9276-10-47 [Crossref] [ Google Scholar]
  11. Penman-Aguilar A, Talih M, Huang D, Moonesinghe R, Bouye K, Beckles G. Measurement of health disparities, health inequities, and social determinants of health to support the advancement of health equity. J Public Health Manag Pract 2016; 22(Suppl 1):S33-42. doi: 10.1097/phh.0000000000000373 [Crossref] [ Google Scholar]
  12. Hosseinpoor AR, Bergen N, Barros AJ, Wong KL, Boerma T, Victora CG. Monitoring subnational regional inequalities in health: measurement approaches and challenges. Int J Equity Health 2016; 15:18. doi: 10.1186/s12939-016-0307-y [Crossref] [ Google Scholar]
  13. Bagheri Lankarani K. Health in Iran; 40 years after the Islamic revolution. Shiraz E Med J 2019; 20(2):e89606. doi: 10.5812/semj.89606 [Crossref] [ Google Scholar]
  14. Sabermahani A, Barouni M, Seyedin H, Aryankhesal A. Provincial human development index, a guide for efficiency level analysis: the case of iran. Iran J Public Health 2013; 42(2):149-57. [ Google Scholar]
  15. Movahedi M, Hajarizadeh B, Rahimi A, Arshinchi M, Amirhosseini K, Motlagh M. Trend and geographical inequality pattern of main health indicators in rural population of Iran. Hakim Res J 2008; 10(4):1-10. [ Google Scholar]
  16. Yazdi M, Mahjub H. Ranking maternal health status in rural areas in Iran based on multivariate techniques of factor and cluster analysis. Iran J Epidemiol 2011;7(1):7-14. [Persian].
  17. Hosseinpoor AR, Mohammad K, Majdzadeh R, Naghavi M, Abolhassani F, Sousa A. Socioeconomic inequality in infant mortality in Iran and across its provinces. Bull World Health Organ 2005; 83(11):837-44. [ Google Scholar]
  18. Murray CJ, Frenk J. A framework for assessing the performance of health systems. Bull World Health Organ 2000; 78(6):717-31. [ Google Scholar]
  19. Shahri S, Tabibi SJ, Nasiripour A, Ghaffari F. The dimensions of health system performance evaluation with emphasis on the coverage of the vulnerable groups in Iran. Int J Med Res Health Sci 2016; 5(5):9-17. [ Google Scholar]
  20. Maleki S, Sheikhi H. The analysis and classification of welfare indexes and the determination of priority of development in Iranian provinces using factor and cluster analyses. Journal of Geography and Planning 2009; 14(29):61-85. [ Google Scholar]
  21. Wong ST, Browne AJ, Varcoe C, Lavoie J, Fridkin A, Smye V. Development of health equity indicators in primary health care organizations using a modified Delphi. PLoS One 2014; 9(12):e114563. doi: 10.1371/journal.pone.0114563 [Crossref] [ Google Scholar]
  22. Ruano AL, Furler J, Shi L. Interventions in primary care and their contributions to improving equity in health. Int J Equity Health 2015; 14:153. doi: 10.1186/s12939-015-0284-6 [Crossref] [ Google Scholar]
  23. Saleh S, Alameddine M, Mourad Y, Natafgi N. Quality of care in primary health care settings in the Eastern Mediterranean region: a systematic review of the literature. Int J Qual Health Care 2015; 27(2):79-88. doi: 10.1093/intqhc/mzu103 [Crossref] [ Google Scholar]
  24. Zanganeh Baygi M, Seyedin H, Salehi M, Jafari Sirizi M. Structural and contextual dimensions of Iranian primary health care system at local level. Iran Red Crescent Med J 2015; 17(1):e17222. doi: 10.5812/ircmj.17222 [Crossref] [ Google Scholar]
  25. World Bank. Islamic Republic of Iran - Health Sector Review. Washington, DC: World Bank; 2008.
  26. Nasrollahpour Shirvani SD, Maleki MR, Motlagh ME, Kavosi Z, Tofighi S, Gohari MR. Self assessment of Iran universities of medical sciences based on European foundation for quality management (EFQM) and Iran excellence model. World Appl Sci J 2011; 15(10):1391-7. [ Google Scholar]
  27. Remington PL, Catlin BB, Gennuso KP. The County Health Rankings: rationale and methods. Popul Health Metr 2015; 13:11. doi: 10.1186/s12963-015-0044-2 [Crossref] [ Google Scholar]
  28. Jahanmehr N, Rashidian A, Khosravi A, Farzadfar F, Shariati M, Majdzadeh R. A conceptual framework for evaluation of public health and primary care system performance in iran. Glob J Health Sci 2015; 7(4):341-57. doi: 10.5539/gjhs.v7n4p341 [Crossref] [ Google Scholar]
  29. International Health Partnership, World Health Organization. Monitoring, evaluation and review of national health strategies: a country-led platform for information and accountability. WHO; 2011. Available from: https://apps.who.int/iris/handle/10665/85877. Accessed May 25, 2019.
  30. Rashidian A, Khosravi A, Khabiri R, Khodayari-Moez E, Elahi E, Arab M, et al. Islamic Republic of Iran’s Multiple Indicator Demograpphic and Health Survey (IrMIDHS), 2010. Tehran: Ministry of Health and Medical Education; 2012.
  31. Esteghamati A, Meysamie A, Khalilzadeh O, Rashidi A, Haghazali M, Asgari F. Third national Surveillance of Risk Factors of Non-Communicable Diseases (SuRFNCD-2007) in Iran: methods and results on prevalence of diabetes, hypertension, obesity, central obesity, and dyslipidemia. BMC Public Health 2009; 9:167. doi: 10.1186/1471-2458-9-167 [Crossref] [ Google Scholar]
  32. Joint Research Centre-European Commission. Handbook on constructing composite indicators: methodology and user guide. OECD Publishing; 2008: Available from: https://www.oecd.org/els/soc/handbookonconstructingcompositeindicatorsmethodologyanduserguide.htm.
  33. Metge CJ, Chateau D, Prior H, Soodeen R, De Coster C, Barré L. Composite Measures/Indices of Health and Health System Performance. Winnipeg, MB: Manitoba Centre for Health Policy; 2009.
  34. Murray CJ, Salomon JA, Mathers CD, Lopez AD. Summary Measures of Population Health: Concepts, Ethics, Measurement and Applications. Geneva: World Health Organization; 2002.
  35. Lim SS, Allen K, Bhutta ZA, Dandona L, Forouzanfar MH, Fullman N. Measuring the health-related Sustainable Development Goals in 188 countries: a baseline analysis from the Global Burden of Disease Study 2015. The Lancet 2016; 388(10053):1813-50. doi: 10.1016/s0140-6736(16)31467-2 [Crossref] [ Google Scholar]
  36. Shahraz S, Forouzanfar MH, Sepanlou SG, Dicker D, Naghavi P, Pourmalek F. Population health and burden of disease profile of Iran among 20 countries in the region: from Afghanistan to Qatar and Lebanon. Arch Iran Med 2014; 17(5):336-42. [ Google Scholar]
  37. World Health Organization. Global Health Observatory (GHO) data: Mortality and global health estimates. https://www.who.int/gho/mortality_burden_disease/en/. Accessed June 15, 2018.
  38. Slama S, Hammerich A, Mandil A, Sibai AM, Tuomilehto J, Wickramasinghe K. The integration and management of noncommunicable diseases in primary health care. East Mediterr Health J 2018; 24(1):5-6. doi: 10.26719/2018.1.5 [Crossref] [ Google Scholar]
  39. Global Burden of Disease Collaborative Network. Global Burden of Disease Study 2017 (GBD 2017) Burden by Risk 1990-2017 2018; https://vizhub.healthdata.org/gbd-compare/. Accessed 21 May 2019.
  40. Takian A, Amerzadeh M. An International Comparative Policy Analysis to Accelerate Actions against Non-Communicable Diseases: The Experience of Iran. Prince Mahidol Award Conference (PMAC). 2019. https://pmac2019.com/uploads/poster/A058-AMIRHOSSEINTAKIAN-f72c.pdf.
  41. Goli S, Mahjub H, Goli M, Sadeghi Far M. Risk factors ranking of non-communicable disease in different provinces of Iran using multivariate factor analysis methods. Journal of Knowledge & Health 2018;12(4):7-15. [Persian].
  42. Sheidaei A, Gohari K, Kasaeian A, Rezaei N, Mansouri A, Khosravi A. National and subnational patterns of cause of death in Iran 1990-2015: applied methods. Arch Iran Med 2017; 20(1):2-11. [ Google Scholar]
  43. Nomura S, Sakamoto H, Glenn S, Tsugawa Y, Abe SK, Rahman MM. Population health and regional variations of disease burden in Japan, 1990-2015: a systematic subnational analysis for the Global Burden of Disease Study 2015. Lancet 2017; 390(10101):1521-38. doi: 10.1016/s0140-6736(17)31544-1 [Crossref] [ Google Scholar]
  44. Bahadori M, Sanaeinasab H, Ghanei M, Mehrabi Tavana A, Ravangard R, Karamali M. The social determinants of health (SDH) in Iran: a systematic review article. Iran J Public Health 2015; 44(6):728-41. [ Google Scholar]
  45. Beheshtian M, Khosravi A, Olyaeemanesh A, Malekafzali H, Bonakdar Esfahani S, Hosseiny Ghavamabad L. Developing a household survey tool for health equity: a practical guide in Islamic Republic of Iran. Med J Islam Repub Iran 2015; 29:305. [ Google Scholar]
  46. Browne AJ, Varcoe CM, Wong ST, Smye VL, Lavoie J, Littlejohn D. Closing the health equity gap: evidence-based strategies for primary health care organizations. Int J Equity Health 2012; 11:59. doi: 10.1186/1475-9276-11-59 [Crossref] [ Google Scholar]
  47. Sharpe A, Andrews B. An Assessment of Weighting Methodologies for Composite Indicators: The Case of the Index of Economic Well-Being. Ottawa: Centre for the Study of Living Standards; 2012.
  48. Decancq K, Lugo MA. Weights in multidimensional indices of wellbeing: an overview. Econ Rev 2013; 32(1):7-34. doi: 10.1080/07474938.2012.690641 [Crossref] [ Google Scholar]
  49. Canadian Council on Learning (CCL). The 2010 Composite Learning Index: Five Years of Measuring Canada’s Progress in Lifelong Learning. Ottawa: CCL; 2010. p. 1-16.
  50. Hsu A, Emerson J, Levy M, de Sherbinin A, Johnson L, Malik O, et al. The 2014 Environmental Performance Index. New Haven, CT: Yale Center for Environmental Law and Policy; 2014.
  51. Yazdi-Feyzabadi V, Emami M, Mehrolhassani MH. Health information system in primary health care: the challenges and barriers from local providers’ perspective of an area in Iran. Int J Prev Med 2015; 6:57. doi: 10.4103/2008-7802.160056 [Crossref] [ Google Scholar]
  52. Ministry of Health and Medical Education. Demographic and Health Survey, Iran 2000: Preliminary Draft Report. Tehran, Iran: Ministry of Health and Medical Education; 2002.
Submitted: 01 Jul 2020
Revised: 16 Jul 2021
Accepted: 01 Sep 2021
First published online: 01 Apr 2022
EndNote EndNote

(Enw Format - Win & Mac)

BibTeX BibTeX

(Bib Format - Win & Mac)

Bookends Bookends

(Ris Format - Mac only)

EasyBib EasyBib

(Ris Format - Win & Mac)

Medlars Medlars

(Txt Format - Win & Mac)

Mendeley Web Mendeley Web
Mendeley Mendeley

(Ris Format - Win & Mac)

Papers Papers

(Ris Format - Win & Mac)

ProCite ProCite

(Ris Format - Win & Mac)

Reference Manager Reference Manager

(Ris Format - Win only)

Refworks Refworks

(Refworks Format - Win & Mac)

Zotero Zotero

(Ris Format - FireFox Plugin)

Abstract View: 1859
PDF Download: 946
Full Text View: 7