DOES THE Q U A N T IT Y OF SCIENTIFIC
PUBLICATIONS REFLECT THE Q U A L ITY ?
A RISING ISSUE FOR P R O M O TIO N IN D EV ELO PIN G
COUNTRIES
Bahadır M . G üllüoğlu, M .D . / A . Ö zdem ir A k ta n , M .D ., F.A .C .S .,
D e p a rtm e n t o f G e n e ra l S u rg e ry, S c h o o l o f M e d ic in e , M a rm a ra U n iv e rs ity , Is ta n b u l, T u rk e y
ABSTRACT
Objective:
Turkey's international scientific ranking increased from 42nd in 1991 to 25th place in 1998. In this study, we intended to clarify Marmara University School of Medicine's scientific publication trend for the last four years between 1995-1998 in comparison with previous four-year period between 1991-1994, regarding quality.Methods:
We sorted out the total number of publications from all academic institutions in Turkey, Marmara University and Marmara University School of Medicine indexed in Science Citation Index between 1991 and 1998. We compared the total number of faculty members and "scientific publication per faculty member (ppf)" on a yearly basis in order to place their trend especially by comparing the time period of the first four years between 1991 and 1994 to the last four years.Results:
The total number of publications from theschool o f m edicine increased from 15 in 1991 to 80 in
1998. The percentage of publications from the school
o f m edicine out of all university publications was determined to be 63% in 1991, 77% in 1994 and 58% in 1998. p p f in sch o o l o f m edicine was 0.07 in 1991, 0.15 in 1994 and 0.22 in 1998. Although the number of
articles increased from 11 in 1991 to 44 in 1998, its percentage within total publications decreased from 78% in 1991 to 55% in 1998.
Conclusion:
Although the number of the publications from the school of medicine increased, its percentage among all publications in the university has decreased. In addition to this, most authors preferred to publish papers other than articles which in turn resulted a decline in quality of published material. Therefore, thetotal number of publications from the medical faculty does not reflect an accurate interpretation of its current scientific situation in Marmara University.
K ey W ords:
Scientific rank, publication, science citation index, school of medicine, Marmara UniversityIN TR O DUCTIO N
Scientific publications are assumed to be objective criteria for evaluating an institution's or individual's academic exerience and scientific development. Medical faculties and other institutions achieve acknowledgement and increase their pressure on scientific societies and colleges parallel to their
improved scientific publishing performance (1).
Scientific publications are placed in different national and international journals where the scientists declare their experience to common view and communicate with their colleagues. They are further classified as
reviews, articles, letters, notes a n d m eeting-abstracts
(2). To obtain a more objective conclusion about the value of a particular scientific publication, it is more accurate to take the ones which are published at peer reviewed international journals. Today, there are several scientific indexes in which the journals are classified and Science Citation Index (SCI) is believed to be the most prestigious (3).
In Turkey and many countries throughout the world, pressure is increasing on researchers to publish. This "publish or perish" policy has certain pitfalls, fraud being the most unethical. Although journals fight to prevent fraud and dual publication, complete eradication seems impossible. The number of authors per article seems to be increasing for the same reason
and certain journals ask specifically the function of each author if the number appears excessive (4). Another pitfall is "salami publication" where the same results are published in small pieces by adding new and usually trivial data. The pressure to publish also forces researchers to lower the quality of scientific research to increase the number.
In a previous report (5), it was determined that there is a steady increase in the total number of publications from Marmara University School of Medicine (MUSM) parallel to the scientific progress seen in Marmara University and all other Turkish academic institutions. As a result of this progress in the total number of published studies, Turkey's scientific ranking is
improving continuously (6). Medical schools in Turkey
contribute about 50% of scientific publications (6).
In this study, we aimed to investigate the trend in the
quality of publications from MUSM. It was
hypothesised that increased pressure for publication will decrease the quality of publications. For this purpose, scientific publication from MUSM indexed in SCI in the last four years between 1995-1998 was compared with the previous four-year period between 1991-1994.
M ATER IALS A N D M ETHO D S
All scientific publications from Marmara University School of Medicine indexed in SCI'between 1991 and 1998 were investigated. Publications were classified
as article, letter, review, and meeting-abstract as they appear in SCI. Total number of faculty members were determined and "scientific publication per faculty member (ppf)" was also calculated. In this study, all data has been gathered from internet sources via
academic websites such as The Turkish C ou ncil o f
H igh er E ducation (7), M arm ara U niversity (8), The S cientific a n d Technical R esearch C ou ncil o f Turkey (6) and State Institute o f S tatistics (9). Furthermore all departments were asked to bring their scientific publications which are indexed in SCI in case of our failure to collect them all from internet or official sources.
RESULTS
Turkey's international scientific ranking increased from 42nd in 1991 to 25,h place among nations all over the world in 1998. In fact, this increase was more distinctive in the last four years. The total number of publications from Turkey increased by 91% in the time period 1991-1994 while the increase was 121% between 1995 and 1998. The total number of publications increased from 1206 in 1991 to 5109 in 1998 (5,6). Scientific publication per faculty member
(ppf) was also found to have increased from 0.04 in 1991 to 0.09 in 1998 (Fig. 1).
The total number of publications from Marmara University has also increased from 32 in 1991 to 142 in 1998. The trend of increase is similar to Turkey's general scientific performance. Marmara University
6000 5000 g 4000 Q. 3000 0
1
§ 2 00 0 c 1000r
0,09 -j 0,08 ; 0,07 • 0,06 0,05 Q. Q. ■ 0,04 -• 0.03 • 0,02 0,01 0 years F i g . lAs the total number of scientific publications are increasing in Turkey, there is a consistent rise in ppf on yearly basis.
B a h a d ı r G ü llü o ğ lu , Ö z d e m ir A k t a n
contributed 2.7% of all international publications from Turkey in 1991 and this has not changed since then as this figure was 2.8% in 1998. ppf in Marmara University also increased from 0.017 in 1991 to 0.056 in 1998 (Fig. 2). The total number of publications from
the s c h o o l o f m e d ic in e increased from 15 in 1991 to 80
in 1998. The percentage of publications from the
s c h o o l o f m e d ic in e out of all university publications
was determined to be 63% in 1991, 77% in 1994 and 58% in 1998. p p f in s c h o o l o f m e d ic in e was 0.07 in 1991, 0.15 in 1994 and 0.22 in 1998 (Table I). Although there was progress, the slope of the
acceleration in increase of p p f was found to decrease
between 1991-1994 and 1995-1998 (114%, 47%, respectively).
The characteristics of the publications from s c h o o l o f
m e d ic in e according to their types is detailed in Table II.
Although the number of a r t ic le s increased from 11 in 1991 to 44 in 1998, its percentage within total publications decreased from 78% in 1991 to 55% in
1998. The number and percentage of le tte rs and
m e e tin g a b s tr a c ts were determined to be increased
through out the investigated period. There were 18
(22%) le tte r s in 1998 where the same figure was 2
(11%) in 1991. There were 19 (23%) m e e tin g -
a b s tr a c ts in 1998 which is more then the amount we
determined in 1991 (n=2; 11 %). Overall, 8 6 articles, 18
letters and 8 meeting-abstracts were published for the
period between 1991 and 1994, where for the last four years (1995-1998) the corresponding figures were found to be 167, 42 and 70, respectively.
F i g . 2 . :
Both the total number of publications and ppf are increasing in Marmara University.
T a b l e I. Total number of publications and p p fin M a rm a ra U n iv e rs ity , S c h o o l o f M e d ic in eon yearly basis
Y e a r N u m b e r o f P u b lic a t io n s in M U N u m b e r o f P u b l i c a t i o n s in M U S M ( % ) N u m b e r o f F a c u lt y M e m b e r s in M U S M p p f in M U S M 1991 32 15 (47) 223 0.07 1992 50 24 (48) 238 0.1 1993 51 32 (63) 253 0.13 1994 52 40 (77) 266 0.15 1995 77 59 (77) 286 0.21 1996 92 66 (72) 316 0.21 1997 115 73 (63) 352 0.21 1998 142 80 (58) 357 0.22 MU : Marmara University
MUSM : Marmara University, School of Medicine ppf : Publications per faculty member
T a b l e II. Characteristics of publications from M a rm a ra U n iv e rs ity , S c h o o l o f M e d ic in e according to their types Y e a r A r t i c l e ( % ) L e t t e r (% ) M e e t i n g - A b s t r a c t (% ) R e v ie w (% ) T o t a l 1991 12 (80) 3 (20) 0 0 15 1992 20 (83) 3 (13) 1 (4) 0 24 1993 25 (78) 3 (9) 4 (13) 0 32 1994 27 (68) 9 (22) 3 (8 ) 1 (2) 40 1995 37 (63) 8 (13) 14 (24) 0 59 1996 44 (67) 4 (6 ) 18 (27) 0 66 1997 42 (58) 12 (16) 19 (26) 0 73 1998 44 (54) 18 (22) 19 (23) 1 (1 ) 80 D IS C U S S IO N
The quality of publications from Marmara University School of Medicine is not improving. Although the
number of published papers from the s c h o o l o f
m e d ic in e is increasing progressively and the school is
growing by means of working space and number of
faculty members (8), the percentage of publications
from the school of medicine out of all scientific papers from the university is determined to be decreasing slightly while the percentage of letters and abstracts increased.
One should not consider only the quantity but also the quality of the published materials and when we evaluate the quality of the papers, we need to look at the types of publishing. Assessment criteria are mainly based on indexation and independent peer-review within that system and original papers or articles are vauled higher than reviews, comments, letters or meeting-abstracts (1,10). Articles or original papers are types of publications which are peer-reviewed and submitted as a result of planned clinical or experimental study (1). Letters are generally written to the editors of the journals as a commentary. These usually are not reviewed by a referee (1). Meeting- abstracts are the summaries of a study published in a journal which is accepted to be presented in a congress or meeting (10). Furthermore, these studies are submitted to the journals to be published as an article or short note and sometimes to different scientific meetings so, in both cases, duplication of publishing occurs (11, 12). Since the letters and meeting-abstracts are also considered a publication, the number of these publications should not reflect an institution's scientific reputation in research. However, this is not the case and international ranking and other evaluations are done by looking at the total number of publications. Probably, the best way to test quality is the number of citations an article gets (13) but this is hard to evaluate.
In Turkey, publishing in international journals is promoted with small monetary rewards by The Scientific and Technical Research Council of Turkey and universities, but at the same time pressure to publish is steadily increasing. Academic appointments are mainly decided by the number and sometimes the quality of international publications. The degree of associate professorship is given after an exam done by The Turkish Council of Higher Education where the first step is the evaluation of publications and in this regard international publication is both mandatory and is the decisive component. In Turkey, total number of academic staff, academic institutions such as universities and higher technology institutes as well as national income are increasing (7, 9). The budget for scientific research is also increasing accordingly. In addition to these facts, we can claim that the availability of scientific resources has caused scientists concentrate on publishing, which is more pronouncable after internet has intervened in our daily life. These factors and awareness of the importance of international publication have proved to be effective in increasing the total number of publications in Marmara University and nationwide.
Marmara University achieved great success by increasing the total number of scientific publications and ppf for the last eight years parallel to Turkey's general performance in this era. This improvement cannot be explained by the increase in the total number of faculty members (7), since ppf has also increased. Turkey produced 0.19% of the international publications in 1991 which increased to 0.56% in 1998. However a recent search in SCI revealed no published prospective multicentre randomised studies from Turkey (14).
Most publications in Marmara University are still being made by the medical faculty members. Although the contribution of the school of medicine to the total number of publications in Marmara University showed
B a h a d ı r G ü llü o ğ lu , Ö z d e m ir A k t a n
a steady progress, its impact in the university is decreasing. Moreover, the percentage of articles or original papers decreased while letters and meeting- abstracts increased among all publications. Therefore, the total number of publications from the medical faculty cannot be assumed to be an accurate interpretation of its current scientific situation in Marmara University.
The trend of the Marmara University School of Medicine's scientific performance is not satisfying. Authors should be discouraged from the attitude of increasing their number of publications with letters and meeting-abstracts. The Scientific and Technical Research Council of Turkey and Marmara University Research Fund have ceased to promote any publication other than an original paper to overcome this problem. At the same time, only papers indexed in SCI are promoted by the Marmara University Research Fund. The ranking of countries and institutions is done by looking at the total number of publications, which is misleading. Institutions should take precautions to increase both the number and quality of scientific publication.
REFERENCES 1. K o c h e n MM, F is c h e r GC, H im m e l W, A b h o lz HH. E v a lu a tio n o f s c ie n t if ic p u b lic a t io n : a re c o m m e n d a tio n (n o t o n ly ) f o r g e n e ra l m e d ic in e . G e s u n d h e its w e s e n 1 9 9 8 ; 6 0 : 1 1 3 -1 1 9 . 2. T he S c ie n tific a n d T e c h n ic a l R e s e a rc h C o u n c il o f T u r k e y (TUB1TAK). S c ie n t if ic p u b lic a t io n s fr o m T u rk e y in 'S c ie n c e C ita tio n In d e x " (1 9 9 1 -1 9 9 8 ). A v a ila b le f r o m : URL: h t t p :/ / w w w . tu b ita k .g o v . t r / t r / t u b it a k / a r t ic le / a it ic le . h tm l. 3. M e e n e n HM. T he im p a c t fa c to r-a r e lia b le s c ie n to - m e tr ic p a ra m e te r ? U n fa llc h iru rg ie 1 9 9 7 ; 2 3 : 128- 134. 4. S w a z e y JP, A n d e r s o n MS, L e w is KS. E th ic a l p r o b le m s in a c a d e m ic re s e a rc h . A m S c ie 1 9 9 3 ; 81 : 5 4 2 -5 5 3 .
5. Yalçın /IS, A k ta n AÖ . S c ie n tific p u b lis h in g fr o m M a rm a ra U n iv e rs ity : c o n t r ib u t io n o f th e s c h o o l o f m e d ic in e . M a rm a ra M e d J 1 9 9 6 ; 9 : 1 2 4 -1 2 8 . 6. T he S c ie n tific a n d T e c h n ic a l R e s e a rc h C o u n c il o f T u rk e y (TUB1TAK). (A n n u a l r e p o r t o f th e in s p ir a tio n p ro g r a m f o r in t e r n a t io n a l s c ie n t if ic p u b lic a tio n s f o r 1 9 9 8 ) 1 9 9 8 y ılı u lu s la r a r a s ı y a y ın la r ı te ş v ik p ro g r a m ı y ı llı k ra p o ru . TÜ B İTA K y a y ın la rı, A n k a ra , 1 9 9 9 .
7. The T u rk is h C o u n c il o f H ig h e r E d u c a tio n (YOK).
A c a d e m ic s ta ff. A v a ila b le f r o m : URL:
h t t p : / / w w w . y o k . g o v . t r / y o k / y o is t / t a b 2 . h t m l o r h t tp ://w w w .y o k .g o v . tr /w e b e n g /c u r r e n t. h tm l
8. M a rm a ra U n iv e rs ity . A c a d e m ic s tru c tu re . A v a ila b le f r o m : URL: h t t p : / / w w w . m a r u n . e d u . t r / e n g lis h / a c a d e m ic /s tr u c tu r e .h lm l
9. R e p u b lic o f T u rk e y , P rim e M in is try S ta te In s titu te o f S ta tis tic s (DIE). F in a n c ia l s ta tis tic s o f T u rk e y : p e r c a p ita g ro s s n a tio n a l p ro d u c t. A v a ila b le fr o m : URL: h t t p :/ / w w w . d ie .g o v . tr /s e e d /n a tio n /p a g e 15. h t m l 10. K e lly JA. S c ie n tific m e e tin g a b tra c ts ; s ig n ific a n c e ,
a c c e s s a n d tre n d s . B u ll M e d L ib r A s s o c 1 9 9 8 ; 8 6 : 6 8 -7 6 .
1 1. D a lu is k i A, K u h n s CA, J a c k s o n KR, L ie b e rm a n JR. P u b lic a tio n r a te o f a b s tra c ts p r e s e n te d a t th e a n n u a l m e e t in g o f th e O r th o p a e d ic R e s e a rc h S o c ie ty . J O th o p Res 1 9 9 8 ; 16: 6 4 5 -6 4 9 .
12. D o n n e lly LF, B is s e t GS 3 r d , V y d a re n y K tt,
T h o m p s o n WM. M u ltip le s u b m is s io n s o f a b s tra c ts ; is h o n e s ty th e p o lic y ? A JR 1 9 9 7 ; 1 6 8 : 8 9 0 -8 9 9 . 13. R e e d KL. C ita tio n a n a ly s is o f fa c u lty p u b lic a tio n :
b e y o n d s c ie n c e c ita tio n in d e x a n d s o c ia l s c ie n c e c ita tio n in d e x . B u ll M e d L ib r A s s o c 1 9 9 5 ; 8 3 : 5 0 3 - 5 0 8 .
14. A k ta n AÖ , G ü llü o ğ lu BM, C in g i A. M u ltic e n tr e tria ls in d e v e lo p in g c o n trie s : w illin g n e s s o f s u rg e o n s to p a rtic ip a te . E u r J S u r g 1 9 9 8 ; 1 6 4 : 7 3 3 -7 3 5 .
o
Uy i o
z
u
h
t u
k
l a
v
m
d
a
:
t t k
s e ç e n e k
A
n
t i
İ l k
s e ç e n e k A
n tiJ U
d u k m
U R U N B İL G İS İF o r m ü l: H e r y u m u ş a k k a p s ü l
60
m g A lv e rin s itr a t300
m g S im e tik o n iç e rir . F a r m a k o lo j ik Ö z e l lik le r i: M e te o s p a s m y l y u m u ş a k k a p s ü l, iki e tk e n m a d d e d e n o lu ş m u ş b ir ü rü n d ü r . A lv e rin , p a p a v e r in e b e n z e r e tk i ile m ü s k ü lo tro p ik k a ra k te rd e a n tis p a z m o d ik ö z e llik g ö s te re n b ir m a d d e d ir. A lv e rin 'in s p a z m o litik e tk is i, p a p a v e rin d e n d a h a fa z la , y a n e tk is i is e p a p a v e rin d e n ü ç k a t d a h a a z b u lu n m u ş tu r. A tro p in e b e n z e r e tk i g ö s te rm e d iğ in d e n m id e a s id i ü z e rin e b ir e tk is i y o k tu r. A lv e rin ile y a p ıla n fa rm a k o k in e tik ç a lış m a la r d a , s e ru m k o n s a n tr a s y o n la r ı o ld u k ç a d ü ş ü k d ü z e y d e b u lu n m u ş tu r. (2.5
n g /m l'n in a ltın d a ) . B u s o n u ç , a lv e r in in r e s o rb e o lm a d ığ ı v e y a s im e tik o n ile b irlik te a lın d ığ ın d a , k a ra c iğ e rd e ö n e m li o ra n d a ilk g e ç iş te e lim in a s y o n e tk is in e u ğ ra d ığ ın ı d ü ş ü n d ü rm e k te d ir. B u s o n u ç la r, a lv e rin in e tk is in i lo k a l o la ra k g ö s te rd iğ in i d e s te k le m e k te d ir. S im e tik o n , f iz y o lo jik o la r a k in e r t b ir m a d d e d ir. O ra l y o lla a lın d ık ta n s o n r a h e r h a n g i b ir m e ta b o liz a s y o n a u ğ r a m a d a n d ış k ıy la a tılır. S im e tik o n ,a k tiv e e d ilm iş d im e tik o n o lu p , g ü ç lü g a z g id e ric i ö z e lliğ e s a h ip tir. G a s tro in te s tin a l s is te m d e k i g a z k a b a rc ık la rın ın y ü z e y g e r ilim le r in i . . . . d e ğ iş tir e r e k , o n la r ı n b ir a r a y a g e lm e s in i v e fiz y o lo jik y o lla r d a n ( g e ğ ir m e , y e lle n m e g ib i) k o la y c a a tılm a la r ın ı s a ğ la r.
E n d ik a s y o n la r ı : K a rın a ğ rıs ı, s p a z m , ş iş k in lik , is h a l v e /v e y a k a b ız lık ile s e y re d e n irrita b l (s p a s tik ) k o lo n s e n d ro m u , f o n k s iy o n e l s in d ir im b o z u k lu k la r ı v e s in d ir im k a n a lın d a a ş ır ı g a z ın y a r a tt ı ğ ı a ğ r ılı d u r u m la r ın t e d a v is in d e e n d ik e d ir. K o n t r e n d ik a s y o n la r ı : İç e r d iğ i m a d d e le re k a rş ı a ş ırı h a s s a s iy e ti o la n k iş ile r d e k u lla n ım ı k o n tre n d ik e d ir. U y a r ı la r / Ö n le m le r : G e b e lik v e s ü t v e rm e d ö n e m in d e k u lla n ılm a s ı ö n e rilm e z . Y a n E tk i le r / A d v e r s E tk ile r : A lv e rin , p a p a v e r in e b e n z e r e tk i g ö s te r d iğ in d e n , p a p a v e r in k u lla n ılm a s ı s ır a s ın d a k a r ş ıla ş ıla n y ü z v e b o y u n d a k ız a r m a , b u la n tı, b a ş a ğ r ıs ı, h a fif u y u ş u k lu k h a li, a le r jik c ilt d ö k ü n tü le r i g ib i y a n e tk ile r g ö r ü le b ilir . K u l la n ı m Ş e k li v e D o z u : M e te o s p a s m y l y u m u ş a k k a p s ü l, d o k t o r ta r a f ı n d a n b a ş k a b ir ş e k ild e ö n e r ilm e d iğ i t a k tir d e ; b e lir tile n e n d ik a s y o n la r d a , g ü n d e
2-3
k e z y e m e k le r d e n ö n c e b ir k a p s ü l a lın ır . A m b a la j:20
y u m u ş a k k a p s ü l iç e re n b lis te r a m b a la j. R u h s a t T a r ih i v e N o .:09
.07
.1996
-99/61
R u h s a t S a h ib i: A li R a if İla ç S a n . A Ş . İm a l Y e r i: M a y o ly S p in d le r (F r a n s a ) R e ç e te ile s a tılır. D a h a g e n iş b ilg i iç in fir m a m ız ı a ra y ın ız .O c a k
2000
P .S .F .1
.909
.650
.-T L .ö n c ü
b i l i m s e l a r a ş t ı r m a l a r l a
2
1
. y ü z y ı l ı n
s a ğ lık lı d ü n y a s ı iç in
y e n i
k i m g e l i ş t i r i y o r ?
i l a ç l a n
N O V A R T I S
Yaşam B ilim le rin d e dünya lid e ri. Ciba ve Sandoz’u birleştiren kuruluş.3
Sağlık