I go away on vacation (hmmmmm, vacation.... sun, beer, sand, beer, waves, beer, seafood, beer and beer...) and all hell breaks loose.
Well, maybe not hell. But a whole new blog collective just... appeared. Scientopia. And many of my favorite science bloggy types have moved there. I was going to list them but Bora over at A Blog Around the Clock has already done so here.
Tres cool.
The ramblings of a slightly disgruntled, but mostly not, bleeding heart liberal academic.
Showing posts with label publishing. Show all posts
Showing posts with label publishing. Show all posts
Monday, August 02, 2010
Monday, June 21, 2010
Another datum on why impact factors are useless
The latest newsy thing from the TheScientist.com just landed in my inbox. Top story today is titled "New impact factors yield surprises." In the short piece the reporter notes how the impact factor (IF) for Acta Crystallographica - Section A has jumped 20-fold since last year and is now the second highest for science journals (edging out NEJM). This apparently is all due to a single 2008 article, chronicling the development of the SHELX crystallography computer program suite, which garnered some 6600 citations.
Okay, so this is an extreme example of how IF's can be manipulated via review-type publications, but still...
On the other hand, if you're currently on the job market and have a publication in Acta Crystallographica - Section A, you just might want to make note of the current IF in your CV.
Okay, so this is an extreme example of how IF's can be manipulated via review-type publications, but still...
On the other hand, if you're currently on the job market and have a publication in Acta Crystallographica - Section A, you just might want to make note of the current IF in your CV.
Labels:
academics,
information,
publishing,
science,
science fiction
Friday, June 11, 2010
If you're going to say no, at least do it quickly
I'm on the editorial board of a journal in my field. I am often assigned manuscripts as managing editor. This means finding reviewers. Of late I've noticed a disturbing trend (ANECDOTE ALERT!!!). People I ask are taking an unreasonably long time to decide whether or not they will review a manuscript. Days. A week even. If this were just one or two people you could explain it away easily enough. They're traveling, for example. But it's not one or two. It's approaching 30-40%. Given that I'm managing two to four manuscripts at any given moment, that's a lot. And when they eventually get back to me (those that do...), they invariably say no they can't review the manuscript.
Why are you taking so long? Read the abstract (which we send in the email), think about what else you have to get done in the next couple of weeks, and decide whether or not this is a review you want to do. Then get back to me by reply email. Not a hard process. The longer you take to decline the invitation, the longer the whole process takes. Is that what you want to happen with your manuscripts? Didn't think so. So if you're going to decline, get off your rear end and say no quickly.
Why are you taking so long? Read the abstract (which we send in the email), think about what else you have to get done in the next couple of weeks, and decide whether or not this is a review you want to do. Then get back to me by reply email. Not a hard process. The longer you take to decline the invitation, the longer the whole process takes. Is that what you want to happen with your manuscripts? Didn't think so. So if you're going to decline, get off your rear end and say no quickly.
Labels:
academics,
editorial,
publishing,
research,
science
Wednesday, May 05, 2010
Building bridges
Based on the comments to my previous post, albeit a small sample size, there does seem to be support for requiring recipients of, or applicants for, bridge funding to demonstrate their worthiness. While I have the attention of a larger than normal audience (thanks to DrugMonkey), let me ask how bridge funding is handled in your department. Do you have set criteria/expectations, or is it handed out seemingly arbitrarily? If there are criteria, what are they?
Labels:
academics,
grants,
personnel,
politics,
professor,
publishing,
research,
science,
tenure-track
Monday, April 05, 2010
Can one reviewer make a difference?
I am occasionally asked to review manuscripts for a journal in my field that has a storied past, but over the last decade has fallen out of favor. It's impact factor (for what little that's worth) is now down below 2.5. This is not a journal I have ever published in, but I feel compelled to accept an invitation to review every now and then for two reasons. One is that I know a number of people on the editorial board and would like to stay on good terms with them. The other, lesser reason, is more altruistic and likely misguided. In the back of my mind I have this little voice saying that maybe this journal can be restored to its former prominence if submitted manuscripts were reviewed more rigorously. Judging from the dross that is regularly published I would say rigorous review is not a common occurrence at this journal.
I've been quite content to review two or three papers a year for this journal for the above reasons. Until recently. Much to my surprise I was asked to review a revised manuscript that I had rejected. Rejected just two weeks before the revised manuscript was submitted. Rejected for what I believed were fundamental flaws of the kind that make pretty much all of the work described in the manuscript worthless. Turns out neither the other reviewer, nor the editor (someone I don't know) spotted the same flaws or agreed with me. I can deal with that. Perhaps I was wrong - it can happen. So I read the revised manuscript and the authors' cover letter. Turns out the authors didn't think my perceived flaws were a problem. Again, I can deal with that. But here's the thing. The flaws I had identified were related to very, very basic solution thermodynamics. The kind you are taught in general chemistry. Or even high school. Okay, I could be wrong, so I consulted a physical chemistry textbook. Nope, I was right according to that. I asked a colleague*, who interrupted me before I could get half way through my explanation to tell me that the solution thermodynamics couldn't be right. For the same reasons I had identified.
So the authors are misguided wrong deluded idiots. Fine, it happens. Apparently the other reviewer either didn't read the manuscript carefully or is in the same category as the authors. Not so fine, but again, it happens. The editor? Now that's where I have a real issue. It would have taken him no more than 15 minutes to have read my review and checked the original submission to find I was right, leading to rejection of the manuscript. Instead he apparently looked at the two reviewer scores, one reject and one (very) minor revisions and split the difference. Lazy bugger.
So I ask you, what's the point? Apparently my efforts to be more rigorous as a single reviewer are wasted in this case. The reality is a journal cannot raise its standards via a "grassroots" effort on the part of the reviewers. I know that and have done for some time.
The moral here is I have to stop listening to those voices in my head.
Oh, and I rejected the manuscript again. And sent the editor in question a short lesson in basic solution thermodynamics. Perhaps not very tactful, but what do I care? I won't be reviewing for him again.
* Staying within the limits of reviewer/author confidentiality of course.
I've been quite content to review two or three papers a year for this journal for the above reasons. Until recently. Much to my surprise I was asked to review a revised manuscript that I had rejected. Rejected just two weeks before the revised manuscript was submitted. Rejected for what I believed were fundamental flaws of the kind that make pretty much all of the work described in the manuscript worthless. Turns out neither the other reviewer, nor the editor (someone I don't know) spotted the same flaws or agreed with me. I can deal with that. Perhaps I was wrong - it can happen. So I read the revised manuscript and the authors' cover letter. Turns out the authors didn't think my perceived flaws were a problem. Again, I can deal with that. But here's the thing. The flaws I had identified were related to very, very basic solution thermodynamics. The kind you are taught in general chemistry. Or even high school. Okay, I could be wrong, so I consulted a physical chemistry textbook. Nope, I was right according to that. I asked a colleague*, who interrupted me before I could get half way through my explanation to tell me that the solution thermodynamics couldn't be right. For the same reasons I had identified.
So the authors are misguided wrong deluded idiots. Fine, it happens. Apparently the other reviewer either didn't read the manuscript carefully or is in the same category as the authors. Not so fine, but again, it happens. The editor? Now that's where I have a real issue. It would have taken him no more than 15 minutes to have read my review and checked the original submission to find I was right, leading to rejection of the manuscript. Instead he apparently looked at the two reviewer scores, one reject and one (very) minor revisions and split the difference. Lazy bugger.
So I ask you, what's the point? Apparently my efforts to be more rigorous as a single reviewer are wasted in this case. The reality is a journal cannot raise its standards via a "grassroots" effort on the part of the reviewers. I know that and have done for some time.
The moral here is I have to stop listening to those voices in my head.
Oh, and I rejected the manuscript again. And sent the editor in question a short lesson in basic solution thermodynamics. Perhaps not very tactful, but what do I care? I won't be reviewing for him again.
* Staying within the limits of reviewer/author confidentiality of course.
Labels:
academics,
delusional,
editorial,
professor,
publishing,
science
Thursday, January 21, 2010
Your science is not enough
There's an awful lot of good advice out there in the blogosphere on how to succeed at many aspects of academia. DrugMonkey and Writedit are great resources for grant-writing, Professor in Training and Prof-like Substance are chronicling the trials and tribulations of being tenure-track assistant profs in the biological sciences, DrDrA is transitioning to the next level, and FemaleScienceProfessor provides a great deal of useful information from the senior level, etc. One thing that I have not seen discussed very much is something I have a problem with...
Assertiveness.
Some grad students and postdocs might be surprised to hear that once you reach the giddy heights of an academic position your kickass science is no longer sufficient. It's what will get you that position, but it's not enough to progress in your field from there. Yes, you can obtain grants and publish based solely on the science, but it's not enough. It's necessary, and importantly, you need some kickass science first and foremost. But kickass science alone probably won't get you invited to speak at a meeting or another institution. It won't set up the collaborations with the heavy hitters and rising stars in your field. Kickass science might make you a familiar name in your field, but not necessarily a presence in the field. It won't necessarily get you the recognition you think you're due.
That's where assertiveness comes in. Want to know how many speakers at meetings (other than the heavy hitters) get those slots? They asked. They pushed themselves forward, told the organizers "I have kickass science, I can give a kickass presentation and I deserve a slot". Ditto for many of those people giving seminars at your institution. Ditto for a collaboration between a heavy hitter and a junior person. Ditto for invitations to submit manuscripts for special issues of journals. Ditto for some publications in GlamourMagz. It goes on all the time. Next time you find yourself thinking "How the hell did they get that invitation/collaboration?", remind yourself they probably asked. Pushed. Lobbied. It's something I'm not terribly good at, but I'm trying to improve (damn it, I'm good enough, I deserve that recognition!).
People are surprisingly often willing to give someone a chance. But just one. You need to deliver. If you promise a kickass presentation of kickass science you had better deliver. Offered a killer collaboration? Deliver it. Pushed for an invitation to submit a stellar manuscript? Make it better than stellar. Otherwise those doors will be slammed shut. Too many doors slammed on you will get you a reputation that's hard to get rid of.
Something to think about and work on.
Just remember though, you have to have the kickass science first.
Assertiveness.
Some grad students and postdocs might be surprised to hear that once you reach the giddy heights of an academic position your kickass science is no longer sufficient. It's what will get you that position, but it's not enough to progress in your field from there. Yes, you can obtain grants and publish based solely on the science, but it's not enough. It's necessary, and importantly, you need some kickass science first and foremost. But kickass science alone probably won't get you invited to speak at a meeting or another institution. It won't set up the collaborations with the heavy hitters and rising stars in your field. Kickass science might make you a familiar name in your field, but not necessarily a presence in the field. It won't necessarily get you the recognition you think you're due.
That's where assertiveness comes in. Want to know how many speakers at meetings (other than the heavy hitters) get those slots? They asked. They pushed themselves forward, told the organizers "I have kickass science, I can give a kickass presentation and I deserve a slot". Ditto for many of those people giving seminars at your institution. Ditto for a collaboration between a heavy hitter and a junior person. Ditto for invitations to submit manuscripts for special issues of journals. Ditto for some publications in GlamourMagz. It goes on all the time. Next time you find yourself thinking "How the hell did they get that invitation/collaboration?", remind yourself they probably asked. Pushed. Lobbied. It's something I'm not terribly good at, but I'm trying to improve (damn it, I'm good enough, I deserve that recognition!).
People are surprisingly often willing to give someone a chance. But just one. You need to deliver. If you promise a kickass presentation of kickass science you had better deliver. Offered a killer collaboration? Deliver it. Pushed for an invitation to submit a stellar manuscript? Make it better than stellar. Otherwise those doors will be slammed shut. Too many doors slammed on you will get you a reputation that's hard to get rid of.
Something to think about and work on.
Just remember though, you have to have the kickass science first.
Labels:
academics,
delusional,
grants,
happiness,
politics,
presentations,
professor,
publishing,
research,
science,
seminars,
talks,
tenure-track,
winning
Tuesday, December 01, 2009
You lost WHAT?!?!?!?!?
I was waiting for the lads over at Drugmonkey to tackle this since CPP would no doubt do a better job. But since they haven't as yet, here goes...
In the November 26 issue of Science there's yet another retraction. This time it's from the group of Peter Schultz. For those who aren't in the know, Schultz has made a name for himself developing ways to trick the translational machinery into inserting non-natural residues into protein chains. The retracted paper (Science 303, 371 (2004)) dealt with the insertion of residues with an attached sugar, the idea being this could be used to study glycosylated proteins in a more controlled manner.
For those without access to Science, here's the retraction in full:
Let's break this down...
Say what?!?!? You LOST the lab notebooks???? And it's not the fault of any of the authors???? Okay, I can imagine a number of circumstances where this could happen. A fire for example. But if it's something like that why not give the details???? I'm all for the assumption of innocence and all that, but come on, this smells worse than a bucket of shrimp in the sun.
They can't reproduce their own experiments. Now call me old school, but I always go by that tried and true rule that the Materials and Methods section of a paper should contain enough detail that the experiments can be reproduced by someone else. Someone not in the lab that did the work. And the retracted article does have two pages of supplementary material, most of which is the Materials and Methods... But the lab (and presumably the authors) that originally did the work still can't reproduce it even with the combination of the lab's collective knowledge and memory plus the published Materials and Methods. Smell that bucket of shrimp yet?
We lose our lab notebooks and can't reproduce our own experiments, but everyone should still trust us...
I need to open a window or two.
In the November 26 issue of Science there's yet another retraction. This time it's from the group of Peter Schultz. For those who aren't in the know, Schultz has made a name for himself developing ways to trick the translational machinery into inserting non-natural residues into protein chains. The retracted paper (Science 303, 371 (2004)) dealt with the insertion of residues with an attached sugar, the idea being this could be used to study glycosylated proteins in a more controlled manner.
For those without access to Science, here's the retraction in full:
Retraction
We wish to retract our Report (1) in which we report that β–N-acetylglucosamine-serine can be biosynthetically incorporated at a defined site in myoglobin in Escherichia coli. Regrettably, through no fault of the authors, the lab notebooks are no longer available to replicate the original experimental conditions, and we are unable to introduce this amino acid into myoglobin with the information and reagents currently in hand. We note that reagents and conditions for the incorporation of more than 50 amino acids described in other published work from the Schultz lab are available upon request.
Zhiwen Zhang,1 Jeff Gildersleeve,2 Yu-Ying Yang,3 Ran Xu,4 Joseph A. Loo,5 Sean Uryu,6 Chi-Huey Wong,7 Peter G. Schultz7,*
* To whom correspondence should be addressed. E-mail: schultz@scripps.edu
1 The University of Texas at Austin, Division of Medicinal Chemistry, College of Pharmacy, Austin, TX 78712, USA.
2 Chemical Biology Section, National Cancer Institute, Frederick, MD 21702, USA.
3 Rockefeller University, New York, NY 10065, USA.
4 6330 Buffalo Speedway, Houston, TX 77005, USA.
5 Department of Chemistry and Biochemistry, University of California, Los Angeles, CA 90095–1569, USA.
6 University of California, San Diego, CA 92121, USA.
7 The Scripps Research Institute, La Jolla, CA 92037, USA.
Reference
1. Z. Zhang et al., Science 303, 371 (2004).
Let's break this down...
Regrettably, through no fault of the authors, the lab notebooks are no longer available to replicate the original experimental conditions...
Say what?!?!? You LOST the lab notebooks???? And it's not the fault of any of the authors???? Okay, I can imagine a number of circumstances where this could happen. A fire for example. But if it's something like that why not give the details???? I'm all for the assumption of innocence and all that, but come on, this smells worse than a bucket of shrimp in the sun.
...and we are unable to introduce this amino acid into myoglobin with the information and reagents currently in hand.
They can't reproduce their own experiments. Now call me old school, but I always go by that tried and true rule that the Materials and Methods section of a paper should contain enough detail that the experiments can be reproduced by someone else. Someone not in the lab that did the work. And the retracted article does have two pages of supplementary material, most of which is the Materials and Methods... But the lab (and presumably the authors) that originally did the work still can't reproduce it even with the combination of the lab's collective knowledge and memory plus the published Materials and Methods. Smell that bucket of shrimp yet?
We note that reagents and conditions for the incorporation of more than 50 amino acids described in other published work from the Schultz lab are available upon request.
We lose our lab notebooks and can't reproduce our own experiments, but everyone should still trust us...
I need to open a window or two.
Labels:
academics,
delusional,
editorial,
publishing,
research,
science,
science fiction
Tuesday, September 15, 2009
Real lives and white lies
The title of this post is stolen borrowed from a new opinion piece by Peter A. Lawrence in PLoS Biology titled "Real Lives and White Lies in the Funding of Scientific Research."* Go read it (open access - it's free!). Lawrence is mostly referring to the current system in Britain, but there are clearly parallels with the system here in the U.S.
Lawrence is concerned with the fate of young innovative scientists. However, many of the opinions cited in Lawrence's piece come from well-established scientists, so it's not clear how some of the suggested "fixes" (shorter grant applications, a tiered system of fixed five-year funding blocks followed by review, etc.) would work for young scientists. One of the quoted scientists complains about a 2.5 year funding gap after 30 years in research, which is easy to interpret as the whining of one of those old farts CPP loves to hate. Maybe he is, maybe he's not. Still, it's an interesting read.
Some highlights:
On the system-
On the advantages of large groups-
And perhaps my favorite paragraph-
Kafkaesque indeed...
* Peter A. Lawrence (2009) Real Lives and White Lies in the Funding of Scientific Research. PLoS Biol 7(9): e1000197
Lawrence is concerned with the fate of young innovative scientists. However, many of the opinions cited in Lawrence's piece come from well-established scientists, so it's not clear how some of the suggested "fixes" (shorter grant applications, a tiered system of fixed five-year funding blocks followed by review, etc.) would work for young scientists. One of the quoted scientists complains about a 2.5 year funding gap after 30 years in research, which is easy to interpret as the whining of one of those old farts CPP loves to hate. Maybe he is, maybe he's not. Still, it's an interesting read.
Some highlights:
On the system-
“What a strange business this is: We stay in school forever. We have to battle the system with only a one in eight or one in ten chance of getting funded. We give up making a living until our forties. And we do it because we want to help the world. What kind of crazy person would go for that?”—Nancy Andrews, Vice Chancellor for Academic Affairs and Dean of the Duke University School of Medicine
On the advantages of large groups-
"The peculiar demands of our granting system have favoured an upper class of skilled scientists who know how to raise money for a big group [3]. They have mastered a glass bead game that rewards not only quality and honesty, but also salesmanship and networking. A large group is the secret because applications are currently judged in a way that makes it almost immaterial how many of that group fail, so long as two or three do well. Data from these successful underlings can be cleverly packaged to produce a flow of papers—essential to generate an overlapping portfolio of grants to avoid gaps in funding.
Thus, large groups can appear effective even when they are neither efficient nor innovative. Also, large groups breed a surplus of PhD students and postdocs that flood the market; many boost the careers of their supervisors while their own plans to continue in research are doomed from the outset. The system also helps larger groups outcompete smaller groups, like those headed by younger scientists such as K. It is no wonder that the average age of grant recipients continues to rise [4]. Even worse, sustained success is most likely when risky and original topics are avoided and projects tailored to fit prevailing fashions—a fact that sticks a knife into the back of true research [5]. As Sydney Brenner has said, 'Innovation comes only from an assault on the unknown” [6].'
And perhaps my favorite paragraph-
"Universities have whole departments devoted to filling in the financial sections of these forms. Liaison between the scientists and these departments and between the scientists and employees of the granting agencies has become more and more Kafkaesque."
Kafkaesque indeed...
* Peter A. Lawrence (2009) Real Lives and White Lies in the Funding of Scientific Research. PLoS Biol 7(9): e1000197
Labels:
academics,
grants,
information,
NIH,
NSF,
politics,
professor,
publishing,
research,
science
Tuesday, August 18, 2009
Factor this
Wolfgang G. Stock of the Department of Information Science at the Heinrich-Heine-University in Düsseldorf has an interesting essay titled "The inflation of impact factors of scientific journals" coming out in ChemPhysChem (subscription required). In it he makes the point that impact factors (IF), h-indices and even eigenfactor scores for journals are flawed and really not very informative. For starters, he points out-
"For example, the British library holds more than 40000 scientific serials and adds about 800 new journals each year, whereas the two most comprehensive multidisciplinary databases, namely Elsevier's Scopus and Thomson Reuter's Web of Science (WoS) cover only 16000 (Scopus) and 10000 (WoS) periodicals."
Note that because of the differences in periodicals surveyed by Scopus and WoS, the IF's obtained from these two sources often disagree on the IF for a given journal.
Stock notes-
"All indicators that work with relative frequency measures (ie, all Group 2 indicators) suffer from serious statistical problems. It is a precondition for calculating average values (in our case: average cites per publication) that there is a Gaussian distribution... In journal informetrics this is not the case."
Seems like a serious flaw to me...
He asserts-
"In no case is it possible to use a journal impact factor on the article level to evaluate the influence of an article, an author or an institution."
Of course we all knew that.
Wish the bean-counters did...
"For example, the British library holds more than 40000 scientific serials and adds about 800 new journals each year, whereas the two most comprehensive multidisciplinary databases, namely Elsevier's Scopus and Thomson Reuter's Web of Science (WoS) cover only 16000 (Scopus) and 10000 (WoS) periodicals."
Note that because of the differences in periodicals surveyed by Scopus and WoS, the IF's obtained from these two sources often disagree on the IF for a given journal.
Stock notes-
"All indicators that work with relative frequency measures (ie, all Group 2 indicators) suffer from serious statistical problems. It is a precondition for calculating average values (in our case: average cites per publication) that there is a Gaussian distribution... In journal informetrics this is not the case."
Seems like a serious flaw to me...
He asserts-
"In no case is it possible to use a journal impact factor on the article level to evaluate the influence of an article, an author or an institution."
Of course we all knew that.
Wish the bean-counters did...
Labels:
academics,
delusional,
information,
publishing,
science fiction
Tuesday, March 17, 2009
Gratuitous self citation
I'm currently reviewing a manuscript where 38 of the 65 cited papers were written by the senior author. And ~30 of those are at best tangentially related to the manuscript under review... I have never come across such a egregious case of gratuitous self-citation. Have you?
Somehow I don't think this manuscript will see the light of day. At least not in its current form.
Somehow I don't think this manuscript will see the light of day. At least not in its current form.
Labels:
academics,
editorial,
publishing,
science,
science fiction
Wednesday, February 25, 2009
Oh dear...
As of this moment, my blog is the top hit for Google searches using:
"how many papers needed for tenure"
"papers needed for tenure"
"papers for tenure"
and number two for:
"how many papers for tenure"
Not that I care that people find my blog that way (I get 4-5 hits a day from people using those searches - and might even get more now with this post). It's more concerning that there are that many people who think they can find the answer on the internet.
Oh, and for those who find this post using such a search, read this.
"how many papers needed for tenure"
"papers needed for tenure"
"papers for tenure"
and number two for:
"how many papers for tenure"
Not that I care that people find my blog that way (I get 4-5 hits a day from people using those searches - and might even get more now with this post). It's more concerning that there are that many people who think they can find the answer on the internet.
Oh, and for those who find this post using such a search, read this.
Labels:
academics,
delusional,
happiness,
professor,
publishing,
research,
science,
tenure-track,
winning
Thursday, January 22, 2009
How Many Papers for Tenure?
The title of this entry comes from a Google search a recent visitor to my blog used.
Good question.
I can't answer it.
The only people who can give you some kind of answer to this are senior faculty in your department (and possibly college), and yourself.
But you absolutely must know the answer very early in the tenure-track process. Preferably before you officially start your position. At the very latest six months in.
So how do you find out how many papers you need? You need to do two things:
1) Ask. Ask early and often. Ask the senior faculty in your department. If you've met some, ask senior faculty in related departments within your college (e.g. within medicine, or within arts and sciences). You may not get a straight answer. You may get several different answers. Hopefully you will get some kind of answer.
2) Look it up. Find out how many publications the last few people who made tenure in your department had. No one tenured in the last few years? Look up the publication totals of recently tenured people in related departments within your college.
Once you've done both of the above, take the largest of the answers you've found (they may not match up).
That's the absolute minimum number of publications you are aiming for.
Absolute minimum. You want more. You may need more.
The answer to the question "how many papers needed for tenure?" is not set in stone.
[UPDATE] Do apply some common sense to the above. Let's say your senior colleagues provide you with a consensus estimate of X publications, and the last three people to get tenure in your department had (X+1), (X+2), and (X+10) publications. Take (X+2) as your minimum goal.
Good question.
I can't answer it.
The only people who can give you some kind of answer to this are senior faculty in your department (and possibly college), and yourself.
But you absolutely must know the answer very early in the tenure-track process. Preferably before you officially start your position. At the very latest six months in.
So how do you find out how many papers you need? You need to do two things:
1) Ask. Ask early and often. Ask the senior faculty in your department. If you've met some, ask senior faculty in related departments within your college (e.g. within medicine, or within arts and sciences). You may not get a straight answer. You may get several different answers. Hopefully you will get some kind of answer.
2) Look it up. Find out how many publications the last few people who made tenure in your department had. No one tenured in the last few years? Look up the publication totals of recently tenured people in related departments within your college.
Once you've done both of the above, take the largest of the answers you've found (they may not match up).
That's the absolute minimum number of publications you are aiming for.
Absolute minimum. You want more. You may need more.
The answer to the question "how many papers needed for tenure?" is not set in stone.
[UPDATE] Do apply some common sense to the above. Let's say your senior colleagues provide you with a consensus estimate of X publications, and the last three people to get tenure in your department had (X+1), (X+2), and (X+10) publications. Take (X+2) as your minimum goal.
Labels:
academics,
information,
professor,
publishing,
research,
science,
tenure-track,
winning
Tuesday, January 20, 2009
Dear Future Applicant for Tenure and Promotion
Your time on the tenure track is thundering its way towards the big decision. Soon you are going to have to put together that thick wad of documents known as your tenure packet/dossier/file. All of the documents in that packet are important, but some are more important than others. None are more important than your curriculum vitae. This document, your c.v., is a summary of almost everything needed to evaluate you for tenure and promotion. The other documents just provide the details.
So, dear applicant, please take the time and spend the effort to make your c.v. a document that will help those evaluating you come to the right decision. Because we really do want to see you be promoted with tenure. (Unless of course one of us is an obnoxious dickwad.)
You can ease our task by making all the information we need easy to find and read. Put the important stuff up front, and leave out the truly unnecessary.
And please don't use your c.v. to demonstrate your artistic nature. Please. Don't.
Do have a neat, logically organized c.v. And spell check it. A sloppy, disorganized c.v. makes you look... well, sloppy and disorganized. Not really what I want in a colleague.
Here are some further thoughts on some (not all) of the basics:
Background/Training/Education
My personal preference is for this to be in reverse chronological order, going from your current position back to your undergraduate schooling. Leave out where you went to high school* - really, we don't give a rat's rear end. And those perfect SAT/GPA/GRE scores you're so proud of?* Not of any interest to us when it comes to tenure decision time.
Publications
Reverse chronological order please. That Journal of Biological Chemistry paper you published while in elementary school? Very impressive, but not going to count towards tenure. Put the papers you've generated as an independent PI first. Those are the only ones that count. And do us a favor. Make it very clear what papers came out of which positions - I personally like subheadings denoting "Papers arising from my postdoctoral work", "Papers arising from my graduate work" etc. It's important to include these because they establish your history. But they won't count towards tenure.
And those manuscripts on your postdoctoral work you published while on tenure track? Sorry, they don't count towards tenure. They belong in the "Papers arising from my postdoctoral work" group. No, really, they don't count. Ever.**
What about papers "in preparation"? Not going to count. Don't bother with them.
Okay, if you really, really must. One "in preparation". Two at the very most. They still won't count. Three or four "in preparation"? That's asking for trouble. Unless you've published a gazillion papers while on tenure track - but they still won't count. If you're a little short on published papers and list three or four "in preparation"?* You've just given me the impression you have trouble finishing things, even with the tenure guillotine hanging over your head.
Ten "in preparation"?* You're a delusional fool. Granted, I've met some tenured delusional fools, but to a person they hid their delusional foolishness until after they got tenure.
Funding
Start with current/active funding. That's the most important by far. Actually it's really all that counts. Then list pending. If you have a revised grant pending that got a good score the last time it was reviewed, give us the score. Expired/previous funding comes last. Within each subgroup, reverse chronological order please.
Awards
You won a trophy for badminton at high school? How nice. Doesn't count. Please just list the relevant stuff. Preferably in reverse chronological order.
Professional Society Membership
Listing this doesn't count for much, but not listing it looks... odd.* It suggests that you're not involved in your field outside of your own research program.
Internal Service
Please indicate what level each committee is. A Graduate Curriculum Committee at the University level is a very different beast to one at the Department level. President of your undergraduate chemistry club? Doesn't count.
External Service
You do have some, right? List the journals you reviewed manuscripts for and the agencies you reviewed proposals for. Editorial boards. Professional society activities. These are important. To get tenure and promotion you need to demonstrate that you have national standing. Recent national standing.
Bottom line: Put the stuff that counts up front. You do know what counts at your institution, right?
* Yes, I have seen this in a c.v. within a tenure packet.
** This topic deserves a post all of it's own.
So, dear applicant, please take the time and spend the effort to make your c.v. a document that will help those evaluating you come to the right decision. Because we really do want to see you be promoted with tenure. (Unless of course one of us is an obnoxious dickwad.)
You can ease our task by making all the information we need easy to find and read. Put the important stuff up front, and leave out the truly unnecessary.
And please don't use your c.v. to demonstrate your artistic nature. Please. Don't.
Do have a neat, logically organized c.v. And spell check it. A sloppy, disorganized c.v. makes you look... well, sloppy and disorganized. Not really what I want in a colleague.
Here are some further thoughts on some (not all) of the basics:
Background/Training/Education
My personal preference is for this to be in reverse chronological order, going from your current position back to your undergraduate schooling. Leave out where you went to high school* - really, we don't give a rat's rear end. And those perfect SAT/GPA/GRE scores you're so proud of?* Not of any interest to us when it comes to tenure decision time.
Publications
Reverse chronological order please. That Journal of Biological Chemistry paper you published while in elementary school? Very impressive, but not going to count towards tenure. Put the papers you've generated as an independent PI first. Those are the only ones that count. And do us a favor. Make it very clear what papers came out of which positions - I personally like subheadings denoting "Papers arising from my postdoctoral work", "Papers arising from my graduate work" etc. It's important to include these because they establish your history. But they won't count towards tenure.
And those manuscripts on your postdoctoral work you published while on tenure track? Sorry, they don't count towards tenure. They belong in the "Papers arising from my postdoctoral work" group. No, really, they don't count. Ever.**
What about papers "in preparation"? Not going to count. Don't bother with them.
Okay, if you really, really must. One "in preparation". Two at the very most. They still won't count. Three or four "in preparation"? That's asking for trouble. Unless you've published a gazillion papers while on tenure track - but they still won't count. If you're a little short on published papers and list three or four "in preparation"?* You've just given me the impression you have trouble finishing things, even with the tenure guillotine hanging over your head.
Ten "in preparation"?* You're a delusional fool. Granted, I've met some tenured delusional fools, but to a person they hid their delusional foolishness until after they got tenure.
Funding
Start with current/active funding. That's the most important by far. Actually it's really all that counts. Then list pending. If you have a revised grant pending that got a good score the last time it was reviewed, give us the score. Expired/previous funding comes last. Within each subgroup, reverse chronological order please.
Awards
You won a trophy for badminton at high school? How nice. Doesn't count. Please just list the relevant stuff. Preferably in reverse chronological order.
Professional Society Membership
Listing this doesn't count for much, but not listing it looks... odd.* It suggests that you're not involved in your field outside of your own research program.
Internal Service
Please indicate what level each committee is. A Graduate Curriculum Committee at the University level is a very different beast to one at the Department level. President of your undergraduate chemistry club? Doesn't count.
External Service
You do have some, right? List the journals you reviewed manuscripts for and the agencies you reviewed proposals for. Editorial boards. Professional society activities. These are important. To get tenure and promotion you need to demonstrate that you have national standing. Recent national standing.
Bottom line: Put the stuff that counts up front. You do know what counts at your institution, right?
* Yes, I have seen this in a c.v. within a tenure packet.
** This topic deserves a post all of it's own.
Labels:
academics,
delusional,
grants,
professor,
publishing,
research,
science,
science fiction,
tenure-track,
winning
Monday, January 12, 2009
Writer's block
Anyone know a good cure?
I'm trying to write what should be the last paper from my old, almost dead research program, but just can't raise the enthusiasm to get it done. I need to get this off my desk for a bunch of reasons, not the least of which being that one of my former undergrads worked her butt off collecting the data for this paper. She deserves the first authorship. She is now off at med school, so the writing is up to me.
I'd rather be writing about my new research...
I'm trying to write what should be the last paper from my old, almost dead research program, but just can't raise the enthusiasm to get it done. I need to get this off my desk for a bunch of reasons, not the least of which being that one of my former undergrads worked her butt off collecting the data for this paper. She deserves the first authorship. She is now off at med school, so the writing is up to me.
I'd rather be writing about my new research...
Labels:
academics,
lab,
publishing,
science,
undergraduates
Monday, December 15, 2008
Numbers
Random observations involving numbers...
Sometime very early this morning my blog had it's 7000th visitor (someone from Brisbane, Australia - bet the weather's better there than here). It blows me away that people not only read some of my blather in the first place, but come back for more! Hat tip to DrugMonkey - much of the traffic I'm getting is due to him.
My very first experimental work-based paper (I used to be a computational biophysicist) has just hit 80 citations. That's about 10/year. Apparently an old dog can teach himself new tricks...
30. The number of degrees (in F; that's about 17C) the temperature is expected to drop by between the time I arrived at work this morning and the time I leave this evening. We're expecting 2-4 inches of mixed snow and ice this evening. Snow I like. Ice sucks.
Sometime very early this morning my blog had it's 7000th visitor (someone from Brisbane, Australia - bet the weather's better there than here). It blows me away that people not only read some of my blather in the first place, but come back for more! Hat tip to DrugMonkey - much of the traffic I'm getting is due to him.
My very first experimental work-based paper (I used to be a computational biophysicist) has just hit 80 citations. That's about 10/year. Apparently an old dog can teach himself new tricks...
30. The number of degrees (in F; that's about 17C) the temperature is expected to drop by between the time I arrived at work this morning and the time I leave this evening. We're expecting 2-4 inches of mixed snow and ice this evening. Snow I like. Ice sucks.
Monday, November 03, 2008
How the hell did that get published?????? [Updated]
[DISCLAIMER: This post was prompted, in part, by recent posts over at Isis's temple and DrugMonkey's cage. One should not take the following as a comment on the paper under discussion there - I have not read it and it's way outside my area of expertise, so I'm not making any judgments about it whatsoever.]
All too often I find myself reading a peer-reviewed paper and wondering how on earth it managed to get by the reviewers and editor, and end up being published. In a reputable journal. I know many of my colleagues have the same experience.
I'm not necessarily talking about disagreeing with the interpretation of data. Rather, it's a matter of poorly executed, incorrect or missing experiments, lack of suitable controls, incorrect statistical analyses, egregious lack of, or incorrect, citation of other published work in the area, etc. In other words, truly bad papers.
How do these get published? I don't know, but I would like to offer a couple of suggestions based on my experiences on the editorial board of a mid-level journal. First up, let me state that I am a strong believer in the peer review process. I am also well aware that it has it's flaws. Secondly, a little background...
Here's how things are supposed to work at the Journal of Doodlewidgets. When a manuscript is submitted, the authors must supply the names of four potential reviewers plus suggest a member of the editorial board as someone suitable for handling the review process. The Editor then assigns the manuscript to an editorial board member (EBM), who may or may not be the one suggested by the authors. The EBM is then supposed to read the manuscript and decide if it's good enough to send out for review or whether it should be rejected without full review. Those manuscripts deemed good enough are then sent out for review. When the reviews are returned to the journal, the EBM makes a final decision (accept, reject, major or minor revisions) and the authors are informed. Many journals in my field have similar processes for handling submissions.
Here's where I see the system breaking down too often: at the EBM level on two counts.
1) As noted above, at the Journal of Doodlewidgets the EBM is supposed to read the manuscript and decide if it's good enough to send out for review. In other words, the EBM is supposed to perform a preliminary review of the manuscript. I suspect (know) this doesn't happen in many cases. There are those who join editorial boards just for the extra line on their CV's, and who can't be bothered with applying the required effort. It's not clear how to handle these people. The obvious answer is to boot them, but that's not so easy if the offending party is a Big Cheese. Journals like to have Big Cheese's on their boards for the cachet. And don't want the negative publicity that might occur if they boot a Big Cheese...
2) The bigger problem lies in the choice of reviewers. It's all too easy to send the manuscript out to two (or more) of the suggested reviewers. Problem is, those people are likely good friends of the authors. We all play that game. We suggest people we know who we think will review our manuscripts fairly. Or, in the case of a (hopefully) minority of authors, automatically favorably. In some cases, authors suggest ex-co-authors or collaborators. The corresponding author of a manuscript I handled recently listed as a suggested reviewer someone they were co-authors with on a manuscript in press! Needless to say that's just not on.
So, it's possible that a given manuscript receives reviews that are more positive than they should be, and the EBM (who hasn't bothered reading the manuscript) simply accepts them at face value. Or the EBM is good friend of one of the authors and over-rides a more negative review. Or, perhaps the manuscript is somewhat outside the EBM's area of expertise, in which case they assume the reviews from the suggested reviewers are legit. In the end, a substandard manuscript can end up being accepted...
Note that this is the opposite of the usual reviewing issue (reviewers being too harsh) often discussed on the blogosphere. And I'm ignoring the issues of lazy reviewers - a good EBM should pick up on those - or unqualified reviewers - which is the EBM's fault for using them.
It's not clear how to deal with this. If all EBM's were conscientious it wouldn't be much of an issue. But how do you ensure that the editorial board is stocked with only the good? I suspect Editors have some idea of who's dead wood, but since there are no good metrics for measuring EBM performance...
EBM's could ignore the list of suggested reviewers, but then what's the point of making authors go through that process? And most authors are probably making legitimate suggestions. You could simply scrap the idea of having a list of suggestions, but then it becomes a real crapshoot if you have a lazy or somewhat unqualified EBM handling your manuscript.
I don't know the best way to fix this, or even if it's as big an issue as I perceive it to be, but I do have three suggestions. The first is for EBM's to use at most only one of the suggested reviewers. Yes, that means making some EBM's work harder, but it's not that much effort. I know because this is what I do. My second suggestion is to require authors to submit a list of people who should be excluded from reviewing due to various conflicts of interest. By this I mean the kind of thing the NSF requires from people applying for a grant. A list of all co-authors and collaborators over the last four years. Plus postdoc and PhD mentors. Okay, so that's a bunch of work for the authors, but you do want that manuscript reviewed fairly, right? And you do want to see fewer crap manuscripts accepted, right? If you keep a running list, it's not that much work. Alternatively, suggesting inappropriate reviewers could be made grounds for immediate rejection, but that can be a difficult call for even the most conscientious EBM.
And finally, the EBM's name should be included in the paper. That alone should improve matters.
And thus endeth yet another long post.
All too often I find myself reading a peer-reviewed paper and wondering how on earth it managed to get by the reviewers and editor, and end up being published. In a reputable journal. I know many of my colleagues have the same experience.
I'm not necessarily talking about disagreeing with the interpretation of data. Rather, it's a matter of poorly executed, incorrect or missing experiments, lack of suitable controls, incorrect statistical analyses, egregious lack of, or incorrect, citation of other published work in the area, etc. In other words, truly bad papers.
How do these get published? I don't know, but I would like to offer a couple of suggestions based on my experiences on the editorial board of a mid-level journal. First up, let me state that I am a strong believer in the peer review process. I am also well aware that it has it's flaws. Secondly, a little background...
Here's how things are supposed to work at the Journal of Doodlewidgets. When a manuscript is submitted, the authors must supply the names of four potential reviewers plus suggest a member of the editorial board as someone suitable for handling the review process. The Editor then assigns the manuscript to an editorial board member (EBM), who may or may not be the one suggested by the authors. The EBM is then supposed to read the manuscript and decide if it's good enough to send out for review or whether it should be rejected without full review. Those manuscripts deemed good enough are then sent out for review. When the reviews are returned to the journal, the EBM makes a final decision (accept, reject, major or minor revisions) and the authors are informed. Many journals in my field have similar processes for handling submissions.
Here's where I see the system breaking down too often: at the EBM level on two counts.
1) As noted above, at the Journal of Doodlewidgets the EBM is supposed to read the manuscript and decide if it's good enough to send out for review. In other words, the EBM is supposed to perform a preliminary review of the manuscript. I suspect (know) this doesn't happen in many cases. There are those who join editorial boards just for the extra line on their CV's, and who can't be bothered with applying the required effort. It's not clear how to handle these people. The obvious answer is to boot them, but that's not so easy if the offending party is a Big Cheese. Journals like to have Big Cheese's on their boards for the cachet. And don't want the negative publicity that might occur if they boot a Big Cheese...
2) The bigger problem lies in the choice of reviewers. It's all too easy to send the manuscript out to two (or more) of the suggested reviewers. Problem is, those people are likely good friends of the authors. We all play that game. We suggest people we know who we think will review our manuscripts fairly. Or, in the case of a (hopefully) minority of authors, automatically favorably. In some cases, authors suggest ex-co-authors or collaborators. The corresponding author of a manuscript I handled recently listed as a suggested reviewer someone they were co-authors with on a manuscript in press! Needless to say that's just not on.
So, it's possible that a given manuscript receives reviews that are more positive than they should be, and the EBM (who hasn't bothered reading the manuscript) simply accepts them at face value. Or the EBM is good friend of one of the authors and over-rides a more negative review. Or, perhaps the manuscript is somewhat outside the EBM's area of expertise, in which case they assume the reviews from the suggested reviewers are legit. In the end, a substandard manuscript can end up being accepted...
Note that this is the opposite of the usual reviewing issue (reviewers being too harsh) often discussed on the blogosphere. And I'm ignoring the issues of lazy reviewers - a good EBM should pick up on those - or unqualified reviewers - which is the EBM's fault for using them.
It's not clear how to deal with this. If all EBM's were conscientious it wouldn't be much of an issue. But how do you ensure that the editorial board is stocked with only the good? I suspect Editors have some idea of who's dead wood, but since there are no good metrics for measuring EBM performance...
EBM's could ignore the list of suggested reviewers, but then what's the point of making authors go through that process? And most authors are probably making legitimate suggestions. You could simply scrap the idea of having a list of suggestions, but then it becomes a real crapshoot if you have a lazy or somewhat unqualified EBM handling your manuscript.
I don't know the best way to fix this, or even if it's as big an issue as I perceive it to be, but I do have three suggestions. The first is for EBM's to use at most only one of the suggested reviewers. Yes, that means making some EBM's work harder, but it's not that much effort. I know because this is what I do. My second suggestion is to require authors to submit a list of people who should be excluded from reviewing due to various conflicts of interest. By this I mean the kind of thing the NSF requires from people applying for a grant. A list of all co-authors and collaborators over the last four years. Plus postdoc and PhD mentors. Okay, so that's a bunch of work for the authors, but you do want that manuscript reviewed fairly, right? And you do want to see fewer crap manuscripts accepted, right? If you keep a running list, it's not that much work. Alternatively, suggesting inappropriate reviewers could be made grounds for immediate rejection, but that can be a difficult call for even the most conscientious EBM.
And finally, the EBM's name should be included in the paper. That alone should improve matters.
And thus endeth yet another long post.
Subscribe to:
Posts (Atom)