What's your h-index?

Actually I don't really want to know. Listing h-indices here would be akin to having a pissing contest. Puerile, messy and smelly...

In recent years I've noticed an increase in the number of people who list the number of times their publications have been cited in their c.v.'s and/or biosketches.* Many have started listing their h-indices as well. At first I viewed this as a form of bragging. But now I've seen it enough that I'm beginning to pay attention. We could argue ad infinitum as to whether number of citations and/or h-indices are useful measures of a person's productivity and standing in their field.** That's akin to the interminable Mac vs. PC arguments*** and I'm really not interested in that kind of semi-religious "discussion". What I am interested in is people's opinions as to whether or not this is a reasonable practice. Do any of my readers list citation statistics in their c.v.'s or biosketches? What are your thoughts on this? Do your respective departments take such things into account come annual review time (which is now for many of us)?

I don't list citation statistics in my c.v./biosketch (but might do so in the future if it seems advantageous). And my department doesn't formally consider such things, although I suspect some of the senior faculty spend some time on ISI's Web of Knowledge prior to annual reviews figuring out the stats on the more junior faculty.

Finally, I wouldn't recommend grad students and junior postdocs listing such stats unless they have a really highly cited paper or two. I have seen senior postdocs applying for TT positions list their stats. In some cases it helps. In others, not so much. It's a good idea to poke around and see how you stack up versus your peers before making the decision.







* Yes, in biosketches in grant proposals. At least in NSF and private foundation proposals.
** Personally I find number of publications, average number of citations per publication, plus h-index the most informative combination, but recognize even that has flaws.
*** Mac.

The month that was

I survived my month with two grant review panels, and a grant submission. Did I mention I also went to a small meeting in that timeframe? And had a root canal the day before one of the review panels?

I don't think I want to repeat that month...



And for Prof-like Substance:



The atrium of the NSF building in Alexandria after the review panels have met. My money is on the PD in the red and white tights.

NSF and too much funding

Prof-like Substance has posted a nice summary of the NSF's funding stats for 2008. In it he writes:

"One thing that I found very surprising was the number of grants per PI. In the fiscal years 2006-08, 83% of PIs had one grant! That left 13% with two grants, 3% with three and 1% with four or more. As someone who has three very different projects that they are trying to get funded and has been talking with a colleague about a fourth, I'm not sure what to make of those numbers. If nothing else, it concerns me that reviewers might balk at a proposal just based on the number of grants held by a PI. Now, I'm not thinking that everything I am submitting will eventually get funded in the next year, but if these projects weren't fundable in my opinion, I wouldn't be wasting my time. Perhaps people who have served on a couple of panels (*cough* Odyssey? *cough*) might shed some light on the perception of when someone has "too much" funding."

I was going to reply in the comments but quickly realized this warranted a post all of it's own. Note that this is all based on my own observations and a few pieces of anecdotal evidence. As far as I know the NSF does not have any written policies regarding this stuff.

There are two issues here: holding more than one NSF grant concurrently, and what amounts to "too much" funding.

Firstly, let me address the comment "...reviewers might balk at a proposal just based on the number of grants held by a PI." Based on my experience on a couple of panels, that's rarely the case. A panel member might point out that someone is well-funded, but it doesn't seem to effect the review or panel scores. I believe it's the Program Directors who take current funding levels into account when making decisions as to who to fund.

As far as holding two NSF grants concurrently goes, the NSF stats reflect what I have observed over time. I have rarely come across someone who is PI on more than one NSF research grant. In fact I can only think of two instances. I do know of people who are PI on an NSF research grant and on a second, or even third, other type of NSF grant (e.g. REU site, equipment grant etc.). I would be one of those. So it happens, but it's rare. What's a PI to do? Call your Program Director and talk to them. Feel them out about the possibility of getting two NSF grants funded. One thing I do know however, submitting two proposals at the same time to the same panel is not received terribly well by the panelists. Or Program Director. Spread out your submissions.

So what has led to 83% of NSF-funded PI's holding just the one NSF grant? I have come to believe it's a function of the NSF's working philosophy. The Program Directors appear to view each grant funded as an investment. They want to "buy low", maintain the investment over the long term, and reap large returns. A well-established, well-funded investigator might be a "safe" investment, but often does not (appear to) give the same return per dollar over the long term as a riskier, young investigator.* What does that mean in practice? A senior person with one or more NIH R01's and no track record of recent NSF funding is unlikely to land an NSF grant. A young investigator with little or no other funding is in the running. Someone who landed an NSF grant early on, and subsequently pulled in other major funding while maintaining the NSF grant, remains in the running (the Program Directors want to hold their investments long term - as long as they continue to perform well on average).

I don't know whether this is fair or not. I have certainly benefited from this system. Keep in mind that the NSF's budget is a small fraction of the NIH's, and that they fund all non-biomedical science, plus math and engineering. Giving out multiple NSF grants to one investigator, or one to someone who is otherwise well-funded, means someone deserving misses out.** On the other hand, a single NSF grant is rarely enough to run a truly productive group...

Once again, the above are conjecture based on my own observations, nothing more.





* I would dearly love to see a study done on productivity/dollar. Many people, including myself, complain that investigators holding four or more R01's are not as productive per dollar as those with just one or two, but it's all based on anecdotal evidence on non-rigorous analysis of one or two mega-funded investigators.

** A Program Director recently told me the BIO Directorate at the NSF currently has a funding rate of ~15%. Better than NIH at the moment, but still lousy. A lot of really good grants are going unfunded.

Megacool faculty position

A colleague brought my attention to a job listing at Purdue University in Indiana. They're looking for someone in Molecular Pharmacology.

My colleague describes the Department thusly:

"As monocultural as my department looks on paper, everyone here is really cool people, we have a great atmosphere and a very friendly, down-to-earth departmental community. People here TRULY COLLABORATE without fearing for their independence. I have been welcomed without hesitation into the group and feel very at home here, and our department head is really fantastic. In general people here are just straight-up folks. We have a formalized junior faculty mentorship program as well as an informal weekly lunch together that I have found totally invaluable to getting on my feet. Our tenure requirements are very rigorous, but everyone seems to be doing their best to help each other make it through (rather than trying to turf each other out). All in all, I think this is an excellent place to start a career and I couldn't be happier with my choice to join this department."

And just in case you think you're not quite a molecular pharmacologist, check out a recent post by Comrade Physioprof. Now go sell yourself.

Mistake?

I'm beginning to wonder if agreeing to be on two grant review panels in the same month I have a grant due was one...

Real lives and white lies

The title of this post is stolen borrowed from a new opinion piece by Peter A. Lawrence in PLoS Biology titled "Real Lives and White Lies in the Funding of Scientific Research."* Go read it (open access - it's free!). Lawrence is mostly referring to the current system in Britain, but there are clearly parallels with the system here in the U.S.

Lawrence is concerned with the fate of young innovative scientists. However, many of the opinions cited in Lawrence's piece come from well-established scientists, so it's not clear how some of the suggested "fixes" (shorter grant applications, a tiered system of fixed five-year funding blocks followed by review, etc.) would work for young scientists. One of the quoted scientists complains about a 2.5 year funding gap after 30 years in research, which is easy to interpret as the whining of one of those old farts CPP loves to hate. Maybe he is, maybe he's not. Still, it's an interesting read.


Some highlights:

On the system-

“What a strange business this is: We stay in school forever. We have to battle the system with only a one in eight or one in ten chance of getting funded. We give up making a living until our forties. And we do it because we want to help the world. What kind of crazy person would go for that?”—Nancy Andrews, Vice Chancellor for Academic Affairs and Dean of the Duke University School of Medicine

On the advantages of large groups-

"The peculiar demands of our granting system have favoured an upper class of skilled scientists who know how to raise money for a big group [3]. They have mastered a glass bead game that rewards not only quality and honesty, but also salesmanship and networking. A large group is the secret because applications are currently judged in a way that makes it almost immaterial how many of that group fail, so long as two or three do well. Data from these successful underlings can be cleverly packaged to produce a flow of papers—essential to generate an overlapping portfolio of grants to avoid gaps in funding.

Thus, large groups can appear effective even when they are neither efficient nor innovative. Also, large groups breed a surplus of PhD students and postdocs that flood the market; many boost the careers of their supervisors while their own plans to continue in research are doomed from the outset. The system also helps larger groups outcompete smaller groups, like those headed by younger scientists such as K. It is no wonder that the average age of grant recipients continues to rise [4]. Even worse, sustained success is most likely when risky and original topics are avoided and projects tailored to fit prevailing fashions—a fact that sticks a knife into the back of true research [5]. As Sydney Brenner has said, 'Innovation comes only from an assault on the unknown” [6].'

And perhaps my favorite paragraph-

"Universities have whole departments devoted to filling in the financial sections of these forms. Liaison between the scientists and these departments and between the scientists and employees of the granting agencies has become more and more Kafkaesque."

Kafkaesque indeed...




* Peter A. Lawrence (2009) Real Lives and White Lies in the Funding of Scientific Research. PLoS Biol 7(9): e1000197

Monday

By 8am this morning I had reinstalled a toilet*, showered, shaved, breakfasted, read the newspaper, drove one of my daughters to school, and built towers out of wooden blocks with my son. I'm not sure I can maintain this pace...









* I tiled the floor yesterday.

PSA: How to schedule a dissertation meeting

In the last three or four weeks I've had five grad students email me trying to set up meetings of their dissertation committees. Let's call these students A, B, C, D and E. Student A's email read:

Dear members of my committee,
I want to have a meeting of my dissertation committee on SpecificDay at SpecificTime.
A

Students B thru E all sent emails along the line of:

Dear members of my committee,
I want to have a meeting of my dissertation committee. When are you available?
B/D/C/E

No, no, no, no, no. Neither of these approaches will do. In fact, these are exactly how NOT to go about the process.

Let's start with student A. The odds of all of your committee members being available at the specific time and date you chose are quite small. In fact, I'm not available then. So now what? You choose another specific time and date? What if I or another committee member aren't available then? How many rounds of this will we have to go through?

Students B thru E. What timeframe are we talking about here? Sometime in the next week? Two weeks? Month? Year? Decade? Millennium?

Okay, so we can probably rule out millennium. And decade. At least for students B, C and D. You guys should have graduated and be long gone by then. E on the the hand...

Even if you pin it down to specific period, say sometime in the next two weeks, do you really want me to send you a list of when I might be available? My calendar currently looks like something Jackson Pollock created on the floor, as do, I suspect, the calendars of all your other committee members.



Pollock's No. 5 1948 is a reasonable representation of Odyssey's calendar.

Why, oh why are you creating so much work for your committee and for yourself?

As a public service here's how you should approach the process:

Send a preliminary email asking if everyone is in town during the period you're hoping to have a meeting in.

Based on the results of the preliminary email, provide a list of five or six times and dates and ask your committee members to indicate which they are available for.*

Based on the replies, choose a time and date that works for everyone. Let everyone know as quickly as possible so they don't inadvertently fill that slot with something else. If there isn't one, try again.


Simple isn't it?





* If your committee is composed of computer savvy faculty you could go high-tech and use something like www.doodle.com.

Factor this

Wolfgang G. Stock of the Department of Information Science at the Heinrich-Heine-University in Düsseldorf has an interesting essay titled "The inflation of impact factors of scientific journals" coming out in ChemPhysChem (subscription required). In it he makes the point that impact factors (IF), h-indices and even eigenfactor scores for journals are flawed and really not very informative. For starters, he points out-

"For example, the British library holds more than 40000 scientific serials and adds about 800 new journals each year, whereas the two most comprehensive multidisciplinary databases, namely Elsevier's Scopus and Thomson Reuter's Web of Science (WoS) cover only 16000 (Scopus) and 10000 (WoS) periodicals."

Note that because of the differences in periodicals surveyed by Scopus and WoS, the IF's obtained from these two sources often disagree on the IF for a given journal.

Stock notes-

"All indicators that work with relative frequency measures (ie, all Group 2 indicators) suffer from serious statistical problems. It is a precondition for calculating average values (in our case: average cites per publication) that there is a Gaussian distribution... In journal informetrics this is not the case."

Seems like a serious flaw to me...

He asserts-

"In no case is it possible to use a journal impact factor on the article level to evaluate the influence of an article, an author or an institution."

Of course we all knew that.

Wish the bean-counters did...

PSIfi careers

Recently there was quite a bit of discussion in the blogosphere regarding a former SLAC National Accelerator Laboratory technician destroying $500,000 worth of proteins crystals. This incident occurred at the Joint Center for Structural Genomics, a part of the NIH-funded Protein Structure Initiative (PSI). You can read about this incident over at DrugMonkey's place.

A couple of the comments following DM's post made the point that these PSI labs are little more than large protein structure factories. 'Tis true. According to the global repository of all that is worth knowing, Wikipedia, PSI labs produced >3400 new structures between the inception of PSI in 2000 and November 2008, with ~1900 being new folds. One can argue whether or not the scientific output is worth the (so-far) >$700 million cost - many people have, including prominent structural biologists such as Greg Petsko. I don't really want to get into that here. What I do want to talk about is one of the human costs of PSI.

PSI employees a great number of scientists. Many of these are employed as postdocs. The problem with this is that many of these "postdocs" aren't really receiving research training.* Sure, they solve many structures, but that in and of itself is not research. The PSI labs are trying to solve as many representative protein structures as possible and each (at least initially) tend(ed) to focus on a single organism (or maybe a couple) as the source of material. A postdoc in a PSI lab could solve a whole bunch of structures, but the only relationship between the proteins would be the organism they were derived from. Many of the proteins were/are of unknown function. And the vast majority of the publications reporting the structures are short letters or notes with many authors... This is not research and it is not research training.

We're not associated with PSI, but do happen to have very good facilities for x-ray crystallography at Big State U. Consequently, in recent faculty searches we have had quite a few applications from PSI-trained crystallographers. Despite long publication lists, none of them have ever made it to the interview pile. Why? Well, an unusually large portion haven't written a coherent research plan (unusually large compared to applications from non-PSI trainees). I suspect they simply don't know how to construct a worthwhile/fundable research project. They haven't received the training. Many of the remainder suggest decent systems to work on (proteins of medical relevance), but propose nothing more than crystallography, which nowadays is not enough to get funding. And they have no preliminary data. None.

You could argue that a postdoc who takes a position in a PSI lab hoping to move on to an academic career is naive. They are. Judging by the applications we've seen, there are a bunch of naive postdocs out there. However, I think the PSI labs share some responsibility here. They should make it very clear to postdoc applicants that the positions they are applying for are unlikely to provide the training necessary for an academic career. Perhaps some of them do. Even better would be to call the positions by a name other than "postdoctoral scholar/fellow/trainee" - something employing "technician" seems more appropriate.

Petsko has stated "As a structural biologist, I want to train people who use structure determination as part of what they do. It is not the end in itself, nor should it be, not any more."

Sounds about right to me.





* Many, not all. I am aware that some PSI postdocs receive excellent research training.

It's party time!!!!!!!!

DrDrA is having a blog party!!!! I'll bring the bourbon.

iPhone apps

I have a question for my iPhone-wielding compadres: what apps do you find truly useful? Other than the ones that come standard.

I've grown partial to the following:

Evernote - particularly useful since it automagically syncs with my laptop via the internet. Good for recording notes, saving web pages etc. A useful catchall and organizer for information.

TripIt - useful as long as you're comfortable with them potentially having access to your travel info. It's also available on LinkedIn if you happen to have an account there. I like the built-in flight status and map features.

UrbanSpoon - for when you're traveling and have a need for good Thai food...

Liberation

We had one humungous mother of a thunderstorm come through a couple of days ago. Knocked out the power in the building I work in.

It fried my office phone.

Woohoo!!11!!!11!!!

Herding cats

I'm in the midst of writing an equipment proposal for a bright shiny new toy that will be really, really useful. To a lot of the faculty here. Although I've never written this kind of proposal before I'm not finding the writing terribly difficult - I know enough about the instrument and what we'll do with it to wax lyrical. No, it's not the writing that's getting to me. It's extracting information from my fellow faculty. It's like herding cats.



Odyssey trying to corral fellow faculty.

All I need from each of them is a biosketch, list of current and pending funding, and a paragraph or two describing the research they would do with the instrument. Is that really so hard?

Apparently it is. To the point that I can now confidently state a new law...

Odyssey's law of equipment proposal writing:

The ability to obtain from a faculty member useful information required for an equipment proposal is inversely proportional to just how useful that piece of equipment would be to that person.




Anyone got a good bullwhip I can borrow?

Odyssey's 3 Rules for Smartphone Use

Female Science Professor recently had a post on why she hates iPhones. Based on some of the comments that resulted from that post I've come to realize that a great many people don't know the correct protocols for smartphone* usage. So here I present:

Odyssey's 3 Rules for Smartphone Use

Rule 1: Thou shalt not just use it, but flaunt it.

We've all seen people engrossed in cellphone conversations at restaurants, ignoring their dining companions. Such behavior is totally unacceptable. Crass. Rude. Except in those cases where an iPhone is in use! In such cases it is acceptable behavior, but only if the user makes it very, very clear to all and sundry that he/she is using an iPhone. The following examples demonstrate incorrect and correct usage:

Incorrect Usages-
(Ranging from bad to absolute worst)

a) Ring, ring!
iPhone owner quickly and unobtrusively retrieves iPhone from pocket, apologizes to dinner companion(s), answers thusly:
"Hello?"
...
"Oh hi. I'm at dinner right now. Can I call you back later? Thanks."
...
"Bye."
Hangs up, apologizes again while silencing phone and putting it away.

b) Ring, ring!
iPhone owner quickly and unobtrusively retrieves phone from pocket, pushes a button to send the caller into voicemail, silences phone, and quickly pockets the device. Apologizes to dinner companion(s).

c) iPhone owner silences iPhone before entering restaurant.

Correct Usage-
Ring, ring!
Cellphone user smiles knowingly and slowly retrieves iPhone from pocket.
Ring, ring!
Holding iPhone at eye-level owner carefully checks to see who is calling.
Ring, ring!
Keeping iPhone at eye-level, owner glances to make sure people at nearby tables are watching and, maintaining that knowing smile perfected by iPhone owners, carefully taps "Slide to Answer".
With a flourish owner then moves to iPhone to his ear and answers in a loud clear voice:
"Hi Bob, you've reached me on my iPhone. What's up?"

During the loud conversation that follows, the iPhone owner makes sure to mention that he is talking on his iPhone at least twice more, and then ends the call with:
"Well Bob, must run now. I'll talk to you soon on my iPhone. I'm hanging up my iPhone now. God, it's great to have an iPhone! Bye."

Rule 2: Thou shalt use thy Apps. And use them. And use them. And use them.

Why else would you have them? Suggested uses:

a) Use Maps to show everyone exactly where you are. This is good at least once for every location.
b) Use Maps to get directions to your next location, even if it's to the restaurant you're standing outside of.
c) Use the in-built camera to make a visual record of every event, no matter how trivial. And immediately send the photos to everyone on your contact list.
d) Make a Voice Memo of every important thought you have. Remember, they're all important!
e) Check the time in Timbuktu using Clock. While you're there, what time is it in Zurich?
f) Show off the last four Youtube videos you watched. Doesn't matter how good they were.
g) Check your Stocks. Don't own any? Check the ones you wished you did own.
h) What's new at the iTunes store? Or the Apps Store? Gotta keep up to date!
i) Look it up on the internet. Doesn't matter what it is. Look it up! "You're ordering the linguini? Look, here are 2,018 pictures of linguini on my iPhone!" "Did you say 'boorish'? Let me look that up on my iPhone!"

Be sure to hold your iPhone at at least eye-level and talk about it in a loud, clear voice while using your Apps. Make sure you say "iPhone" multiple times with plenty of with extra emphasis. And remember, there's no limit to how many times you do this an hour. The more the better!

Rule 3: Email be thy master.

Email is perhaps the most abused aspect of smartphones. Really, the way people use it is pathetic. One should never, ever write "I'm sending this from my iPhone" in an email. Pitiful!

That's what the signature is for! And frankly, the standard "Sent from my iPhone" signature just isn't good enough. It's way too small. Bump it up!

Sent from my iPhone!

See how much better that is? Gain some eco-friendly bonus points by going big and green!

Sent from my iPhone!

Extra bonus points for going all caps.

And don't forget, with your iPhone you're available to answer emails at all times (make sure you have a piercingly loud incoming email notification!). You're available 24/7! Just send it! There's nothing like a "SENT FROM MY iPHONE!!!!!" at 3:30am!







* Although my rules mention iPhones, by "smartphone" I am referring to all such devices (e.g. Blackberries, Palm Pre's etc.)**.

** "Smart" refers to the device, not the user.***

*** I'm a user. I own an iPhone.

DIY ideas...

...available here.


I didn't say they were good ideas...

I need a secretary

How I feel at the moment.

Danger!! Danger, Will Robinson!!!

Get Your Cyborg Name

The yardwork part is debatable...


Cyber-hat tip to Drugmonkey.

This and that

I heard this morning that my late Nanna's house was sold. She passed away earlier this year. I knew the house was on the market but hadn't really thought about it in depth. It's actually quite sad - I have some fond childhood memories of that old place. The fig tree in the backyard, the lanes out the back and on the side, the "old house" smell*... Sigh.


On a brighter note, I'm off to a smallish six day meeting this Sunday. Lots of good people will be there. My goals (you should always have goals, otherwise why attend?) are to:

i) get feedback on my new major research project - progress has been slow but steady,
ii) get feedback on my new major research project's bride, which is showing signs of life,
iii) catch up with old friends/collaborators,
iv) make new friends/collaborators,
v) score at least two seminar invites, and
vi) not make a fool of myself.

Goal vi) might be the hardest.


And finally a quote from my supertech: "Cloning always works. One day."






* Or was it an "old person" smell?

Do Science Scouts have a secret handshake?

After reading DrDrA's post I couldn't resist going over to the Science Scouts site to see what badges I could award myself...



The “I somehow convinced someone to part with a lot of money for science” badge (LEVEL II).

Haven't quite made it to Level III yet...


The “non-explainer” badge (LEVEL I).
It's been this way since grad school. Or even before. I'm trying hard not to earn Level II...


The “has done science whilst under the influence” badge.
Let's be honest now, who hasn't?


The “works with acids” badge.
This one's a bit of a gimme for anyone doing benchwork. Of course I did once dissolve part of a bench using acid...


The “I’ve set fire to stuff” badge (LEVEL III).
I did train as a physical chemist.


The “statistical linear regression” badge.
A necessary evil.


The “I’m a scientist who is fundamentally opposed to administrative duties” badge.
Another gimme.


The “has frozen stuff just to see what happens” badge (LEVEL III).
The irresistible lure of liquid nitrogen...


The “talking science” badge.
Of course!


Now I really should go do some science...