Wednesday, March 7, 2012

How good is your science?

Science (including technology) is the most meaningful activity people can perform after survival.  This says a lot, ranking it ahead of politics, financing, certainly arts, sports, and entertainment.  

The manner scientific research is run these days is so much different from the Newton's time, even Einstein's.  Many more people are doing it, and much more money is involved.  This change parallels with basically everything else in the world.  But a central question remains: is what you are doing significant, useful, or any other descriptive?  Are you any good?

There is always a need to evaluate, but not always a right tool to do so.  If you have a lot of grant money, perhaps you are good.  If you publish in Science the journal, perhaps you are good.  If your company sell for a lot of money, perhaps you are good.  But these criteria do not directly address the virtue of your science.  Perhaps you are just good at marketing or just have some powerful friends.

As a point to illustrate that scientists are as morally feeble as everybody else, to evaluate grants and people these days, even though nobody respectable dares to say aloud he counts journals' impact factors (IF), and everybody respectable says he does not, this is essentially what every review group does and does only in the world.  A less common number to look at is citation.  Citation has its own problem as well, for it differs amongst fields.  But at least a higher number means more people remember it.  Unfortunately, people also often remember wrong; omission and citing the wrong papers is common.

A simple way to rank what scientists do actually is to use a stamp collecting and door/room analogy.  Nature makes and places many stamps in many places (rooms).  So what we are producing or publishing in journals is collecting stamps.  Most stamps are very boring and not that important despite what we'd like to claim.  Or similar ones have been collected by others before, and you simply find extras in the same or a slightly different place later.  The often "me, too" science. 

Great scientists obviously collect the most important stamps, but they accomplish it usually not by out-competing others for stamps in the open, but by finding and opening a door to a new room(s) with unknown stamps.  The mere fact of finding a new room, or more specifically, proposing a brand new idea, pointing out a new area of research, or developing a new technique, is often much more important than picking up the actual stamps themselves. 

For example, Newton's contributions to physics (ideas) and math (tools) have been applied in basically every aspect of life since 1700s.  Darwin's idea was so profound that it gave us the best and most comprehensive understanding of life and diversity.

So how good your science is depends ultimately on how widely applicable your new knowledge is.  The more rooms your singular discovery finds, the more doors it opens, the more significant it is.  Like you propose a formula E=mc2 or a mechanism that is universal in every particle or biological system.  If the mechanism you show is valid in every cell in a human body, then it is more important than if only in, say, a neuron.  Even if the latter might be used to combat dementia, the former might be used to target many other diseases, besides neurological disorders.  Another example is developing a model that people then use to answer a wide range of questions that have been difficult to study before, like yeast, flies, and worms.  Or a technique that over 95% of the biologists will use at least once in their career.  It is certainly possible that a lesser (still good) discovery can net you much more money, like NO and Viagra, vs Mendel's laws or the DNA double-helix model, but anybody will know which is more important scientifically. 

Of course, some examples listed above are truly the best of the best.  And not every single work of the great minds has been of supreme importance.  Some Nobel Prizes were awarded just for collecting good-looking stamps.  In fact, most work by everybody, even the greatest ones, is quite banal, so everybody is "guilty".  Even papers in the "best" journals are >90% stamp collecting to a higher power: more sequences from different species/cells/different conditions, the same mechanism repeated in a different system, albeit perhaps more related to human diseases, or the same old pathway for a sexy protein or RNA.  It is still a bad idea to undervalue knowledge, no matter how useless it seems initially.  For every Pete Sampras, we have Patrick Rafter, Tommy Haas, and many others.

But you will be guiltier if you never go beyond the unimaginative even when it guarantees publications and grants under the current environment, which is the reality.  After all, Darwin did spend years collecting stamps (specimens), but then he came up with the idea and had all the data to back it up.

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.