Skip to main content

Home/ Advanced Concepts Team/ Group items tagged peer review

Rss Feed Group items tagged

Giusi Schiavone

The importance of stupidity in scientific research. - 10 views

  •  
    I suggest you this easy reading ( is on a peer-reviewed scientific journal, IF = 6.14) 'We just don't know what we're doing!!!'
  • ...2 more comments...
  •  
    as a start of a peer reviewed paper this is an interesting first paragraph: "I recently saw an old friend for the first time in many years. We had been Ph.D. students at the same time, both studying science, although in different areas. She later dropped out of graduate school, went to Harvard Law School and is now a senior lawyer for a major environmental organization. At some point, the conversation turned to why she had left graduate school. To my utter astonishment, she said it was because it made her feel stupid. After a couple of years of feeling stupid every day, she was ready to do something else."
  •  
    Hilarious! Mr Schwartz, who made a PhD at Stanford(!) and apparently is working as a postdoc now, has finally discovered what science is about!!! Quote: "That's when it hit me: nobody did. That's why it was a research problem." And he seems so excited about it! I think he should not only get published in 6.14 journal, but also get the Nobel Prize immediately! Seriously, after reading something like this, how one may not have superstitions about the educational system in the US?
  •  
    I tend to agree with you but I think that you are too harsh - its still only an "essay" and one of his points of making sure that education at post graduate level is not about indoctrinating what we know already is valid ...
  •  
    I think this quote by Richard Horton is relevant to the discussion: "We portray peer review to the public as a quasi-sacred process that helps to make science our most objective truth teller. But we know that the system of peer review is biased, unjust, unaccountable, incomplete, easily fixed, often insulting, usually ignorant, occasionally foolish, and frequently wrong." :P
tvinko

Massively collaborative mathematics : Article : Nature - 28 views

  •  
    peer-to-peer theorem-proving
  • ...14 more comments...
  •  
    Or: mathematicians catch up with open-source software developers :)
  •  
    "Similar open-source techniques could be applied in fields such as [...] computer science, where the raw materials are informational and can be freely shared online." ... or we could reach the point, unthinkable only few years ago, of being able to exchange text messages in almost real time! OMG, think of the possibilities! Seriously, does the author even browse the internet?
  •  
    I do not agree with you F., you are citing out of context! Sharing messages does not make a collaboration, nor does a forum, .... You need a set of rules and a common objective. This is clearly observable in "some team", where these rules are lacking, making team work inexistent. The additional difficulties here are that it involves people that are almost strangers to each other, and the immateriality of the project. The support they are using (web, wiki) is only secondary. What they achieved is remarkable, disregarding the subject!
  •  
    I think we will just have to agree to disagree then :) Open source developers have been organizing themselves with emails since the early '90s, and most projects (e.g., the Linux kernel) still do not use anything else today. The Linux kernel mailing list gets around 400 messages per day, and they are managing just fine to scale as the number of contributors increases. I agree that what they achieved is remarkable, but it is more for "what" they achieved than "how". What they did does not remotely qualify as "massively" collaborative: again, many open source projects are managed collaboratively by thousands of people, and many of them are in the multi-million lines of code range. My personal opinion of why in the scientific world these open models are having so many difficulties is that the scientific community today is (globally, of course there are many exceptions) a closed, mostly conservative circle of people who are scared of changes. There is also the fact that the barrier of entry in a scientific community is very high, but I think that this should merely scale down the number of people involved and not change the community "qualitatively". I do not think that many research activities are so much more difficult than, e.g., writing an O(1) scheduler for an Operating System or writing a new balancing tree algorithm for efficiently storing files on a filesystem. Then there is the whole issue of scientific publishing, which, in its current form, is nothing more than a racket. No wonder traditional journals are scared to death by these open-science movements.
  •  
    here we go ... nice controversy! but maybe too many things mixed up together - open science journals vs traditional journals, conservatism of science community wrt programmers (to me one of the reasons for this might be the average age of both groups, which is probably more than 10 years apart ...) and then using emailing wrt other collaboration tools .... .... will have to look at the paper now more carefully ... (I am surprised to see no comment from José or Marek here :-)
  •  
    My point about your initial comment is that it is simplistic to infer that emails imply collaborative work. You actually use the word "organize", what does it mean indeed. In the case of Linux, what makes the project work is the rules they set and the management style (hierachy, meritocracy, review). Mailing is just a coordination mean. In collaborations and team work, it is about rules, not only about the technology you use to potentially collaborate. Otherwise, all projects would be successful, and we would noy learn management at school! They did not write they managed the colloboration exclusively because of wikipedia and emails (or other 2.0 technology)! You are missing the part that makes it successful and remarkable as a project. On his blog the guy put a list of 12 rules for this project. None are related to emails, wikipedia, forums ... because that would be lame and your comment would make sense. Following your argumentation, the tools would be sufficient for collaboration. In the ACT, we have plenty of tools, but no team work. QED
  •  
    the question on the ACT team work is one that is coming back continuously and it always so far has boiled down to the question of how much there need and should be a team project to which everybody inthe team contributes in his / her way or how much we should leave smaller, flexible teams within the team form and progress, more following a bottom-up initiative than imposing one from top-down. At this very moment, there are at least 4 to 5 teams with their own tools and mechanisms which are active and operating within the team. - but hey, if there is a real will for one larger project of the team to which all or most members want to contribute, lets go for it .... but in my view, it should be on a convince rather than oblige basis ...
  •  
    It is, though, indicative that some of the team member do not see all the collaboration and team work happening around them. We always leave the small and agile sub-teams to form and organize themselves spontaneously, but clearly this method leaves out some people (be it for their own personal attitude or be it for pure chance) For those cases which we could think to provide the possibility to participate in an alternative, more structured, team work where we actually manage the hierachy, meritocracy and perform the project review (to use Joris words).
  •  
    I am, and was, involved in "collaboration" but I can say from experience that we are mostly a sum of individuals. In the end, it is always one or two individuals doing the job, and other waiting. Sometimes even, some people don't do what they are supposed to do, so nothing happens ... this could not be defined as team work. Don't get me wrong, this is the dynamic of the team and I am OK with it ... in the end it is less work for me :) team = 3 members or more. I am personally not looking for a 15 member team work, and it is not what I meant. Anyway, this is not exactly the subject of the paper.
  •  
    My opinion about this is that a research team, like the ACT, is a group of _people_ and not only brains. What I mean is that people have feelings, hate, anger, envy, sympathy, love, etc about the others. Unfortunately(?), this could lead to situations, where, in theory, a group of brains could work together, but not the same group of people. As far as I am concerned, this happened many times during my ACT period. And this is happening now with me in Delft, where I have the chance to be in an even more international group than the ACT. I do efficient collaborations with those people who are "close" to me not only in scientific interest, but also in some private sense. And I have people around me who have interesting topics and they might need my help and knowledge, but somehow, it just does not work. Simply lack of sympathy. You know what I mean, don't you? About the article: there is nothing new, indeed. However, why it worked: only brains and not the people worked together on a very specific problem. Plus maybe they were motivated by the idea of e-collaboration. No revolution.
  •  
    Joris, maybe I made myself not clear enough, but my point was only tangentially related to the tools. Indeed, it is the original article mention of "development of new online tools" which prompted my reply about emails. Let me try to say it more clearly: my point is that what they accomplished is nothing new methodologically (i.e., online collaboration of a loosely knit group of people), it is something that has been done countless times before. Do you think that now that it is mathematicians who are doing it makes it somehow special or different? Personally, I don't. You should come over to some mailing lists of mathematical open-source software (e.g., SAGE, Pari, ...), there's plenty of online collaborative research going on there :) I also disagree that, as you say, "in the case of Linux, what makes the project work is the rules they set and the management style (hierachy, meritocracy, review)". First of all I think the main engine of any collaboration like this is the objective, i.e., wanting to get something done. Rules emerge from self-organization later on, and they may be completely different from project to project, ranging from almost anarchy to BDFL (benevolent dictator for life) style. Given this kind of variety that can be observed in open-source projects today, I am very skeptical that any kind of management rule can be said to be universal (and I am pretty sure that the overwhelming majority of project organizers never went to any "management school"). Then there is the social aspect that Tamas mentions above. From my personal experience, communities that put technical merit above everything else tend to remain very small and generally become irrelevant. The ability to work and collaborate with others is the main asset the a participant of a community can bring. I've seen many times on the Linux kernel mailing list contributions deemed "technically superior" being disregarded and not considered for inclusion in the kernel because it was clear that
  •  
    hey, just catched up the discussion. For me what is very new is mainly the framework where this collaborative (open) work is applied. I haven't seen this kind of working openly in any other field of academic research (except for the Boinc type project which are very different, because relying on non specialists for the work to be done). This raise several problems, and mainly the one of the credit, which has not really been solved as I read in the wiki (is an article is written, who writes it, what are the names on the paper). They chose to refer to the project, and not to the individual researchers, as a temporary solution... It is not so surprising for me that this type of work has been first done in the domain of mathematics. Perhaps I have an ideal view of this community but it seems that the result obtained is more important than who obtained it... In many areas of research this is not the case, and one reason is how the research is financed. To obtain money you need to have (scientific) credit, and to have credit you need to have papers with your name on it... so this model of research does not fit in my opinion with the way research is governed. Anyway we had a discussion on the Ariadnet on how to use it, and one idea was to do this kind of collaborative research; idea that was quickly abandoned...
  •  
    I don't really see much the problem with giving credit. It is not the first time a group of researchers collectively take credit for a result under a group umbrella, e.g., see Nicolas Bourbaki: http://en.wikipedia.org/wiki/Bourbaki Again, if the research process is completely transparent and publicly accessible there's no way to fake contributions or to give undue credit, and one could cite without problems a group paper in his/her CV, research grant application, etc.
  •  
    Well my point was more that it could be a problem with how the actual system works. Let say you want a grant or a position, then the jury will count the number of papers with you as a first author, and the other papers (at least in France)... and look at the impact factor of these journals. Then you would have to set up a rule for classifying the authors (endless and pointless discussions), and give an impact factor to the group...?
  •  
    it seems that i should visit you guys at estec... :-)
  •  
    urgently!! btw: we will have the ACT christmas dinner on the 9th in the evening ... are you coming?
Francesco Biscani

PLoS ONE: Editorial Peer Reviewers' Recommendations at a General Medical Journal: Are T... - 4 views

  • reject vs. accept/revise at levels barely beyond chance
  •  
    Apparently the peer review process is no better than chance.
Tobias Seidl

Frontiers | Alternatives to Peer Review: Novel Approaches for Research Evaluation | Fro... - 6 views

  •  
    Some new field of game for the ACT?
  •  
    Very interesting paper!
santecarloni

Breakthrough Propulsion Physics - 7 views

  •  
    The competition is open....
  •  
    And what does one win in the end? Yet another unfeasible concept to be archived somewhere in a journal? Look at "Millis hypothetical drives"... Give me a break, for sure!!
  •  
    I like the sentence "16 peer-reviewed journal articles, and an award-winning website (Warp-When), all for a total investment of less than $1.6M". This gives 100.000 dollars per peer-reviewed paper (we neglect the award-winning web-site under the assumption that is the easy part....). With these number the ACT in 2010 cashed 1.4 millions only in research papers making it an obvious good investment for the European Space Agency also in austerity times!!!
dejanpetkow

junq.info - 3 views

  •  
    This journal publishes failed scientific attempts, experiments, theories. There seems to be a peer review process behind it.
  •  
    OK more to the fun side, but I often think it is not a bad idea to publish "failed" research
ESA ACT

Elsevier has an entire division dedicated to publishing fake advertorial "peer-reviewed... - 1 views

  • Elsevier has an entire division dedicated to publishing fake advertorial "peer-reviewed" journals
    • ESA ACT
       
      trying the sticky notes
  •  
    "Australasian Journal of Bone and Joint Medicine" LOL!!!
  •  
    very strange indeed!
Ma Ru

Some movement toward academic spring here in UK - 2 views

  •  
    "Giving people the right to roam freely over publicly funded research will usher in a new era of academic discovery and collaboration, and will put the UK at the very forefront of open research".
LeopoldS

The Cost of Knowledge - 1 views

  •  
    interesting initiative with already some high profile names from space sector such as Martin Rees, Baumjohann, two guys from NASA ...
Dario Izzo

Who's Afraid of Peer Review? - 0 views

  •  
    A fake paper was accepted in 60% of tried open access journals, just because the author paid the fee :)
  •  
    Love the comment that some papers which originally rejected it, in the end did accept it anyway after some correspondence
aborgg

Graphene sponge can absorb light and emit energetic electrons for breakthrough solar sa... - 1 views

  •  
    The unique structure and properties of graphene and the morphology of the bulk graphene material make it capable of not only absorbing light at various wavelengths but also emitting energetic electrons efficiently enough to drive the bulk material following Newtonian mechanics.
  •  
    Hard to believe this should actually work, but would be quite a breakthrough indeed. I wonder, since the material should build up a significant electric potential over time, thus, pulling back the ejected electrons. Well, the paper apparently is not peer-reviewed, and I found some rather critical comments in some forums. Let's see if the experiment will be verified by another research team in due course.
Francesco Biscani

Claimed Proof That P != NP - 4 views

  •  
    Yet another one? Wish him good luck... I doubt anyone will waste time peer-reviewing his article. Here's quite a nice overview of the efforts on the problem: http://www.win.tue.nl/~gwoegi/P-versus-NP.htm
  •  
    thanks Marek - very nice link indeed ... did not know about it
Nina Nadine Ridder

Top 10 Surprising Results of Global Warming | LiveScience - 5 views

  •  
    #4 is pretty interesting 
  • ...1 more comment...
  •  
    first time I hear about this!!! Is there any peer reviewed paper reference to this? should impact missions like GOCE!!
  •  
    There are (even in Science): http://science-mag.aaas.org/cgi/reprint/314/5803/1253.pdf There is also a group at UCAR (lead by S. Solomon, one of the Gods in atmospheric research) who are analyzing this effect: http://www.ucar.edu/news/releases/2006/thermosphere.shtml
  •  
    for the drag effect, this is well known in fluid mechanics, we use the Knudsen number, which explains this phenomenon ... for a perfect gaz though!
Luís F. Simões

Peer review: Trial by Twitter : Nature News - 1 views

  • Blogs and tweets are ripping papers apart within days of publication, leaving researchers unsure how to react.
  •  
    includes some discussion on the aftermath of NASA's arsenic paper
Nicholas Lan

Global Farming futures - 2 views

  •  
    forecasting to 2050 wouldn't recommend the executive summary but the collection of reports seems to be quite comprehensive across a range of relevant areas "The Project has involved around 400 leading experts and stakeholders from about 35 countries across the world. Drawing upon over 100 peer-reviewed evidence paper commissioned by the Project which can be accessed in full here (hyperlink). "
Christos Ampatzis

Academic publishers make Murdoch look like a socialist - 4 views

  •  
    Who are the most ruthless capitalists in the western world? Whose monopolistic practices make Walmart look like a corner shop and Rupert Murdoch a socialist? You won't guess the answer in a month of Sundays. While there are plenty of candidates, my vote goes not to the banks, the oil companies or the health insurers, but - wait for it - to academic publishers.
  •  
    fully agree ... "But an analysis by Deutsche Bank reaches different conclusions. "We believe the publisher adds relatively little value to the publishing process … if the process really were as complex, costly and value-added as the publishers protest that it is, 40% margins wouldn't be available." Far from assisting the dissemination of research, the big publishers impede it, as their long turnaround times can delay the release of findings by a year or more." very nice also: "Government bodies, with a few exceptions, have failed to confront them. The National Institutes of Health in the US oblige anyone taking their grants to put their papers in an open-access archive. But Research Councils UK, whose statement on public access is a masterpiece of meaningless waffle, relies on "the assumption that publishers will maintain the spirit of their current policies". You bet they will. In the short term, governments should refer the academic publishers to their competition watchdogs, and insist that all papers arising from publicly funded research are placed in a free public database. In the longer term, they should work with researchers to cut out the middleman altogether, creating - along the lines proposed by Björn Brembs of Berlin's Freie Universität - a single global archive of academic literature and data. Peer-review would be overseen by an independent body. It could be funded by the library budgets which are currently being diverted into the hands of privateers. The knowledge monopoly is as unwarranted and anachronistic as the corn laws. Let's throw off these parasitic overlords and liberate the research that belongs to us."
  •  
    It is a really great article and the first time I read something in this direction. FULLY AGREE as well. Problem is I have not much encouraging to report from the Brussels region...
Ma Ru

Dark Matter or Black Hole Propulsion? - 1 views

  •  
    Anyone out there still doing propulsion stuff? Two more papers just waiting to get busted... http://arxiv.org/abs/0908.1429v1 http://arxiv.org/abs/0908.1803
  • ...5 more comments...
  •  
    What an awful bunch of complete nonsense!!! But I don't think anybody wants to hear MY opinion on this...
  •  
    wow, is this serious at all...!?
  •  
    Are you joking?? The BH drive propses a BH with a lifetime of about an year, just 10^7 tons, peanuts!! Then you have to produce it, better not on Earth, so you do this in space, with a laser that produces an equivalent of 10^9 tons highly foucussed, even more peanuts!! Reasonable losses in the production process (probably 99,999%) are not yet taken into account. Engineering problems... :-) The DM drive is even better, they want to collect DM and compress it in a propulsion chamber. Very easy to collect and compress a gas of particles that traverse the Earth without any interaction. Perhaps if the walls of the chamber are made of artificial BHs?? Who knows??
  •  
    WRONG!!! we are all just WAITING for your opinion on this ....!!!
  •  
    well, yes my remark was ironic... I'm surprised they did a magazine on these concepts...! But the press is always waiting for sensational. They do not even wait for the work to be peer-reviewed now to make an article on it ! This is one of the bad sides of arxiv in my opinion. It's like a journalist that make an article with a copy-paste in wikipedia ! Anyway, this is of course complete bullsh..., and I would have laughed if I had read this in a sci-fi book... but in a "serious" article i'm crying... For the DM i do not agree with your remark Luzi. It's not dark energy they want to use. The DM is baryonic, it's dark just because it's cold so we don't see it by usual means. If you believe the in the standard model of cosmology, then the DM should be somewhere around the galaxies. But it's of course not uniformly distributed, so a DM engine would work (if at all...) only in the periphery of galaxies. It's already impossible to get there...
  •  
    One reply to Pacome, though the discussion exceeds by far the relevance of the topic already. Baryonic DM is strictly limited by cosomology, if one believes in these models, of course. Anyway, even though most DM is cold, we are constantly bombarded by some DM particles that come together with cosmic radiation, solar wind etc. etc. If DM easily interacted with normal matter, we would have found it long ago. In the paper they consider DM as neutralinos, which are neither baryonic nor strongly or electromagnetically interacting.
  •  
    well then I agree, how the fu.. they want to collect them !!!
jcunha

Metals used in high-tech products face future supply risks - 0 views

  •  
    First peer review study about he criticality of rare-earth metals. It can be read "They found that supply limits for many metals critical in the emerging electronics sector (including gallium and selenium) are the result of supply risks. The environmental implications of mining and processing present the greatest challenges with platinum-group metals, gold, and mercury. For steel alloying elements (including chromium and niobium) and elements used in high-temperature alloys (tungsten and molybdenum), the greatest vulnerabilities are associated with supply restrictions" Questions about estimation apart, this can be a valuable market for asteroid mining.. (ot just more market for Infinium-like companies http://www.technologyreview.com/news/527526/a-cleaner-cheaper-way-to-make-metals/).
jcunha

The physics of life - 2 views

  •  
    Research in active-matter systems is a growing field in biology. It consists in using theoretical statistical physics in living systems such as molecule colonies to deduce macroscopic properties. The aim and hope is to understand how cells divide, take shape and move on these systems. Being a crossing field between physics and biology "The pot of gold is at the interface but you have to push both fields to their limits." one can read
  •  
    Maybe we should discuss about this active matter one of these days? "These are the hallmarks of systems that physicists call active matter, which have become a major subject of research in the past few years. Examples abound in the natural world - among them the leaderless but coherent flocking of birds and the flowing, structure-forming cytoskeletons of cells. They are increasingly being made in the laboratory: investigators have synthesized active matter using both biological building blocks such as microtubules, and synthetic components including micrometre-scale, light-sensitive plastic 'swimmers' that form structures when someone turns on a lamp. Production of peer-reviewed papers with 'active matter' in the title or abstract has increased from less than 10 per year a decade ago to almost 70 last year, and several international workshops have been held on the topic in the past year."
1 - 20 of 21 Next ›
Showing 20 items per page