tag:blogger.com,1999:blog-7464708.post8577647732506642444..comments2024-03-22T06:05:36.544-04:00Comments on Kids Prefer Cheese: Political Science LOLMungowitzhttp://www.blogger.com/profile/02340064320347875601noreply@blogger.comBlogger31125tag:blogger.com,1999:blog-7464708.post-36466187217956298182009-12-08T21:40:37.979-05:002009-12-08T21:40:37.979-05:00I think in econs, it is reasonable to expect a ref...I think in econs, it is reasonable to expect a ref's report in 3 months. Apart from delays, what is frustrating is getting a "no" based on a one-liner like "we think your article is more suitable for other journals". Why can't the editor make that decision right away, rather than having the ref do it after a few months? Also, ref reports that are a skimpy one short para, with no solid reasons for rejection. I think journals should insist on a full report with reasons given for rejection. Otherwise, it's easy to reject with a flimsy report, and put in my CV that I was a reviewer for this journal. Some reports I've seen from colleagues obviously show little time was spent by the ref, without much understanding of the article. It's dishonest & unprofessional. Much time was spent by the author (those who got past the editor in the first place), who surely deserves something better.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-1703206798071174892009-10-07T09:08:59.265-04:002009-10-07T09:08:59.265-04:00No. Compare the attitides of the two on Political ...No. Compare the attitides of the two on Political Compass.In addition read up on how Hitler treated the Jews, then tell me Obama is going to do that in the USA.Vanessahttp://www.asiarooms.comnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-19064518436265224842009-09-23T01:25:57.202-04:002009-09-23T01:25:57.202-04:00I truly agree with Dazy regarding the thesis and p...I truly agree with Dazy regarding the thesis and paper. You topic is very informative too!!Gavinhttp://www.holidaycityeurope.com/madridhotels/noreply@blogger.comtag:blogger.com,1999:blog-7464708.post-65787705867258441582009-06-25T03:15:55.253-04:002009-06-25T03:15:55.253-04:00I'm not a Political Science expert, my elder s...I'm not a Political Science expert, my elder sister is. From her, I gathered that Political science papers are almost always argumentative in one way or another. Concerning the argument, one should be sure to state a clear thesis at the start of his paper. In introduction, one should not only set out the topic, but also should state clearly what he/she intends to argue with respect to it – the thesis.Dazyhttp://www.asiarooms.comnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-2115640277355439792009-06-11T16:36:02.558-04:002009-06-11T16:36:02.558-04:00zbicyclicst: "And the downside would be?
To o...zbicyclicst: "And the downside would be?<br />To oversimplify, if nobody's excited to review it, nobody's going to be excited to read it, either. So what's the point?"<br /><br />You don't think a lot of good ideas are sometimes difficult and boring to read?<br /><br />Quite frankly the impression I get as an Econ graduate student is that the peer review process in Economics in comparison to many other fields is something of a joke.<br />What's all the more entertaining is that some in the Economics field will defend it. Though I suppose that's hardly a surprise given the over-sized egos and automatic jurisdiction over any area of knowledge that a PhD in Economics gives you...Ecapitanoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-46121016264704619122009-06-07T22:34:07.123-04:002009-06-07T22:34:07.123-04:00"if APSR were to only publish papers so intel..."if APSR were to only publish papers so intellectually exciting that people in the field wanted to review them immediately, they would find themselves publishing almost nothing."<br /><br />And the downside would be?<br /><br />To oversimplify, if nobody's excited to review it, nobody's going to be excited to read it, either. So what's the point?zbicyclisthttps://www.blogger.com/profile/10850387889082662189noreply@blogger.comtag:blogger.com,1999:blog-7464708.post-55184317413028546532009-06-06T14:56:30.031-04:002009-06-06T14:56:30.031-04:00Angus,
These comments are fun. You struck a nerve...Angus,<br /><br />These comments are fun. You struck a nerve with your post. I figure if someone wants you to work for them AND gives you a short deadline they should be willing to offer the current consulting rate (or at least provide jmcb like incentives). You should have introduced the JOP editors to Mr. Ted DiBiase.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-64109919562374439052009-06-06T12:54:36.759-04:002009-06-06T12:54:36.759-04:00The current equilibrium in economics generates gre...The current equilibrium in economics generates great uncertainty in assistant professors, as they have to wait a long time to find out if their articles will hit high enough to warrant tenure. This is a common complaint. I would also point out that it forces departments to make tenure decisions based on a much smaller number of publications, which means they make decisions with a noisier signal. This is a cost to the discipline.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-90816819077800845222009-06-05T19:36:03.323-04:002009-06-05T19:36:03.323-04:00Dirty Davey writes "Which has the implication...Dirty Davey writes "Which has the implication, sadly, that top journals in economics and political science are receiving papers that do NOT sufficiently excite their reviewers..."<br /><br />That isn't necessarily sad. Many of the fields covered by Science and Nature involve things which can be measured by techniques which depend on rapidly advancing technologies (e.g., sequencing/synthesis of DNA, and new semiconductor sensors for fields from chemistry to astronomy). This is a technical reason for a natural kid-in-a-candy-store atmosphere to the work. Imagine what political science might be like if events comparable to the USSR archives opening occurred several times each year.<br /><br />In journals in technical fields which don't happen to be downstream from such data explosions, e.g. math and algorithms journals, there's plenty of good work, but it doesn't seem to be as surprise-driven. That's not particularly sad, just different.William Newmanhttps://www.blogger.com/profile/14336821309402794016noreply@blogger.comtag:blogger.com,1999:blog-7464708.post-6995047269438661612009-06-05T19:29:41.242-04:002009-06-05T19:29:41.242-04:00I haven't been a referee for a (strictly) poli...I haven't been a referee for a (strictly) political science journal in more than two years. But I have done many reports for economics journals during that time (of varying levels of perceived quality/prestige) and a few interdisciplinary journals. Three weeks probably is too short of a window due to other commitments (especially, other previous agreements to serve as a referee or, simply, travel). But three to six months? If you really believe that this is what is required to do a thorough, thoughtful, and satisfactory report, then you should get out of the referee business altogether. I don't want to pile on, but this type of behavior/attitude hurts the scientific advancement of our profession.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-9443240524803254442009-06-05T17:56:03.489-04:002009-06-05T17:56:03.489-04:00How much money should they offer you for you to do...How much money should they offer you for you to do it in 3 weeks?Unitnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-2202364268398087662009-06-05T15:01:50.744-04:002009-06-05T15:01:50.744-04:00"They aim to publish only the very most excit..."They aim to publish only the very most exciting papers. When you get a paper from them to review, you spend 20 minutes skimming it. If it's not so important that you want to make room in your schedule to review it immediately, then you write a brief review saying it's not exciting enough for this journal."<br /><br />Which has the implication, sadly, that top journals in economics and political science are receiving papers that do NOT sufficiently excite their reviewers... and that (for example) if APSR were to only publish papers so intellectually exciting that people in the field wanted to review them immediately, they would find themselves publishing almost nothing.Dirty Daveyhttps://www.blogger.com/profile/07908818235405186822noreply@blogger.comtag:blogger.com,1999:blog-7464708.post-22309670362118955602009-06-05T12:13:34.319-04:002009-06-05T12:13:34.319-04:00Jacob hit the nail on the head. I can do what I b...Jacob hit the nail on the head. I can do what I believe to be a quality review in a few days (depends on how long the paper is)...if I drop everything else. In case it matters, my field is computer engineering.<br /><br />The problem is, I already have weeks' worth of commitments, and I accept reviews accordingly.<br /><br />Hmm, so this suggests that at least part of the problem is that other journals give reviewers too much time and people's queues are too long as a result!Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-53960737301597366812009-06-05T11:43:29.617-04:002009-06-05T11:43:29.617-04:00"[...] all they are asking is for you to put ..."[...] all they are asking is for you to put those 2 hours for a review into your queue a little sooner."<br /><br />You seriously only spend a couple hours putting together your review? Do you even bother to check if the math has blatant errors in it? My colleagues and I put more time than that into class reviews of papers already published in prestigious journals! I realize you get faster with time, but the number of reviews in process also goes up.<br /><br />Admittedly, there's probably never a great reason for econ reviews to take more than 3 months. Even still, I find it slightly funny that political scientists seem to think they are better at optimizing under constraints than economists.<br /><br />And Dirty Davey, I wouldn't be a bit surprised to find (c), the reviews are mostly useless. If all papers published in <i>Science</i> are equally excellent, I don't see why we should assume this is a signal that "hard scientists" are better workers (or that their work is more "definitive," for that matter). If anything, I think this signals that the <i>threat</i> of being rejected by a reviewer has more influence on the quality of work than any actual reviewing. In economics, at least, this threat doesn't seem to have the same effect, so there has to be an actual review.Normanhttps://www.blogger.com/profile/12866136113454261245noreply@blogger.comtag:blogger.com,1999:blog-7464708.post-61267954763488128002009-06-05T11:06:34.000-04:002009-06-05T11:06:34.000-04:00Laziness isn't the issue-- but for just the sa...Laziness isn't the issue-- but for just the same reason that Angus' "Look, referee reports are 3-6 months. That's just how it is. " is wrong.<br /><br />An active reviewer is going to review about the same number of manuscripts per year, almost regardless of how long the deadlines are. Say that you're refereeing c. 12 articles per year, just because it's a convenient number. You end up doing each one c. 2 weeks before its deadline.<br /><br />On a 3-6 month clock, you're currently refereeing a ms you got assigned in January, February, or March.<br /><br />On a 3-6 *week* clock, you're currently refereeing a ms you got in April or May.<br /><br />The deadlines come around just as often in either case-- that average frequency is set by the total number of manuscripts you review in a year. "Laziness" would be simply not reviewing many manuscripts. "That's just the way it is" implies that there's something more-than-conventional about the need to take more than 90 days to start a review. But there's not. You can still review a manuscript per month on a 3-week clock. You can still devote just as much time to the reviews, on average, too. <br /><br />What you can't easily do is suddenly add a bunch of 3-week turnaround times to a schedule that's already crowded with the need to do 3-to-6 month old assignments. Angus' non-lazy schedule presumably already looks like that, and so JOP's request looks like queue-jumping from his perspective. <br /><br />There's a limit below which you can't just adopt a new disciplinary equilibrium, because reviewing does require some ability to plan ahead and schedule, and no one's going to block out a day in advance to referee the manuscript that on average they expect to receive soon but haven't yet been assigned. At one-week turnaround times, I'd stop accepting assignments. But I think that limit is well below 90 days, and is probably between 3 and 6 weeks.Jacob T. Levyhttps://www.blogger.com/profile/02575549001627195334noreply@blogger.comtag:blogger.com,1999:blog-7464708.post-3778819484623314362009-06-05T11:03:54.293-04:002009-06-05T11:03:54.293-04:00In finance journals, turnaround time is 4 weeks.
...<i>In finance journals, turnaround time is 4 weeks.</i><br /><br />Isn't it true that for finance journals, authors pay submission fees and reviewers are paid? I don't know from personal experience, but it's what I've heard from friends (and I just checked two journals on the web, both of which listed submission fees). Maybe this is a more rational system, to make authors compensate others for the burdens imposed on them. However, if this is indeed the way it works, then it's not clear what it tells us about other systems.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-1470518844188973582009-06-05T10:56:15.092-04:002009-06-05T10:56:15.092-04:00By the way, regarding Science/Nature asking for re...By the way, regarding Science/Nature asking for reviews in two weeks, this is true. However, it is highly misleading:<br /><br />(1) They aim to publish only the very most exciting papers. When you get a paper from them to review, you spend 20 minutes skimming it. If it's not so important that you want to make room in your schedule to review it immediately, then you write a brief review saying it's not exciting enough for this journal. This means there's hardly any reviewing burden except for the papers that are exciting enough that you don't mind. <br /><br />(2) Most Science/Nature papers are very short, just a few pages, and typically fairly straightforward in style. (I.e., describing an experiment and its results, rather than a lengthy or elaborate theoretical argument.) This really makes a huge difference in the difficulty of refereeing.<br /><br />(3) The review process itself varies between different fields. For example, I know Nature asks authors to suggest some potential referees (with no promise to use those or only those as reviewers, of course); I wouldn't be surprised if Science did as well, but I don't know from personal experience. This is something almost unheard of for journals in my field. I suspect it introduces some bias and game playing into the process, but it does help in making sure that reviewers are close enough in area that they genuinely want to drop everything to read this paper.<br /><br />(4) Science and Nature are pefectly happy to have false negatives in their reviewing process. They get far more excellent papers than they could ever publish, so they have no problem with rejecting many of them (even for silly reasons). This means they tolerate a somewhat sloppy reviewing process, as long as the sloppiness is in the negative direction. It also means there is extra time pressure on reviewers, since if you don't review the paper fast enough, they may interpret it as a sign of lack of interest and reject the paper for that reason.<br /><br />In summary, the reviewing process at Science and Nature is an interesting data point, but it tells us very little about how things could or should work at most other journals.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-74855643677892373662009-06-05T10:17:01.859-04:002009-06-05T10:17:01.859-04:00In finance journals, turnaround time is 4 weeks. A...In finance journals, turnaround time is 4 weeks. As somebody who referees both finance and economics papers, I can't say that economics papers are noticeably harder to referee than finance papers. And I don't think that the referee reports I've gotten on my own papers from finance journals are noticeably worse.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-50849314162689890642009-06-05T09:52:08.424-04:002009-06-05T09:52:08.424-04:00If you can't find the time to do a review with...If you can't find the time to do a review withing a 4-6 week period (and I'm sure that editors would have no problem with 8) then, yes, you are lazy. And bitching and moaning about this the way you do indicates that you are probably an ass too boot.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-42754281436484803632009-06-05T09:52:07.982-04:002009-06-05T09:52:07.982-04:00You're just trying to justify your institution...You're just trying to justify your institutionalized laziness.<br /><br />You haven't succeeded.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-68871590347980679552009-06-05T09:51:51.853-04:002009-06-05T09:51:51.853-04:00Review times in my discipline (History) also run m...Review times in my discipline (History) also run much too long -- 4-5 months is not uncommon, and there's no reason for that. However, it tends to be the higher-rated journals that take longer, and that may reflect that they seek out prestigious reviewers who really do have trouble slotting the necessary 5-10 hours on short notice. Still, as most commentors say, this is more of a time allocation matter: in most cases, the paper for review sits untouched for months, and then is hastily reviewed in the same 2-5 hours it would have gotten right away.<br /><br />In fairness, paper reviews for journals such as Science are frequently farmed out by PIs to their postdocs; in sole practitioner fields, we don't have that option.PQuincyhttps://www.blogger.com/profile/07797313793883747601noreply@blogger.comtag:blogger.com,1999:blog-7464708.post-66822690636855169982009-06-05T09:41:18.385-04:002009-06-05T09:41:18.385-04:00"Busy academics can't do justice to a com..."Busy academics can't do justice to a complicated paper in that short of time."<br /><br />As I pointed out above--<i>Science</i> gives reviewers two weeks. Now either (a) top-level scientists are not particularly busy, (b) <i>Science</i> does not publish complicated papers, (c) <i>Science</i> suffers from poor reviews that do not do justice to its papers, or (d) busy scientists, when asked by <i>Science</i>, do reviews that do justice to complicated papers in a window even shorter than JoP's three weeks.Dirty Daveyhttps://www.blogger.com/profile/07908818235405186822noreply@blogger.comtag:blogger.com,1999:blog-7464708.post-46439778247255036542009-06-05T08:33:02.983-04:002009-06-05T08:33:02.983-04:00I edit a multidisciplinary journal on Latin Americ...I edit a multidisciplinary journal on Latin America, and bug people at two months (no one has complained, or at least not to me). The vast majority complete it by then. I can't really see needing three or more months.Greg Weekshttps://www.blogger.com/profile/15765114859595124082noreply@blogger.comtag:blogger.com,1999:blog-7464708.post-87971373146747772052009-06-05T07:28:35.533-04:002009-06-05T07:28:35.533-04:00Time allocation problem, no? How many hours does i...Time allocation problem, no? How many hours does it take to write a reasonable review? How tightly scheduled is your work flow? Why should my career prospects be held hostage to your inability to turn things around within a short period of time. <br /><br />I don't understand your problem.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7464708.post-90735038394964030082009-06-04T23:35:28.446-04:002009-06-04T23:35:28.446-04:00And to the "Anonymous" guy who says I &q...And to the "Anonymous" guy who says I "look lazy": bite me!!<br /><br />I'll put my work ethic up against yours anytime you'd care to say who you are, pumpkin.<br /><br />(somewhere, Mike Munger is smiling)Angushttps://www.blogger.com/profile/03656436431053306500noreply@blogger.com