site

text for beau's website
Log | Files | Refs

2020-03-13-nih-get-you-funded.md (36897B)


      1 ---
      2 layout: post
      3 title: "Notes on the book 'How the NIH Can Help You Get Funded'"
      4 toc: true
      5 image: https://source.unsplash.com/OfMq2hIbWMQ
      6 tags:
      7   - "physician-scientist"
      8   - "academic writing"
      9   - funding
     10   - "career development"
     11 ---
     12 
     13 # How the NIH Can Help You Get Funded
     14 
     15 [Mike Becich](https://www.dbmi.pitt.edu/person/michael-j-becich-md-phd) is a wonderful researcher and entrepreneur, and chairman of the Department of Biomedical Informatics at the University of Pittsburgh. I met him on the residency and fellowship interview trail, and, among other things, we talked about grant strategy and how to build a career doing research in biomedical machine learning/informatics/data science/etc. He was kind enough to give me a copy of the book <ins>How the NIH Can Help You Get Funded</ins>, which is exactly what it sounds like: a how-to and strategy book for academic research scientists, most of whom depend on funding from the National Institutes of Health to support their work and salaries. The book is a publication of [Oxford University Press](https://global.oup.com/academic/product/how-the-nih-can-help-you-get-funded-9780199989645?cc=us&lang=en&) and also available from [Amazon](https://www.amazon.com/How-NIH-Can-Help-Funded/dp/0199989648).
     16 
     17 These are my notes from and synthesis of this book. The synthesis was made by going through my notes and extracting things I thought were key and may be useful for quick review; the full notes I took as I was reading are copied below that.
     18 
     19 If you notice any mistakes, misconceptions, or flatout wrongheadedness, please shoot me an email. Also, though the general outline of how the NIH works is fairly stable, specifics change from year to year and this book, as with almost every book of its genre, was outdated upon publication. It will be at least a few years before I apply for funding, at which point an even larger number of specific details will be out of date, so what I am looking for is general strategy and key history.
     20 
     21 # Synthesis
     22 This book is a bit hard to summarize, as it has a mix of very practical and technical information, with general guidance, strategy, and advice (to use the parlance du jour, strategy and tactics). I figured this would be the case going in, hence this public store of notes that I can quickly review.
     23 
     24 Some general things:
     25 - The NIH is about science, but is run by, and full of, people. These people have personalities, hopes, fears, egos, soft spots, families, and digestive systems. If you keep this front of mind as you communicate your science, you'll have a Good Time.
     26 - Of all the people at the NIH, your main points of contact are the Program Officers (POs). It is a completely sane and compassionate approach to try and make their lives easier. Also realize that their job is to build a portfolio of cool and important work for their organization, and that they often had prior lives as PIs themselves. So do your homework, know what stresses and timelines they are under, and do your best with your science and your personal communication to develop a relationship of mutual respect and care.
     27 - Also think of your proposal itself as building a relationship with all its readers - you want to be nice to them (make it easy to read and rate - many specific tips and tricks herein), and to make it exciting and fun to imagine what success will look like for your project, the team, the institution that is considering sponsoring it, the patients who will benefit, and the world at large. (Don't resort to corporate technobabble BS, as this makes it less fun/very irritating to read).
     28 - The NIH is also a government organization, and is therefore subject to all manner of red tape, budget constraints (and cuts), fickle bureaucrats, and delays. If you know the timelines and possibilities going in, you'll have a Better Time than You Would Otherwise.
     29 - The R01 Holy Grail makes more sense to me now, since going through this book while also talking to friends who are early in their careers as physcian-scientists. The grant is attached to you, not your institution. You have a large amount of freedom to do what you want with it (with the exception of a small number of funding mechanisms, the NIH pretty much gives you money and gets out of your way - you have to show productivity, but exactly how you accomplish that is your choice). It can be renewed, and this renewal is a bit easier if you're an early investigator. If you want to be a physician-scientist, having funding will let you lighten up on the patient load. You can also hire brilliant people, and having the R01 is a draw for top talent.
     30 - R01 is a pretty good way to fill 2/3 of the triumvirate of what makes careers happy: competence/expertise (you are by definition an expert in your field), autonomy, and relatedness (you bring this - a sense of connection to the people you work with and for, and the cause).
     31 - The "publish or perish" thing makes more sense to me now as well. Tenure seems to be going away at many institutions, or is veryveryvery difficult to get, so a researcher's life is a never-ending cycle of applying for grants that have a government-mandated average length of 4 years. If you want a renewal, or a successful new grant, you have to show productivity. Though there is some understanding that certain kinds of work take a long time to bear fruit, you basically have to have first and/or last author pubs in decent-to-good journals rolling out with some consistency to remain competitive. This book helped me own my identity as a physician-scientist (in training), and all the trappings that go with it, including the high likelihood that I will live most of my career on these funding cycles.
     32 - Speaking of owning my career, the book also makes me curious about non-NIH funding mechanisms, e.g. through other govt orgs or third parties. This book mentions some, including the Dept of Defense and National Science Foundation. If anyone has suggestions for places I should check out that may be conducive to a research career in bioinformatics/data science/machine learning for medicine, particularly blood cancers, with major interests in healthcare disparities and community/population health, shoot me an email. I also want to see patients, so certain industry careers may be out - but I know that industry is also a complex and varied space, with as many shapes of careers as there are individuals, so would be open to hearing about those avenues as well.
     33 - As I finished this book I was also overwhelmed with gratitude to my  undergraduate alma mater, Brigham Young University, for giving me singular opportunities for research across the institution that led me to a career in research, to my medical school alma mater, Cleveland Clinic Lerner College of Medicine, for setting me up to be successful, by giving me time and headspace to think about which skills I wanted to develop, plenty of support to get a head start on them, and mentors in every conceivable area. Next, I am so, so excited and grateful for Vanderbilt University Medical Center and the Harrison Society for welcoming me into their fold. The clinical training will be fantastic, and the way they set up their physician-scientists for success (== R01 and other funding mechanisms) occupies a truly rarefied place among academic institutions in the United States. I'll admit I'm scared of the publish-or-perish thing still, but knowing there is a staggering level of support and deep precedence for success helps assuage the imposter syndrome and insecurity.
     34 - Overall, I'm glad I read this book, and am grateful to Becich and other mentors and friends in science and medicine for getting me to think about the arc of my career and how to increase the likelihood of success. The timing was great (Spring 2020), as I will be entirely engaged in the practice of clinical medicine for the next 2-4 years before jumping back into research. I will likely revisit this book or its successor, as well as these notes, as I scan the horizon for opportunity and learn, as I practice clinical medicine, where help is needed most.
     35 
     36 # Notes
     37 
     38 ## National Institutes of Health
     39 This chapter provides a background on the NIH.
     40 - NIH = 27 Institutes and Centers (ICs)
     41 - began in 1937 with the National Cancer Institute (NCI), then in 1938 cornerstone laid for NIH campus
     42 - part of executive branch, but Congress authorizes and appropriates funding
     43 - budget grew ~2x from 1998-2003, but then failed to keep pace with inflation or dropped. This is problematic because ICs would like to plan for multiple years ahead and provide stable commitments to researchers doing important but longer-than-a-year research. The payline (the score and percentile at which grants are funded) is subject to variations in appropriations.
     44 - budget allocation (rough percents): 80% extramural funding, 11% intramural funding, 5% salaries/admin, 2.5% formal training programs (80+11+5+2.5 = 98.5%)
     45 - Program Officers (POs) are extramural staff associated with each I/C. The authors make the point first here, and repeatedly throughout the text, that *applicants should contact their PO at each stage of the application, review, and award process*.
     46 - Office of the Director: coolest thing here is the Office of Strategic Coordination's Common Fund Programs, including the NIH Director awards. These fund cross-cutting, high-risk, possibly high-yield projects (see [here](https://commonfund.nih.gov/highlights) for current highlights), touting the program as the "venture capital" space within the NIH. Some of the data science-y stuff funded by the NIH was/is via the Common Fund, e.g. development of a [data commons](https://grants.nih.gov/grants/guide/notice-files/NOT-RM-17-031.html). The language is purposefully obtuse, matching the tone of Silicon Valley VC, as I think it has to be when they are looking for (again, purposefully) underspecified opportunity to fund interesting work that doesn't quite fall under any IC purview but has potential to be generally useful.
     47 - A "grant" is different than a loan, contract, or cooperative agreement. The idea is for the IC to determine if your proposed project fits within their strategic plan to have "significant and lasting impact on the field and public health," and then they get out of the way to let you carry out your plan as you see fit, and evaluate your productivity and promise as you apply for renewals, etc.
     48     - This jives with what I learned early on in anthropological/ethnomusicological research: it is widely understood that everything might (will) change when you get in the field, but funding and approval bodies need to see evidence of innovation, possible impact, and careful thought before they hand out money and rubber stamps. You then have freedom to do your work as best you know how, and react to unexpected realities as you see fit.
     49     - Contracts are for specific needs (e.g. developing an animal model, operating a facility); cooperative agreements are similar to grants but involve substantial "scientific or programmatic" involvement from the federal government (i.e. they are less independent).
     50 - At this point, the rest of the book is summarized and a timeline is given. The timeline is a concordance of the timelines of Congress, the ICs, the principle investigator (PI), and the standard funding opportunity announcements.
     51 
     52 ## Institutes and Centers
     53 - More on the program officer (PO).
     54     - POs often were investigators in the field, and have a deep interest in its success.
     55     - They see the PIs as "their investigators"
     56     - It's ok and encouraged to contact POs in the several ICs that might cover your work, and work with them to determine strategy at every key point along the way
     57     - ICs are differents, and POs are different, so don't expect your friend's experience to necessarily match your own
     58 - Advisory Councils
     59     - main job is to determine how well the proposed research fits with the mission of the IC, and if the scientific review was adequate. They don't say much about the scientific merit of a project, as that is the job of the review.
     60     - also review concepts for future initiatives, and *cleared concepts* are the fodder for Requests for Applications - keep the pulse on cleared concepts, and you can get a head start on preparing your applications
     61 - ICs
     62     - a list of each IC and key data is presented. Some notes on ideas I found interesting:
     63         - Love this sentence on clinical vs. basic science research "The NHLBI believes all the clinical research should have some return on investment, unlike basic science research, which should be designed to explore, not build, and in which return decades later is not uncommon." For one recent example, the Shapley value was developed in the 1950s-60s, but was too computationally expensive for all but rather restricted use, and now undergirds some of the most important paradigms in explainable machine learning systems (SHAP was published in 2017, IIRC). I think we have an uneasy relationship with this concept, that basic and theoretical researchers should essentially be encouraged to play, and play their best, knowing full well that much of the research will never be particularly useful, that some of what will be useful will not be useful for decades, and that it is very, very difficult to determine beforehand which is which. The embrace of intellectual freedom and creativity always butts up against funding constraints, and people want ROI.
     64         - NCI R01 success rates financial year 2012: 12.5% for new, 29.4% for renewals, 11.8% for supplement.
     65         - NHLBI R01 success rates in financial year 2012: 13% for new, 25.4% for renewal, 33.3% for supplement.
     66 
     67 ## Center for Scientific Review and the Peer Review Process
     68 - "Scientific review groups" is the official name for the colloquially known "study sections"
     69 - Some alphabet soup decoded:
     70     - P - program project/center
     71     - U - cooperative agreement
     72     - T - training
     73     - K - career development
     74     - N - contracts
     75     - F - fellowship
     76 - How to get your application rejected quickly:
     77     - Don't have a cover letter from the IC approving the submission if your budget exceeds $500,000 direct costs in any 1 year
     78     - Don't comply with the formatting restrictions
     79     - Have the wrong budget type (modular vs. detailed, depending if >/< $250k)
     80     - Ignore specific requirements for your application type
     81     - Fail to pass the sniff test for A2 applications (revision of an unfunded A1) - apparently they use a combination of NLP and a manual review process to find out if you're just swinging away without changing bats
     82 - A0/A1/A2
     83     - A0 - first/new application
     84     - A1 - first revised/amended application
     85     - A2 - second revised application, no longer allowed (max attempts = A1)
     86     - To convert A2 to A0:
     87         - 2/3 of aims must be new
     88         - research plan must be substantively changed
     89         - OR submit under new mechanism OR in response to an RFA (request for applications) if it happens to match your science
     90 - Application ID number decoded:
     91     - Ex: 1R01 CA1234567-01 A1; 5R01 GM000091-62
     92     - First example: New (type I) R01, in the NCI (CA), number 1234567, first year of funding (01), first amendment (A1)
     93     - Type 1: new; Type 2: competing renewal; Type 3: competitive supplement; Type 5: noncompetitive supplement
     94     - Second example: Noncompeting renewal (type 5) RO1, in the National Institute of General Medical Sciences (NIGMS, abbrev GM here), number 91, in the 62nd year of funding. Cool example - was for the "Structure and Function of Enzymes---Role of Metals." Zinc fingers ftw?!
     95 - Study section assignment tip: almost always go with the one they give you, not necessarily the one you wanted. Their interest is in getting you a good review, and know the ins and outs likely better than the individual PI.
     96 - Check the [CSR](https://public.csr.nih.gov/StudySections) website and [RePORTER](https://projectreporter.nih.gov/) to find out which study groups have which interests.
     97     - The CSR website gives more granular details on the study section topics, RePORTER gives results and other data, so CSR -> RePORTER is the usual workflow (though I could imagine reasons for RePORTER -> CSR)
     98 - Also ask your program officer, mentors, and colleagues which study sections you should target.
     99 - **Think about your study sections at the outset**
    100     - If your audience is specific, you can save space and write directly to their knowledge and interests.
    101     - This extends all the way to: know their names and what they've published, and create your steel-man arguments (and a little [Carnegie-esque](https://creativesamba.substack.com/p/feeding-the-baby-rabbits) baby rabbit/Edgar Thomson Steel Works action) by citing their work.
    102     - Also make sure your work gets in front of them and stuck in their heads with some "presuasion" techniques: present at the conferences they are at, invite them to your seminar series, get their take on what is important in their field now and going forward. Just don't bring up any specific proposals (i.e. don't break the rules, but feel free to water the field).
    103 - **Hours spent in different parts of the review process** (this is huge):
    104     - You spent: 100s of hours
    105     - Primary reviewer spends: several hours
    106     - Secondary reviewer: less than primary reviewer
    107     - Unassigned panel members: zero hours to a few minutes (maybe read abstract and specific aims)
    108     - Panel discussion: 10-15 minutes
    109     - SO be kind, it's an elevator pitch not a thesis. ?Read [Brief](https://thebrieflab.com/book_brief/) again?
    110 
    111 ## Getting at Mechanism
    112 Aha! This is part of why I picked this book. I've always been curious about the specific mxns the NIH uses, and when to use which.
    113 - R01
    114     - ~1/2 of extramural NIH funding is R01
    115     - up to 5y length - average length mandated to be 4y, and new and early stage applicants more likely to get 5y award
    116         - when you are no longer early or new, then proposing work with shorter time frames is a bit sexier and more likely to get funded
    117     - renewable
    118     - favors early state investigators (reviewed in their own group, also can reapply within the same funding cycle)
    119 - R21
    120     - "starter" grant
    121     - success rate actually lower than R01, d/t large number of increased applications
    122     - NIH recommends that the R21 *not* be used as an entry for junior investigators, because:
    123         - cannot be renewed
    124         - generally limited to ~$275k over 2y
    125         - no payline break for new or early applicants
    126     - kinda seems like one to avoid, overall - what are the upsides? Not clear from this reading.
    127 - R03
    128     - "Small research grant"
    129     - $50k per year for 2y, nonrenewable
    130     - time limited, focused - e.g. collect pilot data, perform data analysis, develop assay or model
    131     - sometimes limited to K awardees and new investigators
    132     - sometimes used to respond to reviewer concerns for R21s, so it would be a (long path) R21 application -> R03 application -> R03 award -> R01 application and award
    133 - R13
    134     - Conference awards, supports specific costs, usually less than $20k (???)
    135     - Needs letter from IC R13 PO
    136     - 60% success rate
    137 -  R15
    138     - Academic Research Enhancement Award (AREA)
    139     - Limited to academic components w/in institutions with < $6m in funding from >=4 of the past 7y.
    140     - $300k direct costs over 3y, renewable
    141     - Seems like a mini-R01 for early researchers at underfunded/newer programs
    142 - R33
    143     - 4 offered per year.
    144     - Phase II for successful R21.
    145     - Often solicited by funding opportunity announcements and ICs.
    146     - Milestone driven (must be quantifiable) w/ Gantt chart or similar timeline
    147 - R34
    148     - Clinical Trial Planning Grant (phase III trials)
    149     - E.g. data collection tools, manuals, recruitment strategies, data sharing and multiple IRB submissions if multisite, also pilot studies
    150 
    151 Small business grants
    152 - Small Business Innovation Research (SBIR) R41 and R42
    153     - >=40% of the work performed by small business, >=30% by a nonprofit research institution, rest either split or include a third party
    154 - Small business Technology Transfer (STTR), R43
    155     - Primary PI primarily employed by small business. >=67% of the work performed by small business if phase I, >=50% if phase II.
    156 
    157 P grants
    158 - Program projects (P01) or Center (P20, P30, P50, P60)
    159 - Themes that would benefit from collaboration, and would be unlikely to be successful otherwise
    160 - Emphasis on supporting new and nontraditional researchers
    161 - Could be basic or have a clinical component
    162 - Need a large number of R01 and other awards to justify, and if you are interested in starting one of these work closely with the PO
    163 
    164 K awards
    165 - Career Development Awards
    166 - Setup:
    167     - Award is both for the work itself (e.g. specific aims) and to prepare the investigator for R01, so write it this way - emphasize how the training and mentorship will not only make the project more likely to succeed, but will also set you up for a successful career in your field
    168     - This sounds a lot like the ASH awards, with similar strategies:
    169         - make sure your primary advisor is going to be an actual advisor, not just a big name on the proposal (the reviewers will probably know if this is the case, and you would be seemingly paradoxically less likely to get the award)
    170         - go ahead and have that big name as a secondary advisor/part of an advisory panel, and use their expertise to get a broad view of the field and how to succeed in it (if they have time for specific mentoring, gravy)
    171         - write in the first person, about *your* career goals and accomplishments thus far
    172         - start the Candidate section with your long-term goals, to frame the conversation and show the reviewers that you are going somewhere
    173         - acknowledge your gaps and show how the K award will help you fill them - if you have no major gaps, go for the R01, not the K
    174         - have great letters from your mentor and advisory team, that you participate in writing, showing a personalized recommendation and plan, and the qualifications of the mentor(s). Make sure the details in the letters all jive.
    175     - Have some first author papers, to the extent possible (reviewers are understanding if you are a clinical scientist and stuff takes forever to get to the manuscript phase)
    176     - A collection of poster presentations that never -> manuscript is a bad look
    177     - Review papers are +/- helpful, depends on the journal, but might be useful to show commitment to and understanding of the field
    178 - The grant itself:
    179     - Less is more, be ambitious and innovative but realistic about what can be accomplished in the time frame
    180 - All the Ks:
    181     - Different ICs use the same codes for different things, so check the K Kiosk at the NIH website.
    182     - But generally:
    183         - K08, K23, K24: applicants with clinical degrees
    184         - K01, K02: basic scientists
    185         - K01, K08, K23, K25: junior investigators
    186         - K02, K05, K18, K24: established investigators
    187         - K22, K99/R00 (kangaroo!): postdocs (also needs academic appt during award, and need to submit R01 before end of 2nd year of the 3y award). K99 while a postdoc, then R00 activated when faculty appt received
    188         - K12: clinical research career dev, established PI submits application to NIH then trainees compete for slots. Coupled with intensive training and resources (similar to the PSTP programs, with biostats support, grant-writing committees and extensive pre-review, etc.)
    189         - KL2: similar to K12, Clinical and Translational Science Award (CSTA)
    190 
    191 F and T awards
    192 - F: fellowship, T: training
    193 - Like Ks, but required to pay back 1y of support through research and teaching (not patient care).
    194 - Can be obtained predoctoral (e.g. MD-PhDs in training - up to 6y) or postdoctoral - up to 3y.
    195 
    196 Summary: Tons of alphabet soup. Most of us will focus on R01 and ways to get to R01 (K,F,T, maybe R21/R03). For more specific stuff, it's always changing anyway, so look it up and talk to your PO.
    197 
    198 ## Telling Your Story Well
    199 - Specific Aims may be the only page everyone reads, and then likely cursorily, so grab attention and cut the cruft
    200 - One way to cut the cruft: know your audience, give only the background that is absolutely necessary and unlikely to be known/agreed upon by all
    201 - The reviewer is going to be writing bullet points for the summary statement - make this easy for them, do all the work so they don't have to
    202 - How important, relatively, are the sections of the report?
    203 - Table 8.1 gives the correlation coefficients bw overall impact score and 5 criterion scores for 2010. The ones that are likely to be of most interest to me:
    204 
    205 | Institute 	| Approach 	| Significance 	| Innovation 	| Investigator 	| Environment 	| N    	|
    206 | -----------	 | ----------	 | --------------	 | ------------	 | --------------	 | -------------	 | ------	 |
    207 | NCI              | 0.80             | 0.67             | 0.59             | 0.53             | 0.45             | 5396     |
    208 | NHLBI            | 0.82             | 0.67             | 0.64             | 0.56             | 0.48             | 3157     |
    209 
    210 - So Approach is most correlative, then Significance. In other words, it appears that the way you are doing something is the most important thing (though note that every part of the score is indeed part of the score).
    211 - On specific aims:
    212     - write it first, and rewrite it often
    213     - Should address:
    214         - why the work is important
    215         - why are you the one to solve it
    216         - what problems you will solve
    217         - how you will do so
    218         - what the impact will be
    219     - Send a bare-bones version to the PO and colleagues, and take note of the questions they ask
    220     - Narrative order (pretty standard): 1. significance of problem, +/- prior contributions of author if available, 2. your take on the problem, lead the reviewer to your hypothesis and approach by integrating prior work and prelim data, 3. hypothesis and overall approach
    221     - Picture/diagram/table: can be very useful, but don't just repeat the text, and don't make it harder to understand than just reading the proposal.
    222     - One problem with overambitious aims: the reviewers will know that you probably have no idea how long it takes to actually [establish an animal model, recruit patients, build the software, etc.] and you are seen as not having sufficient experience
    223     - Aims complementary but not conditional
    224     - Generate useful data whether or not your hypothesis is confirmed
    225     - **check out the sample R01s from the NIAID** - the link in the book is old, but here's a PDF of the Wahlby grant applicaiton they mention (Image analysis for C elegans) - [Wahlby](https://emergencymed.arizona.edu/sites/emergencymed.arizona.edu/files/sample_nih_proposal_4.pdf), cool for me bc it's fairly ML/AI, and here's the Ratner application, notable for using a schema to communicate the experimental flow - [Ratner](https://www.niaid.nih.gov/sites/default/files/ratnerfull.pdf). Because these were kind of hard to find, I put copies at the following links:
    226     - [Ratner PDF](/assets/pdf/ratnerNIHproposal.pdf)
    227     - [Wahlby PDF](/assets/pdf/wahlbyNIHproposal.pdf)
    228     - ![pic](/images/ratneraims.png)
    229     - Can also conclude with a paragraph "Overall Impact" summarizing what you'd like the reviewer to use as the take-home message in their presentation. "..what will be possible after your research has been completed that is not possible or known now."
    230 
    231 - On approach:
    232     - modular approach based on aims
    233         - briefly restate rationale and hypothesis, integrate relevant prelim data, summarize design and individual experiments, conclude with analysis, interpretation of results, potential problems, alternative approaches.
    234         - Consider an illustration
    235     - key methodology, mentioned by name as needed, but avoid minutiae (it seems that knowing what is and isn't significant is another sign of experience and thoughtfulness).
    236     - cite pubs, especially if you wrote them, demonstrating feasability
    237     - have good stats - consult with your statistician early and often, and have them review before the study section sees your proposal
    238     - indicate how you will interpret the data, especially if they are surprising, and what you will do if the data ends up more fuzzy than expected. I wonder if it would be useful to do what Sekeres recommends and mock up the tables and figures beforehand, to make sure you're collecting the right stuff and analyzing it the right way? (especially if you use the Rmd approach that builds on Sekeres', of actually writing the code that makes the figs, and populating them with mock data, to be filled in as the real stuff comes in)
    239     - Consider the proposed work as part of a 10y plan - for you, and for the reviewers (given that renewing R01 is a thing you will pursue and they will encourage). It's not a single project, but a piece of a career.
    240 
    241 - On significance:
    242     - Significance assumes your work was successful - will the field substantively change as a result? Why does your project deserve funding?
    243     - consider splitting into sections: Importance of the Problem, Knowledge to Be Gained/Impact on the Field
    244     - know your reviewers, and freely cite their papers as appropriate - they probably think their own work is important and impactful, and you want them nodding along in agreement, if not pounding the table with "Amen!"
    245 
    246 - On innovation:
    247     - why is your work different and better than the current approaches?
    248     - methods do not need to be innovative, if their application is likely to yield innovative findings
    249     - consider splitting into sections: Technical Innovation, Conceptual Innovation
    250     - another good place for a bullet point, feed the reviewer their line at the meeting
    251 
    252 - On the introduction:
    253     - If it's an A1, first page will be response/rebuttal.
    254         - Remember the reviewer is always right - tell your friends your visceral reaction, write it down, then shred it, rinse and repeat a few times until you've cooled off.
    255         - Remember the reviewers that see your rebuttal may be different than the initial reviewers
    256         - Take on the big issues, leave the minor stuff - focus on the Resume and Summary of Discussion (individual critiques may have been resolved in the discussion and not revised in the written doc)
    257         - "Sometimes your harshest critics can become your biggest fans on resubmission" - and how. I've experienced this repeatedly.
    258         - Quote verbatim
    259         - Use bullets and indentations to delineate comments and responses
    260         - *brief* appreciative acknowledgement, then get to the meat (obsequiousness is ugly)
    261         - make sure you are addressing the actual concerns, run it by your PO and friends
    262 
    263 - Other sections
    264     - Protection of Research Subjects is another area in which your goal is to comfort the reviewers, assure them you know what you're doing (i.e. a great PoRS is unlikely to get you a top score, but a bad one is a red flag).
    265         -   included in this is your sample size calculation - if not done, or done poorly, will reflect poorly. Biostatisticians are your friends, and will be on the review committees.
    266     - Make each biosketch support the overall narrative. Don't copypasta. Seems that the PI (me) should be willing to write/rewrite others' biosketches for jiviness, and send for approval (a la letters of support)
    267     - Budgets either modular (module = $25k) or detailed. Detailed if project >$250k, involves foreign institutions, or is one of a few specific mxns that always require it
    268         - a too-low budget is also often a sign that you don't know what you're doing
    269 
    270 - On writing in general
    271     - Use language from the criteria in your section subheadings to make it easy for your reviewers - imagine they have a list of checkboxes they are going through. It's much better to not be creative here, so they can find what they are looking for
    272     - Think pagewise: what 2-3 points should no one miss on this page? Consider (sparing) use of bold, italic, etc., but favor white space and emphasis by subtraction.
    273     - q: which fonts *does* the NIH allow?
    274     - page 123: nice list of how to structure writing for max impact (i.e. use psychological principles: make the first word the subject if possible, put the impactful thing at the end of the sentence, build schema through introductory and summary sentences, etc.)
    275     - writing in first person is often less wordy and creates more excitement, buy-in, so use it! (I know there's some difference of opinion on this one, but I'm into bringing personality back to academic and scientific writing, so count me in)
    276     - omit needless words. Use modifiers if they have meaning (e.g. "weakly fluorescent").
    277     - Don't say your work is "innovative." Show it. OK to use the word "novel" in the strictly technical sense, but even then use sparingly.
    278 
    279 ## Getting by with a Little Help from Your Friends
    280 - Homework for talking to your PO: NIH Guide, target IC website, RePORTER. Remember they are not only a go-between, but an advocate.
    281 - Know when your PO truly can't tell you anything - wait for your summary statement (not just percentile/score) before asking for revision advice, then notice of award
    282 - write so that an educated friend could get through your narrative in <1h, ideally less, certainly not more
    283 - might be nice to go through all these notes, quick runthrough of the book again, to pull out all the PO-related tips
    284 
    285 ## Before and after Your Study Section Meets
    286 - Cleared Concepts are available either on dedicated websites or in the Council Minutes (might be a good target for a webscrape - are these minutes in plaintext or PDF?)
    287 
    288 ## Is the Check in the Mail?
    289 - Proportion of applications discussed: NCI 55.6% of grant applications, 46.6% career development applications. NHLBI 57.6% grants, 65.9% career dev. Also, these two are the big dogs in terms of pure number of grants reviewed - the Appendix in this book has nice summaries of all the ICs, would be worth looking into other sources for funding for the type of research I'm into: data science, healthcare disparities, etc.
    290 - PO is the one who advocates for select pay and pay by exception (see, not just a go-between!)
    291 - It's ok to let your PO know if you have tenure evaluation or some other time-sensitive career event coming up so they put you on speed dial, but know that there are tons of other PIs also asking for that special treatment
    292 - Early stage investigators can resubmit 6wk after receipt of summary statement, but make sure it's actually a good idea to do so (how much stronger would the A1 be if you had more prelim data, etc.?)
    293 - It's a Good Idea to start revising your A0 immediately after you turn it in. It will either help you advance scientifically (the research itself or drafting manuscripts, abstracts) or get you a head start on your A1, or both.
    294 
    295 ## The Check is Not in the Mail...
    296 - A1 must be w/in 37mo of A0, but this is too much time. Either the field will have advanced to the point that you need a new A0 to be current, or the field is stagnant and funding is unlikely (though I would submit that there's a slim possibility that the time for the first A0 was a little too early, but you should be reworking it during that time anyway and reevaluating)
    297 - on long term strategy:
    298     - see if your work might be of interest to multiple ICs. Example they give is HPV in the context of head and neck cancer - could involve NCI, National Institute of Dental and Craniofacial Research (NIDCR), National Institute of Allergy and Infectious Diseases (NIAID)
    299     - remember the NIH isn't the only player in the game. DoD, NSF, Agency for Healthcare Research and Quality, etc., etc.
    300 
    301 ## The Check is in the Mail, but...
    302 -  Change of Institution - awards are typically tied to you, not your institution, but there is red tape and negotiation (and tact!) necessary when making a move
    303 - Carryover of funds: if <25% of annual budget, no approval or explanation needed
    304 - No Cost Extension: usually easy to get, no application, lets you carry funds in the year after the award period, can extend to 2y with approval of PO.
    305 
    306 ## Appendix
    307 - some interesting organizations to check out, tailored to my interests (webpages in the book, links may be added here at a future date):
    308     - NCI - Cancer Control and Population Sciences; Cancer Treatment and Diagnosis
    309     - NHLBI - Blood Diseases and Resources
    310     - NIEHS - Risk and Integrated Sciences; Susceptibility and Population Health
    311     - NIGMS - Biomedical Technology, Bioinformatics, and Computational Biology
    312     - National Institute of Minority Health and Healthcare Disparities
    313     - NLM might be fun for NLP work, web scraping stuff, etc.
    314 - A related to-do: I know the researchers I follow that have R01 funding, but haven't looked deeper. Which orgs are funding the cool data science and crossover stuff for my favorite PIs?