Transcript of Research: Art WorksWebinar Q&A Session

>>Here we go. Plenty of questions. I have, what is included in the definition of analysis? Is data entry included, data coding, or a ride up of the results for publication?-- A write-up of the results for publication? You can be doing data entry, however, if it is assumed that the data is already pre-existing and you have not collected the data. Data coating is definitely an allowable activity if it is needed to do so in part of the analysis. Interpretation of the results as part of the analysis as well, and riding out the analysis as well. Analysis is just a function of looking at the data and interpreting the results from what the data tell you. Let's talk about the format requirements. The format requirements that I gave in the Web and are, specifically the executive summary, and then to the description of the data, that is a general format requirement for the reports the Shourd coming in at the end. It -- should come in at the end. That is as specific as we are going to get with those format requirements, and those are listed in the guidelines. I have, how many applications do you anticipate for the 25 grants? Last year, I believe we got about 60 grant applications. We ended up at awarding 15 grants. Since it is the second year after the inaugural year, we are looking forward to getting more than last year's amount of grants, but I cannot tell you exactly how many we will get this year.

>> This is the Office of Research analysis. With regard to that question, as Joe and I explained, 15 or 14out of 60 applications, so you are talking roughly 25% application rates. That is a pretty high thresholdcompared to other programs around the NEA. A pretty high bar that the review panels were placing onthe rim material -- on the material that came to them. To the extent that you can talk about the high quality of the data set, the nature of the questions and why they are particularly important for teasing out impact, the approach, methodology, research questions, all of that will put you in good standing in terms of what we saw last year.

>> Thanks. Another question about whether state agencies -- state's art agencies are eligible to apply.They cannot be the primary applicant. They are not eligible to apply, but they can partner with another organization. I have a question aIRB approval. Will we require IRB approval. That is an institutional reviewboard approval. We do not at this time require UR -- IRB approval on the existing data sets. However, if you do have access to confidential data set, we will require proof that you are granted access to use those data. I have a question about it meta analyses. Somebody asks whether I can go into more detail on what types of men and analyses are available, or does there have to be a component of the projectavailable that is about analyzing a data set? No, there does not have to be. Meza analysis itself is a dataproject. There are a lot of papers written on the topic and if you want to do in that analysis of the literature, then that would be -- a meta-analysis of literature, that would be an acceptable project as well. I have a question -- if I work as a research assistant at a State University, should my application be covered by the University application? The organization that a researcher works for should be the primary applicant for the grants program. Therefore, if you are a research assistant or any type of staff or faculty member at a university, the application should come directly from the university. Another question -- what if we do not use funds for data collection, but some of our collection overlaps with the grant time frame?As long as you are able to show that the support that you are applying for at the NEA is going for analysis of data and that keeps the grant will not support the data collection, this will be an eligible projects tied -- pipe. It is important I Isho in the application and the proposal itself what the NEA funds will be going to support. What are some of the existing data sets available, and what happens if multiple submissionscover similar questions with that same database?

>> The existing requirements are available at our guidelines at Argus.gov, -- arts.gov. There are dozensof datasets that we have listed in the guidelines that can give you good examples of datasets that are out -- high-quality and validity and reliability. The next question is what happens if multiple submissions cover similar questions within the same data bases? We are also interested in the methods that the researcher is using to analyze the data set. It panel will be evaluating the proposals based on the quality of the analytical message and not on Lee -- not only on the data quality and validity. It is about whether usedanalyses and not just the criteria.

>> And I believe all of the criteria, which again, are spelled out in all of the guidelines, there is attention to how the results will be distributed and the potential impacts of the findings. It is important to emphasize inresponse to that application, each applicant will be emphasized. It is a 25% rate, not 20%. That was bothering me. It

>> Can you explain more about conferences or convenience? The grants are not about conferences or convenience. -- convenings. We are looking at analyses of data and those that have communication of value or impact of the arts. Again, we do not require a match for the artworks Grants program this year.And I have been asked to go over the data collection policy once again, which I will. This seems to be one of the questions that we get the most from potential applicants. I will go over that to be sure it is clear. We are not funding primary Data Collection with our grants. Primary data collection will include all of that datacollection that involves the use of human subjects. That would include implementing surveys, interviewing people, were conducting focus groups, for example. If you have questions about specific forms of datacollection, feel free to e-mail us and I can answer your question specifically. The other data collection inthis program is that while the grants will not fun primary Data Collection, they will fund projects for which data collection has not occurred yet, but that the plans are in place for data collection to occurred before the start of the grant time frame. Or as one person asked, during the grant time frame itself. As long as we know that the NEA support will be going toward the actual analysis of the data.

>> And bear in mind that the Grand Canal -- can also cover acquisition of datasets with commercial sources. It is acquiring secondary data at no cost. It is not so much primary Data collection.

>> I have been asked to define values and impacts again. Values refers to descriptive research. Researchthat gives a good understanding of the state of the arts sector. We pointed to population groups that we are interested in. If it is descriptive in nature and describes what the sector and the ecosystem currentlylooks like, we would define that as values research. Impact research looks at what the benefits of the arts are on other areas in other areas of life. We pointed to four primary areas, included -- including Condit to capacity learning and creativity, health and well- being, economic prosperity, and livability. That is how we defined values and impacts. Here we are really concerned with -- we are looking for proposals that are concerned with proposals that are not only describing the arts ecosystem, but looking at what the artsmight be. I have -- the next question is, some programs allow the program directors to contact programstaff to provide feedback on the projects before hand. Is that allowed in this grant mechanism? You can feel free to e-mail us questions or call me directly to ask questions about eligibility guidelines. But in terms of specific projects, we will usually point you back to the guidelines and let you know what is eligible. We will not give feedback in terms of what is a better or worse proposal in case project directors have those types of questions. What portion of the researchers costs may be covered by the grant, and must that fit into the 15% direct or overhead cost? I am going to ask Jillian, since she knows more about direct cost than I do.

>> Thanks, Joanna. It depends on your budget, but I'm going to guess that your answer is no, because the research budget is probably a direct cost and it should be whatever is appropriate for the project. The indirect cost applies to overhead and administrative costs that are generally applicable to the project. The research fees are probably the heart and soul of your proposal. My guess is after you consult with Joanna when you fill out your application, you will find that having it under direct costs is probably the way to go.

>> Thank you, Gillian. Jillian. In cases of a collaboration between artist and scientist, is there a preference on how it is listed as to who is the PI? No, we do not have a preference as to how that is listed.Any suggestions on how someone in clinical private practice and working with medical literature analysis, but not currently familiar with the 501-C3 could apply? The nonprofit does need to be a 501-C3 nonprofit.No suggestions on how that could work. The primary applicant does need to be the 501-C3. There can be collaborations with other nonprofits, however, the primary applicant does need to be a nonprofit. Can you give examples of innovative research questions posed by a last year's successful applicants? The best way to enter the question is to direct everybody to our arts.gov site and maybe we can show that web address once again. You can take a look at the grants that were funded in fiscal year 2012 and the othertypes of research questions and descriptions of projects and how applicants proposed to answer those questions. Is the outcome of the project restricted to be published -- restricted or to be published in other academic journals? I think the question is, are the papers that the results from these grants able to bepublished in academic journals? Yes, that is certainly allowable. We look forward to supporting work that does go into other mediums, such as peer review journals. Is there a limit on the number of applications a university may submit?

>> Know, there is no limit on the number of applications -- No, there is no limit on the number of projects that may be proposed. The the research university may submit multiple applications for the grants program. Can a team of a professor and a doctoral student apply for the grant? And can we use the outcome to publish in a journal? I think I briefly went over that. A team does need to -- can apply, but there does need to be one P.I. And whoever was not listed as the P.I. Can be listed as working on the project. And yes, those reports can be listed in the academic journals. Is an organization with a veryrecent 501-C3 eligible to serve as the organization? As long as that organization is a 501-C3 then they are eligible to be the applicant to the program. If a university is already submitting to the NEA and otherareas, which limited to one application per universities, -- per University, can they still submit to art works in? Yes, they are free to not only apply to the art works program, but other categories at the NEA as well. I have a question about the panel. What types of people sit on the panel, and what sectors do they come from, and are they all are spaced? -- Art based? The panel is a range of experts, as well as somebody who is a little more outside of this sector. They are not all necessarily arts-based, but they do haveexpertise as it relates to the grants program. The types of people that would sit on the panel would not only be academics who do quantitative research, but we can also see consultants on the panel, orpractitioners from organizations that do research or are familiar with research. The second part of the question -- are they all are spaced? They are not all parts based. -- Artest-based. -- arts-based. They are not all, but it is primarily that way. If funded, the grant would begin May 1, 2013. If the applicant still collects data through August, 2013, can we analyze this data, or is it ineligible because it was notcollected before the grand time frame? What is most important is that we see the distinction between the analysis and data collection in the applicant's proposal, and that we see that any NEA support is being used sufficiently to cover the cost of the project. However the researcher proposes to do that will be evaluated by the panel. Can you give us some examples for what you call direct costs for researchers? It is a bit confusing since primary data collection is not funded. Would you mind clarifying this once more? I will give this over to Jillian again since she answered the previous question.

>> Direct costs for the researchers speak could include the work that the researcher is actually doing outside of the data analysis, interpretation of results. In any activity that the researcher might be performing that would be eligible is a direct cost for the researchers feet. -- researcher's feet.

>> How would the quality of the data be evaluated? How will the quality of the data set be evaluated? Not only the analysis and the quality of the data set will be evaluated by the panel, and we are really looking for data sets that are not necessarily a nationally representative in scope, however, the implications fromanalysis and answering the question that is posed and using the data set has a broad application to the arts sector. Those three words, looking for data sets of high-quality, solidity, and reliability. It is most important that the applicant, if they know that the panel will not be familiar with the Davis said, if they provide a little bit of information -- with the data sets, if they provide a little bit of information on the quality of the data. Another question, if I submit a proposal one day I have collected previously, what information about this data set should I include in order for it to be evaluated? Exactly what I said earlier. And the more the better, as long as you can fit into the length of the applicant. If you believe the panel will not be familiar with the data set, then the more information, the better, in terms of how the data were collected, if there are any waiting schemes we need to know about and to the sponsor of the organization is. If the data is confidential and whether the researcher has permission to use the data. What a local or regional focus make for a competitive proposal? I cannot really talk about what would make a competitiveproposal, but I can talk about what would be eligible. Definitely, I grant with a local or regional focus would be an eligible project. I know we are talking about impact and how the arts might have impact on other domains of life, and that is a pretty broad term. However, if you can draw from life and other regionalanalysis and there are broader implications from that, then that would be an eligible project. We have a question about -- I'm having trouble understanding what content to enter the research design section and the data analyses section. The data seen as the Larry similar. -- the data seem very similar. The research design should give a broad description of -- a good, broad description of the methodology the researcher is using to analyze. And then the data analyses section would be a bit more specific. If you are using a specific type of analysis, or a specific type of model to conduct your analyses, a description of theanalyses would be provided there. If you have any more questions on deciphering between the two again, please do not hesitate to call me or e-mail the research grants e-mail. Can you talk a little bit more about the non-profit 501-C3 institutions eligible to apply? As long as you are incorporated as a 501-C3, you are eligible. That includes most universities and colleges. I will give it over to Jillian to answer this question.

>> And Joanna, I think you got it right. I think what may be behind the question is whether we are onlylooking for arts organizations. The answer is, no. We are interested in expanding the disciplines that are looking at Arts Research. Any type of 501-C3 is eligible.

>> Thank you, Gillian. Will projects that concern religious communities be considered? Yes, they will. We do not have any eligibility criteria in terms of the topic of the grant proposal. -- Grant proposed Erb. -- grant proposaer. Can you give me existing examples of the data available? This brings to mind in thatanalysis. If he were looking to do a meta analysis of literature where that data is not readily available and you are doing any kind of program assessment that has broader implications for the sector, that would also be an example where there might not be an existing databases available. Or in the case if data isavailable, but it might be broken up into pieces and not in one centralized database, that could be an example of where the database is not available as well.

>> Joanne that, if I'm not mistaken, is in another example perhaps if someone was going to collect data, but not through our Grant, and they could sufficiently described the parameters of that data collection enough, or the panelist would feel confident about the eligibility, correct?

>> Feddis exactly true. -- that is exactly true. If the data collection has not taken place before the grantstarts, that would be an example as well. I have a question about dissemination. Is dissemination of research results and allowable cost? This would include attending conferences or publications. Yes, it is an allowable costs. If you have dissemination plans, those should be included in your proposal as well. If you have any specific questions in terms of projects that you are thinking about proposing, the best way to ask those questions is to e-mail and I will get back to you pretty quickly. If you have project-specificquestions, it would be best if you e-mail those to NEA -- nea Researchgrants.gov. If you have questions, please keep your mailing those in. Here they come. I have a question about whether any of the funds for Analysis can be used for the ongoing program for which the data were collected. If I understand his question correctly, can those funds for Analysis be used for the ongoing program? The grant is to support the analysis of data and research. That can include a program evaluation, or assessment, as long as it has broader implications for the sector. That is probably what that question is getting at.

>> One thing that I think we keep getting asked, and I want to make sure in case we have not addressed it, when we talk about broader implications for the sector and so forth, as I hope the guidelines make clear -- and this is a crucial difference between the last set of guidelines and this time. We make clear that the applicant has to position their particular project in some light that shows how is significantly contributing to the body topic. There is some sort of literature review or some sort of Citation that could back up what has been done before to explain the availability of research questions in this particular proposal. It is everything to the extent to which the applicant can refer to, whether a data source, a novel, an interesting source to be used alongside what has been done in the past, a novel research technique, or certainly, the research questions themselves and how they contribute to the broader body of literature. I think that would be very useful. Thank you.

>> If one has done a Nutella analysis of literature -- mad- analysis of literature, but wants to take it further,is use of that analysis appropriate? As long as it is very clear in the proposal. What the benefit of the analysis is. That is an eligible product type. -- Project tie. If you have already done a meta-analysis of literature, and you want to do another one, it would have to be clear in the proposal how you would take that further and how it would be different from what the other applicant has already done. We will not besupporting projects that have already been done. However, if there are plans to take the analysis further and it is distinctive from what has already occurred, that would be an eligible project. If the data collection may occur after the grand time frame, but will not be covered -- Grant timeframe, but will not be covered by research grants, will it be eligible? If the data collection -- I think I might have answered this previously.If data collection is to occur after the start of the grant time frame and it is clear within the proposal was the NEA funds will go to support, then the project will be eligible. Is there and intend to continue this program into the future? Yes, we do have the intention of continuing the Research Grants program. This is our second year and we definitely have the intention to continue the program down the line. Is there any plan down the road to fund collection of new data? There are plans to fund the collection of new data.We are simply figuring out all of the specifics to be able to do that. That is something that we are working on at the Office of Research and Analysis. Based on the questions and e- mails we are getting today, thatis one of the more complicated aspects of the program, that we do not fund the primary Data Collection, however, we are looking into options to do so in the future. We have about five minutes left. If you have any questions that have not been answered, please, feel free to tie them into the Q&A box now. If I might have missed a question, type in again and hopefully I will be able to see it. Just a logistical question.When we -- will we posed a recording of this session and if so, when and where? Yes, at our website in a few days and it will be in the Podcast, webcast, and webinars section of our website. You can refer to it in the future. I have a question about the maximum length of narrative. The maximum length is in theguidelines. I do not have them right in front of me, but please feel free to e-mail any research --nearesearchgrants.gov and I can give you the exact length then. Does the NEA anticipate any awards been significantly higher than the 50,000 -- the $30,000? No, we do not anticipate any project being over the $30,000. If total costs are over that, we will be looking at the project to see if the participants haveneed of support at that rate. If you have questions, please type them in.

>> We have a question about what other categories there are at the NEA in addition to our networks. -- In addition to research artworks. We have one called art works without "Research" in front of it. The deadline is in March of each year. We have out reach for our creative grant making. You should look at thoseguidelines when they are posted in the second week of October this year. We also have a category forunderserved communities.

>> Thanks, Jillian. We have a question from an arts organization. Should an arts organization apply who has collected data, be using an outside firm for data analysis, and if so, should you -- can you give guidance on where the artist organization should be? if the arts organization has collected data and they do not believe there should be analysis and they partner with another firm to do the analysis, while the NEA cannot direct anybody toward those types of firms, you are definitely free to partner with somebody to do the analysis portion. I have a question about how long the grant. Is. It is generally one year and canstart as early as May 1, 2013. And I will just answer one more question. Let's see, I have a question about the dates for all NEA deadlines for 2013. Someone will like to say -- would like to see the deadline dates for all of 2013. I will give them over to Jillian.

>> We will publish on our website in January, but I will give you a quick summary of right now. The artworks category has deadlines in March every year. The challenge America fast track project for underserved project is in may have every year. And the our talent deadline is earlier than usual, January.It

>> With that, I'm going to conclude. Thank you for all the -- to all of our Web and are -- webinarparticipants. If you have any questions, please feel free to e-mail us. We will answer administrativequestions as well as eligibility criteria. Please also read over the guidelines on the website. A lot of answers are in the guidelines. It is pretty detailed. Also, please feel free to call the office at the phone number listed on the slide. Thank you for everybody's participation. We look forward to receiving a lot of applications on November 6.