wbcヨーロッパ予選

This page uses Javascript. Please enable Javascript in your browser. Skip to Content Japanese English Chinese About RIETI Site Map Help Contact Discussion Papers Search Site Search Menu Research Areas Research Programs (FY2024-2028) Research Programs (FY2020-2023) Research Programs (FY2016-2019) Research Programs (FY2011-2015) Policy Research Domains (FY2006-2010) Projects Survey Fellows According to Title Alphabetical order RIETI Alumni Research/Policy Papers Discussion Papers (English) Discussion Papers (Japanese) Policy Discussion Papers (English) Policy Discussion Papers (Japanese) Technical Papers (English) Technical Papers (Japanese) Non Technical Summaries List of Articles in Journals Research Digest Discussion Papers Search Publications RIETI Books (English) RIETI Books (Japanese) History of Japan's Trade and Industry Policy Authors' Words Other Publications (English) Other Publications (Japanese) Events Symposiums Workshops BBL Seminars Archived Seminar Series Data JIP Database R-JIP Database CIP Database Industry-Specific Nominal and Real Effective Exchange Rates AMU and AMU Deviation Indicators JSTAR RIETI-TID RIETI FDI Database ICPA Project Links Articles Column Special Series Newspapers & Magazines Fellows' Works VoxEU Column From IZA Perspectives from Around the World Other Contents RIETI Report Policy Update Keizai Sangyo Journal (METI Journal) Research Areas Fellows Research/Policy Papers Publications Events Data Articles Site Map Technical Issues Coontact Discussion Papers Search Close HomeArticlesSpecial SeriesIssues Facing the Japanese Economy in 2013 (January 2013) Issues Facing the Japanese Economy in 2013 (January 2013) The Significance of the Revision of the National Guidelines for Evaluating Government Funded R&D Tweet Print HATA Shigenori Consulting Fellow, RIETI IntroductionThe National Guidelines for Evaluating Government Funded R&D were revised at the Council for Science and Technology Policy and will be followed in earnest in 2013. This revision is quite significant, coming at a time when Japan is faced with a pressing need to strengthen its science, technology, and innovation policies to promote economic growth.In what follows, I will introduce recent trends in Japan's science and technology policies and discuss the significance of the latest changes to the guidelines. Strengthening the governance of science, technology, and innovation policies is a common challenge among OECD countriesAs the world economy continues to stagnate following the collapse of Lehman Brothers and the sovereign debt crisis in Europe, securing economic growth has become a priority policy issue for countries around the world. Particularly in developed nations, how to parlay the results of research and development (R&D) activities into innovation and achieve economic growth has become a major policy issue.Meanwhile, fiscal reform has become a pressing concern not only in Japan but also in the United States and Europe. Against this backdrop, the efficient implementation of science, technology, and innovation policies has become another focus point. For example, in the OECD Science, Technology and Industry Outlook 2012 report, which the Organisation for Economic Co-operation and Development (OECD) publishes biennially (Note 1), case studies of efforts to strengthen the governance of science, technology, and innovation policies, such as integrating related laws and regulations, streamlining evaluation procedures, and establishing specialized evaluation organizations, are introduced. Content and background for the revision of the National GuidelinesThe National Guidelines for Evaluating Government Funded R&D (hereinafter referred to as the National Guidelines) are revised as appropriate in tandem with the formulation of the Science and Technology Basic Plan (Note 2), which is drawn up every five years according to the Basic Act on Science and Technology. The latest revision is in line with the Fourth Science and Technology Basic Plan, formulated in 2011.I would like to briefly touch on the Fourth Science and Technology Basic Plan. The plan has incorporated a new policy perspective that calls for promoting the entire process of innovation—from R&D to application—in an integrated manner. This marks a shift from the conventional "R&D seeds-push" approach, which focuses on the incubation of R&D seeds, to a "problem-solving" approach.The problem-solving approach starts out with identifying a goal or a specific problem that needs to be solved and then R&D and innovation policies—those designed to promote R&D activities and disseminate fruits resulting therefrom into society—toward reaching that goal will be promoted in an integrated manner. This is a major change from past science and technology policies, which were centered around the promotion of R&D activities.Also underlying the latest revision is the notion that Japan's innovation system as a whole, including the evaluation of R&D activities, might not have been effective as a mechanism for promoting innovation. In the past, the chief purpose of evaluating government-funded R&D activities was to establish accountability. It is thus fair to say that interim and ex-post evaluations were respectively intended to determine whether R&D projects were progressing as planned and whether their expected goals were achieved. Accountability will undoubtedly remain important in the future, but it is becoming increasingly critical to consider how to promote innovation in the evaluation of R&D activities. Key points in the revision of the National GuidelinesIn my view, the latest revision of the National Guidelines is significant in two aspects. First, it called for introducing program evaluation. Second, it pointed to the need to make program outcomes visible and measurable. Introduction of program evaluationA "program" referred here is a policy package—composed of multiple R&D projects and measures to promote the dissemination of their results—that will be taken as the smallest unit of evaluation. What is important from an innovation policy standpoint is to implement R&D projects along with measures to facilitate the dissemination of their fruits—such as deregulation, subsidies, and tax breaks—as a package. In promoting R&D in the form of a packaged program, we must create an appropriate mechanism for evaluating such programs.The Ministry of Economy, Trade and Industry (METI) has been making pioneering efforts to promote and evaluate the implementation of packaged R&D programs under the name of the "evaluation of R&D measures." What has been done so far, however, is limited to the "bundling of multiple R&D projects"—i.e., evaluating and managing closely-linked R&D projects as a single package—and there is a long way to go to develop such mere bundles of R&D projects into full-fledged programs with an eye on measures to disseminate R&D fruits (Note 3). Visibility and measurability of program outcomesThe term "Outcome" referred to in the guidelines is an indicator measuring the effects of R&D outcomes. For example, sales revenues from a product developed by utilizing a certain R&D outcome or new product specifications can be used as an Outcome index. In contrast, "Output" is an indicator measuring the level of activities, and its examples include the number of academic papers and the number of patent applications filed. Because of the relative ease at which to obtain and assess such data, the latter type of indicators have long been used as a primary evaluation measurement. However, under the new innovation policy that promotes R&D and the dissemination of the resulting outcomes in an integrated manner, it is essential to make such outcomes visible and measurable. What becomes important in this process is strengthening the ex-ante and follow-up evaluation. Strengthening ex-ante evaluationAs its name suggests, ex-ante evaluation is to evaluate the necessity of an R&D project prior to its implementation. Unlike interim and ex-post evaluations, where specific data are available to be evaluated (e.g., the progress of the project in the case of the former and a specific R&D outcome in the case of the latter), no such data exist in the case of an ex-ante evaluation. Therefore, it will instead evaluate the significance of an R&D project, its intended outcome, plans for measures to disseminate such outcome into society, and so forth.Among all, the intended outcome of an R&D project and its relevant measures is the most important item in ex-ante evaluation because clarifying what is aimed to be achieved helps clarify how they relate to other projects and measures targeting similar outcomes, and enables the effective and efficient attainment of the intended outcome. In view of this, the new National Guidelines advocate strengthening ex-ante evaluation, suggesting the increased use of feasibility studies as an example of specific measures to accomplish this. Strengthening follow-up evaluationFollow-up evaluation is to examine and assess an R&D project comprehensively after a certain period of time has elapsed following its completion, for instance, with respect to whether or not the outcome of the project has been commercialized and what effects or impact it has had on the size of the relevant market, industrial competitiveness, human resource development in the relevant area, and people's livelihoods in general. Because of the significant time and costs involved in the collection and analysis of basic data, follow-up evaluation hitherto has only been conducted for large-scale R&D projects.Follow-up evaluation is an attempt to find out what has been achieved as an outcome of R&D efforts, and from an accumulation of such evaluation experiences, we can derive important implications for our future science, technology, and innovation policies.One relatively recent example is METI's report on the results of its follow-up evaluation of R&D for solar power generation (Note 4). This was an attempt to assess a series of R&D activities for solar power generation undertaken as part of the Sunshine Project, a long-term government program launched immediately after the first oil crisis, in a comprehensive manner, ranging from technological achievements made in the process to the final outcome. Although the technical achievements were generally highly rated, the report states that efforts to disseminate their benefits into society were not necessarily sufficient, having taken place mostly in the form of subsidies to promote the installation of residential solar power systems.By continuing to add such follow-up evaluation results, we should accumulate our knowledge as to what policies are needed to facilitate the dissemination of R&D fruits and incorporate that knowledge in formulating innovation policies. Conclusion"Winning in technology but losing in business" is a phrase typically used to describe the Japanese electronics industry, which has been losing global market share despite its sophisticated technologies. In order to change this situation, the Fourth Science and Technology Basic Plan took a radical shift in policy direction toward those of the problem-solving approach including measures to facilitate the dissemination of R&D fruits.To achieve sustainable economic growth under the adverse influence of a declining and aging population, Japan has to engage in bolder and more adventurous innovation than do other countries. As Japanese companies are cutting back on their R&D investments (Note 5), it is all the more important for the government to implement R&D innovation policies from a medium- to long-term viewpoint to generate innovation seeds. Needless to say, this must be done both efficiently and effectively under severe fiscal constraints.It is sincerely hoped that the purport of the latest revision of the National Guidelines will be fully put into practice and become a strong tool for formulating and implementing science, technology, and innovation policies that can facilitate much-needed economic growth in Japan. December 28, 2012>> Original text in Japanese Footnote(s) ^ http://www.oecd.org/sti/sti-outlook-2012-highlights.pdf (highlights).^ http://www8.cao.go.jp/cstp/kihonkeikaku/4honbun.pdf (Japanese only)^ For the programming of the R&D activities that the Ministry of Economy, Trade and Industry is working on, please refer to the following: http://www8.cao.go.jp/cstp/tyousakai/hyouka/haihu84/siryo5.pdf (Japanese only)^ http://www.meti.go.jp/policy/tech_evaluation/e00/03/h22/397.pdf (Japanese only)^ According to the Survey of Research and Development (the Ministry of Internal Affairs and Communications), the R&D expenses of companies, etc. have declined by approximately 13% over three years, from a peak of 13.8 trillion yen in fiscal 2007 to 12 trillion yen in fiscal 2010. For more details, please refer to the following:http://www.stat.go.jp/data/kagaku/2011/pdf/23ke_gai.pdf (Japanese only) Tweet January 31, 2013 Print Article(s) by this author The Significance of the Revision of the National Guidelines for Evaluating Government Funded R&D January 31, 2013［Issues Facing the Japanese Economy in 2013 (January 2013)］ Japan's Policy Beyond 2013 Under Scrutiny as the World Moves Toward a New Global Warming Regime January 31, 2012［Column］ Articles Column Special Series Priorities for the Japanese Economy in 2024 (January 2024) Priorities for the Japanese Economy in 2023 (January 2023) Priorities for the Japanese Economy in 2022 (January 2022) Priorities for the Japanese Economy in 2021 (January 2021) Priorities for the Japanese Economy in 2020 (January 2020) Priorities for the Japanese Economy in 2019 (January 2019) Priorities for the Japanese Economy in 2018 (January 2018) Priorities for the Japanese Economy in 2017 (January 2017) Priorities for the Japanese Economy in 2016 (January 2016) Fellows' Views on the Trans-Pacific Partnership (TPP) Priorities for the Japanese Economy in 2015 (January 2015) Priorities for the Japanese Economy in 2014 (December 2013) Issues Facing the Japanese Economy in 2013 (January 2013) Issues Facing the Japanese Economy in 2012 (January 2012) Issues Facing the Japanese Economy in 2009 (January 2009) Issues Facing the Japanese Economy in 2008 (January 2008) Issues Facing the Japanese Economy in 2007 (January 2007) RIETI Fellows' View on Incident at Japanese Consulate-General in Shenyang (June 2002) Newspapers & Magazines Fellows' Works VoxEU Column From IZA Perspectives from Around the World Other Contents RIETI Report Policy Update Keizai Sangyo Journal Communications Newsletter RSS Feed Facebook X YouTube Research Areas Research Programs (FY2024-2028) Research Programs (FY2020-2023) Research Programs (FY2016-2019) Research Programs (FY2011-2015) Policy Research Domains (FY2006-2010) Projects Survey Fellows Research/Policy Papers Discussion Papers (English) Discussion Papers (Japanese) Policy Discussion Papers (English) Policy Discussion Papers (Japanese) Technical Papers (English) Technical Papers (Japanese) Non Technical Summaries List of Articles in Journals Research Digest Discussion Papers Search Publications RIETI Books (English) RIETI Books (Japanese) History of Japan's Trade and Industry Policy Authors' Words Other Publications (English) Other Publications (Japanese) Events Symposiums Workshops BBL Seminars Archived Seminar Series Data JIP Database R-JIP Database CIP Database Industry-Specific Nominal and Real Effective Exchange Rates AMU and AMU Deviation Indicators JSTAR RIETI-TID RIETI FDI Database ICPA Project Links Articles Column Special Series Newspapers & Magazines Fellows' Works VoxEU Column From IZA Perspectives from Around the World Other Contents RIETI Report Policy Update Keizai Sangyo Journal (METI Journal) About RIETI Privacy Policy Site Policy Site Map Help Contact METI Web Site Research Institute of Economy, Trade and Industry, IAA (JCN 6010005005426)JCN: Japan Corporate Number Opinions expressed or implied on this website are solely those of the author, and do not necessarily represent the views of the Research Institute of Economy, Trade and Industry (RIETI).Titles, numbers, specific names, etc. on this website are as of the date of publication. In the case of reposting material from our website, contact us beforehand. Top