Skip to main content

Coevolution of COVID-19 research and China’s policies

Abstract

Background

In the era of evidence-based policy-making (EBPM), scientific outputs and public policy should engage with each other in a more interactive and coherent way. Notably, this is becoming increasingly critical in preparing for public health emergencies.

Methods

To explore the coevolution dynamics between science and policy (SAP), this study explored the changes in, and development of, COVID-19 research in the early period of the COVID-19 outbreak in China, from 30 December 2019 to 26 June 2020. In this study, VOSviewer was adopted to calculate the link strength of items extracted from scientific publications, and machine learning clustering analysis of scientific publications was carried out to explore dynamic trends in scientific research. Trends in relevant policies that corresponded to changing trends in scientific research were then traced.

Results

The study observes a salient change in research content as follows: an earlier focus on “children and pregnant patients”, “common symptoms”, “nucleic acid test”, and “non-Chinese medicine” was gradually replaced with a focus on “aged patients”, “pregnant patients”, “severe symptoms and asymptomatic infection”, “antibody assay”, and “Chinese medicine”. “Mental health” is persistent throughout China’s COVID-19 research. Further, our research reveals a correlation between the evolution of COVID-19 policies and the dynamic development of COVID-19 research. The average issuance time of relevant COVID-19 policies in China is 8.36 days after the launching of related research.

Conclusions

In the early stage of the outbreak in China, the formulation of research-driven-COVID-19 policies and related scientific research followed a similar dynamic trend, which is clearly a manifestation of a coevolution model (CEM). The results of this study apply more broadly to the formulation of policies during public health emergencies, and provide the foundation for future EBPM research.

Peer Review reports

Laws and institutions must go hand in hand with the progress of the human mind. As that becomes more developed, more enlightened, as new discoveries are made, new truths discovered and manners and opinions change, with the change of circumstances, institutions must advance also to keep pace with the times.

-Thomas Jefferson

Background

COVID-19 has been a focus of global concern since the beginning of 2020, and research literature, social media, and other information resources related to COVID-19 are being generated at high speed and in unprecedentedly large quantities [34]. In the face of an unknown virus, scientific research has the power, alongside medical treatment and health management, to guide us through unprecedented times.Footnote 1 Moreover, scientific research paves the way for effective policy-making as well. Policy acts as a crucial tool and priority behaviour [28] for social public management. This fact partially explains the explosion of papers during the COVID-19 pandemic. In the face of a public health emergency, policies need to coordinate efforts to combat COVID-19; thus scientific research is included. Consequently, the dynamics between science and policy (SAP) can be understood using a coevolution model (CEM).

The concept of coevolution was originally proposed by Ehrlich and Raven [18]. Four policy-making models were proposed by Zwanenburg and Millstone [92], among which CEM is the only nonlinear model. The CEM reflects two-way feedback and continuous adjustment between SAP until a symbiotic equilibrium is reached under the influence of social and other factors, rather than simply a two-way influence. The CEM is regarded as the best model for effectively capturing the interactions between SAP-making [17, 22, 73]. Policies provide application-oriented research directions for science [13], accelerate the utilization of discoveries [57], and facilitate optimal resource allocation. The policy aids in constructing a denoising mechanism under the CEM to constantly screen for more appropriate scientific evidence to adopt. A new perspective on the relationship between SAP that differs from a more subjective model, the technocratic and decisionist models, has been shaped under CEM [53, 55]. Adjusting scientific evidence for policy-making under CEM is consistent with the goal of achieving evidence-based policy-making (EBPM). EBPM involves the design of policy based on evidence, which embeds scientific evidence throughout the process from policy formulation to evaluation to ensure that policies are scientific, effective, and reasonable [40, 64]. Thus, the dynamics between SAP under CEM meet the goal of EBPM effort [53] and provide a starting point to deeply explore EBPM [85].

One of the main challenges currently encountered during the construction of evidence-based policy is how to effectively transfer scientific evidence in policy-making [4, 32, 64]. The final quality of policy is determined based on the efficiency of elaborately refined scientific evidence operation in all processes constituting policy-making. Scientific evidence adopted in policy is invisible and unavailable to summarize at length to most people other than policy-maker themselves, which increases the difficulty in measuring the efficiency of scientific evidence utilization. Therefore, most of the current studies on the efficiency of scientific evidence operation dwell on the theoretical level [78, 87]. Major trends of scientific research and the corresponding policy changes in the early phase of COVID-19 were concluded, laying the basis for capturing the traces of scientific evidence in other policies without information source. It is also one of the innovative points of this study.

China was selected as a representative case for investigation for the following two reasons: First, China is among the first batch of countries identifying the COVID-19 epidemic. For instance, Weible et al. [77] reported that countries with early outbreaks, such as China and Italy, provided an opportunity for other countries to detect the pandemic and assess early policy responses. Second, China addresses the policy-making process standing on scientific research on COVID-19, but lacks relative research for mainland China. Professor Gao Fu, the Director-General of the Chinese Center for Disease Control and Prevention, claimed that the main objective of scientific research in the early period of the COVID-19 outbreak in China was to offer more reasonable reference and judgement for policy-making at the seventh academic conference of the academic divisions, Chinese Academy of Sciences. Yin et al. [85] recently published an article in Science, revealing the coevolution between SAP-making during the COVID-19 pandemic in 114 countries other than mainland China. Atkinson et al. [3] considered the dynamics of the United Kingdom policy response to the COVID-19 pandemic and explored how COVID-19 policy-making shares links with scientific research in the United Kingdom in order to capture real-time information. Therefore, the current study is complementary to CEM study on COVID-19. Third, this study provides a way to measure the dynamics between policy and scientific research when the policies lack references to the original scientific findings. Unlike other countries or regions, most policies in China do not publish reference sources and are not indexed in databases such as Overton, increasing the difficulty encountered in determining the association of Chinese policies with other information. To investigate the relationship between SAP without reference sources, dynamic trends in scientific research were analysed and identified via machine learning clustering analysis of scientific publications. Trends in relevant policies that correspond to changing trends in scientific research were then traced. This method is in contrast to the use of Altmetric data [33], analogy of numbers between publication and citation [73, 85], and field investigation of policy-making processes in departments involved in policy-making [41, 86] to analyse the policy–science evolutionary relationship. There are two other innovative points of this study.

The time scope of this research is limited to the early stage of COVID-19 in China. This was a period of high uncertainty. With increasing awareness about the virus, scientific research, medical defence and control, and policy-making all needed to continue making ongoing adjustments. With the deep insight and more focus on the virus in the later stage, the need to update scientific research and policy-making decreased gradually (please refer to Additional file 1: Table S1), and thus the interactions between SAP were less frequent and evident than those at the earlier stage. The white paper “Fighting Covid-19: China in Action” issued by the State Council of China reported that nationwide virus control was then being conducted on an ongoing basis from 29 April 2020. However, sporadic cases such as the epidemic outbreak in Beijing in May 2020 had been reported in mainland China. Consequently, the time scope of research cut-off was before 26 June 2020, roughly half a year after China’s official disclosure of COVID-19. Second, the earlier the epidemic is brought under control, the fewer losses society must suffer. The outcomes of prevention and control of the epidemic in the early phase played a more vital role in its overall development than in other stages, making this study informative for early prevention and control of emergencies.

The developmental trends of China’s COVID-19 research were analysed from the perspective of bibliometrics. Scientific research is a process of problem-solving and resolving disputes [21, 36]; therefore, trends of scientific research indirectly reflect whether a scientific consensus has been reached or whether a solution has been developed for a particular problem. Such connections can be revealed when one studies the length of time for which the particular topics remain popular. To clarify the dynamic trends of research, a total of 16 statistically valid time intervals were used. This study focused on the period from 30 December 2019Footnote 2 (the initial announcement of the pandemic) to 26 June 2020, corresponding to a total of 18 intervals. Since the first COVID-related publication from China in PubMed was published on 24 January 2020, the total number of valid intervals is 16 (Additional file 1: Table S2). By calculating the variations in the co-occurrence of items over a range of time intervals, the research confirmed the items with a significant change and conducted a cluster analysis. It was found that in the later stage of the epidemic in China, the trend of research on “children and pregnant patients”, “common symptoms”, “nucleic acid test”, and “non-Chinese medicine” began to decline. In contrast, research on “aged patients”, “severe symptoms and asymptomatic infection”, “antibody assay”, and “Chinese medicine” began to rise. Mental health is a long-term “hot” issue in China’s COVID-19 research. The formulation of relevant COVID-19 policies in China is constantly evolving, and this is partially in response to these dynamic variations in COVID-19 research. In the early stage of the outbreak in China, the formulation of COVID-19 policies followed a rapidly progressing CEM. It also signifies China’s efforts to build EBPM during public health emergencies.

Methodology

Data collection

The research data for this study were derived from PubMed. The alternate names of COVID-19 provided by the Dimension databaseFootnote 3 were used as search terms.Footnote 4 The types of literature to be searched were limited to articles and reviews. As of 26 June 2020, the PubMed database had collected a total of 16 739 publications on COVID-19 research, among which 3708 papers were from China. The scheme used in this study adopted an expanding overlapping aggregation/overlapping time series approach [9, 39, 43]. A total of 16 statistically valid time intervals were used, following the examples provided by Petropoulos and Makridakis [60] and Roosa et al. [62]. Specifically, the time intervals were from 30 December 2019 to 28 January 2020, from 30 December 2019 to 7 February 2020, from 30 December 2019 to 17 February 2020, and so on, cumulatively increasing in 10-day increments until 26 June 2020. The specific intervals and corresponding dates are presented in detail in Additional file 1: Table S2. This strategy of collecting data in overlapping time series can reduce the influence of randomness on the variability of data in short periods and thus can present more stable trends than is possible with the use of continuous time series [9, 43]. Simultaneously, to avoid any bias introduced by the selection of the duration of the time interval, a robustness test (see details in Additional file 1: Appendix S3) was conducted. It was found that the variation significance values of co-occurrence keywords calculated under the 10-day interval scheme and under the 20-day interval scheme were highly correlated, with a correlation (R) value ranging from 0.77–0.93 (for six overlapping time intervals). These correlation ranges indicate that the variation significance of co-occurrence keywords can be effectively demonstrated by using different time interval schemes. In particular, the 10-day interval scheme is able not only to reveal more significant variations in the number of COVID-19 papers, but also to reasonably avoid the random fluctuations to which an excessively short interval would be susceptible.

Data processing

All selected literature was imported into VOSviewer (version 1.6.16) in MEDLINE format for co-occurrence analysis. When setting the analysis conditions, the minimum number of occurrences of a keyword was set as 2, indicating that the keyword appeared in at least two documents. The data on the total link strength of co-occurrence items in different time intervals were extracted to calculate the differences in co-occurrence items. It not only recorded the occurrence frequency of a given item, but also reflected the link strengths of other items appearing at the same time as the given item [16].

The data on the total link strengths of corresponding items varied significantly because of the significant differences in the numbers of papers published during different intervals of different durations. According to the results exported from VOSviewer, the maximum total link strength in the first interval was 73, while that in the last interval was 39 814. To make the subsequent analysis more consistent, it was necessary to first normalize the total link strengths by transforming their values into percentages.Footnote 5

Identification of items with significant variations

Given that the number of co-occurring items varied in different intervals,Footnote 6 data imputation was conducted to determine the missing percentages of the total link strengths of co-occurrence items to facilitate subsequent analysis. The missing data fell into the category of missing not at random; thus this study adopted minimum value imputation as its method [42]. Specifically, the minimum percentages of the total link strength of co-occurrence items in the 16 intervals were extracted separately. Then, data were randomly selected from the range constituted by the 16 minimum percentages for imputation with a 90% confidence interval. After imputation, a one-sample t-test was conducted on the percentage of the total link strength of each co-occurrence item in one interval relative to all prior intervals. This was done according to the following formula:

$$t \, = \overline{X} - \mu_{0} /{\text{SE}},$$

where \(\overline{X}\) denotes the average percentage of the total link strength of the co-occurrence item in all prior intervals, μ0 denotes the percentage of the total link strength of the co-occurrence item in the current interval, and the standard error represents the error of the percentages of the total link strength of the co-occurrence item in all prior intervals.

According to the rules of the one-sample t-test,Footnote 7 significance analysis could not be conducted on the data of the first and second intervals; thus ultimately 14 groups of t-values were obtained. Next, Student’s left-tailed t-distribution test was conducted on the t-values to calculate the significance of the data variations of co-occurrence items across different intervals. Any co-occurrence item having a p-value less than 0.05 was considered significantly changed at that time interval. To avoid any differences in the significance of data variations caused by random imputation, this study performed 10 random imputation iterations on the entire data set. The final imputation and t-test results adopted the average results of 10 random imputation iterations. According to t-test results, the 14 intervals (starting with the third interval), respectively, showed 25, 28, 37, 45, 78, 28, 31, 36, 40, 42, 49, 54, 51, and 56 co-occurrence items (162 in total after deducting redundancy) which showed significant variations in at least one interval.

Classification of items

The interrelationships of the 162 co-occurrence items, which showed significant variations, were explored by classifying them through hierarchical clustering. In light of the significant differences among different items in their percentages of total link strength, Z-score transformation was first performed on the data for each item across the 15 intervals. Further, scikit-learnFootnote 8 was used to analyse the transformed data to produce a dendrogram [59]. The dissimilarities among co-occurrence items were calculated according to average linkage and Euclidean distance metric parameters. According to the exported dendrogram (more details please refer to Additional file 2: Cluster mapR1), the 162 items were classified into seven major clusters based on their variation trends in research “heat”. Figure 1 shows the variations in research heat of all items in each cluster across different intervals, as measured by using Z-score. A high amplitude in Fig. 1 represents a steady increase in research focus rather than an instance of constant high research focus. These amplitude variations are referred to as “heat variations” in the remaining part of this paper. Among them, clusters 1–3 consisted of 80 words presenting a continuous increase in the later stage, while the heat variations of 85 words in clusters 4–7 gradually decreased in the later stage.

Fig. 1
figure 1

Heat variation trends of different clusters across different intervals

Results

Stage 1: analysis results of trend variations

Items that showed significant variations were grouped based on available classification, and five representative groups were selected to analyse their heat trend variations as follows:

Patients: a shift from children and pregnant women to aged patients

According to the data, the focus on child-related items such as “child”, “child preschool”, and “infant” peaked twice in the second and seventh intervals, while the terms “infant, newborn”, “pregnancy”, “pregnancy complications, infectious”, and “caesarean section” corresponding to pregnant women peaked only in the seventh cycle (Fig. 2). Children and pregnant patients present a special set of potential problems, such as a longer incubation period [79], with most recovering within 1–2 weeks after onset [38]. Pregnant women are susceptible to respiratory pathogens due to changes in immune mechanisms and physiological adaptations during pregnancy [47]. In the early stage, owing to the severity of the epidemic, the greatest concern was on the large number of patients, covering the special populations; however, during the middle stage of the epidemic, affecting the overall prevention and control of the epidemic, focus was on the patients belonging to remaining key populations—for example, the inability of some paediatric patients to describe the route of infection—and these presented difficulties to later prevention and screening [67].

Fig. 2
figure 2

Heat variation trends of items related to children, pregnant women, and aged patients across different intervals

The heat variations of the items related to the above-mentioned patient types declined in the later stages as the epidemic eased,Footnote 9 while that related to aged patients increased. The heat variations of the item “aged 80 and over” gradually increased. Compared to younger people, the aged population experienced more severe symptoms [29] and higher mortality rates [48, 80] due to underlying or previous diseases. Considering that most of the existing patients in the later stage of the epidemic in China are severe cases and also that aged patients recover more slowly after infection [72], the aged patients may become the main patient population in late surviving cases.

Clinical characteristics: a shift from common symptoms to severe symptoms and asymptomatic infection

The focus on the most severe illness-related items such as “L-lactate dehydrogenase”, “cytokine release syndrome”, “interleukin-6”, “critical illness”, “hospital mortality”, “C-reactive protein”, and so on increased in the eighth or ninth interval (Fig. 3). The items “leukocyte count”, “lymphocyte count”, “lymphocytes”, and “neutrophils” (neutrophil–lymphocyte ratio) are not specific to severe disease, but clinical characteristics of severe cases present in a different manner than common cases. These severe disease-related items have also been found to be the most relevant to the studies in later stages [51, 61, 83]. The symptoms or indicators of common cases, such as “myalgia”, “diarrhoea”, “fatigue”, “sputum”, and “respiratory sounds”, began to decrease after the third to seventh intervals, respectively, in contrast to the heat variation of the terms relevant to severe cases. However, the clinical characteristics of common cases reached a consensus in the early stages, and the indicators of severe symptoms are in constant turnover due to the complexity of severe disease treatment [46]. Treatment for critical patients still has much room for improvement, as the mortality rate remains high, and thus most studies are constantly updating the critically ill indicators [31, 37, 90].

Fig. 3
figure 3

Heat variation trends of items related to symptoms across different intervals

Notably, asymptomatic infections have been continuously increasing after the sixth and 11th interval in heat variation. Although trends of asymptomatic diseases and asymptomatic infections present in a distinct way, a complementary state exists between their heat variations. Asymptomatic disease-related research is a latecomer. The initial prevention and control of COVID-19 focused on symptomatic patients. However, with the continuation in further studies, most patients were found to suffer from mild symptoms or were asymptomatic [91]. Asymptomatic patients create new pressure for outbreak prevention and control, and whether they are infectious or not remains controversial [23, 25]

Virus testing: a shift from nucleic acid tests to a combination of nucleic acid tests and antibody assays

Nucleic acid test results came under question by many academics in the early stage, due to the issue of false negatives [82, 84] and sensitivity [71]. Therefore, the terms “false negative reactions” and “sensitivity and specificity” increased steeply after the second and third intervals. The problem of false negatives was gradually resolved with the improvement of technology; however, the academic community still emphasized the sensitivity and specificity of the assay [10], with the result that the heat variation of “sensitivity and specificity” lasted longer than that of “false negative reactions”. In the late stage of the epidemic, when the numbers of suspected and confirmed cases in China declined, antibody assays helped to assure a safe reopening of the economy. At the same time, with the emergence of asymptomatic and imported cases, antibody testing has become an important approach to map previous infections, and therefore, later research on virus testing has shifted to antibody testing. The increase in the vital indicators of “immunoglobulin G” and “immunoglobulin M” continued after the ninth interval (Fig. 4).

Fig. 4
figure 4

Heat variation trends of items related to virus testing across different intervals

Drug research: a shift from non-Chinese medicine to Chinese medicine

As the demand for drugs has gradually decreased because of epidemic mitigation in China, most of the items related to drugs show the trend of dropping in the late stage of research, such as “drug therapy, combination”, and the existing drugs “chloroquine”, “indoles”, “lopinavir”, and “ritonavir”. Moreover, researchers’ perceptions of the effects of some drugs changed based on improved research. Early drug adoption relied on severe acute respiratory syndrome (SARS) and Middle East respiratory syndrome (MERS) treatments, such as ritonavir [58], but later, it was found that several medicines such as chloroquine or hydroxychloroquine were associated with huge side effects [6].

Of note, the heat variation of Chinese medicine-related items continues unabated. The heat of “drugs, Chinese herbal” started to increase after the 13th interval, although it declined in the mid-term, and the focus on “medicine, Chinese traditional” increased progressively after the fourth interval and then stabilized. During COVID-19 treatment, a variety of Chinese herbal medicines not only possess obvious efficacy when combined with Western medicine, but also can alleviate the side effects brought by Western medicine. One example is the use of Qingfei Paidu decoction combined with Western medicines such as lopinavir and interferon α2b injection [89]. Lianhua Qingwen capsules exhibit a higher safety profile than the antiviral oseltamivir in the treatment of critical and severe cases of influenza A virus subtype H1N1 in children [52] (Fig. 5).

Fig. 5
figure 5

Heat variation trends of items related to drug research across different intervals

Long-term attention to mental health

The public’s mental health suffered from COVID-19 and may take a longer period to recover compared to physical health. China also began to deploy mental health surveys in January in order to determine the impact of COVID-19 on public mental health [88]. Figure 6 demonstrates that increase in the heat of different research topics related to mental health appeared successively over time; thus overall, mental health maintained a long-term research focus. Research on mental health in China paid close attention to medical staff and people at the epicentre [49] in the early stage of the pandemic, and the attention shifted to the public at large in the middle and late stages [69].

Fig. 6
figure 6

Heat variation trends of items related to mental health across different intervals

Stage 2: analysis results of policy-making

According to data from China’s National Health Commission, 148 policies related to COVID-19 were issued between 30 December 2019 and 26 June 2020.Footnote 10 This study compared the onset of the period of maximum heat in each cluster and the issuance date of the corresponding national policy/guidance programme for each of the five trend changes (Table 1. See the list of policies presented in Additional file 1: Appendix S5). By calculating the differences between the two, an average interval of 8.36 days was found between the issuance of a policy and the maximum heat period of research on related topics. The increase in interest for various clusters followed the release dates of relevant policies and guidelines, which may reflect that the policy plays a certain leading role on related research topics. For example, Diagnosis and Treatment Protocol of COVID-19 (Trial Version 7) released on 4 March 2020 specifies clinical early-warning indicators of severe and critical cases for the first time; these indicators include cytokines, interleukin 6, and C-reactive protein. The significance of items relative to these three indicators began rising extensively after 18 March. Moreover, some particular policy outcomes impacted the scientific research, as reported by some literature studies. For example, when referring to the Prevention and Control Protocol of COVID-19 (Trial Version 6), Ge et al. [26] added that aerosol transmission is a potential transmission route. Liu et al. [50] conducted an experimental study of patient inclusion criteria based on the Diagnosis and Treatment Protocol of COVID-19 (Trial Version 5).

Table 1 Stages of rising heat for various clusters in China’s COVID-19 research and release dates of relevant policies/guidelines

The progress of scientific research is also of vital significance for policy-making [28, 86] and promotes the adaptive adjustment of policies [81]. In the first 2 months after announcing the pandemic situation, the Chinese government adjusted its diagnosis and treatment protocol seven times and revised its protocol for prevention and control six times. The data indicate that the increased focus on some items preceded the release time of relevant policies or guidelines (Table 2), and some of the studies examined herein explicitly suggested that their research results should be used to guide policy. For example, Gao et al. [24] proposed in papers published on 4 February and 19 February, respectively, that chloroquine is an effective treatment for COVID-19, and suggested that chloroquine should be included in the diagnosis and treatment protocol.

Table 2 Stages of rising heat for different items in China’s COVID-19 research and release dates of relevant policies and guidelines

The Diagnosis and Treatment Protocol of COVID-19 (Trial Versions 6 and 7), released on 19 February and 4 March, respectively, both included chloroquine as a recommended drug. Later, with the further enrichment of clinical trial data on chloroquine, the “Notice on Adjusting the Usage and Dosage of Chloroquine Phosphate in Treating COVID-19 on a Trial Basis”, published on 28 February 2020 further adjusted the usage and dosage recommendations for chloroquine. Moreover, “masks”, “infectious disease transmission, patient-to-professional”, “patient discharge”, and “telemedicine” also showed similar time differences between the stage of rising heat of an item and the release of relevant policies or guidelines (see Table 2). Thus, the research foci identified in this study may affect the formulation of COVID-19 policies and guidelines in China.

Discussion

Notably, this study did not trace scientific research evolution supported by policy attributed to the lack of solid references presenting connection between policies and research output. However, in this study, it was observed that the trends of scientific research and related policy changes were closely intertwined in the early stage of COVID-19. This result is based on the calculation of the coincident periods between heat variation in the main themes of scientific research and the centralized enactment of relevant policies. A similar dynamic trend is a manifestation of two-way feedback and adjustment which was emphasized by the CEM. Furthermore, the available evidence indicates that early COVID-19 scientific research and related policies influenced each other. Consequently, the CEM of policy-making was reflected in the early stage of the outbreak in China, consistent with the policy documents published by government agencies and think tanks from 114 countries as presented by Yin et al. [85]. This result is opposed to the opinion proposed by Khazragui and Hudson [44] and Haunschild and Bornmann [33], that only a single piece of research has a decisive influence on policy. Policy-making and scientific research are both gradual processes. Scientific research is the practice of resolving scientific disputes [14] and aims to approach the truth [2]. Given that policies are usually a step behind technological development, it is necessary for them to be constantly updated [54] or to be given adaptive adjustments in response to emerging issues [81]. Policy-makers rely on the participation of other parties concerned with the dynamic adjustment of policies, and scientists within the same sociotechnological circles need to maintain continuous interactions with policies [17, 70]. Importantly, the mission of modern science is not only to create new knowledge, but also to use existing and new scientific knowledge to solve societal problems [63]; thus the policy-making process concerning or depending on science and technology needs to be guided by scientific knowledge [27, 77]. The Global Preparedness Monitoring Board calls for responsible leaders to act decisively based on science, evidence and best practices, and the interest of the people. Zhang et al. [89] also argued that the findings of academia pertaining to public health emergencies may offer a key reference for health policy-making. The Chinese government addressed this during the formulation and revision of the diagnosis and treatment and other protocol for COVID-19, wherein the available medical research evidence was fully considered. Moreover, they scientifically and prudently maximized consensus-building in the press conference of the Joint Prevention and Control Mechanism of the State Council.Footnote 11 It is additional proof of the existence of CEM in Chinese COVID-19 policy formulation.

The coevolution between SAP in the early phase of the COVID-19 pandemic in China also shows individual characteristics that distinguish it from those of other countries. This can be discussed from the following two perspectives:

First, although most of China’s COVID-19 policies are promulgated by the government, the role played by scientific experts in the formulation of some policies is elevated from that of adviser to decisionist. All 148 new Chinese policies related to COVID-19 were promulgated and coordinated by government agencies. This result is in sharp contrast to the conclusion by Yin et al. [85], who reported a low likelihood of the national government citing scientific papers in formulating COVID-19-related policy. About 36.49% of all policies were enacted by the Joint Prevention and Control Mechanism of the State Council in Response to the Novel Coronavirus Pneumonia. The mechanism was launched by the State Council on 20 January 2020 to respond to the severe and specific infectious pneumonia epidemic, with the establishment of a Scientific Research Group, including teams belonging to Nanshan Zhong, Lanjuan Li, and Chen Wang.Footnote 12 In addition to the medical treatment on the front line, these teams incorporated some effective clinical experience into the treatment protocol, which provided scientific and reasonable judgements and recommendations for the prevention and control of the pandemic, and further revised and improved relevant prevention and control measures. Of note, the Scientific Research Group was able to enact certain medical policies without the involvement of politicians. For example, on 25 February 2020, the Scientific Research Group of the Joint Prevention and Control Mechanism of the State Council in Response to the Novel Coronavirus Pneumonia issued a “Notice on Regulating Medical Institutions to Conduct Clinical Studies on the Drug Treatment of Novel Coronavirus Pneumonia”. Therefore, in China, the COVID-19 policy-making approach adopted an “advisers advise and decide” model in the early period, which is different from the “advisers advise and ministers decide” model used in the COVID-19 policy-making in the United Kingdom [3]. Moreover, the “decisionist model” of China’s industrial policy-making was discussed by Chen et al. [11]. The “advisers advise and decide” model may be the fruit of the establishment of an advisory system for the formulation of major science and technology policies in recent years [53]. Although most Chinese policies are initiated or coordinated by the government [68], China has attempted to adjust its policy-setting agenda to be more scientific [75]. Two examples are presented as follows: the establishment of the National Science and Technology Decision-making Advisory Committee in 2017 [19], and an attempt to develop the National Outlines for Medium and Long-term Planning for Scientific and Technological Development (2006–2020, 2021–2035) with the joint participation of the Chinese Academy of Sciences, the Chinese Academy of Engineering, and the Chinese Academy of Social Sciences in the “strategy consultation” mechanism [74].

Second, in China, early policy-making on COVID-19 gave more importance to prior clinical practice, unlike other countries that relied more on statistical modelling. The results of clinical or prevention practice became the main reference for the development of the Diagnosis and Treatment Protocol and Prevention and Control Protocol of COVID-19 in China. The development of COVID-19-related policy in China embraced a model of policy-making while practicing. In other words, whether decisions based on scientific research should be included in policy documents is based on the results of preliminary clinical trials, and revisions are kept for later if any new results are found. The concept that policy-making goes hand in hand with practice is distinct from the traditional notion of some countries that rely on modelling in their policy-making process, for example, during the 2009 swine flu epidemic in the United Kingdom [5]. Modelling remains an important reference for policy formulation in Europe and the United States during the COVID-19 outbreak [12]. In contrast, clinical practice provides more accurate reference information than modelling, and takes into account differences in effects brought by various objects or settings. Modelling provides the reference information at a relatively fast rate and eliminates the need for and risk of conducting clinical investigations in patients under conditions of considerable uncertainty in the early period [35, 65]. Boden and McKendrick [7] considered modelling the most ethical method. Modelling results are also included in consideration of the initial phase after weighing the pros and cons between practice and modelling, such as in case of hydroxychloroquine. About 100 drugs were selected for in vivo experiments on the activity of the novel coronavirus via computer simulation screening and so on. Based on multiple rounds of screening, the Scientific Research Group concentrated on a few drugs such as hydroxychloroquine.Footnote 13 Hydroxychloroquine was recommended in the Diagnosis and Treatment Protocol of COVID-19 (Trial Version 6) according to the results of initial clinical trials. The clinical trial results for more than 100 patients were accumulated before listing the drug in the treatment protocol.Footnote 14 However, the dose, drug regimens, and target patients of hydroxychloroquine standardized in the Diagnosis and Treatment Protocol of COVID-19 (Trial Version 7) were further tested based on additional clinical studies, which showed that overdose of chloroquine may cause damage to the heart and retina. Consequently, in the earliest stage, the candidate methods for treatment and prevention depend on the model results; nonetheless, the formal enrolment in the policy is principally judged by the practical results.

Excluding the difference from other countries, the coevolution of SAP under emergencies also presents some features apart from other domains: science tends to exert a rapid and direct influence on policy formulation in the early period of public health emergencies. The model of policy-making under peacetime is no longer applicable in times of war, such as in the COVID-19 scenario [3, 77]. The high frequency of COVID-19-related policy enactment in the early stages of the pandemic in China exhibited a rapid coevolution between SAP, demonstrating that the response to the emergency needs to run at a faster pace than pandemic development [3]. Importantly, this is different from its progress in the formulation of climate change policies, where it has proven to be difficult to reach a consensus between scientists and government officials even after much discussion [41, 76]. Edmondson [17] reported that the interactions between SAP with respect to the CEM are also affected by external factors such as catastrophic events. Considering the urgency and unknown nature of the epidemic, rapid response is essential to plan for and mitigate further impact [56]. Furthermore, the process of science–policy interaction during any public health emergency may be simplified, with SAP tending to form a direct relationship with each other. Van Zwanenberg and Millstone [92] addressed the concept of coevolution of SAP and mentioned that the interaction between SAP might be influenced by cultural, political, and other contextual factors. Gormley [27] argued that policy could be formed after public opinion on scientific issues was shaped by media coverage. The process of SAP interaction may be slowed with the increase in the influencing factors that need to be considered. In the early period of COVID-19, the government mainly focused on exploring and controlling the pandemic; as a result, the research, prevention, and control under important scientific guidance became the priority. Other themes such as economic recovery and social functioning began to be on the agenda of policy-making after the pandemic was under control. Notably, a difference has been reflected in the COVID-19-related policy between the early period and late period (Additional file 1: Appendix S5). It also proves that scientific information has been regarded as principal evidence to be considered in the early-period policy-making of public health emergencies, even science, and technology-based emergencies. The influence that science information brought to policy consultation can be possibly transferred from being direct and fast in the early period to conditional and uncertain in the later stage, as other factors such as culture, economy, and politics also start playing their role. As a result, the role played by science is destined to diminish to a supportive position.

Some controversial aspects of policy advisory science can also be observed. For instance, Weible et al. [77] mentioned that scientific research contributed to inform and legitimize decision-making, which could be used to obscure the government’s and policy-makers’ responsibility for policy responses and outcomes. Furthermore, Durnová [15] argued that emotions are a crucial part of policy-making. However, the role of emotions and their impact on legitimizing decisions and achieving desired outcomes are likely to be overlooked if excessive attention is focused on the role of scientific research.

Strengths and limitations

This study presents a manifestation of the CEM for SAP, as well as an effective approach to measure the interaction between SAP, while policies simultaneously lack references to the original scientific findings. It not only favours the construction of unbiased approaches to extract scientific evidence for framing policies for future, but also may be beneficial to bridge the gap that exists between SAP, which is discussed based on extensive health and public health literature [8]. This research also serves as a complementary case to the dynamic relationship between SAP at the global scale during the COVID-19 outbreak. However, the other link for the mutual interaction between the two can be further explored by combing scientific paper citation information or interviewing experts and by other methods. Multiple types of scientific information are available for reference during policy formulation. The influence of scientific research on policy-making is not limited to scientific papers, but includes the interactions between scientists and policy-makers and clinical trials [66, 86]. For example, clinical trial results also act as reference for important scientific information, which may also be cited before they are published. This may also be a reason why Chinese policies do not offer scientific reference. Scientific information other than scientific papers needs to be obtained in the future. Moreover, in this study, it was also noticed that policy plays a certain role in leading research questions in COVID-19, and the examples are presented in part 3.2. How and to what extent policies prompt the scientific research questions could be a direction for our future research. The timescale of this study was about 6 months; future studies may find it profitable to use a longer timescale. A base time interval of 10 days was adopted to investigate variations in research trends, but there may be other better division schemes.

Conclusions

Considering that scientific research is a process of solving problems and resolving disputes, the following findings can be drawn from this study. First, a similar dynamic trend was reflected between scientific research and related policy in early period of the COVID-19 outbreak in China, wherein an average interval of 8.36 days was observed between policy disclosure and the intensive publication period of related research. Second, issues such as aged patients, asymptomatic infections, critical care, and antibody testing may be of concern in the later stages of prevention and control. Mental health has remained under-researched and thus a significant challenge in China’s fight against COVID-19, and the sensitivity and specificity of nucleic acid tests still require improvement. Third, the application of Chinese medicine in the treatment of COVID-19 is gaining more recognition in China, while essential involvement of herbal medicine in the treatment of COVID-19 has been further improved.

In their review on the existing global COVID-19 literature, Haghani et al. [30] discovered that most studies have focused on drug safety, where clinical characteristics, treatment, mental health, and nucleic acid and antibody test research are particularly prominent among global studies [1]. This reflects the fact that these issues tend to be common problems faced globally that prompt the strengthening of international collaboration [45], resulting in an unprecedented intensity of international collaborative research during COVID-19.Footnote 15 However, the specific circumstances of the epidemic vary from country to country, and based on this, each country has developed its own countermeasures, such as traditional Chinese medicine. Our study collected research trends of COVID-19 research in the United States which did not include Chinese medicine. Differences in pharmacology between Chinese and Western medical systems cannot be avoided; thus, studies on Chinese herbal medicine and COVID-19 appear more frequently in Chinese journals than in English journals [20].

Availability of data and materials

All data generated or analysed during this study are included in this published article, its Additional file 1 and 3.

Notes

  1. https://www.forbes.com/sites/startswithabang/2020/04/07/the-3-ways-science-will-get-us-through-the-covid-19-pandemic/#39ee6ca52fc3.

  2. http://www.chinadaily.com.cn/a/202004/06/WS5e8b2f5aa31012821728496b_2.html.

  3. https://covid-19.dimensions.ai/.

  4. (("2019-nCoV"[All Fields] OR "COVID-19"[All Fields] OR "SARS-CoV-2"[All Fields] OR "hcov"[All Fields] OR "NCOVID-19"[All Fields] OR "severe acute respiratory syndrome coronavirus 2"[All Fields]) AND ("CHINA"[Affiliation])).

  5. The percentage of the total link strength of a given co-occurrence item equals the total link strength of the given co-occurrence item divided by the sum of the total link strengths of all co-occurrence items.

  6. The numbers of co-occurrence items in each of the 16 intervals were 22, 72, 109, 168, 254, 319, 396, 534, 675, 794, 913, 1043, 1162, 1265, 1347, and 1424.

  7. A one-sample t-test compares target data and test data. The first step is to determine whether the data for a particular item in a particular interval differ from the data for that same item in the previous interval. If so, the data in that interval are adopted as target data, while the data in the previous interval are adopted as test data. Data from at least two previous intervals are required for comparison with the target data. For this reason, no t-test was performed on the second or third intervals. (Recall that the first interval was already discarded for other reasons.) After deleting these two intervals, 14 groups of t-values were ultimately obtained.

  8. Scikit-learn is a Python-based machine learning library.

  9. According to Worldometer, the number of confirmed cases of COVID-19 in China declined rapidly after mid-February 2020, in particular after March 6, when the number of daily new cases dropped below 100; thus the discussion about fever declined at a later stage.

  10. These data are available as of 1 April 2021.

  11. Referring to the press conference of the Joint Prevention and Control Mechanism of the State Council held on 5 February 2020.

  12. Referring to the press conference of the Joint Prevention and Control Mechanism of the State Council held on 7 February 2020.

  13. Referring to the press conference of the Joint Prevention and Control Mechanism of the State Council held on 15 February 2020.

  14. Referring to the press conference of the Joint Prevention and Control Mechanism of the State Council held on 15 February 2020.

  15. https://www.nytimes.com/2020/04/01/world/europe/coronavirus-science-research-cooperation.html

Abbreviations

CEM:

Coevolution model

EBPM:

Evidence-based policy-making

MERS:

Middle East respiratory syndrome

SAP:

Science and policy

SARS:

Severe acute respiratory syndrome

References

  1. Abd-Alrazaq A, Schneider J, Mifsud B, Alam T, Househ M, Hamdi M, Shah Z. A comprehensive overview of the COVID-19 literature: machine learning-based bibliometric analysis. J Med Internet Res. 2021;23(3):e23703.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Anderson A, Petersen A, Wilkinson C, Allan S. Nanotechnology, risk and communication. Berlin: Springer; 2009.

  3. Atkinson P, Gobat N, Lant S, Mableson H, Pilbeam C, Solomon T, Tonkin-Crine S, Sheard S. Understanding the policy dynamics of COVID-19 in the UK: early findings from interviews with policy makers and health care professionals. Soc Sci Med. 2020;1982(266):113423–113423.

    Article  Google Scholar 

  4. Baron J. A brief history of evidence-based policy. Annals Am Acad Polit Social Sci. 2018;678(1):40–50.

    Article  Google Scholar 

  5. Berridge V, Taylor S. The problems of commissioned oral history: the swine flu ’crisis’ of 2009. Oral Hist. 2019;47(2):86–94.

    Google Scholar 

  6. Borba MGS, Val FFA, Sampaio VS, Alexandre MAA, Melo GC, Brito M, Guerra MVF. Effect of high vs low doses of chloroquine diphosphate as adjunctive therapy for patients hospitalized with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection: a randomized clinical trial. JAMA Netw Open. 2020;3(4):e208857–e208857.

    Article  PubMed  Google Scholar 

  7. Boden LA, McKendrick IJ. Model-based policymaking: a framework to promote ethical “good practice” in mathematical modeling for public health policymaking. Front Public Health. 2017;5:68.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Cairney P, Oliver K. Evidence-based policymaking is not like evidence-based medicine, so how far should you go to bridge the divide between evidence and policy? Health Res Policy Syst. 2017;15(1):1–11.

    Article  Google Scholar 

  9. Cerqueira V, Torgo L, Smailović J, Mozetič I. A comparative study of performance estimation methods for time series forecasting. Paper presented at the 2017 IEEE international conference on data science and advanced analytics (DSAA). 2017.

  10. Chan JF, Yip CC, To KK, Tang TH, Wong SC, Leung KH, Yuen KY. Improved molecular diagnosis of COVID-19 by the novel, highly sensitive and specific COVID-19-RdRp/Hel Real-time reverse transcription-PCR assay validated in vitro and with clinical specimens. J Clin Microbiol. 2020. https://0-doi-org.brum.beds.ac.uk/10.1128/JCM.00310-20.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Chen L, Naughton B. An institutionalized policy-making mechanism: China’s return to techno-industrial policy. Res Policy. 2016;45(10):2138–52.

    Article  Google Scholar 

  12. Cheng X, Zhou MT, Tang L, Wang GY. Same pandemic but different studies: an exploration of COVID-19 research at the early stage. Eur Rev Med Pharmacol Sci. 2020;24(23):12545–57.

    CAS  PubMed  Google Scholar 

  13. De Jong SP, Smit J, Van Drooge L. Scientists’ response to societal impact policies: a policy paradox. Sci Public Policy. 2015;43(1):102–14.

    Article  Google Scholar 

  14. Dunlop L, Veneu F. Controversies in science. Sci Educ. 2019;28(6):689–710.

    Article  Google Scholar 

  15. Durnová AP. Understanding emotions in post-factual politics: negotiating truth. Cheltenham: Edward Elgar Publishing; 2019.

    Book  Google Scholar 

  16. van Eck NJ, Waltman L. VOSviewer manual. Leiden Univeristeit Leiden. 2013;1(1):1–53.

    Google Scholar 

  17. Edmondson DL, Kern F, Rogge KS. The co-evolution of policy mixes and socio-technical systems: towards a conceptual framework of policy mix feedback in sustainability transitions. Research Policy. 2019;48(10):103555.

    Article  Google Scholar 

  18. Ehrlich PR, Raven PH. Butterflies and plants: a study in coevolution. Evolution. 1964;18(4):586–608.

    Article  Google Scholar 

  19. Fan CL. Science advice institution for policy making and think tank building. Sci Society. 2017;7(3):79–93.

    Google Scholar 

  20. Fan J, Gao Y, Zhao N, Dai R, Zhang H, Feng X, Hambly BD. Bibliometric analysis on COVID-19: a comparison of research between English and Chinese studies. Front Public Health. 2020;8:477.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Fortunato S, Bergstrom CT, Börner K, Evans JA, Helbing D, Milojević S, Uzzi B. Science of science. Science. 2018;359(6379):eaao0185.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  22. Gallardo L, Barraza F, Ceballos A, Galleguillos M, Huneeus N, Lambert F, Osses M. Evolution of air quality in Santiago: the role of mobility and lessons from the science-policy interface. Elementa Sci Anthropocene. 2018;6(1):38.

    Article  Google Scholar 

  23. Gao J, Tian Z, Yang X. Breakthrough: chloroquine phosphate has shown apparent efficacy in treatment of COVID-19 associated pneumonia in clinical studies. Biosci Trends. 2020;14(1):72–3.

    Article  CAS  PubMed  Google Scholar 

  24. Gao M, Yang L, Chen X, Deng Y, Yang S, Xu H, Gao X. A study on infectivity of asymptomatic SARS-CoV-2 carriers. Respir Med. 2020;169: 106026. https://0-doi-org.brum.beds.ac.uk/10.1016/j.rmed.2020.106026.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Gao Z, Xu Y, Sun C, Wang X, Guo Y, Qiu S, Ma K. A systematic review of asymptomatic infections with COVID-19. J Microbiol Immunol Infect. 2021;54(1):12–6. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jmii.2020.05.001.

    Article  CAS  PubMed  Google Scholar 

  26. Ge ZY, Yang LM, Xia JJ, Fu XH, Zhang YZ. Possible aerosol transmission of COVID-19 and special precautions in dentistry. J Zhejiang Univ Science B. 2020;21(5):361–8.

    Article  CAS  Google Scholar 

  27. Gormley WT. From science to policy in early childhood education. Science. 2011;333(6045):978–81.

    Article  CAS  PubMed  Google Scholar 

  28. Gortmaker SL, Swinburn BA, Levy D, Carter R, Mabry PL, Finegood DT, Moodie ML. Changing the future of obesity: science, policy, and action. Lancet. 2011;378(9793):838–47. https://0-doi-org.brum.beds.ac.uk/10.1016/S0140-6736(11)60815-5.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Guo T, Shen Q, Guo W, He W, Li J, Zhang Y, Peng H. Clinical Characteristics of elderly patients with COVID-19 in Hunan Province, China: a multicenter retrospective study. Gerontology. 2020;66(5):467–75. https://0-doi-org.brum.beds.ac.uk/10.1159/000508734.

    Article  CAS  PubMed  Google Scholar 

  30. Haghani M, Bliemer MC, Goerlandt F, Li J. The scientific literature on Coronaviruses, COVID-19 and its associated safety-related research dimensions: a scientometric analysis and scoping review. Safety Sci. 2020;129:104806.

    Article  Google Scholar 

  31. Han Y, Zhang H, Mu S, Wei W, Jin C, Tong C, Gu G. Lactate dehydrogenase, an independent risk factor of severe COVID-19 patients: a retrospective and observational study. Aging (Albany NY). 2020;12(12):11245–58. https://0-doi-org.brum.beds.ac.uk/10.18632/aging.103372.

    Article  CAS  Google Scholar 

  32. Haskins R. Evidence-based policy: the movement, the goals, the issues, the promise. Ann Am Acad Pol Soc Sci. 2018;678(7):8–37.

    Article  Google Scholar 

  33. Haunschild R, Bornmann L. How many scientific papers are mentioned in policy-related documents? An empirical investigation using Web of Science and Altmetric data. Scientometrics. 2017;110(3):1209–16.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Hechenbleikner EM, Samarov DV, Lin E. Data explosion during COVID-19: a call for collaboration with the tech industry & data scrutiny. EClinicalMedicine. 2020;23:100377. https://0-doi-org.brum.beds.ac.uk/10.1016/j.eclinm.2020.100377.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Heesterbeek H, Anderson RM, Andreasen V, Bansal S, De Angelis D, Dye C, Institute Isaac Newton, Collaboration IDD. Modeling infectious disease dynamics in the complex landscape of global health. Science. 2015;347(6227):aaa4339.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  36. Heffernan K, Teufel S. Identifying problems and solutions in scientific text. Scientometrics. 2018;116(2):1367–82.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Henry BM, Aggarwal G, Wong J, Benoit S, Vikse J, Plebani M, Lippi G. Lactate dehydrogenase levels predict coronavirus disease 2019 (COVID-19) severity and mortality: a pooled analysis. Am J Emerg Med. 2020;38(9):1722–6. https://0-doi-org.brum.beds.ac.uk/10.1016/j.ajem.2020.05.073.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Hong H, Wang Y, Chung HT, Chen CJ. Clinical characteristics of novel coronavirus disease 2019 (COVID-19) in newborns, infants and children. Pediatr Neonatol. 2020;61(2):131–2. https://0-doi-org.brum.beds.ac.uk/10.1016/j.pedneo.2020.03.001.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Hotta LK, Morettin PA, Pereira PLV. The effect of overlapping aggregation on time series models: an application to the unemployment rate in Brazil. Braz Rev Econometrics. 1992;12(2):223–41.

    Article  Google Scholar 

  40. Howlett M. Policy analytical capacity and evidence-based policy-making: lessons from Canada. Can Public Adm. 2009;52(2):153–75.

    Article  Google Scholar 

  41. Humphreys D. Working across boundaries: science–policy interfaces and international forest politics. Environ Sci. 2009;6(3):163–74.

    Google Scholar 

  42. Hunt LA. Missing data imputation and its effect on the accuracy of classification. In: Data Science. Berlin: Springer; 2017.

  43. Jeon Y, McCurdy TH. Time-varying window length for correlation forecasts. Econometrics. 2017;5(4):54.

    Article  Google Scholar 

  44. Khazragui H, Hudson J. Measuring the benefits of university research: impact and the REF in the UK. Res Eval. 2015;24(1):51–62.

    Article  Google Scholar 

  45. Lee JJ, Haupt JP. Scientific globalism during a global crisis: research collaboration and open access publications on COVID-19. High Educ. 2021;81:949–66.

    Article  Google Scholar 

  46. Li X, Liu C, Mao Z, Xiao M, Wang L, Qi S, Zhou F. Predictive values of neutrophil-to-lymphocyte ratio on disease severity and mortality in COVID-19 patients: a systematic review and meta-analysis. Crit Care. 2020;24(1):647. https://0-doi-org.brum.beds.ac.uk/10.1186/s13054-020-03374-8.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Liu K, Chen Y, Lin R, Han K. Clinical features of COVID-19 in elderly patients: a comparison with young and middle-aged patients. J Infect. 2020;80(6):e14–8. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jinf.2020.03.005.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Liu F, Zhu Y, Zhang J, Li Y, Peng Z. Intravenous high-dose vitamin C for the treatment of severe COVID-19: study protocol for a multicentre randomised controlled trial. BMJ open. 2020;10(7):039519.

    Article  Google Scholar 

  49. Liu D, Li L, Wu X, Zheng D, Wang J, Yang L, Zheng C. Pregnancy and perinatal outcomes of women with coronavirus disease (COVID-19) pneumonia: a preliminary analysis. AJR Am J Roentgenol. 2020;215(1):127–32. https://0-doi-org.brum.beds.ac.uk/10.2214/AJR.20.23072.

    Article  PubMed  Google Scholar 

  50. Liu S, Yang L, Zhang C, Xiang YT, Liu Z, Hu S, Zhang B. Online mental health services in China during the COVID-19 outbreak. Lancet Psychiatry. 2020;7(4):e17–8. https://0-doi-org.brum.beds.ac.uk/10.1016/S2215-0366(20)30077-8.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Lu J, Zhang Y, Cheng G, He J, Wu F, Hu H, Chen Z. Clinical characteristics and outcomes of adult critically ill patients with COVID-19 in Honghu, Hubei Province. Nan Fang Yi Ke Da Xue Xue Bao. 2020;40(6):778–85. https://0-doi-org.brum.beds.ac.uk/10.12122/j.issn.1673-4254.2020.06.02.

    Article  CAS  PubMed  Google Scholar 

  52. Luo H, Gao Y, Zou J, Zhang S, Chen H, Liu Q, Wang S. Reflections on treatment of COVID-19 with traditional Chinese medicine. Chin Med. 2020;15:94. https://0-doi-org.brum.beds.ac.uk/10.1186/s13020-020-00375-1.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  53. Lyu J, Wen K. Coordinated model of evidence-based policy making: new framework towards state governance system and capacity. Bull Chin Acad Sci. 2020;35(5):602–10.

    Google Scholar 

  54. McLaren D, Markusson N. The co-evolution of technological promises, modelling, policies and climate change targets. Nat Clim Chang. 2020;10(5):392–7.

    Article  Google Scholar 

  55. Millstone E. Science, risk and governance: Radical rhetorics and the realities of reform in food safety governance. Res Policy. 2009;38(4):624–36.

    Article  Google Scholar 

  56. Mitchell OJ, Doran O, Yuriditsky E, Root C, Teran F, Ma K, Abella BS. Rapid response system adaptations at 40 US hospitals during the COVID-19 pandemic. Resuscitation Plus. 2021;6:100121.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Morrison M, de Saille S. CRISPR in context: towards a socially responsible debate on embryo editing. Palgrave Commun. 2019;5(1):1–9.

    Article  Google Scholar 

  58. Morse JS, Lalonde T, Xu S, Liu WR. Learning from the past: possible urgent prevention and treatment options for severe acute respiratory infections caused by 2019-nCoV. ChemBioChem. 2020;21(5):730–8. https://0-doi-org.brum.beds.ac.uk/10.1002/cbic.202000047.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  59. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Dubourg V. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011;12:2825–30.

    Google Scholar 

  60. Petropoulos F, Makridakis S. Forecasting the novel coronavirus COVID-19. PLoS ONE. 2020;15(3): e0231236. https://0-doi-org.brum.beds.ac.uk/10.1371/journal.pone.0231236.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  61. Qin C, Zhou L, Hu Z, Zhang S, Yang S, Tao Y, Tian DS. Dysregulation of immune response in patients with coronavirus 2019 (COVID-19) in Wuhan, China. Clin Infect Dis. 2020;71(15):762–8. https://0-doi-org.brum.beds.ac.uk/10.1093/cid/ciaa248.

    Article  CAS  PubMed  Google Scholar 

  62. Roosa K, Lee Y, Luo R, Kirpich A, Rothenberg R, Hyman JM, Chowell G. Short-term Forecasts of the COVID-19 Epidemic in Guangdong and Zhejiang, China: February 13–23, 2020. J Clin Med. 2020. https://0-doi-org.brum.beds.ac.uk/10.3390/jcm9020596.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Rosen J. Help to shape policy with your science. Nature. 2018;560(7719):671–4.

    Article  CAS  PubMed  Google Scholar 

  64. Sanderson I. Evaluation, policy learning and evidence-based policy making. Public Admin. 2002;80(1):1–22.

    Article  Google Scholar 

  65. Siettos CI, Russo L. Mathematical modeling of infectious disease dynamics. Virulence. 2013;4(4):295–306.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Stine DD. Science and technology policymaking: a primer. Darby: DIANE Publishing; 2009.

  67. Su L, Ma X, Yu H, Zhang Z, Bian P, Han Y, Geng J. The different clinical characteristics of corona virus disease cases between children and their families in China–the character of children with COVID-19. Emer Microb Infect. 2020;9(1):707–13.

    Article  CAS  Google Scholar 

  68. Sun Y, Cao C. The evolving relations between government agencies of innovation policymaking in emerging economies: a policy network approach and its application to the Chinese case. Res Policy. 2018;47(3):592–605.

    Article  Google Scholar 

  69. Tian F, Li H, Tian S, Yang J, Shao J, Tian C. Psychological symptoms of ordinary Chinese citizens based on SCL-90 during the level I emergency response to COVID-19. Psychiatry Res. 2020;288: 112992. https://0-doi-org.brum.beds.ac.uk/10.1016/j.psychres.2020.112992.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  70. Turnheim B, Berkhout F, Geels F, Hof A, McMeekin A, Nykvist B, van Vuuren D. Evaluating sustainability transitions pathways: bridging analytical approaches to address governance challenges. Glob Environ Chang. 2015;35:239–53.

    Article  Google Scholar 

  71. Udugama B, Kadhiresan P, Kozlowski HN, Malekjahani A, Osborne M, Li VYC, Chan WCW. Diagnosing COVID-19: the disease and tools for detection. ACS Nano. 2020;14(4):3822–35. https://0-doi-org.brum.beds.ac.uk/10.1021/acsnano.0c02624.

    Article  CAS  PubMed  Google Scholar 

  72. Voinsky I, Baristaite G, Gurwitz D. Effects of age and sex on recovery from COVID-19: analysis of 5769 Israeli patients. J Infect. 2020;81(2):e102–3. https://0-doi-org.brum.beds.ac.uk/10.1016/j.jinf.2020.05.026.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  73. Wan JB, Xie GF, Lin H, Zhao LX. Comparative study on science and technology innovation policy-making and advisory system. Bull Chin Acad Sci. 2017;32(6):601–11.

    Google Scholar 

  74. Wan K, Shackley S, Doherty RM, Shi Z, Zhang P, Golding N. Science-policy interplay on air pollution governance in China. Environ Sci Policy. 2020;107:150–7.

    Article  Google Scholar 

  75. Wang S. Changing models of China’s policy agenda setting. Modern China. 2008;34(1):56–87.

    Article  CAS  Google Scholar 

  76. Watson RT. Turning science into policy: challenges and experiences from the science–policy interface. Philos Transact R Society B Biol Sci. 2005;360(1454):471–7.

    Article  Google Scholar 

  77. Weible CM, Nohrstedt D, Cairney P, Carter DP, Stone D. COVID-19 and the policy sciences: initial reactions and perspectives. Policy Sci. 2020;53:225–41. https://0-doi-org.brum.beds.ac.uk/10.1007/s11077-020-09381-4.

    Article  Google Scholar 

  78. Wei J. Research on evidence-based decision making in the era of big data: an analytical framework. Forum Sci Technol China. 2020;7:24–32.

    Google Scholar 

  79. Wei M, Yuan J, Liu Y, Fu T, Yu X, Zhang ZJ. Novel coronavirus infection in hospitalized infants under 1 year of age in China. JAMA. 2020;323(13):1313–4. https://0-doi-org.brum.beds.ac.uk/10.1001/jama.2020.2131.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  80. Wei C, Liu Y, Liu Y, Zhang K, Su D, Zhong M, Meng X. Clinical characteristics and manifestations in older patients with COVID-19. BMC Geriatr. 2020;20(1):395. https://0-doi-org.brum.beds.ac.uk/10.1186/s12877-020-01811-5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  81. Wise RM, Fazey I, Smith MS, Park SE, Eakin H, Van Garderen EA, Campbell B. Reconceptualising adaptation to climate change as part of pathways of change and response. Glob Environ Chang. 2014;28:325–36.

    Article  Google Scholar 

  82. Woloshin S, Patel N, Kesselheim AS. False negative tests for SARS-CoV-2 infection—challenges and implications. N Engl J Med. 2020;383(6):38.

    Article  Google Scholar 

  83. Yan Y, Yang Y, Wang F, Ren H, Zhang S, Shi X, Dong K. Clinical characteristics and outcomes of patients with severe covid-19 with diabetes. BMJ Open Diabetes Res Care. 2020. https://0-doi-org.brum.beds.ac.uk/10.1136/bmjdrc-2020-001343.

    Article  PubMed  PubMed Central  Google Scholar 

  84. Yang W, Yan F. Patients with RT-PCR-confirmed COVID-19 and Normal Chest CT. Radiology. 2020;295(2):E3. https://0-doi-org.brum.beds.ac.uk/10.1148/radiol.2020200702.

    Article  PubMed  Google Scholar 

  85. Yin Y, Gao J, Jones BF, Wang D. Coevolution of policy and science during the pandemic. Science. 2021;371(6525):128–30. https://0-doi-org.brum.beds.ac.uk/10.1126/science.abe3084.

    Article  CAS  PubMed  Google Scholar 

  86. Youtie J, Bozeman B, Jabbehdari S, Kao A. Credibility and use of scientific and technical information in policy making: An analysis of the information bases of the National Research Council’s committee reports. Res Policy. 2017;46(1):108–20.

    Article  Google Scholar 

  87. Yu JL, Yao Q. From data to evidence: research on the construction of evidence-based policy-making mechanism in the era of Big Data. Chin Public Admin. 2020;418(4):81–7.

    Google Scholar 

  88. Zhang Y, Ma ZF. Impact of the COVID-19 pandemic on mental health and quality of life among local residents in Liaoning Province, China: a cross-sectional study. Int J Environ Res Public Health. 2020;17(7):2381.

    Article  CAS  PubMed Central  Google Scholar 

  89. Zhang L, Zhao W, Sun B, Huang Y, Glänzel W. How scientific research reacts to international public health emergencies: a global analysis of response patterns. Scientometrics. 2020;124:747–73.

    Article  CAS  Google Scholar 

  90. Zhao H, Lu X, Deng Y, Tang Y, Lu J. COVID-19: asymptomatic carrier transmission is an underestimated problem. Epidemiol Infect. 2020;148:E116. https://0-doi-org.brum.beds.ac.uk/10.1017/S0950268820001235.

    Article  PubMed  Google Scholar 

  91. Zhao Z, Xie J, Yin M, Yang Y, Ding C, Gao Y, Ma X. Interleukin-6 and severity of COVID-19 patients in Hefei, China. Med Mal Infect. 2020;50(7):629–31. https://0-doi-org.brum.beds.ac.uk/10.1016/j.medmal.2020.06.005.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  92. Zwanenburg PV, Millstone E. BSE: risk, science, and governance. Oxford: Oxford University Press; 2005.

    Book  Google Scholar 

Download references

Acknowledgements

The author wishes to thank MA Qian Jingnan for her assistance with the images depicted in this manuscript.

Funding

This research was supported by the Postdoctoral Research Foundation of China (Grant 2020M671569) and the Key Project of the China National Social Science Fund (Grant 20FXWA003).

Author information

Authors and Affiliations

Authors

Contributions

All authors were involved in the conception and design of the study. XC drafted the manuscript and collected and interpreted the data. MT provided medical information and helped with the data analysis. LT and GW provided key opinions and revised the manuscript. GY supervised the research process. All authors read and approved the final manuscript.

Authors' information

Dr Xi Cheng, postdoctorate in the Department of Digital Communication, Soochow University, Suzhou, China.

Dr Li Tang, full professor in the Department of Public Administration, Fudan University, Shanghai, China.

Dr Maotian Zhou, School of Medicine, Emory University, Atlanta, United States.

Dr Guoyan Wang, full professor in the Department of Digital Communication, Soochow University, Suzhou, China.

Corresponding author

Correspondence to Guoyan Wang.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Adherence to national and international regulations

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Appendix S1.

Number of issued policies and scientific publications on COVID-19 from 2020 January to 2020 December. Appendix S2. Time series in different time intervals. Appendix S3. Robustness tests. Appendix S4. Heatmap of items with significant variation. Appendix S5. List of policies.

Additional file 2:

Heatmap of items with significant variation.

Additional file 3:

Results output from VOSviewer (version 1.6.16).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cheng, X., Tang, L., Zhou, M. et al. Coevolution of COVID-19 research and China’s policies. Health Res Policy Sys 19, 121 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s12961-021-00770-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12961-021-00770-6

Keywords