This Java package can be used to obtain labels for clusters of scientific publications. These clusters can be created using the publicationclassification package.
Labels are obtained based on the titles of a sample of publications in each cluster. The package uses OpenAI GPT language models. It supports the GPT-3.5 and Updated GPT-3.5 Turbo models as well as the GPT-4 and GPT-4 Turbo models.
The publicationclassificationlabeling package was developed by Nees Jan van Eck at the Centre for Science and Technology Studies (CWTS) at Leiden University.
Documentation of the source code of publicationclassificationlabeling is provided in the code in javadoc format. The documentation is also available in a compiled format.
<dependency>
<groupId>nl.cwts</groupId>
<artifactId>publicationclassificationlabeling</artifactId>
<version>1.0.0</version>
</dependency>
implementation group: 'nl.cwts', name: 'publicationclassificationlabeling', version: '1.0.0'
The publicationclassificationlabeling package requires Java 8 or higher. The latest version of the package is available as a pre-compiled jar file on Maven Central and GitHub Packages.
Instructions for compiling the source code of the package are provided below.
Use the command-line tool PublicationClassificationLabelingCreator to obtain cluster labels. The tool can be run as follows:
java -cp publicationclassificationlabeling-1.0.0.jar nl.cwts.publicationclassificationlabeling.PublicationClassificationLabelingCreator
If no further arguments are provided, the following usage notice will be displayed:
PublicationClassificationLabelingCreator version 1.0.0
By Nees Jan van Eck
Centre for Science and Technology Studies (CWTS), Leiden University
Usage: PublicationClassificationLabelingCreator
<pub_titles_file> <label_file>
<api_key> <gpt_model> <print_labeling>
(to create a publication classification labeling based on data in text files)
or PublicationClassificationLabelingCreator
<server> <database> <pub_titles_table> <label_table>
<api_key> <gpt_model> <print_labeling>
(to create a publication classification labeling based on data in an SQL Server database)
Arguments:
<pub_titles_file>
Name of the publication titles input file. This text file must contain two tab-separated
columns (without a header line): a column of cluster numbers and a column of publication
titles. The cluster numbers in the first column must be integers starting at zero. The
publication titles in the second column (e.g., the titles of a sample of 100 publications)
must be concatenated into a single string. The lines in the file must be sorted by the
cluster numbers in the first column.
<label_file>
Name of the labels output file. This text file will contain six tab-separated columns
(without a header line): a column of cluster numbers, a column of short labels, a column
of long labels, a column of keywords, a column of descriptions, and a column of Wikipedia
page links. Cluster numbers are integers starting at zero.
<server>
SQL Server server name. A connection will be made using integrated authentication.
<database>
Database name.
<pub_titles_table>
Name of the publication titles input table. This table must have two columns: cluster_no
and pub_titles. The cluster numbers in the first column must be integers starting at zero.
The publication titles in the second column (e.g., the titles of a sample of 100
publications) must be concatenated into a single string.
<label_table>
Name of the labels output table. This table will have six columns: cluster_no,
short_label, long_label, keywords, summary, and wikipedia_url. Cluster numbers are
integers starting at zero.
<api_key>
OpenAI API key.
<gpt_model>
OpenAI GPT model. The models supported are: 'gpt-4-1106-preview', 'gpt-4',
'gpt-3.5-turbo-1106', and 'gpt-3.5-turbo'.
<print_labeling>
Boolean indicating whether the generated publication classification labeling should be
printed to the standard output or not.
The following example illustrates the use of the PublicationClassificationLabelingCreator tool. Suppose you have a text file cluster_pub_titles.txt:
0 The link-prediction problem for social networks | Twitter Power: Tweets as Electronic Word of Mouth | Sentiment in Short Strength Detection Informal Text | Usage patterns of collaborative tagging systems | Effects of extrinsic and intrinsic motivation on employee knowledge sharing intentions | A Survey of Modern Authorship Attribution Methods | What is user engagement? A conceptual framework for defining user engagement with technology | The wisdom hierarchy: representations of the DIKW hierarchy | Sentiment Strength Detection for the Social Web | Network embeddedness and the exploration of novel technologies: Technological distance, betweenness centrality and density | Making sense of credibility on the web: Models for evaluating online information and recommendations for future research | Believe it or not: Factors influencing credibility on the Web | The dark side of information: overload, anxiety and other paradoxes and pathologies | Searching the Web: The public and their queries | Sentiment in Twitter Events | Judgment of information quality and cognitive authority in the Web | Information and digital literacies: A review of concepts | The Development and Evaluation of a Survey to Measure User Engagement | Knowledge sharing, absorptive capacity, and innovation capability: an empirical study of Taiwan's knowledge-intensive industries | Sentiment analysis: A combined approach | Twitter Use by the US Congress | A framework for authorship identification of Online messages: Writing-style features and classification techniques | Computational Methods in Authorship Attribution | Conceptual approaches for defining data, information, and knowledge | Domain analysis in information science - Eleven approaches - traditional as well as innovative | Knowledge integration in virtual teams: The potential role of KMS | A model of information practices in accounts of everyday-life information seeking | What are communities of practice? A comparative review of four seminal works | E-mail interviewing in qualitative research: A methodological discussion | A review of Web searching studies and a framework for future research | Serendipity and information seeking: an empirical study | The concept of relevance in IR | Development of measures of online privacy concern and protection for use on the Internet | Patterns and Dynamics of Users' Behavior and Interaction: Network Analysis of an Online Community | Earlier web usage statistics as predictors of later citation impact | A feature selection model based on genetic rank aggregation for text sentiment classification | A framework for information quality assessment | Toward a theory of network gatekeeping: A framework for exploring information control | Trustworthiness in mHealth Information Services: An Assessment of a Hierarchical Model with Mediating and Moderating Effects Using Partial Least Squares (PLS) | Social networks, gender, and friending: An analysis of MySpace member profiles | "Isms" in information science: constructivism, collectivism and constructionism | The effects of domain knowledge on search tactic formulation | Information grounds and the use of need-based services by immigrants in Queens, New York: A context-based, outcome evaluation approach | Information quality work organization in Wikipedia | An investigation of critical management issues in ERP implementation: emperical evidence from Canadian organizations | Epistemology and the socio-cognitive perspective in information science | Data Mining Emotion in Social Network Communication: Gender Differences in MySpace | Text mining: Generating hypotheses from MEDLINE | Aspect-based sentiment analysis of movie reviews on discussion boards | Explaining knowledge sharing in organizations through the dimensions of social capital | Ontology-based information extraction: An introduction and a survey of current approaches | Relevance: A Review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance | News cues: Information scent and cognitive heuristics | Conceptual framework for tasks in information studies | A statistical interpretation of term specificity and its application in retrieval | A theory of the task-based information retrieval process: A summary and generalisation of a longitudinal study | Knowledge management and the dynamic nature of knowledge | Relevance: A review of the literature and a framework for thinking on the notion in information science. Part II: Nature and manifestations of relevance | The knowledge pyramid: a critique of the DIKW hierarchy | The factors influencing members' continuance intentions in professional virtual communities - a longitudinal study | Modeling the information-seeking behavior of social scientists: Ellis's study revisited | OCA: Opinion Corpus for Arabic | An ensemble scheme based on language function analysis and feature engineering for text genre classification | Motivations for sharing information and social support in social media: A comparative analysis of Facebook, Twitter, Delicious, YouTube, and Flickr | A nonlinear model of information-seeking behavior | The folksonomy tag cloud: when is it useful? | Developing the information literacy self-efficacy scale | The Effect of Social Network Sites on Adolescents' Social and Academic Development: Current Theories and Controversies | Trust in digital information | Input-friendliness: motivating knowledge sharing across intranets | Using concepts in literature-based discovery: Simulating Swanson's Raynaud-fish oil and migraine-magnesium discoveries | Information literacy landscapes: an emerging picture | Methods for identifying versioned and plagiarized documents | Absorptive capacity and the reach of collaboration in high technology small firms | Beyond vandalism: Wikipedia trolls | Cognitive styles and hypermedia navigation: Development of a learning model | Eye tracking and online search: Lessons learned and challenges ahead | Human information behavior: Integrating diverse approaches and information use | What's Skill Got to Do With It?: Information Literacy Skills and Self-Views of Ability Among First-year College Students | Antecedents and Effects of Social Network Fatigue | The Characteristics and Motivations of Health Answerers for Sharing Information, Knowledge, and Experiences in Online Environments | Hip and Trendy: Characterizing Emerging Trends on Twitter | Social Media and Migration: Virtual Community 2.0 | Understanding the sustainability of a virtual community: model development and empirical test | Connecting with new information landscapes: information literacy practices of refugees | Information and information sources in tasks of varying complexity | Can organizational knowledge capabilities affect knowledge sharing behavior? | Understanding seeking from electronic knowledge repositories: An empirical study | Children's use of the Yahooligans! Web search engine: II. Cognitive and physical behaviors on research tasks | Toward an epistemology of Wikipedia | Children's use of the yahooligans! - Web search engine. III. Cognitive and physical behaviors on fully self-generated search tasks | Testing an Integrative Theoretical Model of Knowledge-Sharing Behavior in the Context of Wikipedia | Sentiment Analysis of Chinese Documents: From Sentence to Document Level | Framing information literacy as information practice: site ontology and practice theory | A graph model for e-commerce recommender systems | Formal knowledge management ontology: Conduct, activities, resources, and influences | Filtering and withdrawing: strategies for coping with information overload in everyday contexts | Understanding consumer trust in Internet shopping: A multidisciplinary approach | Fundamental forms of information | Quality of health information for consumers on the web: A systematic review of indicators, criteria, tools, and evaluation results
1 The journal coverage of Web of Science and Scopus: a comparative analysis | What do citation counts measure? A review of studies on citing behavior | A review of the literature on citation impact indicators | Performance-based university research funding systems | Bibliometric monitoring of research performance in the social sciences and the humanities: A review | Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods | Bias in peer review | Industry funding and university professors' research performance | Measuring contextual citation impact of scientific journals | A new approach to the metric of journals' scientific prestige: The SJR indicator | Factors affecting number of citations: a comprehensive review of the literature | A new methodology for constructing a publication-level classification system of science | What do we know about the h index? | University research evaluation and funding: An international comparison | Betweenness centrality as an indicator of the interdisciplinarity of scientific journals | How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management | Impact of bibliometrics upon the science system: Inadvertent consequences? | Universities and regional economic development: The entrepreneurial University of Waterloo | Comparing alternatives to the Web of Science for coverage of the social sciences' literature | Finding scientific gems with Google's PageRank algorithm | Benchmarking scientific output in the social sciences and humanities: The limits of existing databases | Journal status | Explaining Australia's increased share of ISI publications - the effects of a funding formula based on publication counts | Towards a new crown indicator: Some theoretical considerations | University research funding and publication performance-An international comparison | The Leiden ranking 2011/2012: Data collection, indicators, and interpretation | Scholarly Use of Social Media and Altmetrics: A Review of the Literature | PageRank for Ranking Authors in Co-citation Networks | Entrepreneurial transformations in the Swedish University system: the case of Chalmers University of Technology | Disambiguation and co-authorship networks of the US patent inventor database (1975-2010) | Comparing keywords plus of WOS and author keywords: A case study of patient adherence research | Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies | A further step forward in measuring journals' scientific prestige: The SJR2 indicator | Organizational and institutional influences on creativity in scientific research | Evaluation practices and effects of indicator use-a literature review | Visualizing the intellectual structure and evolution of innovation systems research: a bibliometric analysis | The place of serials in referencing practices: Comparing natural sciences and engineering with social sciences and humanities | Lifting the crown-citation z-score | History of the journal impact factor: Contingencies and consequences | Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? | The publishing delay in scholarly peer-reviewed journals | Comparing university rankings | Funding incentives, collaborative dynamics and scientific productivity: Evidence from the EU framework program | Which Type of Citation Analysis Generates the Most Accurate Taxonomy of Scientific and Technical Knowledge? | Rickety numbers: Volatility of university rankings and policy implications | Towards a new crown indicator: an empirical analysis | Bibliometrics to webometrics | Gender differences in grant peer review: A meta-analysis | Modifying the journal impact factor by fractional citation weighting: The audience factor | Authors as citers over time | Research collaboration and research output: A longitudinal study of 65 biomedical scientists in a New Zealand university | Extending citation analysis to non-source items | The application of bibliometric analyses in the evaluation of social science research. Who benefits from it, and why it is still feasible | The weakening relationship between the impact factor and papers' citations in the digital age | Relativity of citation performance and excellence measures: From cross-field to cross-scale effects of field-normalisation | Grand challenges in altmetrics: heterogeneity, data quality and dependencies | How do you define and measure research productivity? | Better late than never? On the chance to become highly cited only beyond the standard bibliometric time horizon | Problems of Citation Analysis: A Study of Uncited and Seldom-Cited Influences | Measuring Academic Influence: Not All Citations Are Equal | Turning the Tables on Citation Analysis One More Time: Principles for Comparing Sets of Documents | Publish or impoverish An investigation of the monetary reward system of science in China (1999-2016) | Building global-class universities: Assessing the impact of the 985 Project | A Heuristic Approach to Author Name Disambiguation in Bibliometrics Databases for Large-Scale Research Assessments | Field-normalized citation impact indicators and the choice of an appropriate counting method | Caveats for the journal and field normalizations in the CWTS ("Leiden") evaluations of research performance | How are New Citation-Based Journal Indicators Adding to the Bibliometric Toolbox? | The use of percentiles and percentile rank classes in the analysis of bibliometric data: Opportunities and limits | Characteristics of research output in social sciences and humanities: From a research evaluation perspective | Using altmetrics for assessing research impact in the humanities | Should you believe in the Shanghai ranking? | A Bibliometric Classificatory Approach for the Study and Assessment of Research Performance at the Individual Level: The Effects of Age on Productivity and Impact | Modeling the invisible college | Citations to scientific articles: Its distribution and dependence on the article features | Content-based citation analysis: The next generation of citation analysis | Evaluating research: from informed peer review to bibliometrics | Does knowledge diffusion between university and industry increase innovativeness? | ORCID: a system to uniquely identify researchers | National-scale research performance assessment at the individual level | Scopus's Source Normalized Impact per Paper (SNIP) Versus a Journal Impact Factor Based on Fractional Counting of Citations | Is the United States losing ground in science? A global perspective on the world science system | Comparative study of international academic rankings of universities | Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics | Some modifications to the SNIP journal impact indicator | How to evaluate individual researchers working in the natural and life sciences meaningfully? A proposal of methods based on percentiles of citations | Integrated Impact Indicators Compared With Impact Factors: An Alternative Research Design With Policy Implications | Second generation science parks: from structural holes jockeys to social capital catalysts of the knowledge society | Publication patterns in the social sciences and humanities: evidence from eight European countries | Signals in science - On the importance of signaling in gaining attention in science | On the calculation of percentile-based bibliometric indicators | Methodi Ordinatio: a proposed methodology to select and rank relevant scientific papers encompassing the impact factor, number of citation, and year of publication | Blind men and elephants: What do citation summaries tell us about a research article? | Early citation counts correlate with accumulated impact | Modifying publication practices in response to funding formulas | Population modeling of the emergence and development of scientific fields | Advanced indicators of productivity of universities. An application of robust nonparametric methods to Italian data | Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization | On development of fractional calculus during the last fifty years | Assessing the Citation Impact of Books: The Role of Google Books, Google Scholar, and Scopus | A probabilistic similarity metric for Medline records: A model for author name disambiguation
2 Social network analysis: a powerful strategy, also for the information sciences | Google Scholar, Scopus and the Web of Science: a longitudinal and cross-disciplinary comparison | The bibliometric analysis of scholarly production: How great is the impact? | Understanding inverse document frequency: on theoretical arguments for IDF | Negative results are disappearing from most disciplines and countries | Network structure, self-organization, and the growth of international collaboration in science | National characteristics in international scientific co-authorship relations | The literature of bibliometrics, scientometrics, and informetrics | Eco-innovation and new product development: understanding the influences on market performance | Journal impact measures in bibliometric research | Demand-pull, technology-push, and government-led incentives for non-incremental technical change | The emergence of China as a leading nation in science | What is an emerging technology? | R&D collaboration by SMEs: new opportunities and limitations in the face of globalisation | Research collaboration at a distance: Changing spatial patterns of scientific collaboration within Europe | Hyperauthorship: A postmodern perversion or evidence of a structural shift in scholarly communication practices? | Language biases in the coverage of the Science Citation Index and its consequences for international comparisons of national research performance | Applying Centrality Measures to Impact Analysis: A Coauthorship Network Analysis | What do we measure by co-authorships? | Factors associated with disciplinary and interdisciplinary research collaboration | Impact factor: outdated artefact or stepping-stone to journal certification? | Taiwan's National Health Insurance Research Database: administrative health care database as study object in bibliometrics | Towards an explanatory and computational theory of scientific discovery | A comparison of Scopus and Web of Science for a typical university | International collaboration in science and the formation of a core group | Scientific collaboration and endorsement: Network analysis of coauthorship and citation networks | An evolutionary model of continuous improvement behaviour | Initiatives to promote commercialization of university knowledge | Mapping World Scientific Collaboration: Authors, Institutions, and Countries | Betweenness centrality as a driver of preferential attachment in the evolution of research collaboration networks | Advantages and limitations in the use of impact factor measures for the assessment of research performance in a peripheral country | Team size matters: Collaboration and scientific impact since 1900 | Identifying emerging topics in science and technology | Science in Brazil. Part 1: A macro-level comparative study | Spatial scientometrics: Towards a cumulative research program | Bibliometrics and beyond: Some thoughts on web-based citation analysis | Double effort = Double impact? A critical view at international co-authorship in chemistry | Differences in Impact Factor Across Fields and Over Time | Patenting and US academic research in the 20th century: The world before and after Bayh-Dole | A cast of thousands: Coauthorship and subauthorship collaboration in the 20th century as manifested in the scholarly journal literature of psychology and philosophy | The evolving state-of-the-art in technology transfer research: Revisiting the contingent effectiveness model | Economics in Latin America: a bibliometric analysis | Caveats for the use of citation indicators in research and journal evaluations | External technology sourcing and innovation performance in LMT sectors: An analysis based on the Taiwanese Technological Innovation Survey | Web of Science as a data source for research on scientific and scholarly activity | Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus | Changing publication patterns in the Social Sciences and Humanities, 2000-2009 | The structure of scientific collaboration networks in Scientometrics | Gender and productivity differentials in science | Academic research in innovation: a country analysis | Intended and Unintended Consequences of a Publish-or-Perish Culture: A Worldwide Survey | The effect of scholar collaboration on impact and quality of academic papers | Six case studies of international collaboration in science | The evolution of research activity in Spain - The impact of the National Commission for the Evaluation of Research Activity (CNEAI) | The determinants of research output and impact: A study of Mexican researchers | Gender differences in scientific productivity: a persisting phenomenon? | On Predicting the Popularity of Newly Emerging Hashtags in Twitter | Mapping the intellectual structure of scientometrics: a co-word analysis of the journal Scientometrics (2005-2010) | The Impact Factor's Matthew Effect: A Natural Experiment in Bibliometrics | Investigating different types of research collaboration and citation impact: a case study of Harvard University's publications | On the Relationship Between Interdisciplinarity and Scientific Impact | Gender differences in research productivity: A bibliometric analysis of the Italian academic system | On the origins of bibliometrics | Factors Affecting Citation Rates of Research Articles | Africa's contribution to the worldwide research literature: New analytical perspectives, trends, and performance indicators | The rise in co-authorship in the social sciences (1980-2013) | Using patent analyses to monitor the technological trends in an emerging field of technology: a case of carbon nanotube field emission display | Measuring China's research performance using the Science Citation Index | An empirical analysis of the use of alphabetical authorship in scientific publishing | Sex differences in research funding, productivity and impact: an analysis of Quebec university professors | Statistical relationships between downloads and citations at the level of individual documents within a single journal | Community structure of the physical review citation network | A bibliometric chronicling of library and information science's first hundred years | Efficiency of European public higher education institutions: a two-stage multicountry approach | Are the contributions of China and Korea upsetting the world system of science? | Decline of the center: The decentralizing process of knowledge transfer of Chinese universities from 1985 to 2004 | Cooperation with public research institutions and success in innovation: Evidence from France and Germany | Research collaboration and R&D outsourcing: Different R&D personnel requirements in SMEs | Mapping research topics using word-reference co-occurrences: A method and an exploratory case study | Paradigms, citations, and maps of science: A personal history | The impact of multilevel networks on innovation | Do types of collaboration change citation? Collaboration and citation patterns of South African science publications | China's emerging presence in nanoscience and nanotechnology - A comparative bibliometric study of several nanoscience 'giants' | Publication rate expressed by age, gender and academic position - A large-scale analysis of Norwegian academic staff | The Decline in the Concentration of Citations, 1900-2007 | Correlation between the structure of scientific research, scientometric indicators and GDP in EU and non-EU countries | Emerging research fronts in science and technology: patterns of new knowledge development | Neo-colonialism and research collaboration in Central Africa | Modeling a century of citation distributions | Coverage and citation impact of oncological journals in the Web of Science and Scopus | Domain visualization using VxInsight (R) for science and technology management | Are Female Researchers Less Cited? A Large-Scale Study of Norwegian Scientists | Macro-level indicators of the relations between research funding and research output | Eigenfactor: Does the Principle of Repeated Improvement Result in Better Estimates than Raw Citation Counts? | Funding acknowledgement analysis: an enhanced tool to investigate research sponsorship impacts: the case of nanotechnology | Visible, less visible, and invisible work: Patterns of collaboration in 20th century chemistry | Co-citation, bibliographic coupling and a characterization of lattice citation networks | Power laws in citation distributions: evidence from Scopus | ENTRE-U: An entrepreneurial orientation scale for universities | Research emphasis and collaboration in Africa
3 The sharing economy: Why people participate in collaborative consumption | How open is innovation? | One size fits all? Towards a differentiated regional innovation policy approach | Open innovation in SMEs: Trends, motives and management challenges | Open innovation: State of the art and future perspectives | Towards an integrated crowdsourcing definition | Determinants of environmental innovation - New evidence from German panel data sources | Forms of knowledge and modes of innovation | Who co-operates for innovation, and why - An empirical analysis | How open source software works: "free" user-to-user assistance | Measuring innovative performance: is there an advantage in using multiple indicators? | Cooperative R&D and firm performance | Optimal cognitive distance and absorptive capacity | The importance of diverse collaborative networks for the novelty of product innovation | Open innovation in SMEs-An intermediated network model | How communities support innovative activities: an exploration of assistance and sharing among end-users | Environmental innovation and R&D cooperation: Empirical evidence from Spanish manufacturing firms | Motivation of software developers in Open Source projects: an Internet-based survey of contributors to the Linux kernel | Co-operative R&D: why and with whom? An integrated framework of analysis | Relationship between cooperation networks and innovation performance of SMEs | Innovation systems: analytical and methodological issues | Internal capabilities and external knowledge sources: complements or substitutes for innovative performance? | Determinants of innovation capability in small electronics and software firms in southeast England | Global production networks, knowledge diffusion, and local capability formation | The paradox of openness: Appropriability, external search and collaboration | Improvising firms: bricolage, account giving and improvisational competencies in the founding process | Who's right, Marshall or Jacobs? The localization versus urbanization debate | Lessons from innovation empirical studies in the manufacturing sector: A systematic review of the literature from 1993-2003 | Managing external knowledge flows: The moderating role of absorptive capacity | Community, joining, and specialization in open source software innovation: a case study | Innovation in the service sector: The demand for service-specific innovation measurement concepts and typologies | The digital transformation of innovation and entrepreneurship: Progress, challenges and key themes | R&D cooperation and innovation activities of firms - evidence for the German manufacturing industry | Identifying innovation in surveys of services: a Schumpeterian perspective | On the drivers of eco-innovations: Empirical evidence from the UK | Selective revealing in open innovation processes: The case of embedded Linux | Market versus technology drive in R&D internationalization: four different patterns of managing research and development | Profiting from innovation in the digital economy: Enabling technologies, standards, and licensing models in the wireless world | Modelling the innovation value chain | Towards an open R&D system: Internal R&D investment, external knowledge acquisition and innovative performance | Sectoral patterns of small firm innovation, networking and proximity | Innovative capability and export performance of Chinese firms | Benefits, obstacles, and future of six sigma approach | Profiting from voluntary information spillovers: how users benefit by freely revealing their innovations | Absorptive capacity and the search for innovation | Innovation and firm growth: Does firm age play a role? | Reflections on "Profiting from Innovation" | Collaborative networks and product innovation performance: Toward a contingency perspective | The industrial dynamics of Open Innovation - Evidence from the transformation of consumer electronics | Organizational innovation: The challenge of measuring non-technical innovation in large-scale surveys | Shopping motivations on Internet: A study based on utilitarian and hedonic value | Who cooperates on R&D? | Do different types of innovation rely on specific kinds of knowledge interactions? | How user innovations become commercial products: A theoretical investigation and case study | Satisfying heterogeneous user needs via innovation toolkits: the case of Apache security software | The role of internationalization in explaining innovation performance | Technological paradigms, regimes and trajectories: Manufacturing and service industries in a new taxonomy of sectoral patterns of innovation | User-innovators and "local" information: The case of mountain biking | Innovation ecosystems: A critical examination | Knowledge, learning and small firm growth: A systematic review of the evidence | On the relationship between environmental management, environmental innovation and patenting: Evidence from German manufacturing firms | Innovation and export performance: evidence from the UK and German manufacturing plants | Mergers and acquisitions: Their effect on the innovative performance of companies in high-tech industries | Do public subsidies stimulate private R&D spending? | Clusters, convergence, and economic performance | Innovation, collaboration and SMEs internal research capacities | Beyond formal R&D: Taking advantage of other sources of innovation in low- and medium-technology industries | The impact of R&D subsidies on firm innovation | The influence of scope, depth, and orientation of external technology sources on the innovative performance of Chinese firms | Absorptive capacity, technological opportunity, knowledge spillovers, and innovative effort | An investigation into the acceptance of online banking in Saudi Arabia | The impact of technological relatedness, prior ties, and geographical distance on university-industry collaborations: A joint-patent analysis | The impact of open innovation on firm performance: The moderating effects of internal R&D and environmental turbulence | Survivor: The role of innovation in firms' survival | Organisational modes for Open Innovation in the bio-pharmaceutical industry: An exploratory analysis | Crowd science: The organization of scientific research in open collaborative projects | Access to finance for innovative SMEs since the financial crisis | Innovation, regional knowledge spillovers and R&D cooperation | Characteristics of innovating users in a consumer goods field - An empirical study of sport-related product consumers | A man on the inside: Unlocking communities as complementary assets | R&D, firm size and innovation: an empirical analysis | Absorptive capacity, its determinants, and influence on innovation output: Cross-cultural validation of the structural model | Targeting innovation and implications for capability development | Search patterns and absorptive capacity: Low- and high-technology sectors in European countries | The relationships between science, technologies and their industrial exploitation: An illustration through the myths and realities of the so-called 'European Paradox' | The open eco-innovation mode. An empirical investigation of eleven European countries | Building absorptive capacity to organise inbound open innovation in traditional industries | Innovation in times of crisis: National Systems of Innovation, structure, and demand | Internal factors determining a firm's innovative behaviour | Open service innovation and the firm's search for external knowledge | On the green and innovative side of trade competitiveness? The impact of environmental policies and innovation on EU exports | Building absorptive capacity to organise inbound open innovation in traditional industries | Innovation capacity and innovation development in small enterprises. A comparison between the manufacturing and service sectors | Innovation ecosystems: A conceptual review and a new definition | Linking emission trading to environmental innovation: Evidence from the Italian manufacturing industry | The impact of M&A on the R&D process - An empirical analysis of the role of technological- and market-relatedness | The relationship between technology, innovation, and firm performance - Empirical evidence from e-business in Europe | Firms' motivations for cooperative R&D: an empirical analysis of Spanish firms | Managing open innovation projects with science-based and market-based partners | Relationships between open source software companies and communities: Observations from Nordic firms
4 Academic engagement and commercialisation: A review of the literature on university-industry relations | Patents and innovation counts as measures of regional production of new knowledge | Assessing the impact of organizational practices on the relative productivity of university technology transfer offices: an exploratory study | University-industry linkages in the UK: What are the factors underlying the variety of interactions with industry? | Research groups as 'quasi-firms': the invention of the entrepreneurial university | The growth of patenting and licensing by US universities: an assessment of the effects of the Bayh-Dole act of 1980 | Why do some universities generate more start-ups than others? | Investigating the factors that diminish the barriers to university-industry collaboration | National systems of production, innovation and competence building | The economic benefits of publicly funded basic research: a critical review | Searching high and low: what types of firms use universities as a source of innovation? | Founders' human capital and the growth of new technology-based firms: A competence-based view | National Systems of Entrepreneurship: Measurement issues and policy implications | Critical junctures in the development of university high-tech spinout companies | Entrepreneurial orientation, technology transfer and spinoff performance of US universities | Why do academics engage with industry? The entrepreneurial university and individual motivations | 30 years after Bayh-Dole: Reassessing academic entrepreneurship | Does the knowledge spillover theory of entrepreneurship hold for regions? | Resources, capabilities, risk capital and the creation of university spin-out companies | Analysing knowledge transfer channels between universities and industry: To what degree do sectors also matter? | Incubator best practice: A framework | Experienced entrepreneurial founders, organizational capital, and venture capital funding | The role of academic technology transfer organizations in improving industry science links | Creating value in ecosystems: Crossing the chasm between, knowledge and business ecosystems | From the entrepreneurial university to the university for the entrepreneurial society | How effective are technology incubators? Evidence from Italy | Factors affecting university-industry R&D projects: The importance of searching, screening and signalling | Knowledge interactions between universities and industry in Austria: sectoral patterns and determinants | Academics or entrepreneurs? Investigating role identity modification of university scientists involved in commercialization activity | The market economy, and the scientific commons | Inflationary bibliometric values: The role of scientific collaboration and the need for relative indicators in evaluative studies | Business incubators and new venture creation: an assessment of incubating models | Work organization and mental health problems in PhD students | Internationalization of innovation systems: A survey of the literature | Action-based entrepreneurship education | The development of an entrepreneurial university | When do incumbents learn from entrepreneurial ventures? Corporate venture capital and investing firm innovation rates | Networks of inventors and the role of academia: an exploration of Italian patent data | Innovation as co-evolution of scientific and technological networks: exploring tissue engineering | Innovation performance and channels for international technology spillovers: Evidence from Chinese high-tech industries | The creation of spin-off firms at public research institutions: Managerial and policy implications | University spin-out companies and venture capital | Firm size and technology centrality in industry-university interactions | The Evolution of Business Incubators: Comparing demand and supply of business incubation services across different incubator generations | Growth and productive efficiency of university intellectual property licensing | The Governance of University Knowledge Transfer: A Critical Review of the Literature | Mid-range universities' linkages with industry: Knowledge types and the role of intermediaries | Informetrics at the beginning of the 21st century - A review | Assessing the relative performance of UK university technology transfer offices: parametric and non-parametric evidence | Bottom-up versus top-down policies towards the commercialization of university intellectual property | Entrepreneurial finance and technology transfer | What motivates academic scientists to engage in research commercialization: 'Gold', 'ribbon' or 'puzzle'? | The role of academic inventors in entrepreneurial firms: sharing the laboratory life | Science Parks and the growth of new technology-based firms - academic-industry links, innovation and markets | University spillovers and new firm location | Understanding a new generation incubation model: The accelerator | A taste for science? PhD scientists' academic orientation and self-selection into research careers in industry | The Open Innovation Journey: How firms dynamically implement the emerging innovation management paradigm | Evolutionary approaches for sustainable innovation policies: From niche to paradigm? | Innovation speed: Transferring university technology to market | The impact of entrepreneurial capacity, experience and organizational support on academic entrepreneurship | Assessing technology incubator programs in the science park: the good, the bad and the ugly | Economic impact of entrepreneurial universities' activities: An exploratory study of the United Kingdom | The nature of academic entrepreneurship in the UK: Widening the focus on entrepreneurial activities | Technological innovation, energy efficient design and the rebound effect | Critical role and screening practices of European business incubators | Combining entrepreneurial and scientific performance in academia: towards a compounded and reciprocal Matthew-effect? | Complementary assets, strategic alliances, and the incumbent's advantage: an empirical study of industry and firm effects in the biopharmaceutical industry | A review of the literature on environmental innovation management in SMEs: implications for public policies | Exploring the knowledge filter: How entrepreneurship and university-industry relationships drive economic growth | A comparative study of new venture top management team composition, dynamics and performance between university-based and independent start-ups | Emergence and development of the National Innovation Systems concept | The expanding role of university patenting in the life sciences: assessing the importance of experience and connectivity | University-incubator firm knowledge flows: assessing their impact on incubator firm performance | In search of complementary assets: The determinants of alliance formation of high-tech start-ups | Determinants and consequences of university spinoff activity: a conceptual framework | R&D cooperation and failures in innovation projects: Empirical evidence from French CIS data | The role of social embeddedness in professorial entrepreneurship: a comparison of electrical engineering and computer science at UC Berkeley and Stanford | Technology Business Incubation: An overview of the state of knowledge | Bias against novelty in science: A cautionary tale for users of bibliometric indicators | Science and the diffusion of knowledge | Ambidexterity, external knowledge and performance in knowledge-intensive firms | A review of TRIZ, and its benefits and challenges in practice | Public research institutions and economic catch-up | Incubator firm failure or graduation? The role of university linkages | Innovation indicators throughout the innovation process: An extensive literature analysis | Measuring the efficiency of university technology transfer | Knowledge management issues in knowledge-intensive SMEs | Venture capital financing and the growth of high-tech start-ups: Disentangling treatment from selection effects | Complements or substitutes? The role of universities and local context in supporting the creation of academic spin-offs | The effectiveness of university knowledge spillovers: Performance differences between university spinoffs and corporate spinoffs | Publication and patent behavior of academic researchers: Conflicting, reinforcing or merely co-existing? | Entrepreneurial effectiveness of European universities: An empirical assessment of antecedents and trade-offs | Understanding innovation in small and medium-sized enterprises: a process manifest | How effective is innovation support for SMEs? An analysis of the region of Upper Austria | A stage model of academic spin-off creation | Spinouts from academic institutions: a literature review with suggestions for further research | Engaging excellence? Effects of faculty quality on university engagement with industry | What enables rapid economic progress: What are the needed institutions? | Vertical alliance networks: The case of university-biotechnology-pharmaceutical alliance chains
5 Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references | Do "altmetrics" correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective | The Conundrum of Sharing Research Data | Reading behavior in the digital environment - Changes in reading behavior over the past ten years | Building an innovation hub: A case study of the transformation of university roles in regional technological and economic development | Do altmetrics point to the broader impact of research? An overview of benefits and disadvantages of altmetrics | An emerging view of scientific collaboration: Scientists' perspectives on collaboration and factors that impact collaboration | Tweeting Biomedicine: An Analysis of Tweets and Citations in the Biomedical Literature | How well developed are altmetrics? A cross-disciplinary analysis of the presence of 'alternative metrics' in scientific publications | Citation time window choice for research impact evaluation | Who publishes in "predatory" journals? | Do open access articles have greater citation impact? A critical review of the literature | High tech start-ups in University Science Park incubators: The relationship between the start-up's lifecycle progression and use of the incubator's resources | Coverage analysis of Scopus: A journal metric approach | Toward a basic framework for webometrics | Validating online reference managers for scholarly impact measurement | Peer review in a changing world: An international study measuring the attitudes of researchers | Evaluating altmetrics | Coverage and adoption of altmetrics sources in the bibliometric community | ResearchGate: Disseminating, Communicating, and Measuring Scholarship? | Big Data, Bigger Dilemmas: A Critical Review | Mendeley Readership Altmetrics for the Social Sciences and Humanities: Research Evaluation and Knowledge Flows | A study of open access journals using article processing charges | Social media use in the research workflow | Academia.edu: Social Network or Academic Network? | The citation advantage of open-access articles | Do Blog Citations Correlate With a Higher Number of Future Citations? Research Blogs as a Potential Source for Alternative Metrics | Automatic term identification for bibliometric mapping | The open access advantage considering citation, article usage and social media attention | Perspectives of webometrics | Programmed method: developing a toolset for capturing and analyzing tweets | Publication Fees in Open Access Publishing: Sources of Funding and Factors Influencing Choice of Journal | Professional networks, scientific collaboration, and publication productivity in resource-constrained research institutions in a developing country | Who Reads Research Articles? An Altmetrics Analysis of Mendeley User Categories | The effect of "Open access" on citation impact: An analysis of ArXiv's condensed matter section | Extracting macroscopic information from Web links | A topology of Twitter research: disciplines, methods, and ethics | What do people study when they study Twitter? Classifying Twitter related academic papers | Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media | Altmetric: enriching scholarly content with article-level discussion and metrics | Tweets as impact indicators: Examining the implications of automated "bot" accounts on Twitter | Reasons for the use and non-use of electronic journals and databases - A domain analytic study in four scholarly disciplines | Enabled backchannel: conference Twitter use by digital humanists | A Material History of Bits | Web page change and persistence - A four-year longitudinal study | Bibliographic and web citations: What is the difference? | Examining the usage, citation, and diffusion patterns of bibliometric mapping software: A comparative study of three tools | Anatomy of Green Open Access | Scholarly use of the Web: What are the key inducers of links to journal Web sites? | Long-term variations in the aging of scientific literature: From exponential growth to steady-state science (1900-2004) | Can we use Google Scholar to identify highly-cited documents? | Evaluating Internet resources: Identity, affiliation, and cognitive authority in a networked world | Social web knowledge sharing and innovation performance in knowledge-intensive manufacturing SMEs | Predatory journals: Who publishes in them and why? | Authors and open access publishing | Conceptualizing documentation on the Web: An evaluation of different heuristic-based models for counting links between university Web sites | Web impact factors for Australasian universities | The Problem of Expertise in Knowledge Societies | Relationship between altmetric and bibliometric indicators across academic social sites: The case of CSIC's members | Duration and quality of the peer review process: the author's perspective | Does the arXiv lead to higher citations and reduced publisher downloads for mathematics articles? | Information seeking behavior of academic scientists | Scientific research activity and communication measured with cybermetrics indicators | Do highly cited researchers successfully use the social web? | Application of the Task-Technology Fit Model to Structure and Evaluate the Adoption of E-Books by Academics | Peer review: still king in the digital age | Validity of altmetrics data for measuring societal impact: A study using data from Altmetric and F1000Prime | The effect of the Web on undergraduate citation behavior 1996-1999 | Is multidisciplinary research more highly cited? A macrolevel study | Evidence for the existence of geographic trends in university Web site interlinking | Why do authors publish in predatory journals? | Web citation data for impact assessment: A comparison of four science disciplines | The direct and indirect impact of culture on innovation | Inside the high-tech black box: A critique of technology entrepreneurship policy | Mendeley Readership Altmetrics for Medical Articles: An Analysis of 45 Fields | Disciplinary differences and undergraduates' information-seeking behavior | F1000 Recommendations as a Potential New Data Source for Research Evaluation: A Comparison With Citations | Methods for estimating the size of Google Scholar | The role of online videos in research communication: A content analysis of YouTube videos cited in academic publications | National Study of Information Seeking Behavior of Academic Researchers in the United States | Localization of Web design: An empirical comparison of German, Japanese, and United States Web site characteristics | The hybrid model for open access publication of scholarly articles: A failed experiment? | The "total cost of publication" in a hybrid open-access environment: Institutional approaches to funding journal article-processing charges in combination with subscriptions | Managing knowledge through collaboration: multiple case studies of managing research in university laboratories in Thailand | Developments in Research Data Management in Academic Libraries: Towards an Understanding of Research Data Service Maturity | Institutional and individual factors affecting scientists' data-sharing behaviors: A multilevel analysis | Open Access and Scopus: A New Approach to Scientific Visibility From the Standpoint of Access | The relationship between tweets, citations, and article views for PLOS ONE articles | Do age and professional rank influence the order of authorship in scientific publications? Some evidence from a micro-level perspective | When are readership counts as useful as citation counts? Scopus versus Mendeley for LIS journals | Can Mendeley bookmarks reflect readership? A survey of user motivations | User Participation in an Academic Social Networking Service: A Survey of Open Group Users on Mendeley | Mapping Korea's national R&D domain of robot technology by using the co-word analysis | Motivations for academic web site interlinking: evidence for the Web as a novel source of information on informal scholarly communication | Bibliometric Analysis using Bibliometrix an R Package | The role of the Internet in informal scholarly communication | Reading behaviour and electronic journals | A proposed ethical warrant for global knowledge representation and organization systems | Copyright compliance and infringement in ResearchGate full-text journal articles | Opening science: towards an agenda of open science in academia and industry
6 The determinants of national innovative capacity | Citations, family size, opposition and the value of patent rights | Technology as a complex adaptive system: evidence from patent data | The product market and the market for "ideas": commercialization strategies for technology entrepreneurs | Entrepreneurial innovation: The importance of context | Innovation and firm growth in high-tech sectors: A quantile regression approach | Complexity, networks and knowledge flow | International patent protection: 1960-2005 | R&D spillovers, patents and the incentives to innovate in Japan and the United States | The relative effectiveness of patents and secrecy for appropriation | Comparing innovation systems: a framework and application to China's transitional context | National innovation systems, capabilities and economic development | Beyond industry-university links: Sourcing knowledge for innovation from consultants, private research organisations and the public science-base | Social innovation research: An emerging area of innovation studies? | Characteristics of highly cited papers | Patent applications and subsequent changes of performance: evidence from time-series cross-section analyses on the firm level | Motives to patent: Empirical evidence from Germany | When is an invention really radical? Defining and measuring technological radicalness | Ownership and firm innovation in a transition economy: Evidence from China | Knowledge sharing, knowledge leaking and relative innovation performance: An empirical study | An audit of technological innovation capabilities in Chinese firms: some empirical findings in Beijing, China | Distributed R&D, cross-regional knowledge integration and quality of innovative output | An approach to discovering new technology opportunities: Keyword-based patent map approach | Which resources matter the most to firm success? An exploratory study of resource-based theory | Academic patent quality and quantity before and after the Bayh-Dole act in the United States | The value of US patents by owner and patent characteristics | The impact on innovation performance of different sources of knowledge: Evidence from the UK Community Innovation Survey | Inventive progress measured by multi-stage patent citation analysis | Technology push and demand pull perspectives in innovation studies: Current findings and future research directions | Innovation studies-The emerging structure of a new scientific field | What hampers innovation? Revealed barriers versus deterring barriers | Collaboration and innovation: a review of the effects of mergers, acquisitions and alliances on innovation | The market for patents in Europe | The structure of invention | Detecting emerging research fronts based on topological measures in citation networks of scientific publications | Inventors and invention processes in Europe: Results from the PatVal-EU survey | The effect of external and internal factors on firms' product innovation | Patent citation analysis - A closer look at the basic input data from patent search reports | National innovative capacity in East Asia | Entrepreneurship: Exploring the knowledge base | The impact of innovation activities on firm performance using a multi-stage model: Evidence from the Community Innovation Survey 4 | Reconfiguring the innovation policy portfolios for Taiwan's SIP Mall industry | Improving patent valuations for management purposes - validating new indicators by analyzing application rationales | The internationalisation of technology analysed with patent data | Innovation: Exploring the knowledge base | China's regional innovation capacity in transition: An empirical approach | China's national innovative capacity | The innovation-economic growth nexus Global evidence | Applicant and examiner citations in US patents: An overview and analysis | Innovation assessment through patent analysis | A tale of two databases: the use of Web of Science and Scopus in academic papers | Web of Science use in published research and review papers 1997-2017: a selective, dynamic, cross-domain, content-based analysis | Does it matter where patent citations come from? Inventor vs. examiner citations in European patents | The technological origins of radical inventions | An Integrated Approach for Main Path Analysis: Development of the Hirsch Index as an Example | Measuring technological capabilities at the country level: A survey and a menu for choice | Why space matters in technological innovation systems-Mapping global knowledge dynamics of membrane bioreactor technology | China's innovation policies: Evolution, institutional structure, and trajectory | Policies for science, technology and innovation: Translating rationales into regional policies in a multi-level setting | Appropriate intellectual property protection and economic growth in countries at different levels of development | If you cannot block, you better run: Small firms, cooperative innovation, and appropriation strategies | The evolution of science policy and innovation studies | R&D and the growth of firms: empirical analysis of a panel of Italian firms | University-industry collaborations in Japan: The role of new technology-based firms in transforming the National Innovation System | Competition and innovation behaviour | Mapping evolutionary trajectories: Applications to the growth and transformation of medical knowledge | The influence of strategic patenting on companies' patent portfolios | Effects of government financial incentives on firms' innovation performance in China: Evidences from Beijing in the 1990s | Publications and patents in nanotechnology - An overview of previous studies and the state of the art | Machineries for Making Publics: Inscribing and De-scribing Publics in Public Engagement | How much should society fuel the greed of innovators? On the relations between appropriability, opportunities and rates of innovation | Behind the recent surge of Chinese patenting: An institutional view | Prediction of emerging technologies based on analysis of the US patent citation network | Innovation and productivity in developing countries: A study of Argentine manufacturing firms' behavior (1992-2001) | The allocation and effectiveness of China's R&D subsidies - Evidence from listed firms | University-industry collaboration and innovation in emergent and mature industries in new industrialized countries | The determinants of regional innovation in Europe: A combined factorial and regression knowledge production function approach | Disentangling the antecedents of ambidexterity: Exploration and exploitation | What drives the formation of 'valuable' university-industry linkages? Insights from the wine industry | Main-path analysis and path-dependent transitions in HistCite (TM)-based historiograms | What determines patent value? Insights from the semiconductor industry | Knowledge sources of entrepreneurship: Firm formation by academic, user and employee innovators | Traces of Prior Art: An analysis of non-patent references found in patent documents | Testing patent value indicators on directly observed patent value-An empirical analysis of Ocean Tomo patent auctions | Intellectual property rights, strategic technology agreements and market structure - The case of GSM | The worldwide count of priority patents: A new indicator of inventive activity | National innovation system in less successful developing countries: the case of Thailand | Recombinant search and breakthrough idea generation: An analysis of high impact papers in the social sciences | Identifying rapidly evolving technological trends for R&D planning using SAO-based semantic patent networks | Intellectual property protection mechanisms in research partnerships | Tracing the links between science and technology: An exploratory analysis of scientists' and inventors' networks | Developing science, technology and innovation indicators: What we can learn from the past | The changing composition of innovative activity in the US - a portrait based on patent analysis | National innovation systems and the intermediary role of industry associations in building institutional capacities for innovation in developing countries: A critical review of the literature | Managing the protection of innovations in knowledge-intensive business services | Intellectual property rights business management practices: A survey of the literature | Patent systems for encouraging innovation: Lessons from economic analysis | Catching up or standing still? National innovative productivity among 'follower' countries, 1978-1999 | Minerva unbound: Knowledge stocks, knowledge flows and new knowledge production | The effect of institutional ownership on firm innovation: Evidence from Chinese listed firms
7 Developing a framework for responsible innovation | Technologies of humility: Citizen participation in governing science | Responsible research and innovation: From science in society to science for society, with society | Scientists' collaboration strategies: implications for scientific and technical human capital | Re-thinking new knowledge production: A literature review and a research agenda | Sleeping Beauties in science | Drivers of innovativeness and performance for innovative SMEs in South Korea: Mediation of learning orientation | Reflections on scientific collaboration, (and its study): past, present, and future | University patenting and its effects on academic research: The emerging European evidence | Researchers' roles in knowledge co-production: experience from sustainability research in Kenya, Switzerland, Bolivia and Nepal | What is societal impact of research and how can it be assessed? a literature survey | Research collaboration in universities and academic entrepreneurship: the-state-of-the-art | Analyzing interdisciplinarity: Typology and indicators | Utilization of social science research knowledge in Canada | Closed or open innovation? Problem solving and the governance choice | The entrepreneurial university: Examining the underlying academic tensions | Academic careers, patents, and productivity: industry experience as scientific and technical human capital | Assessment, evaluations, and definitions of research impact: A review | The Research Excellence Framework and the 'impact agenda': are we creating a Frankenstein monster? | Introducing 'productive interactions' in social impact assessment | Relative efficiency of R & D activities: A cross-country study accounting for environmental factors in the DEA approach | Measuring the innovation production process: A cross-region empirical study of China's high-tech innovations | Beyond the third mission: Exploring the emerging university function of co-creation for sustainability | Modeling the relative efficiency of national innovation systems | Public deliberation and governance: Engaging with science and technology in contemporary Europe | Determining factors in the success of R&D cooperative agreements between firms and research organizations | Coordination costs and project outcomes in multi-university collaborations | Impacts of grants and contracts on academic researchers' interactions with industry | Chinese researchers returning home: Impacts of international mobility on research collaboration and scientific productivity | You can't manage right what you can't measure well: Technological innovation efficiency | Credibility, salience, and legitimacy of boundary objects: water managers' assessment of a simulation model in an immersive decision theater | Relationships between knowledge inertia, organizational learning and organization innovation | University researchers working with private companies | Internationalisation, Mobility and Metrics: A New Form of Indirect Discrimination? | University-industry knowledge and technology transfer in Switzerland: What university scientists think about co-operation with private enterprises | Does research organization influence academic production? Laboratory level evidence from a large European university | Policy learning and innovation theory: an interactive and co-evolving process | Inter-country R&D efficiency analysis: An application of data envelopment analysis | Organizational culture as a knowledge repository for increased innovative capacity | The influence of university departments on the evolution of entrepreneurial competencies in spin-off ventures | How do men and women differ in research collaborations? An analysis of the collaborative motives and strategies of academic researchers | In defence of the linear model: An essay | New roles of science in society: Different repertoires of knowledge brokering | Public Value Mapping and Science Policy Evaluation | Canadian collaboration networks: A comparative analysis of the natural sciences, social sciences and the humanities | Explaining the "University-run enterprises" in China: A theoretical framework for university-industry relationship in developing countries and its application to China | Creativity in scientific teams: Unpacking novelty and impact | Schumacher meets Schumpeter: Appropriate technology below the radar | The dynamics of national innovation systems: A panel cointegration analysis of the coevolution between innovative capability and absorptive capacity | Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence | Measuring the change in R&D efficiency of the Japanese pharmaceutical industry | Women in interdisciplinary science: Exploring preferences and consequences | The dynamics of technological innovation: the case of the pharmaceutical industry | Predictive Effects of Structural Variation on Citation Counts | Balancing credibility, relevance and legitimacy: A critical assessment of trade-offs in science-policy interfaces | Gender differences in research collaboration | Regimes of knowledge production in society: Towards a more political and social reading | University research centers and the composition of research collaborations | 'Impact' in the proposals for the UK's Research Excellence Framework: Shifting the boundaries of academic autonomy | User engagement in sustainability research | Influencing scientists' collaboration and productivity patterns through new institutions: University research centers and scientific and technical human capital | Design and the management of multi-institutional research collaborations: Theoretical implications from two case studies | Mobility versus job stability: Assessing tenure and productivity outcomes | Technological knowledge base, R&D organization structure and alliance formation: Evidence from the biopharmaceutical industry | A review of literature on evaluating the scientific, social and political impact of social sciences and humanities research | Progressing research impact assessment: A 'contributions' approach | 35 years and 160,000 articles: A bibliometric exploration of the evolution of ecology | Evaluating research and innovation policy: a systems world needs systems evaluations | Review and new evidence on composite innovation indicators for evaluating national performance | UK research assessment exercises: Informed judgments on research quality or quantity? | Unintended consequences of cooperative research: impact of industry sponsorship on climate for academic freedom and other graduate student outcome | Does collaborative research have greater epistemic authority? | Technological agglomeration and the emergence of clusters and networks in nanotechnology | Interregional inventor networks as studied by patent coinventorships | Co-producing European climate science and policy: a cautionary note on the making of useful knowledge | Toward a methodological scheme for capturing societal effects of participatory sustainability research | In search of relevance: the changing contract between science and society | Enhancing research collaborations: Three key management challenges | Flows of knowledge, expertise and influence: a method for assessing policy and practice impacts from social science research | Defining and assessing research quality in a transdisciplinary context | State of the art in assessing research impact: introduction to a special issue | Tracing 'productive interactions' to identify social impacts: an example from the social sciences | Intellectual capital reporting for universities: conceptual background and application for Austrian universities | The organization of scientific collaborations | Innovations in the food industry in Germany | Human capital heterogeneity, collaborative relationships, and publication patterns in a multidisciplinary scientific alliance: a comparative case study of two scientific teams | Mapping a research agenda for the science of team science | The UK Research Assessment Exercise: the evolution of a national research evaluation system | Orienting European innovation systems towards grand challenges and the roles that FTA can play | Migrant scientists and international networks | Users as innovators in developing countries: The global sources of innovation and diffusion in mobile banking services | Knowledge transfer activities in social sciences and humanities: Explaining the interactions of research groups with non-academic agents | The representation of the social sciences and humanities in the Web of Science-a comparison of publication patterns and incentive structures in Flanders and Norway (2005-9) | In good company: The influence of peers on industry engagement by academic scientists | Across institutional boundaries? Research collaboration in German public sector nanoscience | The role of funding agencies in creating interdisciplinary knowledge | International scientific collaboration of China with the G7 countries | Stimulating new industries from emerging technologies: challenges for the public sector | The policy challenges of peer review: managing bias, conflict of interests and interdisciplinary assessments | Return mobility and scientific productivity of researchers working abroad: The role of home country linkages
8 Theory and practise of the g-index | An approach for detecting, quantifying, and visualizing the evolution of a research field: A practical application to the Fuzzy Sets Theory field | Impact of data sources on citation counts and rankings of LIS faculty: Web of science versus scopus and google scholar | Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories | h-Index: A review focused in its variants, computation and standardization for different scientific fields | The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index | SciMAT: A new science mapping analysis software tool | Which h-index? - A comparison of WoS, Scopus and Google Scholar | Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups | A Hirsch-type index for journals | Is it possible to compare researchers with different scientific interests? | Are there better indices for evaluation purposes than the h index? a comparison of nine different variants of the h index using data from biomedicine | The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro level | Identifying the effects of co-authorship networks on the performance of scholars: A correlation and regression analysis of performance measures and social network analysis measures | A new classification scheme of science fields and subfields designed for scientometric evaluation purposes | Exploitative and exploratory innovations in knowledge network and collaboration network: A patent analysis in the technological field of nano-energy | A macro study of self-citation | Co-authorship networks and research impact: A social capital perspective | Citation counting, citation ranking, and h-index of human-computer interaction researchers: A comparison of Scopus and Web of Science | A Google Scholar h-Index for Journals: An Alternative Metric to Measure Journal Impact in Economics and Business | Does the h-index for ranking of scientists really work? | Generalized Hirsch h-index for disclosing latent facts in citation networks | An informetric model for the Hirsch-index | An index to quantify an individual's scientific research output that takes into account the effect of multiple coauthorship | Using the h-index to rank influential information scientists | Google Scholar to overshadow them all? Comparing the sizes of 12 academic search engines and bibliographic databases | The Inconsistency of the h-index | A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants | Article 50 million: an estimate of the number of scholarly articles in existence | Which factors help authors produce the highest impact research? Collaboration, journal and document properties | Self-citation and self-reference: Credibility and promotion in academic publication | On the h-index - A mathematical approach to a new measure of publication activity and citation impact | Google Scholar citations and Google Web/URL citations: A multi-discipline exploratory analysis | Does self-citation pay? | Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation-Review of the Literature | Scaling the h-index for different scientific ISI fields | Detecting h-index manipulation through self-citation analysis | A systematic analysis of Hirsch-type indices for journals | Is Google Scholar useful for bibliometrics? A webometric analysis | Citations to the "Introduction to informetrics" indexed by WOS, Scopus and Google Scholar | hg-index: a new index to characterize the scientific output of researchers based on the h- and g-indices | A preliminary test of Google Scholar as a source for citation data: a longitudinal study of Nobel prize winners | The expansion of Google Scholar versus Web of Science: a longitudinal study | H-Classics: characterizing the concept of citation classics through H-index | Article title type and its relation with the number of downloads and citations | A bibliometric analysis of world volatile organic compounds research trends | A modification of the h-index: The h(m)-index accounts for multi-authored manuscripts | The Cognitive Structure of Library and Information Science: Analysis of Article Title Words | An extension of the Hirsch index: Indexing scientific topics and compounds | A review of the characteristics of 108 author-level bibliometric indicators | A bibliometric approach to the role of author self-citations in scientific communication | The Google Scholar Experiment: How to Index False Papers and Manipulate Bibliometric Indicators | What makes an article influential? Predicting impact in social and personality psychology | The skewness of science in 219 sub-fields and a number of aggregates | Knowledge creation in collaboration networks: Effects of tie configuration | Counting the citations: a comparison of Web of Science and Google Scholar in the field of business and management | On the robustness of the h-index | Conference proceedings as a source of scientific information: A bibliometric analysis | Generalizing the h- and g- indices | Exploring the h-index at the author and journal levels using bibliometric data of productive consumer scholars and business-related journals respectively | The use of theory in information science research | The impact of network embeddedness on research output | Mathematical theory of the h- and g-index in case of fractional counting of authorship | International research collaboration: An emerging domain of innovation studies? | Microsoft Academic Graph: When experts are not enough | Hirsch's h-index: A stochastic model | A new methodology for ranking scientific institutions | A concise review on the role of author self-citations in information science, bibliometrics and science policy | Hirsch-index for countries based on essential science indicators data | Empirical analysis and classification of database errors in Scopus and Web of Science | Beyond the Durfee square: Enhancing the h-index to score total publication output | Successive h-indices | Accuracy and Completeness of Publication and Citation Records in the Web of Science, PsycINFO, and Google Scholar: A Case Study for the Computation of h Indices in Psychology | A longitudinal study of Google Scholar coverage between 2012 and 2013 | Patterns of graduate students' information seeking behavior: a meta-synthesis of the literature | Growth dynamics of scholarly and scientific journals | China's global growth in social science research: Uncovering evidence from bibliometric analyses of SSCI publications (1978-2013) | Using the h-index to rank influential British researchers in information science and librarianship | Dimensions: A competitor to Scopus and the Web of Science? | A distributional approach to multinationality measures of international scientific collaboration | Assessing scientific research performance and impact with single indices | Does co-authorship inflate the share of self-citations? | Is there a place for a mock h-index? | Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison | Technological proximity and recombinative innovation in the alternative energy field | Ranking national research systems by citation indicators. A comparative analysis using whole and fractionalised counting methods | h-index sequence and h-index matrix: Constructions and applications | Quantifying the benefits of international scientific collaboration | The Energy-Exergy-Entropy (or EEE) sequences in bibliometric assessment | The w-Index: A Measure to Assess Scientific Impact by Focusing on Widely Cited Papers | Subfield-specific normalized relative indicators and a new generation of relational charts: Methodological foundations illustrated on the assessment of institutional research performance | Power Law Distributions in Information Science: Making the Case for Logarithmic Binning | A systematic analysis of duplicate records in Scopus | Examining the relationship of co-authorship network centrality and gender on academic research performance: the case of chemistry researchers in Pakistan | q(2)-Index: Quantitative and qualitative evaluation based on the number and impact of papers in the Hirsch core | Dimensions: Bringing down barriers between scientometricians and data | Characteristic scores and scales - A bibliometric analysis of subject characteristics based on long-term citation observation | An empirical investigation of the g-index for 26 physicists in comparison with the h-Index, the A-index, and the R-index | What's in a title? Numbers of words and the presence of colons | Ranking Scientists and Departments in a Consistent Manner
9 Technological transitions as evolutionary reconfiguration processes: a multi-level perspective and a case-study | Typology of sociotechnical transition pathways | From sectoral systems of innovation to socio-technical systems - Insights about dynamics and change from sociology and institutional theory | Sustainability transitions: An emerging field of research and its prospects | Sectoral systems of innovation and production | The governance of sustainable socio-technical transitions | Intermediation and the role of intermediaries in innovation | Analyzing the functional dynamics of technological innovation systems: A scheme of analysis | Inter-firm R&D partnerships: an overview of major trends and patterns since 1960 | Innovation studies and sustainability transitions: The allure of the multi-level perspective and its challenges | Bricolage versus breakthrough: distributed and embedded agency in technology entrepreneurship | What is protective space? Reconsidering niches in transitions to sustainability | Ontologies, socio-technical transitions (to sustainability), and the multi-level perspective | Knowledge bases and regional innovation systems: Comparing Nordic clusters | Containing the Atom: Sociotechnical Imaginaries and Nuclear Power in the United States and South Korea | The micro-determinants of meso-level learning and innovation: evidence from a Chilean wine cluster | Technological innovation systems and the multi-level perspective: Towards an integrated framework | Bridging differing perspectives on technological platforms: Toward an integrative framework | Toward a spatial perspective on sustainability transitions | No project is an island: linking projects to history and context | Co-opetition between giants: Collaboration with competitors for technological innovation | Technological regimes, catching-up and leapfrogging: findings from the Korean industries | Reconceptualising the 'policy mix' for innovation | Knowledge-relatedness in firm technological diversification | Business services as actors of knowledge transformation: the role of KIBS in regional and national innovation systems | Governing transitions in the sustainability of everyday life | Three frames for innovation policy: R&D, systems of innovation and transformative change | Legitimizing research, technology and innovation policies for transformative change Combining insights from innovation systems and multi-level perspective in a comprehensive 'failures' framework | The geography of opportunity: spatial heterogeneity in founding rates and the performance of biotechnology firms | Public procurement and innovation - Resurrecting the demand side | Policy mixes for sustainability transitions: An extended concept and framework for analysis | Creative destruction or mere niche support? Innovation policy mixes for sustainability transitions | Can cities shape socio-technical transitions and how would we know if they were? | A system failure framework for innovation policy design | The enactment of socio-technical transition pathways: A reformulated typology and a comparative multi-level analysis of the German and UK low-carbon electricity transitions (1990-2014) | Knowing in action: Beyond communities of practice | How open is open enough? Melding proprietary and open source platform strategies | What do business models do? Innovation devices in technology entrepreneurship | Benefiting from innovation: Value creation, value appropriation and the role of industry architectures | The structuration of socio-technical regimes-Conceptual foundations from institutional theory | Assessing the impact of organizational learning capability on product innovation performance: An empirical test | The structure and evolution of industrial clusters: Transactions, technology and knowledge spillovers | Does a different view create something new? The effect of employee diversity on innovation | Inter-project learning: processes and outcomes of knowledge codification in project-based firms | How agricultural research systems shape a technological regime that develops genetic engineering but locks out agroecological innovations | Toward a systematic framework for research on dominant designs, technological innovations, and industrial change | Thinking about technology: Applying a cognitive lens to technical change | Scientific teams and institutional collaborations: Evidence from US universities, 1981-1999 | What's in it for me? Creating and appropriating value in innovation-related coopetition | Continental, national and sub-national innovation systems - Complementarity and economic growth | Why Open Source software can succeed | Business models for sustainable technologies: Exploring business model evolution in the case of electric vehicles | Rethinking the multi-level perspective of technological transitions | Systemic instruments for systemic innovation problems: A framework for policy makers and innovation scholars | Conceptualising the heterogeneity of research-based spin-offs: A multi-dimensional taxonomy | Dynamic and integrative capabilities for profiting from innovation in digital platform-based ecosystems | The innovative behaviour of tourism firms- Comparative studies of Denmark and Spain | Cooperation, competition, and innovative capability: a panel data of European dedicated biotechnology firms | Regionally asymmetric knowledge capabilities and open innovation exploring 'Globalisation 2' - A new model of industry organisation | Battles for technological dominance: an integrative framework | Knowledge flows through informal contacts in industrial clusters: myth or reality? | 'Energy regions': The transformative power of regional discourses on socio-technical futures | Innovative competence, exploration and exploitation: The influence of technological diversification | Sources of information as determinants of novelty of innovation in manufacturing firms: evidence from the 1999 Statistics Canada Innovation Survey | Integration of market pull and technology push in the corporate front end and innovation management-Insights from the German software industry | Resolving the knowledge paradox: Knowledge-spillover entrepreneurship and economic growth | Science-industry interaction in the process of innovation: the importance of boundary-crossing between systems | The network of innovators in Jena: An application of social network analysis | Towards a typology of intermediaries in sustainability transitions: A systematic review and a research agenda | Does technological diversification promote innovation? An empirical analysis for European firms | The ex ante assessment of knowledge spillovers: Government R&D policy, economic incentives and private firm behavior | Global Innovation Systems-A conceptual framework for innovation dynamics in transnational contexts | Catch-up cycles and changes in industrial leadership:Windows of opportunity and responses of firms and countries in the evolution of sectoral systems | Public Procurement for Innovation as mission-oriented innovation policy | Fishing upstream: Firm innovation strategy and university research alliances | Influence of government R&D support and inter-firm collaborations on innovation in Korean biotechnology SMEs | The strength of strong ties in the creation of innovation | The impact of technology-push and demand-pull policies on technical change - Does the locus of policies matter? | Exploration and exploitation in innovation systems: The case of pharmaceutical biotechnology | Startup size and the mechanisms of external learning: increasing opportunity and decreasing ability? | Knowledge codification and the geography of innovation: the case of Brescia mechanical cluster | How top management team diversity affects innovativeness and performance via the strategic choice to focus on innovation fields | Sustainability transitions: A political coalition perspective | Technology, institutions, and innovation systems | Knowledge diffusion, market segmentation and technological catch-up: The case of the telecommunication industry in China | The Indian software services industry | Technological change and network dynamics - Lessons from the pharmaceutical industry | Innovation on demand-Can public procurement drive market success of innovations? | Compulsive policy-making-The evolution of the German feed-in tariff system for solar photovoltaic power | The influence of regulations on innovation: A quantitative assessment for OECD countries | Technological discontinuities and the challenge for incumbent firms: Destruction, disruption or creative accumulation? | Profiting from business model innovation: Evidence from Pay-As-You-Drive auto insurance | The destabilisation of existing regimes: Confronting a multi-dimensional framework with a case study of the British coal industry (1913-1967) | Mapping and navigating transitions - The multi-level perspective compared with arenas of development | Profiting from innovation and the intellectual property revolution | Plans are nothing, changing plans is everything: the impact of changes on project success | Global and domestic utilization of industrial relevant science: patent citation analysis of science-technology interactions and knowledge flows | The effects of owner identity and external governance systems on R&D investments: A study of Western European firms | Innovation and regional economic development: A matter of perspective? | Characterizing the policy mix and its impact on eco-innovation: A patent analysis of energy-efficient technologies
10 Software survey: VOSviewer, a computer program for bibliometric mapping | CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature | bibliometrix: An R-tool for comprehensive science mapping analysis | Citation review of Lagergren kinetic rate equation on adsorption reactions | Science Mapping Software Tools: Review, Analysis, and Cooperative Study Among Tools | A unified approach to mapping and clustering of bibliometric networks | The Structure and Dynamics of Cocitation Clusters: A Multiple-Perspective Cocitation Analysis | Co-Citation Analysis, Bibliographic Coupling, and Direct Citation: Which Citation Approach Represents the Research Front Most Accurately? | Citation-based clustering of publications using CitNetExplorer and VOSviewer | Science Mapping: A Systematic Review of the Literature | Mapping the backbone of science | Is science becoming more interdisciplinary? Measuring and mapping six research fields over time | How to Normalize Cooccurrence Data? An Analysis of Some Well-Known Similarity Measures | Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature | Constructing bibliometric networks: A comparison between full and fractional counting | Requirements for a cocitation similarity measure, with special reference to Pearson's correlation coefficient | Mapping knowledge structure by keyword co-occurrence: a first look at journal papers in Technology Foresight | A Global Map of Science Based on the ISI Subject Categories | Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience | A Comparison of Two Techniques for Bibliometric Mapping: Multidimensional Scaling and VOS | Comparing of Science Bibliometric Statistics Obtained From the Web and Scopus | CitNetExplorer: A new software tool for analyzing and visualizing citation networks | Science Overlay Maps: A New Tool for Research Policy and Library Management | Bibliometric analysis of tsunami research | Co-occurrence matrices and their applications in information science: Extending ACA to the Web environment | Multidisciplinarity, interdisciplinarity, and patterns of research collaboration in nanoscience and nanotechnology | Measuring researcher interdisciplinarity | Historiographic mapping of knowledge domains literature | From the science of science to Scientometrics visualizing the history of science with HistCite software | Co-citation analysis and the search for invisible colleges: A methodological evaluation | Patterns of Connections and Movements in Dual-Map Overlays: A New Method of Publication Portfolio Analysis | Global stem cell research trend: Bibliometric analysis as a tool for mapping of trends from 1991 to 2006 | A review of emerging trends in global PPP research: analysis and visualization | Interdisciplinarity in science: A tentative typology of disciplines and research areas | Agent-based computing from multi-agent systems to agent-based models: a visual survey | Scientific literature analysis on big data and internet of things applications on circular economy: a bibliometric study | Pathfinder networks and author cocitation analysis: A remapping of paradigmatic information scientists | Global maps of science based on the new Web-of-Science categories | Algorithmic procedure for finding semantically related journals | Tracking and predicting growth areas in science | Toward a Consensus Map of Science | Indicators of the interdisciplinarity of journals: Diversity, centrality, and citations | Evolution of Research Activities and Intellectual Influences in Information Science 1996-2005: Introducing Author Bibliographic-Coupling Analysis | Assessment of world aerosol research trends by bibliometric analysis | Interdisciplinary research: meaning, metrics and nurture | Emerging trends and new developments in information science: a document co-citation analysis (2009-2016) | Comparative Study on Methods of Detecting Research Fronts Using Different Types of Citation | On the normalization and visualization of author co-citation data: Salton's cosine versus the Jaccard index | Bibliometric analysis of homeopathy research during the period of 1991 to 2003 | Scholarly Network Similarities: How Bibliographic Coupling Networks, Citation Networks, Cocitation Networks, Topical Networks, Coauthorship Networks, and Coword Networks Relate to Each Other | Time line visualization of research fronts | Why do we need algorithmic historiography? | Clustering scientific documents with topic modeling | Use of citation per publication as an indicator to evaluate contingent valuation research | Content-Based and Algorithmic Classifications of Journals: Perspectives on the Dynamics of Scientific Communication and Indexer Effects | Evolution of research subjects in library and information science based on keyword, bibliographical coupling, and co-citation analyses | International scientist mobility and the locus of knowledge and technology transfer | High-impact papers presented in the subject category of water resources in the essential science indicators database of the institute for scientific information | Can scientific journals be classified in terms of aggregated journal-journal citation relations using the Journal Citation Reports? | Diversity of references as an indicator of the interdisciplinarity of journals: Taking similarity between subject fields into account | Detecting the Historical Roots of Research Fields by Reference Publication Year Spectroscopy (RPYS) | Selecting publication keywords for domain analysis in bibliometrics: A comparison of three methods | The Relation Between Pearson's Correlation Coefficient r and Salton's Cosine Measure | Using 'core documents' for detecting and labelling new emerging topics | A bibliometric and citation analysis of stroke-related research in Taiwan | Identifying a better measure of relatedness for mapping science | A new technique for building maps of large scientific domains based on the cocitation of classes and categories | Peer reviews and bibliometric indicators: a comparative study at a Norwegian university | What does it mean to be an author? The intersection of credit, contribution, and collaboration in science | Author cocitation analysis and Pearson's r | A scientometric review of emerging trends and new developments in recommendation systems | Co-word analysis of the trends in stem cells field based on subject heading weighting | Scientific discovery and topological transitions in collaboration networks | Communities, knowledge creation, and information diffusion | A bibliometric analysis of the performance of Water Research | Foundations and trends in performance management. A twenty-five years bibliometric analysis in business and public administration domains | A scientometrics review on aggregation operator research | A co-word analysis of library and information science in China | How Fractional Counting of Citations Affects the Impact Factor: Normalization in Terms of Differences in Citation Potentials Among Fields of Science | Classic articles on social work field in Social Science Citation Index: a bibliometric analysis | Intellectual Structure of Human Resources Management Research: A Bibliometric Analysis of the Journal Human Resource Management, 1985-2005 | How interdisciplinary is a given body of research? | Study of international anticancer research trends via co-word and document co-citation visualization analysis | An approach to interdisciplinarity bibliometric indicators | Creation of a Highly Detailed, Dynamic, Global Model and Map of Science | Dynamic animations of journal maps: Indicators of structural changes and interdisciplinary developments | On bibliographic networks | A new instrument for technology monitoring: novelty in patents measured by semantic patent analysis | The 'home advantage' effect and patent families. A comparison of OECD triadic patents, the USPTO and the EPO | Measuring knowledge transfer between fields of science | Interactive overlays: A new method for generating global journal maps from Web-of-Science data | Global remote sensing research trends during 1991-2010: a bibliometric analysis | The intellectual structure and interdisciplinary breadth of Knowledge Management: A bibliometric study of its early stage of development | The Knowledge Base and Research Front of Information Science 2006-2010: An Author Cocitation and Bibliographic Coupling Analysis | A co-word analysis of digital library field in China | The Shifting Sands of Disciplinary Development: Analyzing North American Library and Information Science Dissertations Using Latent Dirichlet Allocation | Growth of international collaboration in science: revisiting six specialties | The semantic mapping of words and co-words in contexts | Visualizing the marrow of science | Exaptation in a digital innovation ecosystem: The disruptive impacts of 3D printing
The PublicationClassificationLabelingCreator tool can then be run as follows:
java -cp publicationclassificationlabeling-1.0.0.jar nl.cwts.publicationclassificationlabeling.PublicationClassificationLabelingCreator cluster_pub_titles.txt label.txt <your OpenAI API key> gpt-3.5-turbo-1106 true
The cluster labels obtained using the tool can be found in the text file label.txt:
0 Information Science Information Science and Knowledge Management Information Science; Knowledge Management; Social Networks; Sentiment Analysis; User Engagement; Authorship Attribution; Information Quality; Knowledge Sharing; Online Communities; Digital Literacies This cluster of papers covers a wide range of topics in the field of information science and knowledge management, including social networks, sentiment analysis, user engagement, authorship attribution, information quality, knowledge sharing, online communities, and digital literacies. https://en.wikipedia.org/wiki/Information_science
1 Bibliometrics Bibliometrics and Research Evaluation Bibliometric Analysis; Research Impact; Citation Indicators; Journal Rankings; University Funding; Altmetrics; Scientific Prestige; Peer Review Bias; Interdisciplinary Research; Publication Delay This cluster of papers focuses on bibliometrics, research evaluation, and the use of citation and altmetrics indicators to assess scientific impact. It covers topics such as journal rankings, university funding based on publication performance, peer review bias, interdisciplinary research, and the implications of publication delay. The papers also discuss the challenges and consequences of using bibliometric measures in research evaluation. https://en.wikipedia.org/wiki/Bibliometrics
2 Scientific Collaboration Scientific Collaboration and Impact Analysis Scientific Collaboration; Bibliometrics; Research Impact; Network Analysis; International Collaboration; Co-authorship; Citation Analysis; Technology Transfer; Research Productivity; Interdisciplinary Research This cluster of papers focuses on scientific collaboration, bibliometrics, and research impact analysis. It explores topics such as network analysis, international collaboration, co-authorship, citation analysis, and technology transfer. The papers also delve into research productivity, interdisciplinary research, and the impact of funding on research output. https://en.wikipedia.org/wiki/Scientific_collaboration
3 Open Innovation Open Innovation and Collaborative Knowledge Sharing Open Innovation; Collaborative Consumption; R&D Cooperation; Innovative Performance; Knowledge Sharing; Environmental Innovation; SMEs; User Innovations; Absorptive Capacity; Innovation Ecosystems This cluster of papers explores the concept of open innovation, collaborative consumption, and R&D cooperation among small and medium enterprises. It delves into the determinants of innovative performance, user innovations, and the role of absorptive capacity in knowledge sharing. Additionally, it investigates environmental innovation, innovation ecosystems, and the impact of open innovation on firm performance. https://en.wikipedia.org/wiki/Open_innovation
4 University-Industry Relations University-Industry Relations and Technology Transfer University-Industry Relations; Technology Transfer; Innovation; Entrepreneurship; Academic Commercialization; Knowledge Transfer; Spin-off Companies; Incubators; Patents and Licensing; Venture Capital This cluster of papers explores the dynamics of university-industry relations, technology transfer, and innovation commercialization. It delves into topics such as the impact of organizational practices on technology transfer productivity, factors influencing university-industry collaborations, the growth of patenting and licensing by universities, and the role of incubators in new venture creation. The papers also investigate the motivations of academics to engage in research commercialization, the effectiveness of innovation support for small and medium-sized enterprises, and the performance differences between university and corporate spinoffs. https://en.wikipedia.org/wiki/University-industry_collaboration
5 Scientific Communication Trends in Scientific Communication and Impact Measurement Altmetrics; Open Access; Scientific Communication; Bibliometrics; Social Media; Research Impact; Scholarly Publishing; Academic Networking; Citation Analysis; Knowledge Dissemination This cluster of papers explores trends in scientific communication, impact measurement, and knowledge dissemination. It covers topics such as altmetrics, open access, scholarly publishing, social media's role in research impact, and the use of bibliometrics for evaluating scientific output. https://en.wikipedia.org/wiki/Altmetrics
6 Innovation Studies Determinants of National Innovative Capacity and Patent Analysis Innovation; Patent Analysis; National Innovation Systems; Technology; Entrepreneurship; Knowledge Flow; Intellectual Property Rights; Firm Innovation; R&D; Science Policy This cluster of papers explores the determinants of national innovative capacity, patent analysis, technology, entrepreneurship, knowledge flow, intellectual property rights, firm innovation, R&D, and science policy. It delves into topics such as the impact of innovation activities on firm performance, university-industry collaborations, and the influence of strategic patenting on companies' patent portfolios. https://en.wikipedia.org/wiki/Innovation
7 Responsible Innovation Framework for Responsible Research and Innovation Responsible Innovation; Research Collaboration; Science Policy; Knowledge Production; Technology Transfer; Academic Entrepreneurship; Interdisciplinary Collaboration; Research Impact Assessment; Innovation Efficiency; Societal Effects of Research This cluster of papers focuses on developing a framework for responsible research and innovation, emphasizing responsible innovation, research collaboration, science policy, knowledge production, technology transfer, academic entrepreneurship, interdisciplinary collaboration, research impact assessment, innovation efficiency, and societal effects of research. https://en.wikipedia.org/wiki/Responsible_Research_and_Innovation
8 Bibliometric Analysis Bibliometric Analysis of Research Impact Metrics Bibliometric Analysis; Research Impact Metrics; Citation Counts; h-Index; Co-authorship Networks; Scientific Collaboration; Google Scholar; Web of Science; Scopus; Publication Dynamics This cluster of papers focuses on the bibliometric analysis of research impact metrics, including citation counts, h-index, and the impact of data sources such as Google Scholar, Web of Science, and Scopus. It also explores the influence of co-authorship networks and scientific collaboration on research performance, as well as the dynamics of scholarly publication. https://en.wikipedia.org/wiki/Bibliometrics
9 Technological Transitions Evolutionary Reconfiguration Processes in Technological Transitions Socio-Technical Transitions; Innovation Systems; Sustainability Transitions; Technology Entrepreneurship; Knowledge Spillovers; Policy Mixes; Open Innovation; Industrial Clusters; Demand-Side Innovation; Intellectual Property This cluster of papers explores the evolutionary reconfiguration processes in technological transitions, focusing on socio-technical transitions, innovation systems, sustainability transitions, technology entrepreneurship, knowledge spillovers, policy mixes, open innovation, industrial clusters, demand-side innovation, and intellectual property. The research delves into understanding the dynamics and change in various sectors and regions, as well as the role of governance and intermediaries in fostering innovation. It also examines the impact of regulations and public procurement on driving market success of innovations. https://en.wikipedia.org/wiki/Technological_transition
10 Bibliometric Mapping Bibliometric Mapping and Interdisciplinary Research Analysis Bibliometric Mapping; Interdisciplinary Research; Citation Analysis; Co-citation Clustering; Scientific Literature Analysis; Science Mapping Software; Research Front Detection; Knowledge Structure Mapping; Author Cocitation Analysis; Global Research Trends This cluster of papers focuses on bibliometric mapping, citation analysis, and interdisciplinary research analysis using various software tools and techniques. It covers topics such as co-citation clustering, author cocitation analysis, research front detection, and mapping knowledge structure. The papers also explore global research trends and the use of science mapping software for analyzing scientific literature. https://en.wikipedia.org/wiki/Bibliometrics
The tool displays the following output:
PublicationClassificationLabelingCreator version 1.0.0
By Nees Jan van Eck
Centre for Science and Technology Studies (CWTS), Leiden University
Reading publication titles from file... Finished!
Reading publication titles from file took 0h 0m 0s.
Creating labeling for each cluster...
Creating labeling cluster 0... Finished!
Labeling:
Short label: Information Science
Long label: Information Science and Knowledge Management
Keywords: Information Science; Knowledge Management; Social Networks; Sentiment Analysis; User Engagement; Authorship Attribution; Information Quality; Knowledge Sharing; Online Communities; Digital Literacies
Summary: This cluster of papers covers a wide range of topics in the field of information science and knowledge management, including social networks, sentiment analysis, user engagement, authorship attribution, information quality, knowledge sharing, online communities, and digital literacies.
Wikipedia: https://en.wikipedia.org/wiki/Information_science
Creating labeling cluster 1... Finished!
Labeling:
Short label: Bibliometrics
Long label: Bibliometrics and Research Evaluation
Keywords: Bibliometric Analysis; Research Impact; Citation Indicators; Journal Rankings; University Funding; Altmetrics; Scientific Prestige; Peer Review Bias; Interdisciplinary Research; Publication Delay
Summary: This cluster of papers focuses on bibliometrics, research evaluation, and the use of citation and altmetrics indicators to assess scientific impact. It covers topics such as journal rankings, university funding based on publication performance, peer review bias, interdisciplinary research, and the implications of publication delay. The papers also discuss the challenges and consequences of using bibliometric measures in research evaluation.
Wikipedia: https://en.wikipedia.org/wiki/Bibliometrics
Creating labeling cluster 2... Finished!
Labeling:
Short label: Scientific Collaboration
Long label: Scientific Collaboration and Impact Analysis
Keywords: Scientific Collaboration; Bibliometrics; Research Impact; Network Analysis; International Collaboration; Co-authorship; Citation Analysis; Technology Transfer; Research Productivity; Interdisciplinary Research
Summary: This cluster of papers focuses on scientific collaboration, bibliometrics, and research impact analysis. It explores topics such as network analysis, international collaboration, co-authorship, citation analysis, and technology transfer. The papers also delve into research productivity, interdisciplinary research, and the impact of funding on research output.
Wikipedia: https://en.wikipedia.org/wiki/Scientific_collaboration
Creating labeling cluster 3... Finished!
Labeling:
Short label: Open Innovation
Long label: Open Innovation and Collaborative Knowledge Sharing
Keywords: Open Innovation; Collaborative Consumption; R&D Cooperation; Innovative Performance; Knowledge Sharing; Environmental Innovation; SMEs; User Innovations; Absorptive Capacity; Innovation Ecosystems
Summary: This cluster of papers explores the concept of open innovation, collaborative consumption, and R&D cooperation among small and medium enterprises. It delves into the determinants of innovative performance, user innovations, and the role of absorptive capacity in knowledge sharing. Additionally, it investigates environmental innovation, innovation ecosystems, and the impact of open innovation on firm performance.
Wikipedia: https://en.wikipedia.org/wiki/Open_innovation
Creating labeling cluster 4... Finished!
Labeling:
Short label: University-Industry Relations
Long label: University-Industry Relations and Technology Transfer
Keywords: University-Industry Relations; Technology Transfer; Innovation; Entrepreneurship; Academic Commercialization; Knowledge Transfer; Spin-off Companies; Incubators; Patents and Licensing; Venture Capital
Summary: This cluster of papers explores the dynamics of university-industry relations, technology transfer, and innovation commercialization. It delves into topics such as the impact of organizational practices on technology transfer productivity, factors influencing university-industry collaborations, the growth of patenting and licensing by universities, and the role of incubators in new venture creation. The papers also investigate the motivations of academics to engage in research commercialization, the effectiveness of innovation support for small and medium-sized enterprises, and the performance differences between university and corporate spinoffs.
Wikipedia: https://en.wikipedia.org/wiki/University-industry_collaboration
Creating labeling cluster 5... Finished!
Labeling:
Short label: Scientific Communication
Long label: Trends in Scientific Communication and Impact Measurement
Keywords: Altmetrics; Open Access; Scientific Communication; Bibliometrics; Social Media; Research Impact; Scholarly Publishing; Academic Networking; Citation Analysis; Knowledge Dissemination
Summary: This cluster of papers explores trends in scientific communication, impact measurement, and knowledge dissemination. It covers topics such as altmetrics, open access, scholarly publishing, social media's role in research impact, and the use of bibliometrics for evaluating scientific output.
Wikipedia: https://en.wikipedia.org/wiki/Altmetrics
Creating labeling cluster 6... Finished!
Labeling:
Short label: Innovation Studies
Long label: Determinants of National Innovative Capacity and Patent Analysis
Keywords: Innovation; Patent Analysis; National Innovation Systems; Technology; Entrepreneurship; Knowledge Flow; Intellectual Property Rights; Firm Innovation; R&D; Science Policy
Summary: This cluster of papers explores the determinants of national innovative capacity, patent analysis, technology, entrepreneurship, knowledge flow, intellectual property rights, firm innovation, R&D, and science policy. It delves into topics such as the impact of innovation activities on firm performance, university-industry collaborations, and the influence of strategic patenting on companies' patent portfolios.
Wikipedia: https://en.wikipedia.org/wiki/Innovation
Creating labeling cluster 7... Finished!
Labeling:
Short label: Responsible Innovation
Long label: Framework for Responsible Research and Innovation
Keywords: Responsible Innovation; Research Collaboration; Science Policy; Knowledge Production; Technology Transfer; Academic Entrepreneurship; Interdisciplinary Collaboration; Research Impact Assessment; Innovation Efficiency; Societal Effects of Research
Summary: This cluster of papers focuses on developing a framework for responsible research and innovation, emphasizing responsible innovation, research collaboration, science policy, knowledge production, technology transfer, academic entrepreneurship, interdisciplinary collaboration, research impact assessment, innovation efficiency, and societal effects of research.
Wikipedia: https://en.wikipedia.org/wiki/Responsible_Research_and_Innovation
Creating labeling cluster 8... Finished!
Labeling:
Short label: Bibliometric Analysis
Long label: Bibliometric Analysis of Research Impact Metrics
Keywords: Bibliometric Analysis; Research Impact Metrics; Citation Counts; h-Index; Co-authorship Networks; Scientific Collaboration; Google Scholar; Web of Science; Scopus; Publication Dynamics
Summary: This cluster of papers focuses on the bibliometric analysis of research impact metrics, including citation counts, h-index, and the impact of data sources such as Google Scholar, Web of Science, and Scopus. It also explores the influence of co-authorship networks and scientific collaboration on research performance, as well as the dynamics of scholarly publication.
Wikipedia: https://en.wikipedia.org/wiki/Bibliometrics
Creating labeling cluster 9... Finished!
Labeling:
Short label: Technological Transitions
Long label: Evolutionary Reconfiguration Processes in Technological Transitions
Keywords: Socio-Technical Transitions; Innovation Systems; Sustainability Transitions; Technology Entrepreneurship; Knowledge Spillovers; Policy Mixes; Open Innovation; Industrial Clusters; Demand-Side Innovation; Intellectual Property
Summary: This cluster of papers explores the evolutionary reconfiguration processes in technological transitions, focusing on socio-technical transitions, innovation systems, sustainability transitions, technology entrepreneurship, knowledge spillovers, policy mixes, open innovation, industrial clusters, demand-side innovation, and intellectual property. The research delves into understanding the dynamics and change in various sectors and regions, as well as the role of governance and intermediaries in fostering innovation. It also examines the impact of regulations and public procurement on driving market success of innovations.
Wikipedia: https://en.wikipedia.org/wiki/Technological_transition
Creating labeling cluster 10... Finished!
Labeling:
Short label: Bibliometric Mapping
Long label: Bibliometric Mapping and Interdisciplinary Research Analysis
Keywords: Bibliometric Mapping; Interdisciplinary Research; Citation Analysis; Co-citation Clustering; Scientific Literature Analysis; Science Mapping Software; Research Front Detection; Knowledge Structure Mapping; Author Cocitation Analysis; Global Research Trends
Summary: This cluster of papers focuses on bibliometric mapping, citation analysis, and interdisciplinary research analysis using various software tools and techniques. It covers topics such as co-citation clustering, author cocitation analysis, research front detection, and mapping knowledge structure. The papers also explore global research trends and the use of science mapping software for analyzing scientific literature.
Wikipedia: https://en.wikipedia.org/wiki/Bibliometrics
Creating labeling for each cluster took 0h 1m 16s.
Writing labeling to file... Finished!
Writing labeling to file took 0h 0m 0s.
The publicationclassificationlabeling package is distributed under the MIT license.
If you encounter any issues, please report them using the issue tracker on GitHub.
You are welcome to contribute to the development of the publicationclassificationlabeling package. Please follow the typical GitHub workflow: Fork from this repository and make a pull request to submit your changes. Make sure that your pull request has a clear description and that the code has been properly tested.
The latest stable version of the source code is available in the main branch on GitHub. The most recent version of the source code, which may be under development, is available in the develop branch.
To compile the source code of the publicationclassificationlabeling package, a Java Development Kit needs to be installed on your system (version 8 or higher). Having Gradle installed is optional as the Gradle Wrapper is also included in this repository.
On Windows systems, the source code can be compiled as follows:
gradlew build
On Linux and MacOS systems, use the following command:
./gradlew build
The compiled class files can be found in the directory build/classes.
The compiled jar file can be found in the directory build/libs.
The compiled javadoc files can be found in the directory build/docs.
The class nl.cwts.publicationclassificationlabeling.run.PublicationClassificationLabelingCreator has a main method. After compiling the source code, the PublicationClassificationLabelingCreator tool can be run as follows:
java -cp build/libs/publicationclassificationlabeling-<version>.jar nl.cwts.publicationclassificationlabeling.run.PublicationClassificationLabelingCreator