Reflecting on 10 Years of the TIM Review

For the past 10 years, this journal has published monthly issues on the theories, strategies, and tools relevant to launching and growing technology businesses. In seeking to bring together diverse viewpoints – from academics, entrepreneurs, companies of all sizes, the public sector, the community sector, and others – the Technology Innovation Management Review (TIM Review) has tried to bridge the gap between theory and practice. The journal’s aim is to provide significant benefits to readers, authors, guest editors, partners, and stakeholders worldwide.


Introduction
For the past 10 years, this journal has published monthly issues on the theories, strategies, and tools relevant to launching and growing technology businesses.In seeking to bring together diverse viewpoints -from academics, entrepreneurs, companies of all sizes, the public sector, the community sector, and others -the Technology Innovation Management Review (TIM Review) has tried to bridge the gap between theory and practice.The journal's aim is to provide significant benefits to readers, authors, guest editors, partners, and stakeholders worldwide.
In this article, we trace the evolution of the journal by analyzing its distinct aspects, the topics it covered, the authors that contributed to it, and the extent to which its articles were read and cited.Our goals are to share with others the lessons learned and to use these lessons to inform the future directions of the journal.

A Brief History of the TIM Review
Ten years ago, this journal was launched as part of a government program "to help business innovators take their products to market" (DeFoe, 2007).With financial support from the Ontario Ministry of Research and Innovation and led by the Technology Innovation Management (TIM) Program (timprogram.ca)at Carleton University in Ottawa, Canada, the journal was a key component of a province-wide project to encourage research commercialization and knowledge transfer, initially within Ontario, then to the rest of Canada, and then worldwide.
The goal of the government program was to spur economic development in Ontario by helping its researchers and entrepreneurs "to combine their expertise to help commercialize their innovations and create highvalue jobs" (DeFoe, 2007).Carleton University's project -the Talent First Network -sought to develop and In July 2007, the first issue of this journal was published under the banner of the Open Source Business Resource.Re-launched with a broader scope in 2011 as the Technology Innovation Management Review, the journal now celebrates its 10th anniversary.In this article, we review the 10-year history of the journal to examine what themes have been covered, who has contributed, and how much the articles have been read and cited.During those 10 years, the journal has published 120 monthly issues, including more than 800 publications by more than 800 international authors from industry, academia, the public sector, and beyond.As discovered with topic modelling, the journal has covered seven themes: open source business, technology entrepreneurship, growing a business, research approaches, social innovation, living labs, and cybersecurity.Overall, the website has attracted over 1 million readers from around the world -31% from Asia, 30% from the Americas, 26% from Europe, 8% from Africa, and 5% from Oceaniawith over 25,000 readers now accessing the site each month.
Fare forward, you who think that you are voyaging; You are not those who saw the harbour Receding, or those who will disembark.
Here between the hither and the farther shore While time is withdrawn, consider the future And the past with an equal mind.
T. S. Eliot (1888Eliot ( -1965) ) Poet, dramatist, and literary critic In The Dry Salvages (1941) " " www.timreview.ca transfer "knowledge about how businesses can use open source assets and processes to generate revenue and reduce costs" (Bailetti, 2007).The project leads decided that a monthly journal appealing to a cross-section of relevant audiences could help develop and disseminate relevant knowledge to help companies compete in emerging technology-based domains (Bailetti, 2007).Thus, this journal was launched in July 2007 by its founding Editor-in-Chief, Dru Lavigne, as the Open Source Business Resource (OSBR).As its focus, the journal sought to answer the question of how to make money with something that is free: to explore the business side of open source (McPhee, 2011).However, the choice to focus on open source software was more about developing understanding and capability within a new competitive environment that it was about free software (Bailetti, 2007).
As open source became "a better-

Distinctive features
The following features have distinguished the journal through its 10-year history: 1. Free to readers and authors: To encourage a diversity of readers and authors, and to remove financial barriers to access or contribution, the journal is online and fully open access and no fees are charged to authors, despite a rigorous peer review process and a high level of editorial support.Authors also retain copyright of their work, which is published in the journal under a Creative Commons Attribution licence (CC-BY; creativecommons.org/licenses/by/3.0/).Readers are encouraged to share and build upon the insights published in the journal.

Monthly issues with short publication timescales:
The journal is published monthly with publication timelines of three to four months, which may be normal or even long for most practitioner publications but are short for most academic publications.The intention (and challenge) is to provide a steady flow of insights at the pace of business while still meeting the requirements of academic contributors.

Themed issues:
In most issues, the journal brings together authors who can provide diverse perspectives on a theme.The journal now also publishes regular (unthemed) issues of articles fitting the overall scope of the journal.

Guest editors:
Guest editors play a key role in defining the vision for themed issues and recruiting high-quality authors to contribute.Through their networks, the journal is able to access new areas of expertise and efficiently grow its community.

Practical implications:
Given the focus on the theories, strategies, and tools that help small and large technology companies succeed, authors are required to emphasize the practical implications of their work.

Diversity:
The journal is designed to bring together diverse viewpoints -from academics, entrepreneurs, companies of all sizes, the public sector, the community sector, and others -to bridge the gap between theory and practice.
7. Rigorous editorial process: All articles published in the journal are peer reviewed using a double-blind process.Regardless of whether they represent industry or academia, authors undergo the same process and write using the same format.The intention is to bring diverse authors together to share insights and to avoid segregating audiences based on article format.Although practitioners must provide adequate support and explanation for any assertions or shared insights, they are not expected to draw upon academic sources.Publications based on research must meet high standards for methodology and analysis while also making the results and their implications accessible to a diverse audience that includes non-academics.
8. Author support: Following peer review and revision, authors whose articles have been accepted receive unique value in the form of editorial support, which goes far beyond copyediting and proofreading to include advice and recommendations on how to im-

Reflecting on 10 Years of the TIM Review
Chris McPhee, Teemu Santonen, Ahmed Shah, and Ali Nazari www.timreview.ca prove their articles, particularly to ensure it will be accessible to diverse readers.This editorial support is provided free of charge to improve the quality of the journal but also to extend its international reach, particularly to authors whose first language is not English.9. Emphasis on emerging topics: The journal was founded based on a need to understand an emerging domain (open source business), and this remains an emphasis.The journal provides guest editors, authors, and readers with opportunities to explore emerging areas, where there may be more questions than answers.

Types of content
In all, there have been 795 publications in the TIM Review up to and including the May 2017 issue (Table 1), which is the timeframe used for most analyses in this article.In each monthly issue of the journal, the Editorin-Chief and the Guest Editors contribute an editorial to introduce that issue's editorial theme and give notice of upcoming issues and events.These editorials represent 15% (118) of all publications.Articles, however, form the core of the TIM Review content: this publication type has accounted for almost 75% (590) of all content published in the journal (Table 1).Less commonly, authors write shorter, less formal pieces focusing on a single practical question: these 39 "Q&As" account for about 5% of the content.Finally, 6% of the content takes the form of 48 summaries from the TIM Lecture Series at Carleton University, which is hosted by the TIM Program.The TIM Lectures provide a forum to promote the transfer of knowledge between university research to technology company executives and entrepreneurs as well as research and development personnel.The lecture subjects mirror areas of interest to the academic program, which are also reflected in the scope of the journal, and both have evolved in parallel over the 10year history of the journal.

Themes
To examine the text of 10 years of TIM Review articles, we used topic modelling, which is a text-mining technique for discovering themes in a large collection of documents (Blei, 2012).The technique assumes that documents are "mixtures of topics", where a topic is a group of words that frequently occur together (McCallum, 2002;Steyvers & Griffiths, 2007).Even when documents are labelled or dominant topics are well known, topic modelling can help discover hidden patterns or provide additional structure to organize, search, navigate, or summarize large collections of documents.The two key outputs of generating a topic model on a collection of documents are: i) a list of topics (i.e., groups of words that frequency occurs together) and ii) lists of the documents that are strongly associated with each of the topics.Ideally, groups of documents that are identified as highly associated with a given topic should be related to each other, and each topic should be distinguishable from other topics.
To generate a topic model for the TIM Review, we used "MALLET: A Machine Learning for Language Toolkit" (mallet.cs.umass.edu),which is open source software developed by Andrew McCallum and other contributors at the University of Massachusetts and the University of Pennsylvania (McCallum, 2002).We pre-processed the text data by defining a list of "stop words" (i.e., familiar words to be ignored in the analysis such as "a", "and", "the", "etc.","TIM", "review", and "author"), stemming the text (i.e., treating "agent" and "agents" as the same word), and joining multi-word terms (e.g., converting "living labs" and "supply chain" to "living_labs" and "supply_chain").
Here, we report the results obtained when generating seven topics in the topic modelling algorithm.Each topic is represented by a set of words that describe the topic and degree to which individual publications are associated to it.Based on our interpretation of these sets of words and our knowledge of the documents associated with each of them, we inferred and applied a subjective label, or "theme", to each of the seven topics identified by the algorithm.
Table 2 lists the seven themes along with their topic words, which are the 20 words that are most likely to occur in publications within that topic.The subsections that follow discuss each of the discovered themes and their associated content (i.e., issues and articles), including results examining the topics over time, which

Reflecting on 10 Years of the TIM Review
Chris McPhee, Teemu Santonen, Ahmed Shah, and Ali Nazari

Open Source Business
For this topic, the model returned words commonly associated with open source and its intersection with business, such as "open source" (and related terms), "license", "proprietary", "free", and "commercial" (Table 2).Given the history of the journal, it is expected that the emphasis on the "Open Source Business" theme would decrease over time, and this trend is reflected in the results (Figure 1).Although open source business was the dominant theme in the journal's early history, it is now rarely covered.The business aspects of open source shifted from being a thread that ran through most of the journal's early publications to a subject that was addressed in recurring special issues specifically dedicated to open source business in January of 2011, 2012, 2013, and 2014, as indicated in Figure 1.

Technology Entrepreneurship
The theme of "Technology Entrepreneurship" is relevant throughout the 10 years of the journal.It relates to the business side of open source, as reflected by its minor presence in early articles, but it was given greater emphasis from 2010 onwards (Figure 2), particularly in the early issues following the re-launch of the TIM Review.Notably, four consecutive issues on Technology Entrepreneurship were published in early 2012 (see Bailetti et al., 2012 for an overview of the four issues), and the several articles in these issues have played a key role in the subsequent growth of the journal, as will be discussed later.Aside from publications within these dedicated special issues, many other articles are associated with the theme of Technology Entrepreneurship, particularly since the re-launch of the journal.

Growing a Business
Articles associated with the theme of "Growing a Business" cover processes, methods, strategies, and other aspects relating to the practical aspects of launching and growing technology businesses, such as developing business models, platforms and business ecosystems, products and services, customers, capabilities, and markets.Although not strongly associated with any special issues or particular efforts in this regard (Figure 3), they highlight the journal's emphasis on the practical implications of the articles, whether they come from academic authors, industry authors, or others., but this theme's increasing emphasis reflects both greater attention to this area following the relaunch of the journal and the journal's increasingly academic perspective.However, the articles associated with this theme also represent a bridging of theory and practice given they seek to identify the research questions, trends, and approaches that will best support technology companies.

Social Innovation
Throughout the 10 years, the journal has published many articles with a strong social innovation element.Indeed, tracking the "Social Innovation" theme over time (Figure 5) highlights contributions from several special issues related to social issues, including: • Social Innovation in September 2008 and July 2012.
• Women in Open Source in June 2009 and, to a lesser degree, Women Entrepreneurs in July 2011.
• Humanitarian Open Source in December 2010.More recently, however, articles from several special issues on innovation have shown associations with this theme, likely because of a terminology overlap and common ideas around building relationships and communities, considering all viewpoints and bringing people together to contribute ideas, share knowledge, etc.These shared concepts may explain the associations from articles associated with the following special issues and contributions: • Articles related to community building, which is a particularly important concept in open source projects.
• Articles related to collaboration and open innovation approaches, including an issue on Local Open Innovation in March 2013.
• A special issue on Creativity in Innovation in July 2015.
• A special issue on Knowledge Mobilization in September 2016.

Living Labs
A particularly prominent theme in the TIM Review has been "Living Labs", which has featured in seven special issues beginning in September 2012 (Figure 6).The prominence of this theme and the special issues was triggered and driven by the appointment of Mika Westerlund to the Given the conceptual overlap, the theme of Living Labs also includes associations from non-living-lab articles that focus on co-creation, open innovation, and service innovation, which are recurring subjects in the TIM Review.
Finally, note that the TIM Review archive of articles on the subject of living labs has been reviewed recently as part of efforts to develop a framework of the defining characteristics of urban living labs (Steen & van Bueren, 2017), which is featured in the same issue as the present article.

Cybersecurity
The seventh theme emerging from topic modelling the TIM Review's 10-year database is "Cybersecurity".Although some early articles are associated with cybersecurity through its relevance to open source software, the theme truly emerges more recently through the journal's partnerships with the VENUS Cybersecurity Corporation (which was first announced in the TIM Review: see Bailetti et al., 2013), Canada's Communications Security Establishment (CSE), and Carleton University's Global Cybersecurity Resource (GCR).These partnerships have also led to a new initiative to develop topic modelling and machine learning tools to discover and explore topics in the TIM Review, and the current analyses represent only an initial step towards this capability.Since July 2013, the TIM Review has published 9 special issues on Cybersecurity (Figure 7).In the case of the OSBR, there are no correlations.In light of the increasingly international reach of the TIM Review since the re-launch, the tendency to favour larger co-author teams is not a surprise: it is in line with prior suggestions from Santonen and Ritala (2014), who viewed a trend of increasing co-authorship as an indicator of increased knowledge sharing and creation, as a result of the collaboration that co-authorship requires (Newman, 2004).
Contributor origins and roles TIM review authors represent 33 countries, which break down by continent as shown in Figure 9.As reported at the time of the re-launch (McPhee, 2011), 85% of OSBR authors were from Canada or the United States, but over the entire 10-year period, the continent of the Americas represents 56% of the overall author community (Figure 9), with an increasing representation of European authors accounting for most of the change (12% vs. 36%).

Chris McPhee, Teemu Santonen, Ahmed Shah, and Ali Nazari
The authors also represent a diversity of roles.Based on their primary affiliations, we identify 56% of authors as representing academia, with 38% of those at the professor or post-doctoral level and 18% being graduate students.Private sector contributors represent 27% of authors and the public and third sectors make up the final 17%.Relative to the OSBR, the TIM Review attracts more academic contributions (McPhee, 2015); however, we note these results under-represent contributors from the private and public sector who are concurrently undertaking graduate studies, which is a common situation in the TIM Program, for example.

Partners
The growth of the TIM Review has been accelerated by partnerships with like-minded and complementary organizations.As the following examples illustrate, these collaborations have typically centered around network building and the production of special issues: • Lead To Win: In several ways, the TIM Review has greatly benefitted from its relationship to the Lead To Win entrepreneurship program (LTW; leadtowin.ca).Led by Carleton University, Lead To Win was recognized by UBI Global as a Top University Business Incubator, which ranked the program seventh overall in North America (Sprott, 2015).In addition to issue sponsorship, the journal has received many contributions from Lead To Win entrepreneurs and mentors, and it has been an ongoing source of insights, ideas, and research projects.
• ISPIM: Since March 2013, the TIM Review has published 11 special issues related to conferences and other events held by the International Society for Professional Innovation Management (ISPIM; ispim-innovation.org).Even some of the collaborations underpinning the co-authorship of this article result from relationships built at ISPIM events (e.g., Santonen & Conn, 2015).
• ENoLL: The TIM Review's extensive publications on the theme of "Living Labs" (as described earlier) have benefitted from special issues in partnership with the European Network of Living Labs (ENoLL; openliving labs.eu), and the journal has received numerous additional contributions from members of its network.
• GCR: The Global Cybersecurity Resource (GCR) is a Carleton University project funded by FedDev Ontario (feddevontario.gc.ca) and focused on growing cybersecurity and cybersecurity-differentiated companies.The GCR has identified analytics -as exemplified by the topic modelling analyses presented earlier in this article -as one means of providing novel and potentially instrumental insights to such companies.

Readership growth
Over its 10-year history, the journal has attracted over 1 million readers, defined as unique visitors (or users) according to its website analytics.Early in the journal's This sustained low level of readership prompted the TIM Program to re-think the journal's objective.A research project was then undertaken to develop a results-based organization design methodology, which drew upon lessons learned from theory and from operating the OSBR, to establish design principles for the re-launch of the journal in October 2011 (McPhee, 2012a(McPhee, , 2012b)).
Following the successful re-launch of the journal, and buoyed by its early success in restoring readership to near-peak levels, in May 2012, the TIM Program declared a goal of reaching 10,000 monthly readers of the TIM Review as part of a TIM Lecture that was subsequently published in the journal (TIM Lecture Series, 2012).This goal of tripling the journal's readership was surpassed a little more than a year later.Now, in 2017, current readership levels fluctuate around 25,000 readers per month (Figure 10).In recent years, as the journal's archive has attracted an increasing share of visits, the monthly readership patterns reflect seasonal fluctuations on a background of growth (Figure 10).

Global reach
In the first issue of the OSBR, the founding Editor-in-Chief declared that: "Initially, the scope of the OSBR will be the province of Ontario, then Canada, and eventually the world" (Lavigne, 2007).Although geographical readership data from the OSBR are not available, the authorship data indeed shows a focus centred on the city of Ottawa, where the journal is based at Carleton University, and a strong majority of authors from Canada.As shown above, the author diversity has become increasingly global since the journal was launched, and the readership data shows an even stronger global reach since the re-launch of the journal in 2011.At 31%, Asia has the highest share of readers based on visits to the journal's website (http://timreview.ca)since October 2011 (Figure 9).Close behind, the Americas represent 30% of readers, 19% of which are in the United States.Only 9% of TIM Review readers are based in Canada.The third major component of readership comes from Europe at 26%.Finally, 8% of readers are in Africa 5% are in Oceania.

Popularity
In terms of which publication types have proven most popular with readers, articles (N=590) clearly have the strongest impact given that they have generated 85% of pageviews on the journal's website since the re-launch.On average, an article will generate 2,063 pageviews.Editorials (N=118) generate less than 2% of all pageviews, which suggests that they are only valued by those who   ).Nearly all the citations (N=2827, 98%) have been made to articles, and only a small number of these have had the greatest impact.
The top five articles alone account for 21% of all citations, and the top 10 account for 32% of all citations.In all, there are only three publications with more than 100 citations.Furthermore, for articles, pageviews as a genuine impact metric was also partially validated: article pageviews and citations were moderately correlated (0.536**, sig.0.000).As Table 5 shows, most of the publications attracting a high number of citations are TIM Review articles; among the 10 most-cited articles, only one is an OSBR article (ranked 4th).Notably, articles on living labs represent 4 of the top 10 articles (and 12 of the top 20 articles; not shown).

Conclusion
This journal was launched 10 years ago by the Talent First Network and the TIM Program at Carleton University to promote economic development by providing companies within its region with competitive advantages through increased understanding of the business side of open source.However, not only did this primary

Reflecting on 10 Years of the TIM Review
Chris McPhee, Teemu Santonen, Ahmed Shah, and Ali Nazari goal change over time in parallel with the evolution of the TIM Program, the journal was also intended to provide additional benefits, which took on increasing importance over time as the scope of the journal and its global reach expanded.
In terms of the next 10 years, the journal seeks to continue to provide benefits to its readers, contributors, partners, and other stakeholders, particularly through increased growth and the use of innovative technologies.For example, the journal is developing new tools based on machine learning and topic modelling to deliver increased value to its various audiences.Future growth will depend on further community building and partnerships to reach new contributors and readers.We will apply the lessons of the journal's past when considering its future.

Table 1 .
Distribution of number of publications by publication type Reflecting on 10 Years of the TIM Review Chris McPhee, Teemu Santonen, Ahmed Shah, and Ali Nazari allowed us to track the evolving importance of the seven identified themes over the 10-year publishing record of the TIM Review.Figures 1 to 7 show the monthly changes in each theme, including a fitted line to summarize the overall trend.

Figure 1 .Figure 2 .
Figure 1.Tracking the "Open Source Business" theme in the OSBR and TIM Review (2007-2017) with key special issues marked

Table 2 .
The seven themes of the TIM Review from 2007 to 2017 and their associated topic words, as discovered using topic modelling

Reflecting on 10 Years of the TIM Review
ChrisMcPhee, Teemu Santonen, Ahmed Shah, and Ali NazariOther articles that have strong associations to this theme have come from special issues:• An issue on Women Entrepreneurs in July 2011.•Issues focusing on entrepreneurship and innovation in particular countries, such as India in August 2014 and May 2016 and Australia in June 2016.
Table 3 lists the top 10 countries by author and readers, further highlighting the European contributions with six out of the top 10 countries for authors being from Europe.
Figure 8. Growth of the TIM Review author community per year and cumulatively

Table 3 .
Top 10 countries by TIM Review authors and readers

Table 4 .
Top 10 articles by pageviews In all, TIM Review and OSBR publications have generated 2,893 citations.A majority of the citations (2,411 citations, 83%) have been generated by TIM Review publications, whereas OSBR publications have generated www.timreview.ca

Reflecting on 10 Years of the TIM Review
only 482 citations (17%

Table 5 .
Top 10 most-cited articles

Table 6 .
Top 10 most-cited authors and their number of articles www.timreview.caReflecting

on 10 Years of the TIM Review Chris
McPhee, Teemu Santonen, Ahmed Shah, and Ali NazariAbout the AuthorsChris McPhee is Editor-in-Chief of the Technology Innovation Management Review.Chris holds an MASc degree in Technology Innovation Management from Carleton University in Ottawa, Canada, and BScH and MSc degrees in Biology from Queen's University in Kingston, Canada.He has nearly 20 years of management, design, and content-development experience in Canada and Scotland, primarily in the science, health, and education sectors.As an advisor and editor, he helps entrepreneurs, executives, and researchers develop and express their ideas.Teemu Santonen is a Principal Lecturer at the Laurea University of Applied Sciences in Finland and is leading Laurea's Centre for Applied Research and Development (CARD) in the area of Service Design and Open Innovation.At Laurea, he has personally initiated and managed various research projects achieving 2.5 M EUR in cumulative funding.He received his PhD (Econ.)degree in Information Systems Science from Aalto University in Finland in 2005 and has published or presented over 50 papers in international peer-refereed journals and at conferences.Currently, his research interests focus on social network analysis (SNA), Scientometrics", and innovation management.At Laurea, Santonen has also filed several invention disclosures that have resulted in a startup company and one patent.The Finnish Inventor Support Association has honoured Santonen's novel crowdsourcing project as the best school-related innovation in Finland.He is also a scientific panel member of ISPIM (The International Society for Professional Innovation Management) and is a former board member of Finnish Strategic Management Society.Prior to his academic career, Santonen worked for over a decade as a consultant and development manager in leading Finnish financial, media, and ICT sector organizations.Ahmed Shah holds a BEng in Software Engineering from Lakehead University in Thunder Bay, Canada, and an MEng in Technology Innovation Management from Carleton University in Ottawa, Canada.Ahmed has experience working in a wide variety of research roles at the VENUS Cybersecurity Corporation, the Global Cybersecurity Resource, and Carleton University.Ali Nazari is a consultant in the field of information technology and software applications.Ali holds a BSc degree in Computer Science from Shahid Beheshti University in Tehran, Iran, and an MSc degree in Technology Information Management from Payam Noor University, also in Tehran.Currently, he is a graduate student in the Technology Innovation Management Program at Carleton University in Ottawa, Canada.He has 7 years of experience in data analysis, design, and development of IT/software applications and 10 years of experience with planning, consulting, and managing IT/software issues.