7.0 Processing Rules for Underlying COUNTER Reporting Data

Usage data collected by content providers for the usage reports to be sent to customers should meet the basic requirement that only intended usage is recorded and that all requests that are not intended by the user A person who accesses the online resourceare removed.

Because the way usage records are generated can differ across platforms, it is impractical to describe all the possible filters Limits or restrictions placed on the usage to be included in a COUNTER report usually expressed as a name-value pair, i.e. “Access_Type=Controlled”and techniques used to clean up the data. This Code of Practice, therefore, specifies only the requirements to be met by the data to be used for building the usage reports.

7.1 Return Codes

Only successful and valid requests MUST be counted. For web server log files successful requests are those with specific W3C Status Codes, codes (200 and 304). The standards for return codes are defined and maintained by W3C (http://www.w3.org/Protocols/HTTP/HTRESP.html). If key events are used, their definition MUST match the W3C standards. (For more information see The Friendly Guide to Release 5: Technical Notes for Content Providers.)

7.2 Double-Click Repeated click on the same link by the same user A person who accesses the online resourcewithin a period of 30 seconds. COUNTER requires that that double-clicks that occur in an interval of 30 seconds or less must be removed.Filtering

The intent of double-click Repeated click on the same link by the same user A person who accesses the online resourcewithin a period of 30 seconds. COUNTER requires that that double-clicks that occur in an interval of 30 seconds or less must be removed.filtering is to remove the potential of over-counting which could occur when a user A person who accesses the online resourceclicks the same link multiple times, typically due to a slow internet connection. Double-click filtering applies to Total_Item_Investigations, Total_Item_Requests, No_License and Limit_Exceeded. See Sections 7.3 and 7.4 below for information about counting unique items and titles. The double-click Repeated click on the same link by the same user A person who accesses the online resourcewithin a period of 30 seconds. COUNTER requires that that double-clicks that occur in an interval of 30 seconds or less must be removed.filtering rule is as follows:

Double-clicks, i.e. two clicks in succession, on a link by the same user A person who accesses the online resourcewithin a 30-second period MUST be counted as one action. For the purposes of COUNTER, the time window for a double-click Repeated click on the same link by the same user A person who accesses the online resourcewithin a period of 30 seconds. COUNTER requires that that double-clicks that occur in an interval of 30 seconds or less must be removed.on any page is set at a maximum of 30 seconds between the first and second mouse clicks. For example, a click at 10:01:00 and a second click at 10:01:29 would be considered a double-click (one action); a click at 10:01:00 and a second click at 10:01:35 would count as two separate single clicks (two actions).

A double-click Repeated click on the same link by the same user A person who accesses the online resourcewithin a period of 30 seconds. COUNTER requires that that double-clicks that occur in an interval of 30 seconds or less must be removed.may be triggered by a mouse-click or by pressing a refresh or back button. When two actions are made for the same URL within 30 seconds the first request A category of COUNTER “Metric Type” that represent a user A person who accesses the online resourceaccessing content (i.e. full text of an “Article”)MUST be removed and the second retained.

Any additional requests for the same URL within 30 seconds (between clicks) MUST be treated identically: always remove the first and retain the second.

There are different ways to track whether two requests for the same URL are from the same user A person who accesses the online resourceand session. These options are listed in order of increasing reliability, with Option 4 being the most reliable.

1. If the user A person who accesses the online resourceis authenticated only through an IP address, that IP address Internet Protocol (IP) address of the computer on which the session is conducted and may be used by content providers as a means of authentication and authorization and for identifying the institution a user is affiliated with. The identifying network address (typically four 8-bit numbers, aaa.bbb.cc.dd) of the user's computer or proxy.combined with the browser’s user-agent (logged in the HTTP header) MUST be used to trace double-clicks. Where you have multiple users on a single IP address Internet Protocol (IP) address of the computer on which the session is conducted and may be used by content providers as a means of authentication and authorization and for identifying the institution a user is affiliated with. The identifying network address (typically four 8-bit numbers, aaa.bbb.cc.dd) of the user's computer or proxy.with the same browser user-agent, this can occasionally lead to separate clicks from different users being logged as a double click from one user. This will only happen if the multiple users are clicking on exactly the same content within a few seconds of each other.
2. When a session cookie A data file that a web server can set to a browser to track activity by that browser and attribute that usage to a session.is implemented and logged, the session cookie A data file that a web server can set to a browser to track activity by that browser and attribute that usage to a session.MUST be used to trace double-clicks.
3. When a user A person who accesses the online resourcecookie is available and logged, the user A person who accesses the online resourcecookie MUST be used to trace double-clicks.
4. When an individual has logged in with their own profile, their username MUST be used to trace double-clicks.

7.3 Counting Unique Items

Some COUNTER Metric_Types count the number of unique items that had a certain activity, such as a Unique_Item_Requests or Unique_Item_Investigations.

For the purpose of COUNTER metrics, an item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.is the typical unit of content being accessed by users, such as articles, book chapters, book sections, whole books (if delivered as a single file), and multimedia Non-textual media such as images, audio and video.content. The item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.MUST be identified using the unique ID which identifies the work (e.g. chapter or article) regardless of format (e.g. PDF, HTML, or EPUB). If no item-level identifier is available, then use the item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.name in combination with the identifier of the parent In COUNTER “Item Reports” the “Parent” is the publication an item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.is part of i.e. for a “Journal Article”, the “Parent” is the “Journal”; and for a “Book Chapter”, the “Parent” is the “Book”.item (i.e. the article An item of original written work published in a “Journal”, other serial publication, or in a “Book”. An “Article” is complete, but usually cites other relevant published works in its list of “References”, if it has one. A COUNTER “Data_Type” used to identify and filter usage of content defined as “Articles”.title + ISSN of the journal, or chapter A subdivision of a “Book” or of some categories of “Reference Work”; usually numbered and titled. A COUNTER “Section_Type”.name + ISBN of the book).

The rules for calculating the unique item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.counts are as follows:

If multiple transactions qualifying for the Metric_Type in question represent the same item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.and occur in the same user-sessions, only one unique activity MUST be counted for that item.

A user A person who accesses the online resourcesession is defined any of the following ways: by a logged session A successful “Request” of an online service. It starts when a user connects to the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)or “Database” and ends by terminating activity that is either explicit (by leaving the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)through exit or logout) or implicit (timeout due to user inactivity). (NISO)ID + transaction date, by a logged user A person who accesses the online resourceID (if users log in with personal accounts) + transaction date + hour of day (day is divided into 24 one-hour slices), by a logged user A person who accesses the online resourcecookie + transaction date + hour of day, or by a combination of IP address + user agent + transaction date + hour of day.

To allow for simplicity in calculating session A successful “Request” of an online service. It starts when a user connects to the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)or “Database” and ends by terminating activity that is either explicit (by leaving the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)through exit or logout) or implicit (timeout due to user inactivity). (NISO)IDs, when a session ID A unique identifier that identifies a unique user A person who accesses the online resourcesession and is used to group usage events for double-click; “Unique_Item” and “Unique_Title” filtersis not explicitly tracked, the day will be divided into 24 one-hour slices and a surrogate session ID A unique identifier that identifies a unique user A person who accesses the online resourcesession and is used to group usage events for double-click; “Unique_Item” and “Unique_Title” filterswill be generated by combining the transaction A usage event.date + hour time slice + one of the following: user ID, cookie ID, or IP address + user agent. For example, consider the following transaction:

• Transaction date/time: 2017-06-15 13:35
• IP address: 192.1.1.168
• User agent: Mozilla/5.0
• Generated session A successful “Request” of an online service. It starts when a user connects to the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)or “Database” and ends by terminating activity that is either explicit (by leaving the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)through exit or logout) or implicit (timeout due to user inactivity). (NISO)ID: 192.1.1.168|Mozilla/5.0|2017-06-15|13

The above replacement for a session ID A unique identifier that identifies a unique user A person who accesses the online resourcesession and is used to group usage events for double-click; “Unique_Item” and “Unique_Title” filtersdoes not provide an exact analogy to a session. However, statistical studies show that the result of using such a surrogate for a session ID A unique identifier that identifies a unique user A person who accesses the online resourcesession and is used to group usage events for double-click; “Unique_Item” and “Unique_Title” filtersresults in unique counts are within 1–2 % of unique counts generated with actual sessions.

7.4 Counting Unique Titles

Some COUNTER Metric_Types count the number of unique titles that had a certain activity, such as a Unique_Title_Requests or Unique_Title_Investigations.

For the purpose of COUNTER metrics, a title represents the parent In COUNTER “Item Reports” the “Parent” is the publication an item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.is part of i.e. for a “Journal Article”, the “Parent” is the “Journal”; and for a “Book Chapter”, the “Parent” is the “Book”.work that the item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.is part of. When the item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.is a chapter A subdivision of a “Book” or of some categories of “Reference Work”; usually numbered and titled. A COUNTER “Section_Type”.or section, the title is the book. The title MUST be identified using a unique identifier (e.g. an ISBN The International Standard Book A non-serial publication of any length available in print (in hard or soft covers or in loose-leaf format) or in electronic format. A COUNTER “Data_Type”.Number (ISBN) is a unique 13-digit number used to identify a “Book”.for a book) regardless of format (e.g. PDF or HTML).

The rules for calculating the unique title counts are as follows:

If multiple transactions qualifying for the Metric_Type in question represent the same title and occur in the same user-session only one unique activity MUST be counted for that title.

A user A person who accesses the online resourcesession is defined any of the following ways: by a logged session A successful “Request” of an online service. It starts when a user connects to the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)or “Database” and ends by terminating activity that is either explicit (by leaving the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)through exit or logout) or implicit (timeout due to user inactivity). (NISO)ID + transaction date, by a logged user A person who accesses the online resourceID (if users log in with personal accounts) + transaction date + hour of day (day is divided into 24 one-hour slices), by a logged user A person who accesses the online resourcecookie + transaction date + hour of day, or by a combination of IP address + user agent + transaction date + hour of day.

To allow for simplicity in calculating session A successful “Request” of an online service. It starts when a user connects to the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)or “Database” and ends by terminating activity that is either explicit (by leaving the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)through exit or logout) or implicit (timeout due to user inactivity). (NISO)IDs, when a session ID A unique identifier that identifies a unique user A person who accesses the online resourcesession and is used to group usage events for double-click; “Unique_Item” and “Unique_Title” filtersis not explicitly tracked, the day will be divided into 24 one-hour slices and a surrogate session ID A unique identifier that identifies a unique user A person who accesses the online resourcesession and is used to group usage events for double-click; “Unique_Item” and “Unique_Title” filterswill be generated by combining the transaction A usage event.date + hour time slice + one of the following: user ID, cookie ID, or IP address + user agent. For example, consider the following transaction:

• Transaction date/time: 2017-06-15 13:35
• IP address: 192.1.1.168
• User agent: Mozilla/5.0
• Generated session A successful “Request” of an online service. It starts when a user connects to the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)or “Database” and ends by terminating activity that is either explicit (by leaving the service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)through exit or logout) or implicit (timeout due to user inactivity). (NISO)ID: 192.1.1.168|Mozilla/5.0|2017-06-15|13

The above replacement for a session ID A unique identifier that identifies a unique user A person who accesses the online resourcesession and is used to group usage events for double-click; “Unique_Item” and “Unique_Title” filtersdoes not provide an exact analogy to a session. However, statistical studies show that the result of using such a surrogate for a session ID A unique identifier that identifies a unique user A person who accesses the online resourcesession and is used to group usage events for double-click; “Unique_Item” and “Unique_Title” filtersresults in unique counts are within 1–2 % of unique counts generated with actual sessions.

7.5 Attributing Usage when Item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.Appears in More Than One Database

Content providers that offer databases where a given content item (e.g. an article) is included in multiple databases MUST attribute the Investigations and Requests metrics to just one database. The following recommendations may be helpful when choosing when ambiguity arises:

• Give priority to databases that the institution The organization for which usage is being reported.has rights to access.
• If there is a priority order for databases for search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.or display within the platform, credit usage to the highest priority database.
• Beyond that, use a consistent method of prioritizing database, such as by database ID or name.
• If none of the above, pick randomly.

7.6 Federated Searches

Search activity generated by federated search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.engines MUST be categorized separately from searches conducted by users on the host platform.

Any searches generated from a federated search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.system MUST be included in the separate Searches_Federated A COUNTER “Metric Type” used to report “Searches” conducted through a “Federated Search” service. See also “Federated Search”.counts within Database Reports and MUST NOT be included in the Searches_Regular or Searches_Automated A COUNTER “Metric Type” used to report “Searches” conducted through a discovery service An online information host that provides that capability for users to “Search” a wide variety of content from a single “Search” interface. Access to content is facilitated through direct access to content hosted on the site as well as through a variety of linking technologies to access content at other content sites.or by an “Automated Search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.Agent”. See also “Automated Search”counts.

The most common ways to recognize federated search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.activity are as follows:

• A federated search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.engine may be using its own dedicated IP address, which can be identified and used to separate out the activity.
• If the standard HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browsersinterface is being used (e.g. for screen scraping), the user A person who accesses the online resourceagent within the web log files can be used to identify the activity as coming from a federated search.
• For Z39.50 An international standard protocol created by “NISO” for search.  A Z39.50 client can search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.any Z39.50 compatible online service.  Often used by Federated Search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.services to facilitate searching content at other sites.activity, authentication is usually through a username/password combination. Create a unique username/password that just the federated search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.engine will use.
• If an API or XML gateway An intermediary online service which does not 4 ECO typically host the items requested by the user. The gateway will either refer the user to another site or service to download the item, or will request the item from another site or service and delivers it to the user within its own gateway environment. Items may be cachedis available, set up an instance of the gateway An intermediary online service which does not 4 ECO typically host the items requested by the user. The gateway will either refer the user to another site or service to download the item, or will request the item from another site or service and delivers it to the user within its own gateway environment. Items may be cachedthat is for the exclusive use of federated search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.tools. It is RECOMMENDED that you also require the federated search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.to include an identifying parameter when making requests to the gateway.

COUNTER provides lists of user A person who accesses the online resourceagents that represent the most common federated search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.tools. See Appendix G.

7.7 Discovery Services and Other Multiple-Database Searches

Search activity generated by discovery services and other systems where multiple databases not explicitly selected by the end user A person who accesses the online resourceare searched simultaneously MUST be counted as Searches_Automated A COUNTER “Metric Type” used to report “Searches” conducted through a discovery service An online information host that provides that capability for users to “Search” a wide variety of content from a single “Search” interface. Access to content is facilitated through direct access to content hosted on the site as well as through a variety of linking technologies to access content at other content sites.or by an “Automated Search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.Agent”. See also “Automated Search”on Database Reports. Such searches MUST be included on the Platform Reports A series of COUNTER reports that provide usage aggregated to the “Platform” level.as Searches_Platform, but only as a single search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.regardless of the number of databases searched.

Example: A user A person who accesses the online resourcesearches a content site where the librarian has pre-selected 20 databases for business and economics searches. For each search A user-driven intellectual query, typically equated to submitting the “Search” form of the online service A branded group of online information products from one or more vendors that can be subscribed to/licensed and searched as a complete service, or at a lower level (e.g. a collection)to the server.conducted by the user:

• In the Database Report, each of the 20 databases gets credit for 1 Searches_Automated.
• In the Platform An interface from a “Content Provider” that delivers the content to the user A person who accesses the online resourceand that counts and provides the COUNTER usage reports.Report, Searches_Platform gets credited by 1.

7.8 Internet Robots and Crawlers

Activity generated by internet robots and crawlers MUST be excluded from all COUNTER usage reports. COUNTER provides a list of user A person who accesses the online resourceagent values that represent the crawlers and robots that MUST be excluded. Any transaction A usage event.with a user A person who accesses the online resourceagent matching one on the list MUST NOT be included in COUNTER reports.

COUNTER maintains the current list of internet robots and crawlers at https://github.com/atmire/COUNTER-Robots

7.9 Tools and Features that Enable Bulk Downloading

Only genuine, user-driven usage MUST be reported. COUNTER reports MUST NOT include usage that represents requests of full-text content when it is initiated by automatic or semi-automatic bulk download A single event where multiple content items are downloaded to the user’s computer.tools where the downloads occur without direct user A person who accesses the online resourceaction.

• Products like Quosa or Pubget MUST only be recorded only when the user A person who accesses the online resourcehas clicked on the downloaded full-text article The complete text, including all references, figures and tables, of an article, plus links to any supplementary material published with itin order to open it.
• Full text retrieved by automated processes such as reference manager software or robots (see Section 7.8 above) MUST be excluded.
• Usage that occurs through emailing of a list of articles (Requests) or citations (Investigations) that was not as a result of a user A person who accesses the online resourceexplicitly selecting the items for sharing MUST be excluded. Note that the act of a user A person who accesses the online resourceexplicitly sharing an item Collective term for content which is reported at a high level of granularity, e.g. “Full Text Article” (original or a review of other published work); an “Abstract” or digest of a “Full Text Article”; a sectional HTML Article formatted in HTML so as to be readable by a web browser Hypertext Markup Language. A form of text markup readable by web browserspage; supplementary material associated with a “Full Text Article” (e.g. a supplementary data set), or non-textual resources, such as an image, a video, audio, dataset, piece of code, chemical structure or reaction.would be considered an Investigation, and a user A person who accesses the online resourcedownloading and then emailing a PDF Portable Document Format, file formatted for the Adobe Acrobat reader. Items such as full-text articles or journals published in PDF format tend to replicate the printed page in appearancewould also be considered a Request.

7.10 Text and Data Mining

Text and data mining (TDM) is a computational process whereby text or datasets are crawled by software that recognizes entities, relationships, and actions. (STM Statement on Text and Data Mining)

TDM does NOT include straightforward information retrieval, straightforward information extraction, abstracting and summarising activity, automated translation, or summarising query-response systems.

A key feature of TDM “Text and Data Mining” (“TDM”) is a computational process whereby text or datasets are crawled by software that recognizes entities, relationships and actions. (STM Publishers) An “Access_Method” in a COUNTER report used to separate regular A COUNTER “Access_Method”. Indicates that usage was generated by a human user A person who accesses the online resourcebrowsing/searching a website, rather than by “Text and Data Mining” (“TDM”) processes.usage from usage that represents access to content for the purposes of “Text and Data Mining”.is the discovery of unknown associations based on categories that will be revealed as a result of computational and linguistic analytical tools.

Principles for reporting usage:

• COUNTER does not record TDM “Text and Data Mining” (“TDM”) is a computational process whereby text or datasets are crawled by software that recognizes entities, relationships and actions. (STM Publishers) An “Access_Method” in a COUNTER report used to separate regular A COUNTER “Access_Method”. Indicates that usage was generated by a human user A person who accesses the online resourcebrowsing/searching a website, rather than by “Text and Data Mining” (“TDM”) processes.usage from usage that represents access to content for the purposes of “Text and Data Mining”.itself, as most of this activity takes place after an article An item of original written work published in a “Journal”, other serial publication, or in a “Book”. An “Article” is complete, but usually cites other relevant published works in its list of “References”, if it has one. A COUNTER “Data_Type” used to identify and filter usage of content defined as “Articles”.has been downloaded. All we can do is track the count of articles downloaded for the purposes of mining.
• Usage associated with TDM “Text and Data Mining” (“TDM”) is a computational process whereby text or datasets are crawled by software that recognizes entities, relationships and actions. (STM Publishers) An “Access_Method” in a COUNTER report used to separate regular A COUNTER “Access_Method”. Indicates that usage was generated by a human user A person who accesses the online resourcebrowsing/searching a website, rather than by “Text and Data Mining” (“TDM”) processes.usage from usage that represents access to content for the purposes of “Text and Data Mining”.activity (e.g. articles downloaded for the purpose of TDM) MUST be tracked by assigning an Access_Method A COUNTER attribute indicating whether the usage related to an “Investigation” or a “Request” was generated by a human user A person who accesses the online resourcebrowsing and searching a website (“Regular”) or by “Text and Data Mining” processes (“TDM”).of TDM.
• Usage associated with TDM “Text and Data Mining” (“TDM”) is a computational process whereby text or datasets are crawled by software that recognizes entities, relationships and actions. (STM Publishers) An “Access_Method” in a COUNTER report used to separate regular A COUNTER “Access_Method”. Indicates that usage was generated by a human user A person who accesses the online resourcebrowsing/searching a website, rather than by “Text and Data Mining” (“TDM”) processes.usage from usage that represents access to content for the purposes of “Text and Data Mining”.activity MUST be reported using the Title, Database, and Platform An interface from a “Content Provider” that delivers the content to the user A person who accesses the online resourceand that counts and provides the COUNTER usage reports.Master Reports by identifying such usage as Access_Method=TDM.
• Usage associated with TDM “Text and Data Mining” (“TDM”) is a computational process whereby text or datasets are crawled by software that recognizes entities, relationships and actions. (STM Publishers) An “Access_Method” in a COUNTER report used to separate regular A COUNTER “Access_Method”. Indicates that usage was generated by a human user A person who accesses the online resourcebrowsing/searching a website, rather than by “Text and Data Mining” (“TDM”) processes.usage from usage that represents access to content for the purposes of “Text and Data Mining”.activity MUST NOT be reported in Standard Views (TR_J1, TR_B1, etc.).

Detecting activity related to TDM:
TDM activity typically requires a prior agreement between the content provider An organization whose function is to commission, create, collect, validate, host, distribute and trade information in electronic form and in doing so provides usage data. This includes organisations sometimes referred to as “Publishers”, “Vendors”, “Platforms” and/or “Intermediaries”.and the individual or organization downloading the content for the purpose of text mining. The content provider An organization whose function is to commission, create, collect, validate, host, distribute and trade information in electronic form and in doing so provides usage data. This includes organisations sometimes referred to as “Publishers”, “Vendors”, “Platforms” and/or “Intermediaries”.can isolate TDM-related traffic using techniques like:

• Providing a dedicated end-point that is specifically for TDM “Text and Data Mining” (“TDM”) is a computational process whereby text or datasets are crawled by software that recognizes entities, relationships and actions. (STM Publishers) An “Access_Method” in a COUNTER report used to separate regular A COUNTER “Access_Method”. Indicates that usage was generated by a human user A person who accesses the online resourcebrowsing/searching a website, rather than by “Text and Data Mining” (“TDM”) processes.usage from usage that represents access to content for the purposes of “Text and Data Mining”.data harvesting.
• Requiring the use of a special account or profile for TDM “Text and Data Mining” (“TDM”) is a computational process whereby text or datasets are crawled by software that recognizes entities, relationships and actions. (STM Publishers) An “Access_Method” in a COUNTER report used to separate regular A COUNTER “Access_Method”. Indicates that usage was generated by a human user A person who accesses the online resourcebrowsing/searching a website, rather than by “Text and Data Mining” (“TDM”) processes.usage from usage that represents access to content for the purposes of “Text and Data Mining”.data harvesting.
• Assigning an API key that would be used for the harvesting.
• Registering the IP address Internet Protocol (IP) address of the computer on which the session is conducted and may be used by content providers as a means of authentication and authorization and for identifying the institution a user is affiliated with. The identifying network address (typically four 8-bit numbers, aaa.bbb.cc.dd) of the user's computer or proxy.of the machine harvesting content.

Harvesting of content for TDM “Text and Data Mining” (“TDM”) is a computational process whereby text or datasets are crawled by software that recognizes entities, relationships and actions. (STM Publishers) An “Access_Method” in a COUNTER report used to separate regular A COUNTER “Access_Method”. Indicates that usage was generated by a human user A person who accesses the online resourcebrowsing/searching a website, rather than by “Text and Data Mining” (“TDM”) processes.usage from usage that represents access to content for the purposes of “Text and Data Mining”.without permission or without using the endpoint or protocol supplied by the content provider An organization whose function is to commission, create, collect, validate, host, distribute and trade information in electronic form and in doing so provides usage data. This includes organisations sometimes referred to as “Publishers”, “Vendors”, “Platforms” and/or “Intermediaries”.MUST be treated as robot or crawler Any automated program or script which visits websites and systematically retrieves information from them, often to provide indexes for search engines.traffic and MUST be excluded from all COUNTER reports.