4

My research points towards "no".

From here:

Full Text Indexes Are Data About Books, and That’s Fair Use

From here:

full-text indexing is allowed as fair use under US copyright law. Indices are allowed as "transformative uses".

This source also suggests a technical way of full-text indexing without copyright infringement under two assumptions:

  1. You can't infringe the copyright to a work if you don't copy the work.
  2. If you can't reconstruct a work from its index, then distributing copies of the index doesn't infringe on the work's copyright.

However, most of the sources I could find online focus on the US and are some 10 year old. What is the latest development in this field (with focus on the EU)? Are there technical ways of avoiding an infringement of copyright?

Technical Introduction

In contrast to a metadata search that searches documents (web content, books, and other) by means of metadata (e.g. the author, date of creation, etc.) a full-text search is looking for occurrences of words, phrases, whole sentences, paragraphs, or - generally speaking - strings of characters in the document's text corpus.

A full-text index is a rather broad term for a technical solution to the problem of finding strings of characters in a text corpus without having to scan the whole document every time.

Usually, a full-text index is created by scanning the whole document and collecting statistics on the frequency of words (and so on) and often also the words' position in the document. That depends on the purpose of the index. Some indexes answer whether a words is in the document at all, others how often, or even where in the document.

To directly address the question raised by @DPenner1 in the comments: In general, indexes can identify arbitrary long phrases.

I don't know whether this is of importance but, as also the second source points out, it is sometimes technically possible to calculate (accurately) or guess the original text corpus from the index.

Once the index has been created, it is (technically) possible to copy and disseminate the index without the original text-corpus.

2
  • 2
    Note that both of your sources mention fair use which is a concept specific to US copyright law. EU copyright law is up to the individual member states, though it's currently in a process of harmonization through the EU Copyright Directive. EU laws on text mining are still pretty uneven.
    – amon
    Feb 26 at 5:47
  • 1
    This isn't a technical site, could you elaborate on the details of a full-text index? Eg. I don't really see how indexing all words individually would be an infringement in EU law, but if that index can identify phrases, then there could be more debate.
    – DPenner1
    Feb 26 at 17:08

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.