-
Notifications
You must be signed in to change notification settings - Fork 4
Expand file tree
/
Copy pathsampling_proposal.html
More file actions
7 lines (7 loc) · 19.8 KB
/
sampling_proposal.html
File metadata and controls
7 lines (7 loc) · 19.8 KB
1
2
3
4
5
6
7
<?xml version="1.0" encoding="UTF-8"?><html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en"><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /><!--THIS FILE IS GENERATED FROM AN XML MASTER. DO NOT EDIT (5)--><title>Sampling criteria for the ELTeC</title><meta name="author" content="COST Action CA16204 – WG1" /><meta name="generator" content="Text Encoding Initiative Consortium XSLT stylesheets" /><meta name="DC.Title" content="Sampling criteria for the ELTeC" /><meta name="DC.Type" content="Text" /><meta name="DC.Format" content="text/html" /><link href="http://www.tei-c.org/release/xml/tei/stylesheet/tei.css" rel="stylesheet" type="text/css" /><link rel="stylesheet" media="print" type="text/css" href="http://www.tei-c.org/release/xml/tei/stylesheet/tei-print.css" /></head><body class="simple" id="TOP"><div class="stdheader autogenerated"><h1 class="maintitle">Sampling criteria for the ELTeC</h1></div><!--TEI front--><h2>Table of contents</h2><ul class="toc toc_body"><li class="toc"><span class="headingNumber">1. </span><a class="toc toc_0" href="#index.xml-body.1_div.1">Task</a></li><li class="toc"><span class="headingNumber">2. </span><a class="toc toc_0" href="#index.xml-body.1_div.2">Method</a></li><li class="toc"><span class="headingNumber">3. </span><a class="toc toc_0" href="#index.xml-body.1_div.3">Objectives of sampling criteria </a></li><li class="toc"><span class="headingNumber">4. </span><a class="toc toc_0" href="#index.xml-body.1_div.4">Sampling criteria </a><ul class="toc"><li class="toc"><span class="headingNumber">4.1. </span><a class="toc toc_1" href="#index.xml-body.1_div.4_div.1">Eligibility criteria </a></li><li class="toc"><span class="headingNumber">4.2. </span><a class="toc toc_1" href="#index.xml-body.1_div.4_div.2">Composition criteria </a></li></ul></li><li class="toc"><span class="headingNumber">5. </span><a class="toc toc_0" href="#index.xml-body.1_div.5">Metadata for texts in ELTeC </a></li><li class="toc"><span class="headingNumber">6. </span><a class="toc toc_0" href="#index.xml-body.1_div.6">Literature</a></li></ul><!--TEI body--><div class="teidiv0" id="index.xml-body.1_div.1"><h2><span class="headingNumber">1. </span><span class="head">Task</span></h2><p>The task for WG1 is to develop guidelines for data and metadata for the creation of the ELTeC. This task can be split up into several distinct tasks: Guidelines for corpus design, basic annotation and metadata schemes and workflow. This discussion paper focuses on corpus design and metadata because both tasks interplay with each other.</p><p>The goal of CA16204 is to create a big benchmark corpus of literature from 1840-1920 (first period) for different computational distant reading methods for corpus annotation and analysis. The task of creating annotation guidelines of WG1 needs to be closely communicated and coordinated with WG2 in order to know which methods and tools needs which kind(s) of annotation model and format. The same holds for the development of the metadata scheme. </p><p>For creating such a benchmark corpus, we need a corpus design which allows for a comparability of texts and individual sub-collections according to different metadata set(s). It should be possible for every COST Action member to sample sub-collections from the ELTeC for specific tasks and research questions. In a first step, we focus on the development of clear, operationalized, transparent and motivated selection criteria for the corpus.</p><p>It is important to stress that we do not intend to define what a novel is by defining what kind of selection criteria we will use for ELTeC. The category novel may be divided into three groups where at least one of the following core criteria is met: a) textual: length (>10.000 words), prose, fiction, narrative structure b) peritextual (the term ‘novel’ (or its equivalent) in the title or subtitle of the text ) and c) contextual: the text is bibliographically listed with the UDC: 82-31 Novels. Full-length stories.</p></div><div class="teidiv0" id="index.xml-body.1_div.2"><h2><span class="headingNumber">2. </span><span class="head">Method</span></h2><p>We follow a non-normative but metadata-based approach of sampling criteria which will follow a corpus design approach. Corpus sampling criteria are mostly oriented/developed by the research question or/and contexts of the corpus creators group. In CA16204, we have neither only a single research question nor a fixed and previously known corpus creator group. The research context of the Action is more interested in knowledge production in a methodological sense and does not prefer a single method, model or theory. Furthermore, the member group of the Action will fluctuate and consist of researches from different disciplines with different theoretical and cultural contexts. Thus, we need to build the corpus design on a methodical basis. With this method, we will also be able to select canonical texts as well but not exclusively. </p><p>Representativeness is a kind of ideal which we would like to pursue but which cannot be achieved as whole. We will therefore aim to represent the variety of a population. In line with the MoU, the ELTeC will be designed as a monitor corpus where texts (from different languages and periods) can be added over time. We then need to decide which criterion is balanced in which way and interplays with other criteria.</p></div><div class="teidiv0" id="index.xml-body.1_div.3"><h2><span class="headingNumber">3. </span><span class="head">Objectives of sampling criteria </span></h2><p>According to the MoU, the corpus design should be balanced with respect to language and publication date of the texts. This means that the corpus should not be based solely on chronological criteria, meaning that we need a text from each year of the period in question. The main sampling criterion ‘language’ will require not to include translations at all. We will prefer to take the first edition of a novel or editions of these novels. By a novel, we prefer to take the edition of the book, hence we don't prefer novels only printed in journals, unless a particular literary tradition only features novels printed in serial format. If we consider editions of a novel, these editions should be freely available (free licences for reusing them. The first edition is more interesting from a philological point of view. It represents the authentic texts of the authors. Dealing with historical texts might require some cleaning up or normalizations. We will merge all word forms which are seperated by line breaks. At the moment, we must assume that there are no (sufficiently good) normalization tools for every language. Later editions of a novel may be already normalized in some way. This might lead to different text representations in ELTeC which should be indicated in the metadata. </p><p>Considering also later freely available editions of a novel has two advantages: First, members of the Action already can provide machine-readable text documents (html, TEI etc.) of later editions and second, in some languages it might be easier to find later editions which already exist in a machine-readable format (in this way we do not have to put effort in digitizing them).</p><p>Electronically availability should not be a leading sampling criterion althoug availability is a limiting factor. A text should not be excluded from ELTeC because it is not digitized, but it should be excluded if the text cannot be made freely available in ELTeC. If we only use availability as a selecting criterion, we are at risk of copying projects such as ‘Gutenberg’ for example. The issue remains of finding additional funds to digitise non-canonical books. Un til that moment, the solution would be to create pilot corpora (that can later be supplemented or substituted by an alterna tive) for literatures that do not have a significant number of digitized texts. </p><p>We then need additional criteria which can be applied without having to know (read) the texts in question. The criteria should be checked without a deep knowledge about the texts. Otherwise, this will oppose the goal of the whole Action and the methodical approach of distant reading. The criteria should be operationalizable, meaning decidable from text metadata. Here, we define text metadata in a wider scope than only the classical bibliographical metadata. In this way corpus design interacts with metadata. Some of the text’s metadata can be used as sampling criteria. These criteria are text-external and -internal criteria (cf. Hunston 2008) on which we then need to rely. The selection criteria may be assisted by bibliographical overviews (wherever available) for each language in order to avoid possible canon-derived bias. </p><p>We suggest using an online table as a means of collecting nominations for inclusion in the ELTeC but other methods are feasible. </p></div><div class="teidiv0" id="index.xml-body.1_div.4"><h2><span class="headingNumber">4. </span><span class="head">Sampling criteria </span></h2><p>For creating a language collection two steps have to be done: First step is selection: identifying text candidates. Second step is balancing: proportion within the corpus. Both steps are defined in this document.</p><p>The following principles apply: </p><ul><li class="item">We will represent the variety of production and aim to maximize the variety within each time period.</li><li class="item">We will prefer to collect novels published as a book in first as well as later editions over novels published in serial publications (journals).</li><li class="item">We will not include translations.</li><li class="item">We will consider only freely available texts and trying to reuse already digitized texts.</li><li class="item">We will use non-normative sampling criteria which allow for selecting canonical novels and non-canonical novels.</li><li class="item">Metadata should indicate the type of text representation (normalized or non-normalized, first or later editions etc.). </li><li class="item">We will strictly follow the selection and balancing criteria and we prefer 80 novels meeting these criteria over 100 novels which do not meet the criteria.</li></ul><div class="teidiv1" id="index.xml-body.1_div.4_div.1"><h3><span class="headingNumber">4.1. </span><span class="head">Eligibility criteria </span></h3><p>In order to be considered for inclusion, a text must... </p><ul><li class="item">have been first published as a book (or exceptionally as a serial publication) between 1840 and 1920s, </li><li class="item">have first been published in a European country. [maybe not "first": within that decade],</li><li class="item">be a novel, i.e. a fictional prose narrative of at least 10000 words</li><li class="item">have originally been written in the language of the given subcollection.</li></ul><p>The MoU defines the languages to be sampled. It does not propose distinguishing regional variation (e.g. in German), nor geographical variation (e.g. the French spoken in Belgium, France, or Switzerland). It assumes only European varieties, so English excludes US English; French excludes Quebecois. </p><p>We follow a language-based approach (not country-based). This means for example that we include Swiss German texts in the German language collection. We prefer standard varieties over dialect varieties if sampling criteria for text candidates are met. </p><ul><li class="item">Open Question: Maybe some Exceptions: - Publication place is a sometimes a problem: e.g. for Portuguese novels published in as Brazilian publications or Croatian authors published in Germany. </li><li class="item">Possible Languages for the first iteration: Dutch, English, French, German, Greek, Italian, Polish, Portuguese, Russian, Spanish, Hungarian.</li></ul></div><div class="teidiv1" id="index.xml-body.1_div.4_div.2"><h3><span class="headingNumber">4.2. </span><span class="head">Composition criteria </span></h3><p>This section briefly summarizes the classification criteria applied, and also the ideal target proportions of titles to be included for each category within the balanced collection. </p><dl><dt><span>Date : 1840 to 1920 (first iteration)</span></dt><dd><p>We will divide into four groups: </p><ul><li class="item">group A (1840-1859): code T1</li><li class="item">group B (1860-1879): code T2</li><li class="item">group C (1880-1899): code T3</li><li class="item">group D (1900-1920): code T4</li></ul> <p style="font-weight:bold">Each time slot should be represented and should contain at least 20% of the total number of titles.</p></dd><dt><span>Reprint count</span></dt><dd><p>We propose to use the number of times a work has been reprinted during a specific period as an objective measure of its reception. We count the number of reprints attested during the period 1970-2010 according to Worldcat or a relevant national library catalogue and classify texts as either: </p><ul><li class="item">low: less than 2 reprints</li><li class="item">high: 2 or more reprints</li></ul><p>Note that we do not include digitizations of texts in the reprint count.</p> <p style="font-weight:bold">At least 30% of titles should be classified as "high"; at least 30% should be classified as "low". </p></dd><dt><span>Author gender</span></dt><dd><p>We use the following three categories for actual (not claimed) author gender </p><ul><li class="item">male</li><li class="item">female</li><li class="item">mixed (undefined or more than one author)</li></ul> <p style="font-weight:bold">At least 10% and at most 50% of the titles should have a female author.</p></dd><dt><span>Author title count</span></dt><dd><p>The number of titles per author should be controlled. Ideally, no author should be represented by more than three titles. We count </p><ul><li class="item">the number of authors represented by a single title</li><li class="item">the number of authors represented by exactly three novels</li></ul> <p style="font-weight:bold">No less than 9 and no more than 11 authors should be represented by exactly three novels; all other authors should be represented by a single title only.</p></dd><dt><span>Length</span></dt><dd><p>We classify titles by their length as follows: </p><ul><li class="item">short (10k-50k word tokens) </li><li class="item">medium (50k-100k word tokens)</li><li class="item">long (>100k word tokens)</li></ul> <p style="font-weight:bold">Each length category should be represented and should contain at least 20% of the total number of titles.</p> </dd></dl><p>Since it is an open issue how to classify novels by topic and in particular since different languages do not share the same terminology for the concept, we do not use the topic or type of novel as a sampling criterion. Texts should however provide metadata about their genre, using appropriate keywords in the descriptive metadata.</p></div></div><div class="teidiv0" id="index.xml-body.1_div.5"><h2><span class="headingNumber">5. </span><span class="head">Metadata for texts in ELTeC </span></h2><p>We list here some examples of the metadata items to be collected for each text. These will be provided by specific components of the TEI Header structure. </p><p>See <a class="link_ref" href="https://distantreading.github.io/Schema/eltec-1.html">Encoding Guidelines</a> for more details.</p><ul><li class="item">title</li><li class="item">subtitle</li><li class="item">publication date</li><li class="item">publication place</li><li class="item">publisher</li><li class="item">series</li><li class="item">editor</li><li class="item">author<ul><li class="item">name</li><li class="item">sex</li><li class="item">first language</li><li class="item">place of birth</li><li class="item">entry of a person database such as GND or VIAF if available</li></ul></li><li class="item">size<ul><li class="item">in words / in tokens</li></ul></li><li class="item">pages</li><li class="item">topics (cf. Falkentheorie)<ul><li class="item">politics, crime, espionage, provincial, school, adventure, war, faith, domestic, nature, factory, love, family, history, mystery, urban life, art, rural life</li></ul></li><li class="item">subgenre<ul><li class="item">work-in-progress novel</li></ul></li><li class="item">Narrator(s)<ul><li class="item">first person</li><li class="item">third person</li><li class="item">authorial/omniscient narrator</li></ul></li><li class="item">canonicity/reception<ul><li class="item">rated by a canon: y/n</li><li class="item">canon</li></ul></li><li class="item">keywords<ul><li class="item">from OPACs? others? Own?</li></ul></li><li class="item">language<ul><li class="item">possible: language area, language type (e.g. German, Bavarian)</li></ul></li><li class="item">Source reference (if available)<ul><li class="item">e.g. DTA, textgrid etc.</li></ul></li></ul></div><div class="teidiv0" id="index.xml-body.1_div.6"><h2><span class="headingNumber">6. </span><span class="head">Literature</span></h2><ol class="listBibl"><li id="index.xml-bibl-d29e220"><div class="biblfree">Algee-Hewitt, Mark; McGurl, Mark (2015): <span class="titlem">Between Canon and Corpus. Six Perspectives on the 20th-Century Novels.</span> Stanford Literary Lab Pamphlet no 8.</div></li><li id="index.xml-bibl-d29e224"><div class="biblfree">Biber, Douglas (1993): <q class="titlea">Representativeness in Corpus Design.</q> In: <span class="titlej">Literary and Linguistic Computing </span>(8), 243–257.</div></li><li id="index.xml-bibl-d29e232"><div class="biblfree">Herrmann, Leonhard (2011): <q class="titlea">System? Kanon? Epoche?</q> In: Matthias Beilein, Claudia Stockinger und Simone Winko (Hg.): <span class="titlem">Kanon, Wertung und Vermittlung. Literatur in der Wissensgesellschaft.</span> Berlin: De Gruyter (Studien und Texte zur Sozialgeschichte der Literatur, Bd. 129), S. 59–75.</div></li><li id="index.xml-bibl-d29e239"><div class="biblfree">Hunston, Susan (2008): <q class="titlea">Collection strategies and design decisions.</q> In: Anke Lüdeling und Merja Kytö (Hg.): <span class="titlem">Corpus Linguistics. An International Handbook</span>. 2 Bände. Berlin: De Gruyter (1), S. 154–168.</div></li><li id="index.xml-bibl-d29e246"><div class="biblfree">IFLA (2009): <span class="titlem">Functional Requirements for Bibliographic Records</span> (Technical Report). Online verfügbar unter http://www.ifla.org/publications/functional-requirements-for-bibliographic-records, zuletzt geprüft am 23.12.2016.</div></li><li id="index.xml-bibl-d29e250"><div class="biblfree">Lüdeling, Anke (2011): <q class="titlea">Corpora in Linguistics. Sampling and Annotation</q>. In: Karl Grandin (Hg.): <span class="titlem">Going Digital. Evolutionary and Revolutionary Aspects of Digitization</span>. New York: Science History Publications (Nobel Symposium, 147), 220–243.</div></li><li id="index.xml-bibl-d29e258"><div class="biblfree">Moisl, Hermann (2009): <q class="titlea">Exploratory Multivariate Analysis</q>. In: Anke Lüdeling und Merja Kytö (Hg.): <span class="titlem">Corpus Linguistics. An International Handbook</span>. 2 Bände. Berlin: De Gruyter (2), S. 874–899.</div></li><li id="index.xml-bibl-d29e265"><div class="biblfree">Winko, Simone (1996): <q class="titlea">Literarische Wertung und Kanonbildung</q>. In: <span class="titlem">Grundzüge der Literaturwissenschaft.</span> Hrsg. v. H. L. Arnold und H. Detering. München, 585–600.</div></li><li id="index.xml-bibl-d29e273"><div class="biblfree">van Zundert, Joris; Andrews, Tara L. (2017): <q class="titlea">Qu'est-ce qu'un texte numérique? A new rationale for the digital representation of text.</q> In: <span class="titlej">Digital Scholarship in the Humanities </span>(32), S. 78–88. DOI: 10.1093/llc/fqx039.</div></li></ol></div><!--TEI back--><div class="stdfooter autogenerated"><div class="footer"><!--standard links to project, institution etc--><a class="plain" href="/">Home</a> </div><address>COST Action CA16204 – WG1 .
Date: 2018-01<br /><!--
Generated from index.xml using XSLT stylesheets version 7.49.0
based on http://www.tei-c.org/Stylesheets/
on 2020-07-11T11:04:02Z.
SAXON PE 9.9.1.7.
--></address></div></body></html>