- Text corpus
linguistics, a corpus (plural "corpora") or text corpus is a large and structured set of texts (now usually electronically stored and processed). They are used to do statistical analysis and hypothesis testing, checking occurrences or validating linguistic rules on a specific universe.
A corpus may contain texts in a single language ("monolingual corpus") or text data in multiple languages ("multilingual corpus"). Multilingual corpora that have been specially formatted for side-by-side comparison are called "aligned parallel corpora".
In order to make the corpora more useful for doing linguistic research, they are often subjected to a process known as
annotation. An example of annotating a corpus is part-of-speech tagging, or "POS-tagging", in which information about each word's part of speech (verb, noun, adjective, etc.) is added to the corpus in the form of "tags". Another example is indicating the lemma (base) form of each word. When the language of the corpus is not a working language of the researchers who use it, interlinear glossing is used to make the annotation bilingual.
Some corpora have further "structured" levels of analysis applied. In particular, a number of smaller corpora may be fully parsed. Such corpora are usually called Treebanks or Parsed Corpora. The difficulty of ensuring that the entire corpus is completely and consistently annotated means that these corpora are usually smaller, containing around 1 to 3 million words. Other levels of linguistic structured analysis are possible, including annotations for morphology, semantics and pragmatics.
Corpora are the main knowledge base in
corpus linguistics. The analysis and processing of various types of corpora are also the subject of much work in computational linguistics, speech recognitionand machine translation, where they are often used to create hidden Markov models for POS-tagging and other purposes. Corpora and frequency lists derived from them are useful for language teaching.
Text corpora are also used in the study of
historical documents, for example in attempts to decipher ancient scripts, or in Biblical scholarship. Some archaeological corpora can be of such short duration that they provide a snapshot in time. One of the shortest corpora in time, may be the 15-30 year Amarna letterstexts-( 1350 BC). The "corpus" of an ancient city, (for example the " KültepeTexts" of Turkey), may go through a series of corpora, determined by their find site dates.
Some notable text corpora
American National Corpus
Bank of English
British National Corpus
Corpus Juris Secundum
Corpus of Contemporary American English (COCA)360 million words, 1990-2007. Freely available online.
Brown Corpus, forming part of the "Brown Family" of corpora, together with LOB, Frown and F-LOB.
International Corpus of English
Oxford English Corpus
Scottish Corpus of Texts & SpeechOther languages:
Amarna letters, (for Akkadian, Egyptian, Sumerogram's, etc.)
Bijankhan CorpusA Contemporary Persian Corpus for NLP researches
Croatian National Corpus
Hamshahri CorpusA Contemporary Persian Corpus for IR researches
Neo-Assyrian Text Corpus Project
Persian Today Corpus
Thesaurus Linguae Graecae(Ancient Greek)
Linguistic Data Consortium
Natural language processing
Natural Language Toolkit
Parallel text alignment
Search engines: they access the "web corpus".
* [http://corpus.byu.edu/ Freely-available, web-based corpora (100 million - 360 million words each): American, British (BNC), TIME, Spanish, Portuguese]
* [http://www.clres.com/corp.html ACL SIGLEX Resource Links: Text Corpora]
* [http://www.eva.mpg.de/lingua/files/morpheme.html The Leipzig Glossing Rules] : Conventions for interlinear
* [http://www.ahds.ac.uk/linguistic-corpora Developing Linguistic Corpora: a Guide to Good Practice]
Wikimedia Foundation. 2010.
Look at other dictionaries:
Neo-Assyrian Text Corpus Project — In the Neo Assyrian Text Corpus Project, the following works are published: Contents 1 State archives of Assyria cuneiform texts 2 State archives of Assyria studies 3 See also 4 Reference … Wikipedia
Corpus linguistics — is the study of language as expressed in samples (corpora) or real world text. This method represents a digestive approach to deriving a set of abstract rules by which a natural language is governed or else relates to another language. Originally … Wikipedia
Corpus — (Latin plural corpora, English plural corpuses or corpora) is Latin for body. It may refer to: Contents 1 Law 2 Biology … Wikipedia
Corpus Juris Canonici — • The term corpus here denotes a collection of documents; corpus juris, a collection of laws, especially if they are placed in systematic order Catholic Encyclopedia. Kevin Knight. 2006. Corpus Juris Canonici Corpus Juris … Catholic encyclopedia
Corpus-assisted discourse studies — Corpus assisted discourse studies, or CADS, is related historically and methodologically to the discipline of corpus linguistics. The principal endeavor of corpus assisted discourse studies is the investigation, and comparison of features of… … Wikipedia
Corpus Coranicum — ist der Name eines 2007 begonnenen Forschungsprojekts der Berlin Brandenburgischen Akademie der Wissenschaften. Das zunächst auf drei Jahre angelegte Projekt wird nominell von der an der Freien Universität Berlin lehrenden Professorin für… … Deutsch Wikipedia
Text segmentation — is the process of dividing written text into meaningful units, such as words, sentences, or topics. The term applies both to mental processes used by humans when reading text, and to artificial processes implemented in computers, which are the… … Wikipedia
Corpus juris — (lat., Rechtsw.), 1) die Gesammtmasse eines Rechts; 2) bes. die Zusammenfassung der sämmtlichen römischen Rechtsquellen. I. C. j.. od. C. j. civilis (C. j. romani, C. j. Justinianei), die jetzt gebräuchliche Sammlung der als gemeines Recht… … Pierer's Universal-Lexikon
corpus juris — corpus jur·is / ju̇r is, yu̇r ēs/ n [Medieval Latin, literally, a body of law]: a comprehensive collection of the law of a judicial system or of a country or jurisdiction Merriam Webster’s Dictionary of Law. Merriam Webster. 1996. corpus juris … Law dictionary
Corpus Reformatorum — Corpus Reformatorum: title page to volume 1 … Wikipedia