An adorned colection is a "collection">collection in which the words in each work in the corpus have been adorned with morphological information such as part of speech and lemma.
Adornment is the process of adding information such as morphological information to texts. We use the term "adornment" in preference to terms such as "annotation" or "tagging" which carry too many alternative and confusing meanings. Adornment harkens back to the medieval sense of manuscript adornment or illumination performed by monks - attaching pictures and marginal comments to texts.
An affix is a prefix or suffix which can be added to a morpheme or word to modify its meaning.
An attribute in machine learning terms is a property of an object which may be used to determine its classification. For example, one attribute of a literary work is its genre: play, novel, short story, etc.
Bayes's rule defines the condssitional probability for two events A and B as follows: Pr(A | B) = Pr(B | A) * Pr(A) / Pr(B)
A bigram is an ordered sequence of two adjacent words, characters, or morphological adornments.
A bound morpheme is a prefix or suffix which is not a word but which can be attached to a free morpheme to modify its meaning. For example, the bound morpheme "un" may be attached to the free morpheme "known" to form the new morpheme/word "unknown."
See part.
Words which appear near each other in a text more frequently than we would expect by chance are called collocates . Collocates may be ngrams, but may also consist of multiple words with gaps between one or more of the words.
A component is a bundle of services. A component knows how to render messages.
A Collection is a set of works.
Data herding is the process of acquiring, combining, editing, normalizing, and warehousing texts so they can be used for further analysis.
A datastore means a query-able data source.
A toolset is an integrated set of tools for textual analysis. Default Toolsets have been prepared by MONK for novice users as independent applications that can be used "as is." While Default toolsets are pre-defined by MONK, advanced users can add tools to a Default Toolset and save it as their own Project Toolset.
A document coordinate system assign a numeric vector of coordinate values to the position of each token in a document. A typical coordinate value might consist of a pair of line and column values based upon the printed form of the text, or a character offset and length pair based upon the digitized text.
The edit distance between two strings of characters is the number of operations required to transform one of them into the other. The most commonly use transformation operations are character insertion, character deletion, and character replacement.
A feature is a characteristic of the data being examined, selected in order to reduce the number of variables that need to be considered in predictive data-mining. Features can be of many different types, depending on the nature of the data and its preparation. In MONK, where the data is textual, the features that can be selected, at this point, are either lemma or spelling, and those features can be further constrained (or not) by specifying a feature class, which is some part of speech (e.g., noun, adjective, verb). More complex features may become available in future versions of MONK: e.g. clusters of ngrams could be returned by a repetition analysis.
A free morpheme is the basic or root form of a word. Bound morphemes can be attached to modify the meaning.
A hard tag is an SGML, HTML, or XML tag which starts a new text segment but does not interrupt the reading sequence of a text. Examples of hard tags include <div> and <p>.
A hidden Markov model (HMM) is a statistical model in which the system being modeled is assumed to be a Markov process with unknown parameters. The problem is to find the unknown parameters using values of the observable model parameters.
A jump tag is an SGML, HTML, or XML tag which interrupts the reading sequence of a text and starts a new text segment. Examples of jump tags include
Keyword extraction extracts "interesting" phrases which characterize a text.
Language recognition attempts to determine the language(s) in which a text is written. Literary texts are generally composed in one principal language with possible inclusions of short passages (letters, quotations) from other languages. It is helpful to categorize texts by principal language and most prominent secondary language, if any. We can use statistical methods based upon character ngrams and rank order statistics to determine the principal language of a text and list possible secondary languages.
The lemma form or lexical root of an inflected spelling is the base form or head word form you would find in a dictionary. A lemma can also refer to the set of lexemes with the same lexical root, the same major word class, and the same word-sense.
Lemmatization is the process of reducing an inflected spelling to its lexical root or lemma form. The lemma form is the base form or head word form you would find in a dictionary.
A lexeme is the combination of the lemma form of a spelling along with its word class (noun, verb. etc.).
A lexicon is a collection of words and their associated morphological information as used in a corpus.
Machine learning occurs when a computer program modifies itself or "learns" so that subsequent executions with the same input result in a different and hopefully more accurate output. Machine learning methods may be supervised, i.e., using training data, or unsupervised, without using training data.
A Markov process is a discrete state random process in which the conditional probability distribution of the future states of the process depends only upon the present state and not on any past states.
A message is a query or the result of a query.
There are different types of monk metadata
Middleware means the stuff between the interface and the datastore(s).
MONK is a web environment with a MONK user interface. Text is available in collections of works made of work part. Users use tools integrated in toolsets and workbenches.
MorphAdorn used as a verb is a Monk neologism which means "to adorn a text using MorphAdorner."
MorphAdorner is a suite of Java programs which performs morphological adornment of words in a text. A high-level description of MorphAdorner's capabilities appears at [http://apps.lis.uiuc.edu/wiki/display/MONK/About+MorphAdorner">.
A morpheme is a minimal grammatical unit of a language. A morpheme consists of a word or meaningful part of a word that cannot be divided into smaller independent grammatical units.
A multiword unit is a special type of collocate in which the component words comprise a meaningful phrase.
A named entity is a multiword unit consisting of a type of name such as a personal name, corporate name, place name, or date.
An ngram is an ordered sequence of n adjacent words, characters, or morphological adornments.
NUPOS is a part of speech tag set devised by Martin Mueller to allow part of speech tagging of English texts from all periods as well as texts in classical languages. Further information about NUPOS appears in [Morphology and NUPOS|https://apps.lis.uiuc.edu/wiki/display/MONK/Morphology+and+NUPOS">.
Paragraph are the lowest possible level of parts in the table of content.
Paratext are things like the preface, footnotes, speaker labels in plays etc. i.e. they can be entire parts or little segments of text inside a part.
A part (called chunk before) is a part of a work residing in a collection. A chunk consists of an ordered series of words and associated morphological information with a label. A chunk may be treated as a bag of words or ngrams for data analysis and navigation.
The part of speech is the role a word performs in a sentence. A simple list of the parts of speech for English includes adjective, adverb, conjunction, noun, preposition, pronoun, and verb. For computational purposes, however, each of these major word classes is usually subdivided to reflect more granular syntactic and morphological structure.
Part of speech tagging adorns or "tags" words in a text with each word's corresponding part of speech. Part of speech tagging relies both on the meaning of the word and its positional relationship with adjacent words.
A phone is an acoustic pattern which apeakers of a particular natural language consider distinguishable and linguistically important. Distinct phones in one language may be grouped together and treated as the same sound in another language.
A phoneme is a group of phones considered to be the same sound by speakers of a specific natural language. One or more phonemes combine to form a morpheme.
A prefix consists of characters comprising one or more bound morphemes which can be added to the front of a word to modify its meaning.
Project has one or more worksets, results (from using toolsets) and intermediate data such as training sets. A project has an owner, private/public access and a description.
Pronoun coreference resolution matches pronouns with the nouns to which they refer. Some pronouns may not actually refer to a specific noun. For example, in the sentence "It is not clear how to proceed" the initial pronoun "It" does not refer to any specific noun.
A pseudo-bigram generalizes the computation of bigram statistical measures to ngrams longer than two words by splitting the original multiword units into two groups of words, each treated as a single "word".
Ratings are annotations. They have a label (e.g. sentimentality), a value, an author and an access status (private or public).
Results are the output of applying the tools defined in a Toolset to the parts defined by a Workset. If a Toolset has not previously been applied a to a Workset, then no Results will appear in the browser.
Sentence splitting assembles a tokenized text into sentences. Recognizing sentence boundaries is a difficult task for a computer and generally requires a combination of rules and statistical methods.
A service is a list of messages that serve a particular component.
A soft tag is an SGML, HTML, or XML tag which does not interrupt the reading sequence of a text and does not start a new text segment. Examples of soft tags include <hi> and <em>.
The spelling is the orthographic representation of a spoken word. Words may have more than one spelling, particularly in texts dating from earlier periods when spelling was not standardized.
Spelling standardization is the mapping of variant, often archaic, spellings to standard modern forms.
Stemming removes affixes from a spelling. The resulting stem is not necessarily a proper lexeme. Stemming offers a simpler alternative to lemmatization. Stemming can be useful in information retrieval applications, but is much less useful in literary applications. Popular stemmers include the Martin Porter's stemmer and the Lancaster (Paice-Husk) stemmer.
String similarity is a measure of how similar two strings of characters are. A similarity of 0.0 indicates two strings are completely different, while a similarity of 1.0 indicates two strings are identical. Dozens of different string similarity measures have been proposed.
A suffix consists of characters comprising one or more bound morphemes which can be added to the end of a word to modify its meaning.
Supervised learning is a machine learning technique which predicts the value of a given function for any valid input after having been presented with training examples (i.e. pairs of input and correct output).
The Table of Contents describes the structure of a collection or a work. It is created at the time of the ingestion of the collection in MONK using the structure of the XML tags found in the original files. Issue: not all collections actually have divs called works and paragraphs So some equivalent has to be defined e.g. Stanza and line group.
See adorned collection.
The Text Encoding Initiative (TEI) Guidelines "are an international and interdisciplinary standard that enables libraries, museums, publishers, and individual scholars to represent a variety of literary and linguistic texts for online research, teaching, and preservation." More information may be found at the official Text Encoding Initiative site.
Abbreviation for Text Encoding Initiative.
TEISimple is a literary DTD created by Martin Mueller to enable the use of a common XML DTD across all texts to be included in Monk. A fuller description may be found at TEISimple A useful May Have?
Tool corresponds to the smallest unit of functionality offered to users (and probably a software module that can be composed with others). Individual tools you can combined in the workbench. Some may be used autonomously, other only in combination with other tools in a toolset. Users can use individual tools (e.g. to browse collections or to get a concordance), use pre-defined Toolsets that combine tools to accomplish more complex analysis (e.g. compare 2 corpora), or they can assemble sets of tools into their own custom toolsets using a workbench.
Toolset is an integrated set of tools built using the workbench.
Toolstep is the working together of multiple toolsets.
A trigram is an ordered sequence of three adjacent words, characters, or morphological adornments.
Unsupervised learning is a machine learning method which fits a model to observed data without benefit of training data.
The Viterbi algorithm allows searching a space containing an apparently exponential number of points to be searched in polynomial time. The Viterbi algorithm is frequently used in hidden Markov model statistical part of speech tagging applications to reduce the time complexity of seaches for the best tags for a sequence of spellings in a sentence.
A word is the basic unit of a language. Words are composed of morphemes.
Word sense disambiguation is the process of distinguishing different meanings of the same word in different textual contexts. For example, a "bank" can be both a financial institution or a geographic location next to a river.
Word tokenization splits a text into words, whitespace, and punctuation.
A work is a single text which is a member of a Collection. Each work consist of one or more text segments called parts.
Workbench is a work environment where a set of tools and toolsets are available.
Workset is the set of parts of interest, selected by a user to conduct their work. Users can have multiple worksets which can be edited, emailed etc. They represent the entire scope of interest, from which two or more corpora might be subsetted and compared.