Skip to content

Latest commit

 

History

History
267 lines (213 loc) · 16.2 KB

README.md

File metadata and controls

267 lines (213 loc) · 16.2 KB
Raw

Version DOI GitHub repo size License

This is a README file for a data repository originating from the DCML corpus initiative and serves as welcome page for both

For information on how to obtain and use the dataset, please refer to this documentation page.

Edvard Grieg - Lyric Pieces (A corpus of annotated scores)

This corpus of annotated MuseScore files has been created within the DCML corpus initiative and employs the DCML harmony annotation standard. It is one out of nine similar corpora that have been grouped together to An Annotated Corpus of Tonal Piano Music from the Long 19th Century which comes with a data report that is currently in press at Empirical Musicology Review.

Version history

See the GitHub releases.

Getting the data

With full version history

The dataset is version-controlled via git. In order to download the files with all revisions they have gone through, git needs to be installed on your machine. Then you can clone this repository using the command

git clone https://github.com/DCMLab/grieg_lyric_pieces.git

Without full version history

If you are only interested in the current version of the corpus, you can simply download and unpack this ZIP file.

Data Formats

Each piece in this corpus is represented by four files with identical names, each in its own folder. For example, the first movement has the following files:

  • MS3/op12n01.mscx: Uncompressed MuseScore file including the music and annotation labels.
  • notes/op12n01.tsv: A table of all note heads contained in the score and their relevant features (not each of them represents an onset, some are tied together)
  • measures/op12n01.tsv: A table with relevant information about the measures in the score.
  • harmonies/op12n01.tsv: A list of the included harmony labels (including cadences and phrases) with their positions in the score.

Opening Scores

After navigating to your local copy, you can open the scores in the folder MS3 with the free and open source score editor MuseScore. Please note that the scores have been edited, annotated and tested with MuseScore 3.6.2. MuseScore 4 has since been released and preliminary tests suggest that it renders them correctly.

Opening TSV files in a spreadsheet

Tab-separated value (TSV) files are like Comma-separated value (CSV) files and can be opened with most modern text editors. However, for correctly displaying the columns, you might want to use a spreadsheet or an addon for your favourite text editor. When you use a spreadsheet such as Excel, it might annoy you by interpreting fractions as dates. This can be circumvented by using Data --> From Text/CSV or the free alternative LibreOffice Calc. Other than that, TSV data can be loaded with every modern programming language.

Loading TSV files in Python

Since the TSV files contain null values, lists, fractions, and numbers that are to be treated as strings, you may want to use this code to load any TSV files related to this repository (provided you're doing it in Python). After a quick pip install -U ms3 (requires Python 3.10) you'll be able to load any TSV like this:

import ms3

labels = ms3.load_tsv('harmonies/op12n01.tsv')
notes = ms3.load_tsv('notes/op12n01.tsv')

How to read metadata.tsv

This section explains the meaning of the columns contained in metadata.tsv.

File information

column content
fname name without extension (for referencing related files)
rel_path relative file path of the score, including extension
subdirectory folder where the score is located
last_mn last measure number
last_mn_unfolded number of measures when playing all repeats
length_qb length of the piece, measured in quarter notes
length_qb_unfolded length of the piece when playing all repeats
volta_mcs measure counts of first and second endings
all_notes_qb summed up duration of all notes, measured in quarter notes
n_onsets number of note onsets
n_onset_positions number of unique note onsets ("slices")

Composition information

column content
composer composer name
workTitle work title
composed_start earliest composition date
composed_end latest composition date
workNumber Catalogue number(s)
movementNumber 1, 2, or 3
movementTitle title of the movement

Score information

column content
label_count number of chord labels
KeySig key signature(s) (negative = flats, positive = sharps)
TimeSig time signature(s)
musescore MuseScore version
source URL to the first typesetter's file
typesetter first typesetter
annotators creator(s) of the chord labels
reviewers reviewer(s) of the chord labels

Identifiers

These columns provide a mapping between multiple identifiers for the sonatas (not for individual movements).

column content
wikidata URL of the WikiData item
viaf URL of the Virtual International Authority File (VIAF) entry
musicbrainz MusicBrainz identifier
imslp URL to the wiki page within the International Music Score Library Project (IMSLP)

Generating all TSV files from the scores

When you have made changes to the scores and want to update the TSV files accordingly, you can use the following command (provided you have pip-installed ms3):

ms3 extract -M -N -X -D # for measures, notes, expanded annotations, and metadata

If, in addition, you want to generate the reviewed scores with out-of-label notes colored in red, you can do

ms3 review -M -N -X -D # for extracting measures, notes, expanded annotations, and metadata

By adding the flag -c to the review command, it will additionally compare the (potentially modified) annotations in the score with the ones currently present in the harmonies TSV files and reflect the comparison in the reviewed scores.

Questions, Suggestions, Corrections, Bug Reports

For questions, remarks etc., please create an issue and feel free to fork and submit pull requests.

License

Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0).

Naming convention

The file names listed in the Overview below refer to the opus numbers of the 10 books.

Overview

file_name measures labels standard annotators reviewers
op12n01 23 43 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.30) Adrian Nagel
op12n02 79 125 2.3.0 Adrian Nagel (2.1.0), John Heilig (2.3.0) Adrian Nagel
op12n03 52 110 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op12n04 72 97 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op12n05 40 109 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op12n06 56 126 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op12n07 56 74 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op12n08 32 78 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op38n01 86 141 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op38n02 41 46 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op38n03 48 87 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op38n04 36 66 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op38n05 41 70 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op38n06 47 104 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op38n07 53 55 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op38n08 84 130 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op43n01 42 102 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op43n02 30 98 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op43n03 35 112 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op43n04 36 52 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op43n05 36 110 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op43n06 72 127 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op47n01 184 158 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op47n02 126 183 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op47n03 106 93 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op47n04 38 21 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op47n05 41 109 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op47n06 74 83 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op47n07 97 134 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op54n01 61 110 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op54n02 159 286 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op54n03 194 267 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op54n04 63 91 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op54n05 204 118 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op54n06 90 171 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op57n01 146 313 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op57n02 125 183 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op57n03 67 186 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op57n04 92 116 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op57n05 169 202 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op57n06 95 156 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op62n01 90 72 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op62n02 81 163 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op62n03 65 95 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op62n04 81 97 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op62n05 62 45 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op62n06 150 173 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op65n01 173 203 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op65n02 26 128 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op65n03 58 87 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op65n04 71 112 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op65n05 48 128 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op65n06 179 222 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op68n01 56 156 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op68n02 88 186 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op68n03 114 134 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op68n04 90 85 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op68n05 43 95 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op68n06 202 200 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op71n01 95 180 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op71n02 54 107 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op71n03 79 72 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op71n04 77 87 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op71n05 98 155 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op71n06 32 133 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel
op71n07 74 74 2.3.0 Adrian Nagel (2.1.1), John Heilig (2.3.0) Adrian Nagel

Overview table automatically updated using ms3.