Big improvements:
Why type:
myScore.recurse().getElementsByClass(note.Note)
When you can now type:
myScore[note.Note]
Or if you want to find the first Key object in the piece, don't type:
walkure.flat.getElementsByClass(key.Key)[0]
...which will walk through the entire score, even though you just want something at the beginning. You can instead do:
walkure[key.Key].first()
in a millionth of the time. Streams and StreamIterators get the .first() and .last() methods, though only .first() is currently a major speedup. When we figure out how to walk an iterator quickly backwards, though, one day, .last() will also magically become faster.
Making a stream from notes could take a lot of space:
c = note.Note('C')
d = note.Note('D')
m = stream.Measure()
m.append(c)
m.append(d)
p = stream.Part()
p.append(m)
So why not:
c = note.Note('C')
d = note.Note('D')
p = stream.Part(stream.Measure([c, d]))
now if a list of elements are passed into the stream constructor, they are appended one after another, not all inserted at position 0.
If a stream is passed to another Stream's constructor it is put into the Stream itself, not its elements. This was a common mistake in v6 and earlier:
c = note.Note('C')
m = stream.Measure(c)
p = stream.Part(m)
sc = stream.Score(p)
Before, since Streams are list-like, the only thing in the Score would have been the single note C with no parts or measures at all!
In v7, the code above will create a perfectly well-formed score (well, except the lack of TimeSignature, etc., but music21 can figure that out for you.
Oh, and if you put multiple Measures into a Part constructor, they're all appended as they should be. Put put multiple Parts into a Score constructor or multiple Voices into a Measure constructor and they're all at offset 0, like they should be. Smart is better than inflexible.
Because of this change, there's now much more incentive to create proper Part, Measure, etc. objects than just making everything a general Stream.
Streams can now retrieve a single element with recursive search by id:
sc['#myId']
or easily iterate over all elements recursively by group:
for n in sc['.myGroup']: ...
If it looks like CSS querySelectors, it's for a reason. And we're just getting started with showing the power of these elements.
Stream.flat has become Stream.flatten() -- why? (a) it's a verb, and should be a verb. (b) it takes a long time to generate and alters the .sites on the contained notes, so it shouldn't be a property, which implies that it's fast and has no side-effects. (c) it is now no longer shorter and faster to type than Stream.recurse() which is what you want to do 90% of the time anyhow. Stream.flat will stick around for at least 2 more versions, becoming deprecated in v8 or 9 and removed in v9 or 10. I know it's our version of "print(a)" replacing "print a" and it'll take some time to get used to. But it was a mistaken choice in 2008 and it's just as much of a mistake in 2021.
(For .semiFlat, just use Stream.flatten(retainContainers=True) which is much clearer)
New Core Developer: Jacob!
Jacob Tyler Walls has joined the commit/core development group of music21 and can now review your pull requests etc. He has made MAJOR contributions to v7 and it would not be out without him! Please send him your thanks when you use music21. Because he's on the core team now, I won't single out his contributions separately from my own (for the most part. When it's big, I'll say so).
Other substantial improvements
- I hope you're editing your own files in a modern IDE like PyCharm or VSCode. We've added tons of typing information to help you find bugs before you run.
- Significant improvement in MIDI Quantization. We still recommend converting MIDI to MusicXML (or Humdrum/MEI/etc.) in a dedicated MIDI processor, but many more MIDI files will work "out of the box" in music21 v7.
- Go ahead and parse a large piano score from musicxml. But don't go get your customary cup of coffee. Jacob made it very fast now! Lots of speedups!
- PercussionChords or chords containing a mixture of Note and Unpitched objects are now supported! We're getting much closer to equal support for percussion as for pitched music!
- Multiple instruments can be in a part now and manipulated and exported to musicxml. This works simultaneously in voices, successively (broken before in musicxml), or overridden on a single note basis with n.storedInstrument.
- Full support for Python 3.9. Python 3.10 also seems to work with m21v7, but is not officially supported. Official support will come during the v.7 lifecycle unless it requires backward incompatible changes (unlikely). In keeping with music21 policy to support the last three versions of Python, version 7 will be the last version of music21 to support Python 3.7.
- The representation of many music21 objects has changed and become standardized to give a lot more information (what type of rest is it? What octave is the note in?) This should help with debugging and shouldn't affect anyone unless you are parsing repr() for information. (Don't do that). If you are creating your own Music21Object subclasses define _reprInternal() to return just internal information beyond the class name to get it right.
- Braille output respects lineLength configurations. Slurs work better too in braille.
- MIDI import comes with measures already made for you!
- roman.romanNumeralFromChord() recognizes a bunch more chords including all augmented sixth chords in all inversions (except German7 which I can't figure out). And RomanNumeral now takes "It" alone to mean It+6, and same for the others -- it puts them in their most common inversions. To get root-position Aug6 chords, spell out their figures explicitly: It53, Ger7, Fr7, etc.
- Ornaments now realize with their key contexts. Trills are great.
- MIDI input now preserves channel and program numbers for MIDI output.
- Chris Reyes has contributed a formal grammar for TinyNotation which helped us find lots of bugs. Thanks!
- Write compressed musicxml directly by passing in a filename ending in .mxl.
- getContextByClass has configuration options that when called on a Stream let them look inside themselves for their own context.
- Beaming improvements in pickups and incomplete final measures.
- MusicXML and MIDI files that give a part name like "flute" but no instrument or program code will get a Flute object in music21. It's the least we can do. And if a score sets a MIDI-0 instrument but no part name and only a single staff, it's probably a default value and not a piano, so we just give a generic Instrument object.
Incompatible Changes that might affect casual users:
- Python 3.6 is no longer supported. Stay with 6.7.1 if you need that.
- The default extension for musicxml is now .musicxml and not .xml
- MIDI import comes with measures already made
- Stream.iter is now Stream.iter() -- the old format will work for one more version. (Most people just do "for el in s" anyhow, so not a big deal.
- findGaps() now returns Rest objects at the same place as the old Music21Objects. Makes it easier to add them back to the Stream to fill gaps.
- See above about if you're parsing repr() that representations have changed.
- n.pitch.accidental = 'sharp' is no longer allowed. Do n.pitch.accidental = pitch.Accidental('sharp') -- this is so that querying n.pitch.accidental afterwards returns the same object.
- Stream.sorted has become Stream.sorted(), but you probably should never call this anyhow, since all streams are always sorted unless you set .autoSort to False.
- stripTies() removes retainContainers parameter. They're always retained. Just call .flatten() after stripTies to remove them. MatchByPitch is also True by default now.
- Before running WindowedAnalysis on a Score, flatten it. (This came from the makeMeasures change)
- See the changes to instantiating a Stream with a list of elements above.
- note.SpacerRest() is gone. Use a normalRest with .style.hideObjectOnPrint set to True.
- ComposerPopularityFeature is gone. It was a fun routine that added the popularity of the composer by googling her or him and returning the log10 of the number of search results. But Google changed their API so it was no longer working. Too bad. (It's not working in v6 either)
- Dynamics, etc. now use "placement" instead of "positionPlacement"
- Now that Percussion chords are being used and unpitched objects will appear more often, do not assume that the only things in ".notes" are Notes and Chords. So if you want to call ".pitch" on the object, check that it is a Note, instead of checking that it is not a Chord.
Other improvements and fixes
- Add TempoChangeSpanner with subclasses RitardandoSpanner and AccelerandoSpanner. How these were missed is beyond me!
- ABC supports more chord formats including better durations (thanks Marian Schultz)
- Stream.splitAtDurations() now works and can efficiently remove all "complex" durations.
- A number of places where "coreElementsChanged()" weren't being called now are.
- NotRest objects all get .pitches attribute, which might be empty. Version 8 will add this to Rest objects as well, which will of course always be empty.
- Lots of docs typos fixed (thanks Meekohi)
- Plaintext (non-Regexp) lyric searching had bugs that are fixed
- Piano Scores can now have independent key signatures in each hand imported and exported to musicxml properly. Go play "The Alcotts" now. :-)
- Cross-staff spanners in piano scores import much better.
- Lots of special strings and ints have become Enums. Expect more in the future.
- MakeMeasures can be run on a score without losing its part information.
- Running Score.measures(24, 26) etc. will only get spanners relevant to that measure range, not every darn slur in the score!
- Speedups now that the minimum Python version 3.7 has dictionaries that preserve insertion order.
- Bold + Italic text exports to musicxml properly.
- Added common.misc.unique which gets a unique list from an iterator while preserving order (unlike set)
- Meter has been split into four modules to make it easier for someone to figure out how TimeSignatures work without needing to read about AccentSequences first. TimeSignatures are much faster to generate.
- Lots more docs in the duration module.
- Decent beams in output of a score w/o explicit time signatures
- When you mistype a path into converter, now you'll get a FileNotFoundError rather than music21 trying to parse the path name as a type of notation.
- simplifyEnharmonics on a Chord can now be given a keyContext to figure out a better way of reducing accidentals (thanks gulnazaki!)
- ChordSymbol objects transpose properly to a new ChordSymbol that reflects its current bass/root etc.
- Chord.isTranspositionallySymmetrical -- can the chord be transposed up some number of semitones between 1 and 11 and get the same pitch classes? Also has a requireIntervallicEvenness which checks if it is a tritone-dyad, augmented triad, diminished-seventh chord, wholetone scale, etc. for which inversion cannot be determined by ear.
- hyphen-to-camelCase is now way faster, so is elementOffset() -- this would be a "so-what" except that together with an improvement to duration creation they speed up MusicXML parsing by almost 40%.
- Spanner.getSpannedElementIds is sped up. Again a so what? Well, it's 75% faster MusicXML output for scores with spanners such as slurs, etc.
- Duration.expressionIsInferred attribute. Think that a QL of 0.5 is always an eighth note? Well, if it's between 0.333 and 0.16666 it might be a dotted-eighth triplet. When a note is set with a quarter length, expressionIsInferred is True, and music21 is allowed to renotate it to fit the context. A note with duration 2.5 might be quarter + dotted quarter in 5/8 as 2+3 but might be the opposite in 3+2 5/8. Not fully implemented, but something for the future.
- Lots of little speedups all around.
- Full measure rests now work in 9/8 and some other meters where there is no way of expressing a note of that length, but we can for rests with a Whole Note.
- Improvements to NeoRiemannian operations on MIDI-generated notes. Thanks ax-le.
- Dynamics, wedges, coda, segno, and tempo markings retain their positions on musicxml import/export. And thanks to Gesellkammer metronome marks also know if they're above or below the staff.
- makeTies() works better when a note inside a voice is tied to a note outside of a voice. No unnecessary voices made.
- TAB staves always have notes that are stem down. (Thanks Louis Bigo)
- DataSet.write() now tells you the filepath that was written. (Duh!)
- Add Chord.hasAnyEnharmonicSpelledPitches() -- C4 E4 G4 B#4 returns True
- isItalianAugmentedSixth etc. gains a permitAnyInversion=False keyword which can be set to True to find unusual inversions of augmented 6th chords. Oh, and they're much simpler and faster (if it matters)
- Mordents etc. return GenericIntervals when realized so that they can take into account key signatures.
- Finding the root of a chord is much, much faster. That's something that's needed for lots of analytical methods.
- i7 and iv7 are now minor seventh chords when in a Major key. So C-Eb-G-Bb. To get a minor-major chord, spell it as i[add7]. Tonic minor-major chords in third inversion in major currently have no representation. I think that that's a very rare case that this is an improvement for everyone.
- FrontAlteration symbols are fixed for Neapolitan and AugmentedSixth roman numerals.
- Add common.classTools.tempAttribute and saveAttributes context-managers for temporarily setting an attribute to something else and restoring it afterwards. (just a helper)
- Stream.duration is much better about detecting non-standard ways of altering containing note durations. Thanks Greg Chapman for finding the bug.
- MusicXML can import measures containing only ChordSymbols (empty leadsheets)
- converter.parse() with a URL can now also take forceSource=True to redownload a file from the net.
- Scores generated by .template() now export repeats properly.
- makeTies() takes a classFilterList now.
- makeRests puts rests properly in measures. So you can do. s = stream.Stream(); s.append(meter.TimeSignature('4/4')); s.insert(9, note.Note()); call makeRests() and get two full bars of rests, a quarter rest, and then your note and rests afterwards!
- MusicXML input now handles notes that have different durations than the typical modern length implied by their shape (handy for contemporary music and the baroque).
- TimeSignatures of 3.0/4.0 are now identified as an error before they're parsed into something weird. (Thanks Luke Poeppel)
- Gracenote and appogiature display improvements.
- Crashes in feature extraction should be less rare as more common edge cases are handled.
- GraceNotes no longer interfere with beaming.
- .melodicIntervals() works with Chords now too.
- Lilypond output fixes and improvements. With Lilypond now having a native Mac-64bit app, it is no longer under threat of being removed from music21.
- Various write/show routines now work in multi-user Unix environments where users do not have write access to the normal temp folder. (Thanks tanchihpin0517)
- Improvements to TwelveToneRow.areCombinatorial() (Thanks Mark Gotham)
- KeySignature objects can now run asKey(tonic='A') and will try to find what mode has this key signature with that tonic.
- Substantial improvements in Stream.findConsecutiveNotes() including with and without voices.
- advanced users who need a very fast output of a Score which has already been asserted to be well-formed can call .write(makeNotation=False), which will not create any beams, tuplets, etc. Unless you are a power user who needs the extra speed for processing thousands of files, and who can run a debugger to see what is wrong, don't use this. It's going to crash on you. But for those who do need it, the speedup is tremendous.
- Transposing instruments set to .atWrittenPitch now display at written not sounding pitch in musicxml output.
- Add Electric Piano and Choir instruments.
- Music21 via pip will always be installed with the correct requirements (thanks James Owers)
- Very long notes can now be shown via .show() and will be broken up into multiple measures.
- Add Chord.inversionText to easily get "First inversion" "Root position" etc. For unusual augmented sixth chord inversions, we add this text to the common name.
- Smarter decisions on when to rearticulate an accidental after a key change.
- Successful writing to MuseScore PNG/PDF will not fill your console with junk.
Deprecated methods/etc. that you were warned about that have been removed:
- Chord.findRoot() [dep. since 2018] is gone. Just use Chord.root()
- Editorial.misc['anyKey'] is gone. Just use Editorial.anyKey instead.
- humdrum.parseFile() and humdrum.parseData() are gone. [Dep. since v6] Just call converter.parse('myFile.krn') instead. These functions stuck around for way too long since they appear in the original music21 publications, but time changes.
- interval.convertSpecifier() is gone. [dep v6] use interval.parseSpecifier() instead, which returns a interval.Specifier enum instead.
- Roman.scaleOffset is removed. Use the identical .frontAlterationTransposeInterval instead.
Incompatible changes that will only bite real music21 fanatics:
- setElementOffset has addElement and setActiveSite removed as options
- Environment.launch() no longer raises CalledProcessError
- Duration.updateQuarterLength() is gone/private. QuarterLengths should always automatically match the type/dots/tuplet, etc. unless "unlinked".
- Harmony.addChordStepModification() sets default for updatePitches to True.
- Roman.followsKeyChange is now Roman.editorial.followsKeyChange
- makeAccidentals inPlace defaults to False.
- Stream.__init__ is mostly in Stream.base now.
- We've taken advantage of Python 3.7's module level __dir__ to remove things you don't want to see from dir(module)
- A number of string/int returns have become StrEnums or IntEnums which can compare to their old values (i.e., OffsetSpecial.AT_END == 'highestTime'), but if you're doing isinstance checking then it's not going to work. Relatedly getOffsetBySite(returnString=True) becomes getOffsetBySite(returnSpecial=True)
- Stream.quantize() has recurse=False by default, matching other music21 methods.
- StripTies() inPlace=True now returns None like other inPlace=True methods.
- Meter split into 4 modules.
- test/stream.py is now stream/tests.py
- duration.durationTupleFromQuarterLength and durationTupleFromTypeDots are gone -- just create a Duration object with a given quarterLength or type and dots instead. (made private on Duration)
- setDefaultBeatPartitions moves forceCompound to a keyword only attribute.
- default for key.KeySignature() is now no-sharps or flats rather than None (non-standard key signature).
- Style objects are ProtoM21Objects.
- Spanner.replaceSpannedElement() only takes Elements not memory locations.
- hasAnyRepeatedDiatonicNote removes the useless testRoot keyword.
- Realizing a mordent or trill or turn will give a different (now correct) result in a key context.
- See the change to "It" to mean "It6" etc.
- See changes to i7 and iv7 in Major.
- makeRests puts rests properly in measures.
- Many music21 specific exceptions have been replaced by very similar general Python exceptions. Grabbing an element that doesn't exist from a stream, like s[123999] raises an IndexError not a StreamException, for instance.
- Ambitus.getPitchRanges() is removed. Just do stream.analyze('ambitus')
- .mx is no longer an abbreviation for musicxml.
- Now that isinstance() is very fast on Python, we use that a lot internally. This will only bite people who are loading modules from two different installations of music21 somehow (like using a package that includes its own version of music21). Otherwise just enjoy the speed.
- Chord now inherits from ChordBase to support having the same features on PercussionChord
- Stream.extendDurationsAndGetBoundaries is gone -- did too many things at once.
New Deprecations
- Stream.variants. Call Stream[variant.Variant] or Stream.getElementsByClass(variant.Variant) instead.
- Score.flattenParts(). Basically unused. Iterate over sc.parts and call .flatten() on each of them.
- common.Iterator. You haven't been using Python 2.6 for years, so you don't need it.
- Duration.fill(). Was just a test function and we don't put them on objects any more.
- TimeSignature.loadRatio(). Create a new TimeSignature or set .ratioString = '4/4' or .load()
- TimeSignature.beatDuration returns NaN rather than raising an exception if beats are unequal.
- common.almostEquals. Since Python 3.4, Math.isclose() is better.
- Spanner.getSpannedElementById(). Of course you never used this.
- Stream.makeChords(). Use chordify() instead.
- Stream.getKeySignatures(). Use getElementsByClass(key.KeySignature)
- Stream.getClefs(). use getElementsByClass(clef.Clef) or getContextByClass(clef.Clef) or bestClef() depending on what you want.
- VoiceleadingQuartet.color. Use .style.color instead.
- Note that isClassOrSubclass was slated to be deprecated in v7, but it was found to be too useful to remove completely. Nonetheless, we prefer isinstance(n, note.Note) instead.
This was a HUGE amount of work since v6.7 released in February. Super proud of the community for making it possible. If you're on a version older than 6.7, here are the biggest things you're missing:
6.7 -- Composite lyrics: multiple syllables on one note
6.5 -- PartStaff round-tripping to musicxml, RomanText output, better lyric searching
6.3 -- Compatibility with macOS Big Sur and Python 3.8
6 -- Type-hinting, no external modules bundled, interval fixes
5.7 -- big bug squashing. Chorale metadata. Chord.notes tools
5.5 -- Chord.commonName improvements. Volpiano. Cad64
5.3 -- ABC parsing improvements. containerInHierarchy. Py 3.7 support
5 -- Chordify massive speedups. MusicXML style preservation. Multiprocessing AI/ML
4 -- Graphing rewrite. Local Corpora. Style objects. TinyNotation subclassing. Direct PDF generation
...and the list goes on.
Thanks always to the Seaver Institute, MIT, and the National Endowment for the Humanities for supporting music21.
No comments:
Post a Comment