David William Hearn (composer, arranger, producer and creator of StaffPad) joins the show to talk about StaffPad, how teachers can use it, and the thought process behind designing great iPad software.
Patreon supporters get bonus discussion about recent tv, movies, and music we have been engaging with. Thanks to my sponsors this month, Scale Exercise Play-Along Tracks.
This week on Music Ed Tech Talk I am joined by Joe Plazak, Principal Software Engineer and Designer of Sibelius, to talk all about their summer iPad release.
Listen below or in the podcast app of your choice! I look forward to writing more about Sibelius for iPad down the road.
Episode Description: Joe Plazak (Principal Software Engineer and Designer) joins the show to talk about Sibelius for Mobile and their new iPad app.
This episode is sponsored by Blink Session Music: Because Virtual Lessons Are More Than a Video Chat.
Backstage Access Patreon Subscribers can listen to extended discussion including Joe Plazak's Book of the Week and some of my reflections on writing Digital Organization Tips for Music Teachers.
Dorico for iPad is out today! You can read their announcement here. It's a desktop-class adaptation, which includes most of the features I need for my everyday work as a music teacher. I am beyond excited that a major professional scoring app has come to the iPad for two reasons:
I depend on iOS for getting much of my work done. There are still apps and workflows that require me to take out my Mac, and I am delighted whenever the release of a professional iPad app lessons these occurrences.
Our niche professional corner of the world is receiving legitimate, pro-featured, software for iPadOS, a market that is still light on “pro” software, even from Apple themselves (like, for real... where is Logic Pro on iPad?). While many "pro" iPad apps are companion experiences to bigger desktop versions, Dorico brings a whole lot of the power from its desktop app to its mobile version, proving that the iPad can be every bit as "pro" as its name suggests.
Dorico for iPad's free tier is similar to their free desktop offering Dorico SE, and an in-app subscription adds features comparable to their Dorico Elements version. The iPad app has new features, many of which are optimizations for touch, including several new input methods (piano, fretboard, drum pads, and a new Key Editor). Dorico for iPad doesn't do everything. Serious composers and power users might need the desktop for some things. For me, a middle school band director, it will fill most of my iOS composing needs.
There are some quirks due to Dorico not supporting features that make iPad apps feel like iPad apps: full Apple Pencil support, responsive touch gestures, file system integration, Magic Keyboard/trackpad support, and multitasking are examples of this. While there is room for improvement, it's bold for the Dorico team to pack a desktop-class experience into the first version. I am thankful for their hard work and wish the Dorico team future success on this project.
Video
Watch Dorico for iPad in action.
Some Musings on Professional iPad Apps
When my long-time favorite iPad app (forScore) came to the Mac earlier this year, I wrote about it.
While forScore was one of the few remaining iPad apps I wanted on Mac, there are, similarly, plenty of Mac apps I would still love to see on iPad.
One could argue that with the latest iPad hardware (featuring M1 chips), there is no excuse for professional apps not to run on the platform. I agree! The iPad has more than enough processing power, all of the necessary input devices (if you have a keyboard and mouse), and even some things that the Mac doesn't have (like touch support and the Apple Pencil).
The issue of why the iPad lacks pro apps is too broad to cover here, but it has much to do with how Apple has positioned iPadOS and the App Store model over the past 10 years. It is becoming easier than ever to make a cross-platform app, but this doesn't change the fact that there are still some fundamentally dissimilar aspects of developing for iOS and macOS. The arguably bigger problem is that the App Store (even with fewer sandboxing limitations in recent years) is hostile towards the exact kind of developers who cater to niche professionals like composers and music teachers.
For example, companies who make digital audio workstations and notation editors have traditionally charged prices in the multiple hundreds of dollars, costs which the mobile market has decided is not acceptable. Such developers also offer things like crossgrade/upgrade/educational pricing, group licenses, and more. These are not feasible in the current-day App Store, and I think Apple is oblivious to keep calling the iPad Pro the iPad Pro while not providing more flexible App Store rules. This is not to mention that Apple hasn’t even brought their professional apps (Logic Pro, Final Cut Pro, and Xcode), to the iPad.
I am dependent on my iPad and prefer to work on it whenever possible. Its light form factor and simple operating system make me feel more nimble moving in and out of apps. Dorico has always been one of the reasons I have to take my Mac out of my bag when I am sitting on the couch wrapping up some school work late at night. Even though there are good score apps on iPad, the convenience of leaning back on the couch to get work done has been counterbalanced by needing to import and export XML files back and forth, just to get these apps to talk to Dorico on desktop.
It is within that context that I am pleased to say Dorico is available for iPad today. It's the first of the major professional desktop scoring apps to be released on a mobile platform, and after just a few weeks of use, I can tell that it will become my primary notation editor on iOS.
I'm a Music Teacher
Because I am a music teacher, my opinions about scoring software are viewed through the lens of someone who does not depend on the entire feature set of Dorico, particularly engraving and playback. This means I usually need to get in and out of the program fast and that I am often performing tasks like writing scale exercises, reconstructing missing bass clarinet parts from my library, or adding percussion instruments to the score of a piece on our next concert. That said, I admire tools that empower me to work efficiently, and for notation, Dorico is that tool.
If you are looking for a professional composing perspective, and a more comprehensive feature overview, I recommend the Scoring Notes review of Dorico for iPad.
Dorico for iPad and Its Features
Dorico for iPad is an ambitious and stellar 1.0 that should make every developer of pro software take note and get to work.
The Dorico team has brought many of the core functions that make Dorico so powerful on Mac and Windows to the iPad version. All of the features I depend on are all there. It has keyboard input, powerful pop-overs, MIDI controller input, and all of the custom Notation and Layout Options that are available on desktop. It even has the same custom keyboard shortcut editor.
Dorico is available for free with a set of features very similar to their desktop offering Dorico SE. If you subscribe to the app through In-App Purchase, features are added which bring in line with the experience of using Dorico Elements.
Dorico for iPad has all of the modes you would expect: Setup, Write, Engrave, and Play. There is no Print mode and I don't miss it. All of the export options I use regularly are conveniently accessed through a share button in the upper right corner of the application. Play mode supports third-party iOS plugins. This is certainly more limiting than desktop, because iOS doesn’t support traditional VSTs, but this is also not a feature I take advantage of anyway.
Dorico for iPad is so much Dorico that it is hard to write about it without reviewing the existing desktop versions, which is not something I have set out to do here. That said, it is worth noting some of the things that are added for touch, and some of the quirks that result from a desktop app being so faithfully reproduced on a touch-based tablet.
One of the things that makes Dorico on iPad feel so faithful to the desktop version is that computer keyboard input is nearly identical with a Magic Keyboard attached. Once I got acclimated to the small differences in the user interface, I comfortably began recalling all the same shortcuts and workflows I am used to.
Because this version is designed to be used without the keyboard attached, there are some added on-screen buttons for touch control. Extra toolbar buttons for things like delete, repeat, undo, redo, and moving the arrow keys, are all included.
A floating toolbar, which can be moved around on the screen, allows common note adjustments to be made by finger. This toolbar includes things like moving a selected note up/down, shifting a selection of notes right or left by a 16th note, etc...
Holding on the score with one finger and then dragging displays a rectangle on-screen that can select multiple elements of the score at once. And there are also some new methods of touch input:
An on-screen piano, which you can pan across and resize by dragging and pinching.
A fretboard for instruments like guitar.
Drum pads for percussion instruments (much more intuitive for writing drum set parts in my opinion.)
An integrated mixer which you can see right inside of Write mode.
A new Key Editor. I can best describe the Key Editor as a piano roll editing tool for the notes of your score. Users who are familiar with MIDI note editing in a digital audio workstation will love visualizing the notes of the staff as colorful rectangles. They can be dragged vertically to change pitch, horizontally to change the rhythm, and can be resized to adjust the duration. It is an intuitive way to work, particularly for touch.
Native Software
There will always be room for growth. What I want most from future iterations of Dorico on iPad can be best explained in the context of the forScore article I linked at the top of this post. forScore is a beloved app amongst musicians that is iPad-first but has recently been ported to the Mac through Apple's Catalyst technology. My TL;DR in my forScore Mac review was basically to say that it's amazing to have such an indispensable music app on Mac, even though it has some quirks relating to the fact that some iPad paradigms don't translate to the Mac.
My Dorico first impressions are more or less the inverse of that statement. Dorico for iPad is desktop-class. What I'd like to see from it down the road is to become more iPad-native through taking advantage of common features on the platform. Dorico is written using Qt, a development platform that makes it easy to write one code base for Windows and Mac. This same development platform is what made it easier to bring Dorico to the iPad now, but for this same reason, I can understand that the team had their hands full prioritizing the features for the first version.
Now that the iPad Pro has excellent trackpad, keyboard, and mouse support, I don't feel that different using it than I do my Mac in many instances. While Dorico's "desktop-ness" is its greatest strength, its fluency makes the missing iPad-isms more apparent. Here are a few:
Dorico doesn't have Apple Pencil support (with the exception of it imitating a touch in some circumstances).
Dorico does not work with the native File picker, which is to say that you can't open a Dorico project from your Dropbox or iCloud Drive within the Files app, edit it, and then save it back to the original location. You must instead import it from within the Dorico app, which then makes a copy inside of the app. You can export it back to the original location you pulled it from, but don't forget to delete the old copy! See an image below of OmniOutliner, a popular outlining app for iPad. When launched, it shows the same interface as the Files app. A document can be selected, edited, and saved back to the same location. I would love to see Dorico add this feature down the road.
Trackpad support isn't native. Magic Keyboard users will note that two-finger swiping (which moves around the score in the Mac version) does nothing on iPad. Because the Magic Trackpad can simulate a finger, clicking and dragging with one finger will simulate the gesture of dragging the score around.
Dorico does not support multitasking features like Split View. This means that another app cannot share the screen at the same time unless it is in Slide Over mode which means it is a tiny, iPhone-sized, app that floats above Dorico and covers part of the information on the screen. One of my favorite workflows with notation software is to open it on half of the screen while referencing another score in forScore on the other half. The image below depicts forScore on screen at the same time as Dorico in Slide Over.
Elephants, Pencils, and Software Instruments
The obvious elephant in the room is StaffPad. StaffPad is not always included in conversations about major pro notation software (Sibelius, Finale, Dorico), but relative to the power of most iPad software in the App Store, it deserves to be a part of the conversation. I covered StaffPad here.
StaffPad feels very iPad-native and supports a premium design experience and numerous pro-features, like, for example, a store of top-of-the-line audio plugins within the app.
While the comparison to Dorico is fair, I also feel like StaffPad is aiming for a different experience. Sure, they will compete to some extent, but StaffPad is aiming at new innovative methods of input, and high-end audio output that is all intuitively integrated into the same package. For example, StaffPad features Apple Pencil gestures for note input, exclusively, and a forthcoming feature will listen to you play an instrument in the microphone and transcribe you in real-time. StaffPad's third-party software instruments sound great and require little fuss to set up. It’s all a very iPad-first experience. But it's an iPad-only experience (unless you are also using it on Windows).
The strength of Dorico on iPad is that you are getting much of the power of the desktop version, on iOS. This means that there are some quirks, but that you are ultimately less inhibited by what you can produce. Dorico’s Engrave mode allows you to get more customizable, better looking, scores and note input in the Write mode is just as easy to do with a computer keyboard or MIDI controller as it is on a desktop.
I do appreciate the novelty of writing scores with the Apple Pencil. It feels nice. In fairness to Dorico, I wanted to see if I am more efficient using this method. I took about 10 excerpts from my music teaching resource library (music I would use a notation editor for in real life) and timed myself recreating these excerpts into both StaffPad and Dorico.
Much like using the self-checkout lane of a grocery store, I “felt” faster in StaffPad, but I was about twice as fast at note entry using Dorico in every instance. I was also 100 percent sure that the note I input would be the note that appeared on the screen.
I appreciate that there is competition in this space, and I think that stylus input has a place in the future of mobile score software. But I have shifted most of my score work on iOS to Dorico, and will probably continue to do so in the future. It sure is great having another professional Mac app on iPad. Here’s to hoping that my other tools like Logic, Final Cut, and Descript are next in line.
Thanks Dorico team for an ambitious and excellent release. I am looking forward to years of updates.
Speaking of forScore coming to the Mac, I continue to hear chatter in the technology community about touchscreen Macs. The design of Apple's forthcoming macOS update, Big Sur, has larger, more spread apart, user interface elements, indicating that it might be getting prepared for touch input. This would align well with Apple's transition to putting their own silicone chips in their devices this year.
I have no idea if Apple is making Macs with touchscreens, but I find it hard to believe they would take their existing Mac laptop and desktop designs and simply make the current screens touchable.
At Apple's developer conference this past June, there were obvious signs that Apple wants developers to adopt design elements from macOS in their iPad apps and vice versa.
Silicone enabled Macs will run touch-first, iOS apps natively, and Apple has been working hard to make their technologies consistent across all platforms. I wouldn't be surprised if touch screen Macs came out of the box with Apple Pencil support. And if Macs have Pencil support, no one wants to awkwardly hold a pencil up in the air in front of them and draw on a horizontal screen.
Here is where I am going with this. With sheet music apps like forScore finally coming to the Mac, and Apple technologies being shared across devices, I am starting to think that I would love a Mac with a display that folded back on its keyboard. Something that I could plug into my audio interface and large screen monitor to edit audio on at home, and then flip onto my podium and read scores off of during band rehearsal. They could charge nearly anything for a 14 inch MacBook Pro in this format and I would buy it.
Who knows if it would be an optimal experience? Who knows if it's what Apple is planning? Who knows if it is anywhere near ready? Not me. It will be very curious to see what happens over the next few months as Apple has announced that some Macs will make this transition by the end of the year.
With GoodNotes, it’s easy to mix drawing and writing. It’s also easy to write in a magnified view while the words simultaneously appear in a normal size on the page behind it.
And with yesterday’s version 5.5 update, GoodNotes is now also able to collaborate.
I use Apple Notes for most mixed media note taking (text, checklists, images, web links) and DEVONthink for my archiving needs (long term file, email, web archiving). But most notes I write by hand go in GoodNotes. It is nice to see any app add collaboration as a feature. I am not sure if I would use this in GoodNotes but it will be fun to try.
The other thing I use GoodNotes for every day (when school is meeting in person) is for annotating my custom-made seating charts to keep track of student data. You can read about that on this article I wrote for SBO Magazine. What makes GoodNotes so convenient for annotating PDFs like this is that it treats them as a paper style instead of fillable PDF, so you don't need to go into any kind of annotation 'mode' to begin marking it up with the Apple Pencil.
When school let out in March, I wrote My Very Straightforward and Very Successful Setup for Teaching Virtual Private Lessons. The impetus for this post, and its snarky title, was an overwhelming number of teachers I saw on Facebook fussing about what apps and hardware they should use to teach online when all you really need is a smartphone, FaceTime, and maybe a tripod.
I stand by that post. But there are also reasons to go high-tech. I have had a lot of time this summer to reflect on the coming fall teaching semester. I have been experimenting with software and hardware solutions that are going to make my classes way more engaging.
Zoom
I have been hesitant about Zoom. I still have reservations about their software. Yet, it is hard to resist how customizable their desktop version is. I will be using Google Meet for my public school classes in September, but for my private lessons, I have been taking advantage of Zoom’s detailed features and settings.
For example, it’s easier to manage audio ins and outs. Right from the chat window, I can change if my voice input is going through my Mac's internal microphone or my studio microphone, or if video is coming from my laptop webcam or my external Logitech webcam. This will also be useful for routing audio from apps into the call (we will get to that in a moment).
Zoom allows you to choose the audio/video input from right within the call.
Zoom also allows you to AirPlay the screen of an iOS device to the student as a screen sharing option. This is the main reason I have been experimenting with Zoom. Providing musical feedback is challenging over an internet-connected video call. Speaking slowly helps to convey thoughts accurately, but it helps a lot more when I say “start at measure 32” and the student sees me circle the spot I want them to start in the music, right on their phone.
You can get really detailed by zooming in and out of scores and annotating as little as a single note. If you are wondering, I am doing all of this on a 12.9 inch iPad Pro with Apple Pencil, using the forScore app. A tight feedback loop of “student performance—>teacher feedback—>student adjustment” is so important to good teaching, and a lot of it is lost during online lessons. It helps to get some of it back through the clarity and engagement of annotated sheet music.
Selecting AirPlay as a screen sharing option.
AirPlaying annotated sheet music to the Zoom call using the iPad Pro and forScore app.
As much as I love this, I still think Zoom is pretty student hostile, particularly with the audio settings. Computers already try to normalize audio by taking extreme louds and compressing them. Given that my private lessons are on percussion instruments, this is very bad. Zoom is the worst at it of all the video apps I have used. To make it better, you have to turn on an option in the audio settings called “Use Original Audio” so that the host hears the student’s raw sound, not Zoom’s attempt to even it out. Some of my students report that they have to re-choose this option in the “Meeting Settings” of each new Zoom call.
If this experiment turns out to be worth it for the sheet music streaming, I will deal with it. But this is one of the reasons why I have been using simple apps like FaceTime up until this point.
My Zoom audio settings.
My Zoom advanced audio settings.
Sending App Audio Directly to the Call
I have been experimenting with a few apps by Rogue Amoeba that give me more control over how audio is flowing throughout my hardware and software.
Last Spring, I would often play my public school students YouTube videos, concert band recordings from Apple Music, and warm-up play-alongs that were embedded in Keynote slides. I was achieving this by having the sound of these sources come out of my computer speakers and right back into the microphone of my laptop. It actually works. But not for everyone. And not well.
Loopback is an app by Rogue Amoeba that allows you to combine the audio input and output of your various microphones, speakers, and apps, into new single audio devices that can be recognized by the system. I wrote about it here. My current set up includes a new audio device I created with Loopback which combines my audio interface and a bunch of frequently used audio apps into one. The resulting device is called Interface+Apps. If I select it as the input in my computer’s sound settings, then my students hear those apps and any microphone plugged into my audio interface directly. The audio quality of my apps is therefore more pure and direct, and there is no risk of getting an echo or feedback effect from my microphone picking up my computer speaker’s sound.
A Loopback device I created which combines the audio output of many apps with my audio interface into a new, compound device called “Interface+Apps.”
I can select this compound device from my Mac’s Sound settings.
Now I can do the following with a much higher level of quality...
Run a play-along band track and have a private student drum along
Play examples of professional bands for my band class on YouTube
Run Keynote slides that contain beats, tuning drones, and other play-along/reference tracks
and...
Logic Pro X
Logic Pro X is one of my apps routing through to the call via Loopback. I have a MIDI keyboard plugged into my audio interface and a Roland Octopad electronic drum pad that is plugged in as an audio source (though it can be used as a MIDI source too).
The sounds on the Roland Octopad are pretty authentic. I have hi-hat and bass drum foot pedal triggers so I can play it naturally. So in Logic, I start with an audio track that is monitoring the Octopad, and a software instrument track that is set to a piano (or marimba or xylophone, whatever is relevant). This way, I can model drum set or mallet parts for students quickly without leaving my desk. The audio I produce in Logic is routed through Loopback directly into the call. My students say the drum set, in particular, sounds way better in some instances than the quality of real instruments over internet-connected calls. Isn’t that something...
Multiple Camera Angles
Obviously, there is a reason I have previously recommended a set up as simple as a smartphone and a tripod stand. Smartphones are very portable and convenient. And simple smartphone apps like FaceTime and Google Duo make a lot of good default choices about how to handle audio without the fiddly settings some of the more established “voice conference” platforms are known for.
Furthermore, I can’t pick up my desk and move it to my timpani or marimba if I need to model something. So I have begun experimenting with multiple camera angles. I bought a webcam back in March (it finally just shipped). I can use this as a secondary camera to my laptop’s camera (Command+Shift+N in Zoom to change cameras).
Alternatively, I can share my iPhone screen via AirPlay and turn on the camera app. Now I can get up from my desk and go wherever I need to. The student sees me wherever I go. This option is sometimes laggy.
Alternatively, I can log in to the call separately on the iPhone and Mac. This way, there are two instances of me, and if I need to, I can mute the studio desk microphone, and use the phone microphone so that students can hear me wherever I go. I like this option the best because it has the added benefit of showing me what meeting participants see in Zoom.
Logging in to the Zoom call on the Mac and iPhone gives me two different camera angles.
SoundSource
This process works well once it is set up. But it does take some fiddling around with audio ins and outs to get it right. SoundSource is another app by Rogue Amoeba that takes some of the fiddly-ness out of the equation. It replaces the sound options in your Mac’s menubar, offering your more control and more ease at the same time.
This app is seriously great.
This app saved me from digging into the audio settings of my computer numerous times. In addition to putting audio device selection at a more surface level, it also lets you control the individual volume level of each app, apply audio effects to your apps, and more. One thing I do with it regularly is turn down the volume of just the Zoom app when my students play xylophone.
Rogue Amoeba's apps will cost you, but they are worth it for those who want more audio control on the Mac. Make sure you take advantage of their educator discount.
EDIT: My teaching set up now includes the use of OBS and an Elago Stream Deck. Read more here.
Conclusion
I went a little overboard here. If this is overwhelming to you, don't get the idea that you need to do it all. Anyone of these tweaks will advance your setup and teaching.
This post is not specific about the hardware I use. If you care about the brands and models of my gear, check out My Favorite Technology to read more about the specific audio equipment in my setup.
I remember seeing the introduction of StaffPad for Windows Surface tablets back in 2015. Applications that convert handwriting to music notation were not widespread yet and I was absolutely shocked by the demo videos.
My amazement was immediately followed by frustration when I leaned this was a Windows only product. It was a tough pill to swallow, but I understood. The iPad was (and is) widely held as a superior tablet for consumer and professional use, but iOS did not have proper stylus support at the time. There were only third party options, and none of them leveraged the operating system for the level of accuracy that the Apple Pencil now provides.
When the iPad Pro launched months later, I thought "surely StaffPad will now be possible." Turns out I was right. Though it has taken many years, the StaffPad team has been hard at work, and the product is now available for iOS.
I have been beta testing StaffPad for the past month. I consider myself to be testing it largely from the perspective of a music educator, specifically a middle school band director, which means that I am doing things like...
Reconstructing missing flute parts from my music library using the original score
Arranging extra percussion parts for works that are sparse in percussion writing
Writing short folk melodies to use in our sectional curriculum
...pretty basic stuff. If you want a very balanced and comprehensive review of all the StaffPad features, not just the ones I depended on, I strongly recommend you check out the Scoring Notes review by David MacDonald.
TL;DR: If you want to skip this review, I'll get to the point:
StaffPad is an exceptional tool for music educators. It is elegantly designed, astoundingly intuitive, and makes exactly the right trade-off for what a teacher would and would not need in a pro-level score editor. It is a best-of-class example of what a professional 'iPad-first' app should look like. It legitimizes the platform by being a tool that executes tasks that no other computing device can.
While I believe StaffPad near-perfectly conceived, it's hand writing recognition is a headache to use at times, and it needs to improve a lot in this area for me to consider it rock-solid-dependable. Fortunately, I got better at it as I wrote this review.
Ok, let's get to it.
UPDATE: I spoke at length about my experiences using StaffPad on my pocast. Listen and subscribe below.
The design of StaffPad is one of the most impressive I have ever seen. It is undeniably professional, but maintains the elegance and simplicity you would expect if you are familiar with Apple’s native iOS apps. It manages not to be overbearing with buttons and knobs, yet none of the tools seem too far away or too many menus deep.
Let's look at the home page.
Everything is beautifully laid out in a way where my eyes naturally gravitate towards the information relevant to me. There isn’t any information on this screen that doesn’t need to be.
Home shows just recent documents, Library shows all of your stuff, templates shows the customary templates you would expect from a score editor, and Collections shows some pre-made StaffPad scores designed to show off the sound library. I appreciate how the Templates page is not bogged down with dozens of rare options like Mariachi Band.
The Store button takes you to a screen where you can buy sound libraries and other extensions. More on that later. Discover takes you to some helpful introduction videos.
I am going to get into note input in a bit. Before that, I want to pontificate the nature of writing notes with a pencil on a touch surface.
At launch, the iPad made a promise to simplify computing for every person, allowing you to touch directly what you want to do on the screen and removing the abstraction of pointing and clicking, the preferred interface of personal computers for decades.
John Gruber, amongst other Apple commentators, have recently had a lot to say about the original promise of the iPad; about how it has maybe lost its way as it has tried to become more like the Mac, introducing inscrutable multitasking gestures and imitating professional PC software rather than leveraging the strengths of a touch interface. There is a great conversation about it on his podcast, which makes special reference to how revolutionary the original GarageBand app was for iPad.
I mention all of that here because I think StaffPad perfectly fulfills that original iPad promise. Writing notes directly on the screen really is the way to write music, as it removes all abstractions and lets you just touch where you want things to go. It also exists in a category of rare, niche, and professional iPad apps that a) cost real money, and b) could not really exist on a Mac. I already wrote about this a little bit here.
So what features exactly does StaffPad have? If you want an exhaustive list, check out StaffPad's help page. It is very detailed and straightforward.
Though StaffPad’s website has a great introduction video, the help page lists everything StaffPad can do in a concise manner.
If you need specialty engraving features and every editing feature money can buy, you need Dorico or Sibelius (but choose Dorico). If you need a sketch app for music notation, that can make 90% of your score needs come true from the comfort of your couch, StaffPad has you covered.
There are trade-offs. But for my basic purposes, they are just the right trade-offs. For a handwritten sketch app, StaffPad strikes exactly the right balance of what it does and what it doesn't do, especially considering the quality of the resulting scores. There aren't a lot of ways to customize your score's layout, but StaffPad makes really good default choices about how to stylize the final product.
I appreciate that everything StaffPad does is very discoverable and not buried too many layers deep. Most things, you can just write directly on the screen with the pencil (though I had a lot of trouble with articulation, and especially with dynamics). StaffPad attempts to solve the problem of organizing features by using what I call a "double tool bar." I am sure they have a technical name for it. Basically, the tool bar shows one set of tools, and when you tap the upward or downward facing arrow on the upper left corner of the screen, it shows another set of tools.
If I knew the logic behind how StaffPad has organized these tools, I would probably be able to find them better, but because the options are selectable from two sides of the same toolbar, I often get confused which "side" of it I need to be on to get what I want. At least changing it over is only a tap away.
One side of the tool bar has buttons which contains the following...
Play, pause, forward, backward buttons.
Button to trigger Reader mode.
Button to toggle a metronome.
Options to change the voice(of which there are four).
Button to toggle an annotation mode.This mode allows you to scribble freely on your score and highlight certain sections. This mode is necessary because regular strokes draw notes on the staff by default. I can’t think of any standard notation editor that allows freeform annotations with a stylus since most of them are not designed for a tablet.
A loop tool. This tool is great but buggy. It does what you would expect. It allows you to circle a section of music and then copy, paste, or duplicate it. This is a nice way to solve the problem of there being no keyboard shortcuts for selection, copy, and paste, in the app. Sometimes StaffPad crashes when I use it.
The famous three-dots button.(which in most apps means "more") This button takes you to most of the notations that you cannot write on the staff directly with the Apple Pencil - trills, fermatas, rehearsal markings, etc. This button is so frequently accessed that I kind of wish it showed up on both sides of the tool bar. Furthermore, it would be great to be able to edit the order the options appear, rather than scrolling to the right every time I need a rehearsal marking.
Fenby. - a digital assistant that you can talk to. Fenby is wicked cool. Similar to digital assistants like Siri, however, it works really well only when it works. I got used to telling it to "add strings" or "transpose" the score, but there are other commands listed on the StaffPad website that I could not get to work.
The other side of the tool bar includes buttons for...
Undo and redo buttons. Which, again, are so commonly needed that I wish they showed up on both sides of the tool bar. You can use the new text gestures introduced with iOS 13 to three finger pinch (copy), three finger spread (paste), three finger swipe left (undo) and three finger swipe right (redo). Once you get the hang of these, you really start to fly.
Also, a bonus note (and my favorite take away from Paul Shimmons' StaffPad review): copying a selection of music in StaffPad, and pasting it into another app results in a beautifully formatted score excerpt. It’s nice touches like this that make StaffPad a delight to work with.
Copy and paste using the new three finger gestures in iOS 13 is very natural.
Button add/remove instruments. This screen is super elegant and I love it.
Automation layer. You can actually draw your automations right onto each stave with the pencil. It is too bad this is a feature I will not use that much, because the implementation is really slick. I hope that all iOS DAWS consider adding Apple Pencil support for automation layers.
Button to toggle transposing vs. non transposing score.
Playback buttons. Again, these are on both sides of the toolbar but I use them far less often than some of the other options.
Button to access version history.
Share button. The share menu is ridiculously elegant and straightforward. It has all of the export options you would want, and appears very clean. My only complaint is that it does not work the way standard iOS share buttons work where once you share something, the share menu is no longer active. In StaffPad, it is more of a "mode" that you enter in to. I don't prefer this, but it is also not the end of the world.
Home button to go to the main screen.
Settings button. This screen is really straightforward and easy on the eyes. This is the one case where I do wish StaffPad would add more options. The screen is designed nicely enough that I would not mind scrolling downward for more options.
For example, I would like to be able to customize the tool bar or choose for the Apple Pencil's double tap gesture to do something other than initiate a lasso select.
Fenby. I do not think this feature is useful enough to put on both tool bars.
Note input
Ok so here’s where the rubber meets the road. StaffPad only accepts note input through the Apple Pencil. I have written about this elsewhere. I would love for StaffPad, like Notion, to have a Mac counterpart. But it’s not designed that way. Because Windows operates on a tablet, Surface users of StaffPad do not need to distinguish between tablet and PC operating systems. StaffPad runs on Windows, period. macOS is a different operating system than iPadOS, so there is no way I can run StaffPad on my Mac.
Interestingly, the main PC score apps, Dorico, Sibelius, and Finale, have made no attempts at an iPad app. I find that we are in this weird fragmented stage with Apple software where nearly any productivity app (I am thinking iWork, the Omni apps, even now Photoshop) can run on any Apple platform and even sync your work between devices, meanwhile niche pro apps still tend to exist on only one platform (Pro Tools/Ableton on the Mac and forScore/StaffPad for the iPad for example). These niche pro apps take unique advantage of platform conventions (the ability to work with complex audio streams in the case of DAWS on the Mac, and the Apple Pencil in the case of iPad).
Maybe its for the best. But I can’t help but feel like StaffPad would be superior if I could snap my iPad into the Smart Keyboard Folio and enter notes from there, or boot up a Mac version and enter notes with a MIDI keyboard..
Because I can’t do that, it is imperative that StaffPad’s handwriting recognition is air tight.
Simply put: it doesn’t register for me all the time. While I am getting better at it after a month of practice, it has a way to go. Sometimes I write really messy and get surprisingly great results on first pass. Other times, I write as slowly and neatly as I can and StaffPad doesn’t convert the notation.
Fortunately, StaffPad’s rules for notation conversion are very thoughtfully considered. Unlike Notion, notes do not convert until I tap somewhere outside the current measure I am composing. This means I can stop and think as long as I want before moving on. StaffPad also leaves anything that it doesn’t recognize in my own handwriting while converting the rest. This means I do not have to worry about an ambiguous pencil stroke being converted into StaffPad’s best guess, and I can go back and fix it later. Speaking of fixing things later, there isn’t a need to be too careful, because notes that end up a line or a space to high or low can be held with the pencil tip and dragged wherever you want on the staff.
This video shows off the design, features, and note input of StaffPad in action.
StaffPad’s design ingenuity continues to shines in the details. You are allowed to write whatever you want in a bar, regardless of if it fits in the time signature or not. StaffPad also allows you to drag the bar line to the right with the pencil if you run out of room. These considerations work well for my brain, because there is less cognitive overhead. I feel like I am writing with a pencil and paper, not a computer.
Still, there are times that I have to try numerous attempts before achieving success. The StaffPad support team recommended that I do notes in one pass, articulations in another, and dynamics in yet another, until I gain confidence with the system. They also recommended that I try to write the notes at approximately the size they will appear once converted. This advise helped but I am still making more mistakes than I would like.
My wife is a professional artist. She uses the iPad Pro to do illustrations and design mock ups. In other words, she has way better control of a pencil than I do. I asked her to spend some time writing various different musical symbols, at varying speeds and sizes. She, too, was perplexed at which of her pencil strokes worked and which ones didn’t.
StaffPad’s help documentation (again, excellent) makes it look really easy. The examples of handwriting are really loose. As a percussionist who detests how other score programs handle drum set notation, I would love to be able to write drum parts as easily as the support documentation illustrates. No matter how hard I try to imitate it, I am getting inconsistent results enough so that I am reluctant to try these features again in the future.
While I am reflecting on note input, I need to acknowledge that StaffPad has, by far, the best implementation of erasing that I have ever seen for the Apple Pencil. There is no double-tap, or need to tap a button on screen to turn on the eraser. You simple press harder! It takes a little getting used to, and it is easy to press too hard when attempting to compose and erasing by mistake. But overall, I wish all apps would adopt this style. It is truly a dream.
Hard press to erase in @StaffPad is by far the best implementation of erasing with Apple Pencil I have seen in any app. It is even more seamless than if the Apple Pencil added an eraser to the other side. I’m seriously ruined for eraser tools in all other software. pic.twitter.com/fTJxDpsgVB
Most of my testing for StaffPad included preparing for my recent band concerts. My Concert Band has 10 percussionists and some of my music had only three or four parts. I also have some flutes in my Jazz Band this year, and planned some repertoire that does not have original flute parts. Arranging these additional parts took place while I was on leave for the birth of my first child and was awaiting a return to school, where I would have only two weeks to prepare this concert before the performance date.
Headaches aside, the lightness and simplicity of StaffPad’s design, mixed with its direct note input, made this an indispensable tool for me in the past month. Projects that would have had more overhead using a heftier score editor like Dorico were a breeze using StaffPad and iOS. The iPad’s portability made it easy to sneak little additions to my work into busy days of carrying, holding, and feeding a newborn in one arm while sitting on the couch in my living room rather than at a desk.
Between pencil input and the tool bars mentioned above, there are a handful of features that are hidden beneath contextual menus that are achieved by long pressing on various places in the score. Long pressing in a measure allowed you to change the time or key signature. Long pressing on bar lines allows you to change their style or add measures to the music, add lyrics, text, or chords. These menus are very tastefully done, and as I have already mentioned, they have just enough features that they are confusing to dig through, but just enough that I was never wondering where something was. The lyrics and chords options are not as in depth as other score applications, but they were just right for my needs.
iOS-ness
There are features available to third party apps that I believe should be in every app. I was disappointed that StaffPad did not follow a few of these conventions.
Specifically, I wish StaffPad supported Split View. iPad apps can now share half the screen with another app. StaffPad only works in full screen.
This was frustrating for me, particularly in my arranging project mentioned earlier. I wanted to be able to open forScore on one half of the screen for a reference of the full score, and then compose in StaffPad on the other half of the screen. StaffPad customer support informs me that they experienced weird multi-touch results when StaffPad was on half of the screen and that it doesn’t work. But I would still like to see it happen.
You can use other apps in slide over view, which is where you drag an iPhone-sized version of an app over top a full screen app for quick reference. You can see if the screenshot below that this is really too small to be tenable for score reference.
Referencing a score is awkward because StaffPad doesn’t support the iPad’s splitview feature.
Playback
Spitfire and cinesamples audio libraries, amongst others, are available as inn-app purchases. They sound fantastic! Given how seamlessly they work with StaffPad, it is astounding how easy it is to get good sounding playback. If only using advanced audio plugins with score apps was this easy on macOS and Windows.
That said, I am extremely hesitant about buying these plugins. These samples, once purchased, only work with StaffPad on iOS and cannot be used with any other program like they can be if you purchase the PC versions of these plugins directly from the companies that engineer them.
Conclusion
StaffPad is a unique composing application that leverages everything unique about the iPad to provide what I anticipate will be an indispensable tool for my work as a music educator. While the handwriting recognition doesn’t always work as I expect, it gets better with each update and also as I practice it.
StaffPad is elegantly designed and makes trade-offs that position it as perhaps the most natural score editor I have ever worked with. I am so glad that this app exists both as a tool for my professional work, and as a statement about what the iPad can be. I would recommend it to anyone who is looking for a score app that balances power and ease as long as they acknowledge that there is a learning curve and a price.
Five years ago, StaffPad came to Windows Surface tablets. StaffPad is a professional music notation application that turns handwritten notes into beautiful music notation. It is built around the stylus being the primary input, and because the iPad did not have stylus support at launch, StaffPad remained Windows only.
Multiple years into Apple supporting its own official stylus, the Apple Pencil, StaffPad is finally here on iPad!
StaffPad’s intro video sells itself, so I am not going to write much about the app here. Instead, I point you to…
Since the features of StaffPad are covered in the links above, I want to comment on two interesting aspects of this release.
First, the price. At $89.99, this is no impulse purchase. I find it refreshing to see a professionally priced app like this on the App Store. For years, the App Store has seen a race to the bottom type approach for grabbing sales. Users are so used to <5 dollar apps that the idea of paying for software has diminished from reality.
Increasingly, developers are finding that subscription based pricing is the only way to maintain software and put food on the table. There was a big discussion about this in the Apple community last week when beloved calendar application Fantastical released their version 3 and went to subscription pricing. As is customary when an app goes to subscription pricing, users of the application and bystanders alike were enraged at the idea of a calendar costing four dollars a month.
I couldn’t resist sneaking my love of Fantastical into this post. The interface is beautiful.
And the natural language input is one of many essential features that helps me get my work done more efficiently.
As a user of Fantastical, I was happy to keep supporting development. It is one of my most used applications on a daily basis and its features are essential to me having a full time teaching job, while also scheduling gigs, 25 private students, speaking engagements, and all of my other personal events.
Fantastical is what I would call a prosumer application. It offers more power to someone looking for an advanced and well designed calendar, and it has a wide appeal (everyone needs a calendar!). Four dollars a month is steep, but manageable. Now that the price is reoccurring, I do think it will appeal to a smaller audience, as each user will have to reevaluate on a monthly or yearly basis whether or not this application is continuing to be worth the cost.
StaffPad is very different. It is a professional creation tool. Much like Photoshop is essential to designers and photographers, score editors are essential to the lives of most musicians, composers, and music educators. By charging 89 dollars, StaffPad follows a long history of apps in its field, which are often priced between 200 and 600 dollars.
I have to wonder… if the iPad had more software like this, and from an earlier point in time, would users have adjusted their expectations and would more expensive professional apps be more viable? And if so, would the viability of such professional apps lead to more (and better) professional apps on iOS?
And furthermore, would Apple adjust to these trends? Apple still offers no free trial for apps (something that will definitely deter a lot of my music teaching colleagues away from giving StaffPad a chance). Not to mention that professional creative software has a tradition of volume licensing and educator discounts. Educators who would normally be able to afford a program like this for themselves or their class are going to be stuck if they are looking for the same options with StaffPad.
App developers get around to this in number of ways, an example of which is to offer a free app where you have to buy it as an in-app purchase after a week. Of course there is also the subscription model. I am glad StaffPad went with a more traditional model than a subscription because it fits within the tradition of how its class of software is priced. And my hope is that this just might convince more developers to bring their own apps to iPadOS.
Which brings me to my second point…
StaffPad doesn’t, and probably wont, have a macOS app. It is built entirely around stylus input. This is why it could only exist on Windows Surface tablets at first. I am thrilled it is on iPad, but this presents an interesting question for users of Apple products.
A Windows Surface user notices no distinction between whether or not StaffPad operates on a touch-based OS or a traditional point-and-click OS, because they are one and the same. Even as macOS and iPadOS move closer and closer together, this distinction has lead them to be products with very different potentials.
On the other end, all the other players in the score-editor field (Sibelius, Finale, Dorico) remain “desktop” applications that run on traditional point-and-click operating systems. With the power of the current iPad Pro, there is no reason these applications couldn’t exist on iOS, other than that developing for iOS is very different. None of these developers have shown any signs of bringing their programs to iPadOS any time soon, and I would suspect StaffPad has no plans for a Mac version.
I admire how Apple has held their ground about the iPad being the iPad and the Mac being the Mac. It has made both platforms stronger. But as the iPad becomes a more viable machine for getting work done, Apple has got to get a plan for how to solve this essential “input” question.
I am starting my third week of paternity leave tomorrow. And while I am doing my best to ignore work at all costs, I am also reminded that when I return I will have three weeks with my students to work on their band assessment music. My long term sub (who is incredible) will have been working on it with them for three weeks by the time I return. Naturally, there is still a lot I want to accomplish with it on my own time.
To that end, I decided to get organized. When I organize large projects, I like to create a mind map.
In my brain, there are a lot of ways I want to keep kids engaged with our current repertoire. I have score study and lesson planning tasks, music and videos I want to inspire them with, strategies for rehearsal, alongside stories and verbal illustrations to communicate abstract tonal and phrasing ideas. I also have some behavioral concerns that need to get locked down so that our focus is at 100 percent. Personally, I don’t know any way to dump out these interconnected ideas and see how they fit together without a map.
MindNode is a mind mapping application for iOS and macOS that lets you easily dump ideas quickly into a beautifully structured map. A MindNode document starts with a single bubble in the middle of the screen from which you can create “nodes,” or branches, off from the middle. It is possible to create a vast tree of hierarchical concepts, topics, and ideas, without even taking your hands off the keyboard, much like typing a quick bullet point list into a note.
The nodes can later be dragged around freely anywhere on the map. When you move one branch, all of the others adjust around it dynamically, ensuring that your map is balanced.
Dragging a node adjusts the map.
MindNode has a ton of features that are beyond the scope of this post. You can add notes, images, and tasks to nodes, which you can see I have done in the map above. You can apply various different themes to the way the nodes look, or even customize your own theme. You can also view your map as a linear outline. The new version, MindNode 7 has even just added a visual tagging feature to help you better organize your nodes. You can read about that here.
MindNode is full of tools to conceptualize your map and format it so that it looks great.
One of my favorite new features is the Apple Pencil support. When you screenshot a mind map you can choose to annotate it like a normal screenshot or you can select 'Full Page' and MindNode will fit the entire document into view and cut out all of the user interface elements like menus and buttons. This way, you can mark up a clean copy of the file which you can then export as a PDF to an app of your choice.
This is what annotating a normal screenshot looks like.
MindNode uses Apple's PencilKit API to strip away buttons and menus, leaving you with a clean document to annotate.
MindNode's export tools are amazing. In the next screenshot, you can see all of the options. You can export the document itself as an image, PDF, or outline, just to name a few choices. But what I love is the option to export the nodes to the task manager OmniFocus or Things as a project.
Next, you can see a screenshot of Apple Notes with an exported MindNode PDF (left) alongside todo app Things (right). MindNode has neatly formatted my map as a project in Things with headings and checkable todos that I can later give due dates and deadlines too. Awesome!
In that screenshot, notice another PDF beneath my MindNode document. It is another PDF I exported. It is a score map of Greenwillow Portrait by Mark Williams which I am performing with one of the bands.
One of my goals for the quarter is to spend more time in the score. I like to occasionally study a score starting with the big picture and later moving to finer details. To help establish this big picture, I will occationally make a map that serves as a rough guide to a piece. One of my problems with drawing maps is running out of screen space on any of the four ends of the iPad. To solve this, I used Concepts, an open canvas drawing app.
It's full of features, but I am most attracted to the style of the pen tools and its ability to keep drawing in any direction, without being limited by the four walls of the iPad's screen. The document just keeps adding room to whichever side I keep drawing on. It's worth checking out if you have a need for this kind of drawing tool.
When I started this document, I ran out of room on the side of the screen at measure 19. All I needed to do to solve that problem is zoom out and keep drawing.
Happy winter and good luck preparing for your spring assessments if you are taking a performing group to one!
