| Turning a Steno machine into a musical instrument | Jack Armitage | 22/10/15 13:41 | Hello, I have a short graduate project in which my task is to repurpose a piece of technology. My background is music technology, and one idea I'm currently assessing is to find an old Steno machine and try to power a sound engine via Plover. I have a few questions for the group that I would be grateful for some feedback on. 1) Has this been tried before to anyone's knowledge, in this form or some other? It would be great to see how that went if so. 2) Hardware-wise, is it possible to retrofit the Stenoboard PCB inside an old Steno machine? 3) How hackable is Plover for a project like this? I saw someone made a tutor app using Processing which is really great, but it seems that it doesn't directly interface with Plover. Would this design pattern be reasonable to follow? Any other thoughts or suggestions would be appreciated. Thanks, Jack |
| Re: Turning a Steno machine into a musical instrument | Kristen C | 22/10/15 13:47 | I can't help with any of that, but I just want to say I really, really love this idea. I would love to be able to use my steno machine as a musical instrument!! |
| Re: Turning a Steno machine into a musical instrument | Jack Armitage | 22/10/15 13:48 | Ha, thank you. If it's feasible and I go ahead with it, I will definitely post updates. |
| Re: Turning a Steno machine into a musical instrument | Ted Morin | 22/10/15 13:53 | Hm, one thing you might try for now is reading the log file real-time like StenoTray does. Plover tends to read only when the user releases all the keys, so your chords will sound open release, not on keypress (I think that's a good thing, personally). See this GitHub issue where brentn requests hooks for programs and hacks just like the one you are thinking of https://github.com/openstenoproject/plover/issues/269 (not resolved yet :( ) -- |
| Re: Turning a Steno machine into a musical instrument | Jack Armitage | 22/10/15 14:06 | Ok that makes sense, thanks. There's two musical directions the project can go in. The first is a real-time improv system – i.e. press some keys, hear some notes. In this case, I would hope to add extra sensors to the keys like these instruments have. The other direction is 'offline' composing, where the playhead is a few seconds behind the typist's input, which should be possible given the speed capabilities of Steno. In the first scenario, knowing about key presses would be critical, but potentially not for the second. Is this feature request likely to be addressed in the next few weeks? If not, I guess I would have to create a separate key logging program to augment the Plover output. |
| Re: Turning a Steno machine into a musical instrument | Ted Morin | 22/10/15 14:09 | Hooks isn't high on my priority list, but it could be if you wanted it to be. If you assume the user is using NKRO you can also just listen for those keypresses. Serial machines won't alert Plover on keypresses necessarily, but rather only stroke release. |
| Re: Turning a Steno machine into a musical instrument | Jack Armitage | 22/10/15 14:20 | Ok, well I don't want to put any pressure on your project, but it would be great for this project and it sounds like others would benefit too.
It looks like hardware-wise I would base it on the Stenoboard, so I would be hoping I could alter that firmware to send more information about keystrokes to Plover.
Jack Armitage |
| Re: Turning a Steno machine into a musical instrument | Owain | 22/10/15 14:35 | On Thursday, 22 October 2015 21:41:39 UTC+1, Jack Armitage wrote: In a simple form, you could use a custom dictionary to translate steno input into something like Lilypond input file format (in a similar way to people who already use steno to generate code) and pipe that output in realtime into a compatible midi player like Frescobaldi Owain |
| Re: Turning a Steno machine into a musical instrument | Owain | 22/10/15 14:44 | On Thursday, 22 October 2015 22:06:01 UTC+1, Jack Armitage wrote: Depends how you do the composing. If you compose note-by-note then note will follow steno stroke. If you assign steno strokes to multiple-note sequences eg a bass rhythm line to be repeated x times on a single stroke, then the bass can be starting to be played out while you still compose the treble. You may need to introduce some way of synchronising different streams, eg bars, if you want to sequentially input concurrent output, eg treble then bass clef. Owain |
| Re: Turning a Steno machine into a musical instrument | Jack Armitage | 22/10/15 14:44 | Hi Owain, That sounds interesting as a workflow. I need to learn more about how dictionaries work (and about Steno in general). Ideally I would make it output MIDI or OSC and then ship that off to something like PureData or SuperCollider as that's what I'm familiar with, and the sound design/synthesis possibilities are quite broad there. |
| Re: Turning a Steno machine into a musical instrument | Jack Armitage | 22/10/15 14:48 | Yes, the idea of assigning phrases is one of the most interesting aspects to me, and I think you're right about event sequencing being a key feature. I'm anticipating running a master clock and possibly a few other clocks if things are happening at different times. My ideas for the pattern generation and sequencing are somewhat inspired by live coding environments like Tidal, which I sometimes use in live performance: |
| Re: Turning a Steno machine into a musical instrument | Achim Siebert | 22/10/15 15:27 | I don't really see how this would be much different from using a standard midi keyboard then - apart from the looks of the machine and some "pre-processing" by Plover. There's so many possibilities to "translate" incoming Midi data already - e.g. in Logic's environment or in Reaktor etc. What you get out of a steno machine is chords - same as from a midi keyboard. The only difference might be that you can hit more keys together in a controlled way than on a piano. This would need quite some serious "steno" training, though. The firmware of the Stenoboard is available, so you could program the Arduino in it directly to give out e.g. pitch values. No need to have Plover in between the Stenoboard and the Midi or OSC processor you'll use. I'm looking forward to see and hear the outcome of this endeavor - a "Stenophone"? Best, Achim. |
| Re: Turning a Steno machine into a musical instrument | Jack Armitage | 22/10/15 15:45 | Stenophone - I like it! I think you hit the nail here: "What you get out of a steno machine is chords - same as from a midi keyboard. The only difference might be that you can hit more keys together in a controlled way than on a piano. This would need quite some serious "steno" training, though."That's what I see as being unique about Steno, along with the dictionary system. The project is about asking what can musical instrument designers learn from the Steno scene - I already assume not all concepts will map well, but I think those that don't may fail in interesting ways that e.g Logic environment wouldn't provoke. Steno is a way of seeing typing and language, and immersing myself in that with my music hat on just feels like it will produce something fun! I will def check out the firmware, thanks for the tip there. Even if I go down your suggested route and skip Plover, I imagine I'll still use it as inspiration for encoding/decoding input/output. --To unsubscribe from this group and all its topics, send an email to ploversteno+unsubscribe@googlegroups.com. -- Jack Armitage |
| Re: Turning a Steno machine into a musical instrument | Steven Bhardwaj | 23/10/15 01:11 | Hi, Jack, Whatever direction it takes, the project "sounds" exciting! ;) My favorite ideas for a realtime stenophone are 1- integration with text-to-speech, whether chord-by-chord as described by Aziz Yemloul here, or phrase-by-phrase with sound production cued by a trigger chord or foot pedal. 2- use as a large-library digital sampler. A big advantage over existing realtime-performance digital samplers could be that the sound library can be organized as intuitively and easily as language itself. I imagine a song that requires a hundred sounds to perform - it would take a long time to memorize their locations in the sampler for fluent access in performance. However, with steno, the sounds could each be given one-chord names. Let's say I'm performing a cover of Maroon 5's "Animals" song. Then my hundred sounds could be conveniently and thematically named: "TPEURB": "fish", "WOFL": "wolf", "STPHAEUBG": "snake", "TAOEURG": "tiger", ...etc Perhaps it would be difficult to perform an entire piece with such a digital sampler being the lone instrument, especially if there's some latency in the system. But it might be a nice addition to an electronic musician's kit. Cheers, Steven |
| Re: Turning a Steno machine into a musical instrument | Ted Morin | 23/10/15 06:34 | When I was learning steno I played with this website and used the steno keys and it made some pretty interesting sounds: https://groups.google.com/forum/#!topic/ploversteno/9NJu6XJD7go Playing now with a much higher speed, I can find that some simple combos work pretty well. "to see me, do we he" is quite all right. "...,,,,...,,,," works quite well, too. Maybe this could be inspiration for you. I'd say that you're going to have to find a way to make it sound good, though. Knowing that the vowels almost always get pressed (sometimes together), as well as all the combos on the left side of the layout especially (just go through ABCDEFGHIJKLMNOPQRSTUVWXYZ). Maybe blues would be a nice starting point since we're so used to hearing improvized blues all the time that it would probably sound all right. Also to consider is that there's steno order, but you could also assign based on rows of the layout. Hm, I'm looking into IPC in python and I think that actually giving you what strokes are happening will not be a problem. It's more the GUI that I'll have to work on (don't want to broadcast by default) |
| Re: Turning a Steno machine into a musical instrument | Jack Armitage | 27/10/15 03:14 | Hey all,
Thanks for all your input on this idea!
Quick update – I'm now focussing on acquiring a cheap old Steno machine (any tips for UK please let me know) that I can hack on. I may not be able to do this project as part of my studies but I'm still interested in pursuing it. I'll post further updates to the forum as soon as I have any.
Jack
Jack Armitage |
| Re: Turning a Steno machine into a musical instrument | Jack Armitage | 03/11/15 06:06 | In a twist of fate, the project I was going to do for this assignment fell to pieces quite literally – I bought a Super Nintendo from eBay to hack on, but it got smashed up in the post! I don't have time to find a new one, so... 'Project Stenophone' is back on! I've acquired an old machine (pic below) and am probably going to install a Teensy 3.2 + RasPi 2 inside it, and attempt to sense the keystrokes. Will post updates here as I go, wish me luck! |
| Re: Turning a Steno machine into a musical instrument | Jack Armitage | 20/11/15 12:37 | Not sure if anyone is monitoring this thread, but anyway... I've managed to digitise the keys of my stenograph, here's a pic showing where I fitted the PCB. I used QRE1113GR optical reflectance sensors to measure the linear motion of the types. I need to calibrate the sensors but once I've done that I can start learning steno proper and integrate it with the live coding language I use (tidal.lurk.org/). I may then try to get the whole thing running on a Raspberry Pi so I can just run audio straight out of the stenograph... Build pic:
|
| Re: Turning a Steno machine into a musical instrument | Mirabai Knight | 20/11/15 19:39 | I'm totally still reading this! I think it's fascinating.
Mirabai Knight, CCP, RDR
StenoKnight CART Services 917 576 4989 m...@stenoknight.com http://stenoknight.com |
| Re: Turning a Steno machine into a musical instrument | Joshua Taylor | 21/11/15 05:51 |
Me too! :)
|
| Re: Turning a Steno machine into a musical instrument | Johnny Sagan | 21/11/15 06:41 | Also fascinated! Sent from my iPhone |
| Re: Turning a Steno machine into a musical instrument | kettleb...@verizon.net | 04/10/16 17:51 |