Status of 2009 audio cleanup, tagging, etc.
M. Edward (Ed) Borasky
something running that will create a dataset we can break up into
pieces and process individually. What I have is
1. A set of post-processed files. The processing steps were:
a. Convert file names to lower case.
b. Insert MP3 tags for Title, Artist, Album, Track, Year, Comment
and Genre. The "Album" field is composed of
the room number, name and date of the session. The Comment is
"Open Source Bridge 2009" and the genre
is "Spoken Word". The "Track" is *not* the conference track -
it's the track number on the "Album". To get
the tagger to work, I had to use the latest "version" of the
tagging "standard", ID3v2.4.
http://en.wikipedia.org/wiki/ID3
c. Normalize the audio levels.
2. The Perl script to do this: http://github.com/znmeb/OSBridge-2010/blob/master/Audio2009/tag.pl
3. A bash script to install all the dependencies on openSUSE 11.2:
http://github.com/znmeb/OSBridge-2010/blob/master/Audio2009/dependencies.bash
Next steps:
1. Now that the files are tagged, they can be renamed and re-organized
so the directories and file names are recognizable, rather than being
things like "110/110_Wednesday/mz00012..mp3". That can be automated,
and I'm planning to get that running tonight.
2. Upload the files somewhere. If all else fails, I can put them up on
my site, but I'd rather not.
3. Validation of the tags. I'm pretty sure I have them all labeled
correctly, but it needs to be checked.
4. Front and back trimming: quite a few of the files have long gaps in
the beginning before the talk starts, and stuff at the end that needs
to be removed. The way to do this with Audacity is:
a. Load the file in Audacity. If there's a gap in the beginning,
remove it with the "Cut" operation.
b. Listen to the file. When the actual end of the talk occurs,
remove everything after that with the "Cut"
operation.
c. Save the file.
Jonathan Leto
Thanks for all of your work on this, Ed. We all appreciate it greatly!
That is also a great summary of what you did. Nice work.
Would it be possible to provide these audio files as a torrent? I can
help with that.
Duke
--
Jonathan "Duke" Leto
jona...@leto.net
http://leto.net
Selena Deckelmann
> Would it be possible to provide these audio files as a torrent? I can
> help with that.
+100
I'll start seeding as soon as they're available.
-selena
--
http://chesnok.com/daily - me
http://endpoint.com - work
M. Edward (Ed) Borasky
this *is*, after all, Portland) ;-)
> > http://github.com/znmeb/OSBridge-2010/blob/master/Audio2009/dependenc...
>
> > Next steps:
>
> > 1. Now that the files are tagged, they can be renamed and re-organized
> > so the directories and file names are recognizable, rather than being
> > things like "110/110_Wednesday/mz00012..mp3". That can be automated,
> > and I'm planning to get that running tonight.
>
> > 2. Upload the files somewhere. If all else fails, I can put them up on
> > my site, but I'd rather not.
>
> > 3. Validation of the tags. I'm pretty sure I have them all labeled
> > correctly, but it needs to be checked.
>
> > 4. Front and back trimming: quite a few of the files have long gaps in
> > the beginning before the talk starts, and stuff at the end that needs
> > to be removed. The way to do this with Audacity is:
>
> > a. Load the file in Audacity. If there's a gap in the beginning,
> > remove it with the "Cut" operation.
> > b. Listen to the file. When the actual end of the talk occurs,
> > remove everything after that with the "Cut"
> > operation.
> > c. Save the file.
>
> --
> Jonathan "Duke" Leto
> jonat...@leto.nethttp://leto.net
Igal Koshevoy
I've cleaned up, documented and published my Bittorrent service:
http://opensourcebridge.org/planning/teams/tech/projects#bittorrents_server
There are Bittorrent files shared by the servers:
- Source code for Open Source Bridge's Bittorrent servers: http://github.com/igal/osbp_bittorrent
- The service is run by the “torrent” account on the production servers and run from the “osbp_bittorrent” directory. See the source code above or run “rake help” for usage instructions.
- If you need to add or modify the files being served:
- Login to the “tor...@opensourcebridge.org” account
- Go to the “osbp_bittorrent” directory
- Put the new files into its “files” subdirectory
- Run “rake restart” to have the server use the new files
- Then from all the other servers, go to the “osbp_bittorrent” directory and run “rake pull restart” to pull the files from the “opensourcebridge.org” server to the local stash and restart the Bittorrent server.
Currently, Reid and I can login to this account. Please provide us the files to us and we'll distribute them.
-igal
M. Edward (Ed) Borasky
stalling out. So I'm going to need to go the DVD route. As luck would
have it, I'm going to be at the "Bus Project" tonight for a meeting at
7, and normally I have dinner at Produce Row before that. So I can
bring DVDs over with me. How does 6 at Produce Row sound? One DVD copy
or two? I have DVD-RWs, so they can be re-used once you get the files
uploaded.
How many people are we going to have doing the editing? Should I post
a screen capture of an Audacity session of how to trim the gaps off?
On Feb 9, 3:42 am, Igal Koshevoy <i...@pragmaticraft.com> wrote:
> If you want to publish stuff through Open Source Bridge's torrent
> servers, please make the files available to us. You can use physical
> media (e.g., DVD), put them online (e.g., FTP), or better yet, make a
> torrent that we can download.
>
> I've cleaned up, documented and published my Bittorrent service:
>
>
>
> >http://opensourcebridge.org/planning/teams/tech/projects#bittorrents_...
>
> > There are Bittorrent files shared by the servers:
>
> > * Source code for Open Source Bridge's Bittorrent servers:
> > http://github.com/igal/osbp_bittorrent
> > * The service is run by the "torrent" account on the production
> > servers and run from the "osbp_bittorrent" directory. See the
> > source code above or run "rake help" for usage instructions.
> > * If you need to add or modify the files being served:
> > o Login to the "torr...@opensourcebridge.org" account
> > o Go to the "osbp_bittorrent" directory
> > o Put the new files into its "files" subdirectory
> > o Run "rake restart" to have the server use the new files
> > o Then from all the other servers, go to the
M. Edward (Ed) Borasky
meeting generally lasts till 8:30 if nobody can be there at 6. ;-)
Igal Koshevoy
> I tried about four times to upload the files to my server and FTP kept
> stalling out.
sends your password out over the network without encryption. You should
use a secure file transfer protocol, such as SFTP, FTPS, SCP, or RSYNC
over SSH.
I prefer to transfer big files with RSYNC over SSH because it's smart
enough to only transfer the parts of the file that are needed. Here's
what an rsync command for uploading a file, which you can re-run to
resume the transfer if it breaks, and once the transfer is finished, it
won't do anything else:
rsync -vax --stats --progress --partial SOURCE TARGET
> So I'm going to need to go the DVD route. As luck would
> have it, I'm going to be at the "Bus Project" tonight for a meeting at
> 7, and normally I have dinner at Produce Row before that. So I can
> bring DVDs over with me. How does 6 at Produce Row sound? One DVD copy
> or two? I have DVD-RWs, so they can be re-used once you get the files
> uploaded.
>
Sorry, I can't make it tonight.
> How many people are we going to have doing the editing?
Depends on how many volunteer.
> Should I post a screen capture of an Audacity session of how to trim the gaps off?
>
Sure, please describe somewhere what you're actually doing.
-igal
M. Edward (Ed) Borasky
Please let me know when / where they show up on line - I'll develop
the tutorials on how to edit them with Audacity once I know the
download - upload process. Note that Audacity does *not* require a
Linux machine - it runs on Windows and Macs too. ;-)
John Prohodsky
record. How can I access the MP3's?
John