XLarge Instance?

3 views
Skip to first unread message

Shaun

unread,
Sep 30, 2008, 11:12:30 AM9/30/08
to Panda
I can't seem to launch panda on anything other than a small
instance... anything that I need to do to get it going?

Martyn Loughran

unread,
Sep 30, 2008, 11:14:17 AM9/30/08
to panda...@googlegroups.com
What kind of problem are you experiencing?

Shaun

unread,
Sep 30, 2008, 12:26:06 PM9/30/08
to Panda
I get the following error any time I try to run an instance other than
m1.small:

EC2 responded with an error for RunInstances
Invalid ParameterValue: The requested instance type's architecture
(x86_64) does not match



On Sep 30, 10:14 am, "Martyn Loughran" <mar...@new-bamboo.co.uk>
wrote:
> What kind of problem are you experiencing?
>

Martyn Loughran

unread,
Oct 1, 2008, 10:56:47 AM10/1/08
to panda...@googlegroups.com
Shaun,

At the moment we're only supplying a 32 bit AMI image which explains
why you can't start the larger instances. Right now we're
concentrating on scaling horizontally; supporting a large instance is
something we might consider in the future (it's just time consuming).
However, if you need it, it is something you could set up yourself.
We've tried panda on a large instance and it works great.

Martyn

Shaun

unread,
Oct 1, 2008, 2:38:42 PM10/1/08
to Panda
So - by scaling horizontally you mean multiple instances? Will this
increase
encoding throughput (so reduce the time it takes to encode an
individual file)
or allow multiple files to be encoded at the same time?

Any pointers on setting an XL instance up myself (new to ec2)

On Oct 1, 9:56 am, "Martyn Loughran" <mar...@new-bamboo.co.uk> wrote:
> Shaun,
>
> At the moment we're only supplying a 32 bit AMI image which explains
> why you can't start the larger instances. Right now we're
> concentrating on scaling horizontally; supporting a large instance is
> something we might consider in the future (it's just time consuming).
> However, if you need it, it is something you could set up yourself.
> We've tried panda on a large instance and it works great.
>
> Martyn
>

Damien Tanner

unread,
Oct 2, 2008, 7:31:02 AM10/2/08
to panda...@googlegroups.com
Hi Shaun,

I'd recommend running some benchmarks for yourself on the large
instance as ffmpeg is setup to run with 4 threads and will encode h264
videos pretty fast! Panda has been architected to allow multiple
encoders to be running, so running two instances simultaneously will
give you twice the throughput. We're planning to write a tutorial on
setting up your own cluster soon.

Setting up the XL yourself will take a little while as you'll likely
have to setup the environment from scratch. Compiling ffmpeg is not
for the faint hearted ;)

--
Kind Regards,
Damien Tanner
Co-Founder and Director, New Bamboo

Creating fresh, flexible and fast-growing web applications is our passion.

+44 (0)78 6312 7999
+44 (0)20 7099 7486
http://www.new-bamboo.co.uk

Martyn Loughran

unread,
Oct 2, 2008, 7:43:39 AM10/2/08
to panda...@googlegroups.com
Shaun,

As Damien says setting up an XL image will take some time. If I were
you I'd try out what Amazon call a "High-CPU Medium Instance" first.
It's a 32-bit image and therefore will work with the current AMI. It's
also got 5 times the compute power for only twice the price.

If you do any benchmarking it would be great if you could post them
back to this list.

Martyn

Shaun

unread,
Oct 2, 2008, 8:06:00 AM10/2/08
to Panda
I will do some benchmarking after my meeting today.

I've compiled ffmpeg a few times before... not it isn't for the
faint hearted but I may give it a shot.

As far as going with the high-cpu medium instance - I don't
see an option listed in elastic fox for it... unless it goes by
a different name.... gonna have to command line it?

On Oct 2, 6:43 am, "Martyn Loughran" <mar...@new-bamboo.co.uk> wrote:
> Shaun,
>
> As Damien says setting up an XL image will take some time. If I were
> you I'd try out what Amazon call a "High-CPU Medium Instance" first.
> It's a 32-bit image and therefore will work with the current AMI. It's
> also got 5 times the compute power for only twice the price.
>
> If you do any benchmarking it would be great if you could post them
> back to this list.
>
> Martyn
>
> On Thu, Oct 2, 2008 at 12:31 PM, Damien Tanner <dam...@new-bamboo.co.uk> wrote:
>
> > Hi Shaun,
>
> > I'd recommend running some benchmarks for yourself on the large
> > instance as ffmpeg is setup to run with 4 threads and will encode h264
> > videos pretty fast! Panda has been architected to allow multiple
> > encoders to be running, so running two instances simultaneously will
> > give you twice the throughput. We're planning to write a tutorial on
> > setting up your own cluster soon.
>
> > Setting up the XL yourself will take a little while as you'll likely
> > have to setup the environment from scratch. Compiling ffmpeg is not
> > for the faint hearted ;)
>

Damien Tanner

unread,
Oct 2, 2008, 8:19:56 AM10/2/08
to panda...@googlegroups.com
Shaun,

You may have to, it's the High-CPU Medium Instance.

If you're going to have a shot at compiling for the High-CPU Extra
Large Instance I can send you over some notes I have when the Panda
image was first created, so you'll be able to get an almost identical
environment and we can help with any issues.

Shaun

unread,
Oct 2, 2008, 8:21:52 AM10/2/08
to Panda
That would be greatly appreciated

Damien Tanner

unread,
Oct 2, 2008, 8:36:16 AM10/2/08
to panda...@googlegroups.com
Shaun,

Here are the original notes, we're working on a more structure guide.

---
FFMPEG
---
Compile ffmpeg with h264 support (debian doesn't include it)
http://www.jbkempf.com/blog/post/2007/10/04/Build-vlc-under-a-fresh-sid

./configure --enable-libx264 --enable-gpl --enable-libfaad
--enable-libfaac --enable-swscaler --enable-pp --enable-libmp3lame
--enable-libamr-nb --enable-libamr-wb --enable-liba52
--enable-libtheora --enable-libvorbis --enable-libxvid
Codecs I need to add: qdm2, vp6f

Extra stuff for flash h264
install gpac and nero's aac encoder
http://massanti.com/2007/09/28/encoding-h264-video-aac-plus-audio-for-flash/

GPAC
sh ./configure --enable-sdl-static
make install-lib && make && make install

CODECS
----

X264
svn co svn://svn.videolan.org/x264/trunk x264
./configure --enable-mp4-output --enable-shared
make && make install

AMR (samr)
http://ftp.penguin.cz/pub/users/utx/amr/

FAAC
libfaa

A52
http://liba52.sourceforge.net/downloads.html

ALAC
http://craz.net/programs/itunes/alac.html

THEORA etc...
http://www.theora.org/downloads/
apt-get install libtheora0 libtheora-dev libvorbis0a libvorbis-dev

---

apt-get install ffmpeg libavcodec0d libavformat0d libavifile-0.7c2
libpostproc0d libasound2-plugins avifile-player avifile-utils
avifile-mad-plugin avifile-mjpeg-plugin avifile-vorbis-plugin
zlib1g-dev automake sysutils libtool libfaac-dev yasm

Compile nginx with upload progress module
(http://blog.new-bamboo.co.uk/2008/2/29/using-the-nginx-upload-progress-module-with-safari)
./configure --with-http_flv_module
--add-module=/root/nginx_uploadprogress_module_safari_fix
--without-http_rewrite_module --with-debug --without-http_gzip_module

Compile zlib

Grab libs required to compile ruby
apt-get build-dep ruby

Compile ruby 1.8.6 (merb needs this) and rubygems

gem i -y merb rvideo SQS flvtool2 rails daemons log4r json
merb_helpers merb_activerecord
aws-s3 rspec

Reply all
Reply to author
Forward
0 new messages