Is the current ubuntu for wandboard supporting GPU/VPU already ?

[Cliff Tsai]

Hi ,
  
   Just want to know if the current ubuntu for wandboard supporting i.MX6 GPU/VPU already.

thx

[Juan Double]

Hi !

GPU acceleration don't work. VPU should work, but there appears to be a lot of things to do with gstreamer.

[jean charles mammana]

Check on buildroot tool.

It has everything to deal with the VPU (vpu lib, lib fsl and gstreamer plugins).

I already build an image to test it but I'm waiting my wandboard dual :(

[miniscule hyrule]

Did you ever get your Wandboard?  

I had buildroot installation issues and was 

wondering if you were able to customize your 

build and share your experiences...

   TIA

[jean charles mammana]

Yes, I got it last friday.

I'm working on the wandboard dual support for buildroot.

I currently have working wifi, bluetooth, VPU and USB OTG (which emulate a serial console).

I'll put an sdcard img to download to have some feedback and I will have to discuss with the buildroot guys to add my patchs to the mainline.

[jean charles mammana]

Hi all,

I've finish to add the wandboard dual to buildroot.

wifi, bluetooth, audio, usb otg (serial) and vpu (w/ gstreamer) should work.

Is someone to test my image and give me some feedback ?

For information :

- toolchain : crosstool ng

- kernel : coming from the "official" git repository : http://repo.or.cz/w/wandboard.git

- uboot : coming from the mainline git repository

- rootfs : busybox/glibc based.

user : default (no password)

user : root / root

download link : http://dl.free.fr/nzZO42xAG

Simply unzip the file and put it on your sdcard using dd (on linux) or win32diskimager (on windows).

Console is available through the RS232 link (115200 8N1) or using SSH through ethernet.

Now, I have to find a git server to put my buildroot branch into :)

[Roy Feldman]

Since Gstreamer needs more work for Ubuntu, what does work with the VPU? Can VLC be used now, or does it need more work as well?

Is Freescale Semiconductor supporting VPU and GPU driver development with either documentation or code samples.  I suspect their hands are tied by ARM and Vivante.

How long will it take to have VPU support for video streaming in Ubuntu? I wish I could help, but I am not qualified to write device drivers.  

Is anybody working on GPU support? If so, can anybody make an informed guess when there will be something usable by mere users like me. ;-)  FWIW, I would like to see 2D support before 3D.

Is it reasonable to expect smooth video streaming over the Internet with the existing hardware? I have read a discussion about  the Wandboard's video capabilities on the XBMC forum. One of the posts states that the DualLite will not support realtime HD transcoding.  I can live without real-time HD, but I would like to have real-time 480p transcoding and still have some CPU cycles left.  Any thoughts?

The same post says that a Dual would make a big difference in graphics and video performance.  Are there any specific plans for a Dual based Wandboard?

Thanks in advance,

Roy

[jean charles mammana]

Hi Roy,

I've just finished to rebuild my buildroot image with the new wandboard sdk.

Download link : http://dl.free.fr/eFX3AaqIL (unzip and copy the file to your sdcard using dd or win32diskimager.exe)

To test the VPU you can execute these commands (as root) :

gst-rtsp-launch "( videotestsrc is-live=1 ! video/x-raw-yuv,format=(fourcc)I420,width=800,height=600,framerate=(fraction)30/1 ! queue ! vpuenc codec=6 ! rtph264pay name=pay0 pt=96 )"

gst-rtsp-launch "( videotestsrc is-live=1 ! video/x-raw-yuv,format=(fourcc)I420,width=800,height=600,framerate=(fraction)30/1 ! x264enc ! rtph264pay name=pay0 pt=96 )"

These commands will stream over RTSP a video pattern encoded as h264.
The first command will use the VPU H264 encoder. The second one will use a software library.

To play the RTSP stream, use VLC or ffplay (by exemple) with the following command line : rtsp://wandboard:8554/test

Now you can stream any source you want (file, webcam, ...) using the VPU encoder.

[Roy Feldman]

Hi Jean,

Thank you for the info and your generous work on VPU support.  I am about to purchase a Wandboard Dual, so it may be a week or so

before I can try your latest image.

Do you have any plans to work on getting either Gsteramer or VLC to work with the VPU?

I am also very curious how your are uncovering the VPU api to developing VPU support in Linux.

Has Freescale provided any useful documentation on the VPU? Are you looking at how Android apps use the VPU to uncover the api?

I have never developed a Linux device driver, but I am curious how you are developing Linux driver support for hardware with limited or no documentation. 

Thanks again,

Roy

--
You received this message because you are subscribed to a topic in the Google Groups "Wandboard" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/wandboard/cgLvVHZN_2o/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to wandboard+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[iafg]

Freescale generously provides vpu/gpu codecs for gstreamer framework with their 'ltib' Linux distribution (also for Android). It's a matter of doing the work to retarget them for different distributions.

[Otavio Salvador]

On Sun, Mar 31, 2013 at 1:08 AM, iafg <iaintrave...@gmail.com> wrote:
> Freescale generously provides vpu/gpu codecs for gstreamer framework with their 'ltib' Linux distribution (also for Android). It's a matter of doing the work to retarget them for different distributions.

Done in Yocto as well :)

--
Otavio Salvador O.S. Systems
E-mail: ota...@ossystems.com.br http://www.ossystems.com.br
Mobile: +55 53 9981-7854 http://projetos.ossystems.com.br

[Roy Feldman]

Does this mean that Gstreamer will be available for the Wandboard before VLC? I ask because I would like to write an app with video streaming on the Wandboard and I have only worked with VLC widgets.

If Gstreamer will be available with hardware acceleration before VLC, then I will switch over to working with Gstreamer widgets.

Also, would it be fair to assume that there will eventually be a Gstreamer based browser plugin for Firefox or Chromium?

I guess I need to study Yocto more. I thought Yocto was just a set of tools and templates for porting to a specific ARM framework, but didn't actually maintain support for specific ARM gpus or vpus. 

 

[jean charles mammana]

Gstreamer VPU integration is already done for few months.

Freescale only provide a gstreamer frontend to use its vpu encoder/decoder. But it provides this as source code. So you can check them and write your own plugin for vlc on any player you want.

All documentation (with schematics) is here : http://boundarydevices.com/freescale-gstreamer-plugins/

imx firmware, vpulib, fsl mm codec (as binary) and fsl gst plugins are available here : http://download.ossystems.com.br/bsp/freescale/source/

I've made some test (wandboard dual) with my buildroot image :

- 1080p h264 decoding : 2/3% CPU

- 720p h264 encoding : 20/30% CPU

- 1080p h264 encoding : 40/50% CPU

I've also added uvch264_src gstreamer plugin in my image that is able to get an already h264 compressed stream from a h264 capable webcam (like logitech C920). In this case you grab a 1080p H264 stream with 0% CPU usage and you can use the imx vpu decoder to display it :)

[Dragonik]

Hi, could You share this img? Have You tried xbmc?

Best regards .

[jean charles mammana]

Dragonik : Check this : http://www.wandboard.org/index.php/forums?place=msg%2Fwandboard%2FcgLvVHZN_2o%2FLOGiFJzyf0EJ

I don't know if xbmc supports the IMX VPU processor.

[Roy Feldman]

Hi Jean,

Since Gstreamer VPU integration is done, is there any additional work required to run Gstreamer apps

like Totem and its browser plugin?

I would test it myself, but I am waiting for my Wandboard Dual to ship. 

BTW, your VPU test results are very encouraging and Gstreamer architecture doc is very helpful..

Thanks in advance,

Roy

p.s. I apologize if people have seen this post before.  I deleted and reposted this question because of a few embarrassing typos. ;-) 

[Jean-Luc Aufranc]

Hi Roy,

Totem already works with video hardware decoding in the latest Ubuntu image (29/03).

On Tuesday, April 02, 2013 10:19 AM, Roy Feldman wrote:

Hi Jean,

Since Gstreamer VPU integration is done, is there any additional work required to run Gstreamer apps

like Totem and its browser plugin?

I would test it myself, but I am waiting for my Wandboard Dual to ship.ďż˝

BTW, your VPU test results are very encouraging and Gstreamer architecture doc is very helpful..

Thanks in advance,

Roy

p.s. I apologize if people have seen this post before. �I deleted and reposted this question because of a few embarrassing typos. ;-)�

On Sunday, March 31, 2013 2:12:51 PM UTC-7, jean charles mammana wrote:

Dragonik : Check this :�http://www.wandboard.org/index.php/forums?place=msg%2Fwandboard%2FcgLvVHZN_2o%2FLOGiFJzyf0EJ

I don't know if xbmc supports the IMX VPU processor.

Le dimanche 31 mars 2013 14:51:03 UTC+2, Dragonik a �crit�:

Hi, could You share this img? Have You tried xbmc?

Best regardsďż˝.



W dniu niedziela, 31 marca 2013 12:42:08 UTC+2 u�ytkownik jean charles mammana napisa�:

Gstreamer VPU integration is already done for few months.

Freescale only provide a gstreamer frontend to use its vpu encoder/decoder. But it provides this as source code. So you can check them and write your own plugin for vlc on any player you want.

All documentation (with schematics) is here :�http://boundarydevices.com/freescale-gstreamer-plugins/

imx firmware, vpulib, fsl mm codec (as binary) and fsl gst plugins are available here :�http://download.ossystems.com.br/bsp/freescale/source/

I've made some test (wandboard dual) with my buildroot image :

- 1080p h264 decoding : 2/3% CPU

- 720p h264 encoding : 20/30% CPU

- 1080p h264 encoding : 40/50% CPU

I've also added uvch264_src gstreamer plugin in my image that is able to get an already h264 compressed stream from a h264 capable webcam (like logitech C920). In this case you grab a 1080p H264 stream with 0% CPU usage and you can use the imx vpu decoder to display it :)

Le dimanche 31 mars 2013 07:34:00 UTC+2, Roy Feldman a �crit�:

Does this mean that Gstreamer will be available for the Wandboard before VLC? I ask because I would like to write an app with video streaming on the Wandboard and I have only worked�with�VLC widgets.

If Gstreamer will be available with hardware�acceleration�before VLC, then I will switch over to working with Gstreamer widgets.

Also, would it be fair to assume that there will eventually be a Gstreamer based browser plugin for Firefox or Chromium?

I guess I need to study Yocto more. I thought Yocto was just a set of tools and templates for porting to a�specific�ARM framework, but didn't actually maintain support for specific ARM gpus or vpus.�

ďż˝

On Sat, Mar 30, 2013 at 9:23 PM, Otavio Salvador <ota...@ossystems.com.br> wrote:

On Sun, Mar 31, 2013 at 1:08 AM, iafg <iaintrave...@gmail.com> wrote:

> Freescale generously provides vpu/gpu codecs for gstreamer framework with their 'ltib' Linux distribution (also for Android). It's a �matter �of doing the work to retarget them for different distributions.

Done in Yocto as well :)

--

Otavio Salvador ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ ďż˝ O.S. Systems
E-mail: ota...@ossystems.com.br �http://www.ossystems.com.br
Mobile: +55 53 9981-7854 � � � � � � �http://projetos.ossystems.com.br

--
You received this message because you are subscribed to a topic in the Google Groups "Wandboard" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/wandboard/cgLvVHZN_2o/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to wandboard+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--
You received this message because you are subscribed to the Google Groups "Wandboard" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wandboard+...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.

ďż˝
ďż˝

[Roy Feldman]

Hi Jean-Luc,

Thats great news!  Have you or anybody else successfully used the Totem browser plugin in Firefox or Chromium to 

play videos?

In general, would I be correct in assuming that all Gstreamer based apps should work now?

Thanks,

Roy

On Tue, Apr 2, 2013 at 3:09 AM, Jean-Luc Aufranc <cnx...@cnx-software.com> wrote:

Hi Roy,

Totem already works with video hardware decoding in the latest Ubuntu image (29/03).

On Tuesday, April 02, 2013 10:19 AM, Roy Feldman wrote:

Hi Jean,

Since Gstreamer VPU integration is done, is there any additional work required to run Gstreamer apps

like Totem and its browser plugin?

I would test it myself, but I am waiting for my Wandboard Dual to ship. 

BTW, your VPU test results are very encouraging and Gstreamer architecture doc is very helpful..

Thanks in advance,

Roy

p.s. I apologize if people have seen this post before.  I deleted and reposted this question because of a few embarrassing typos. ;-) 

On Sunday, March 31, 2013 2:12:51 PM UTC-7, jean charles mammana wrote:

Dragonik : Check this : http://www.wandboard.org/index.php/forums?place=msg%2Fwandboard%2FcgLvVHZN_2o%2FLOGiFJzyf0EJ

I don't know if xbmc supports the IMX VPU processor.

Le dimanche 31 mars 2013 14:51:03 UTC+2, Dragonik a écrit :

Hi, could You share this img? Have You tried xbmc?

Best regards .



W dniu niedziela, 31 marca 2013 12:42:08 UTC+2 użytkownik jean charles mammana napisał:

Gstreamer VPU integration is already done for few months.

Freescale only provide a gstreamer frontend to use its vpu encoder/decoder. But it provides this as source code. So you can check them and write your own plugin for vlc on any player you want.

All documentation (with schematics) is here : http://boundarydevices.com/freescale-gstreamer-plugins/

imx firmware, vpulib, fsl mm codec (as binary) and fsl gst plugins are available here : http://download.ossystems.com.br/bsp/freescale/source/

I've made some test (wandboard dual) with my buildroot image :

- 1080p h264 decoding : 2/3% CPU

- 720p h264 encoding : 20/30% CPU

- 1080p h264 encoding : 40/50% CPU

I've also added uvch264_src gstreamer plugin in my image that is able to get an already h264 compressed stream from a h264 capable webcam (like logitech C920). In this case you grab a 1080p H264 stream with 0% CPU usage and you can use the imx vpu decoder to display it :)

Le dimanche 31 mars 2013 07:34:00 UTC+2, Roy Feldman a écrit :

Does this mean that Gstreamer will be available for the Wandboard before VLC? I ask because I would like to write an app with video streaming on the Wandboard and I have only worked with VLC widgets.

If Gstreamer will be available with hardware acceleration before VLC, then I will switch over to working with Gstreamer widgets.

Also, would it be fair to assume that there will eventually be a Gstreamer based browser plugin for Firefox or Chromium?

I guess I need to study Yocto more. I thought Yocto was just a set of tools and templates for porting to a specific ARM framework, but didn't actually maintain support for specific ARM gpus or vpus. 

 

On Sat, Mar 30, 2013 at 9:23 PM, Otavio Salvador <ota...@ossystems.com.br> wrote:

On Sun, Mar 31, 2013 at 1:08 AM, iafg <iaintrave...@gmail.com> wrote:

> Freescale generously provides vpu/gpu codecs for gstreamer framework with their 'ltib' Linux distribution (also for Android). It's a  matter  of doing the work to retarget them for different distributions.

Done in Yocto as well :)

--

Otavio Salvador                             O.S. Systems
E-mail: ota...@ossystems.com.br  http://www.ossystems.com.br
Mobile: +55 53 9981-7854              http://projetos.ossystems.com.br

--
You received this message because you are subscribed to a topic in the Google Groups "Wandboard" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/wandboard/cgLvVHZN_2o/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to wandboard+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

--

You received this message because you are subscribed to the Google Groups "Wandboard" group.
To unsubscribe from this group and stop receiving emails from it, send an email to wandboard+...@googlegroups.com.

For more options, visit https://groups.google.com/groups/opt_out.
 
 

[miniscule hyrule]

Wow not THAT H264 offloading trick is freakin' brilliant - - what toolsets are you using to add all of this to your image? 

I just need minimal OS that will give me camera support, BT, wifi, and USB so I can remotely choose multiple cameras

and stream them. 

 

 

On Sunday, March 31, 2013 5:42:08 AM UTC-5, jean charles mammana wrote:

Gstreamer VPU integration is already done for few months.

Freescale only provide a gstreamer frontend to use its vpu encoder/decoder. But it provides this as source code. So you can check them and write your own plugin for vlc on any player you want.

All documentation (with schematics) is here : http://boundarydevices.com/freescale-gstreamer-plugins/

imx firmware, vpulib, fsl mm codec (as binary) and fsl gst plugins are available here : http://download.ossystems.com.br/bsp/freescale/source/

<SNIP>

[jean charles mammana]

I built my image using buildroot tool.

I've added the wandboard support to buildroot but it's not on the mainline repository because I added lot of patches.

[Miguel Vazquez]

Hey Jean

I just started using build root and I have been having trouble building an image for my board.

I read that you were planing on putting your buildroot branch into git. If so can you point me to the git.

If not can you guide me on what configurations I need to set for the build root.

Thanks 

[jean charles mammana]

Hi Miguel,

Take a look here : http://www.wandboard.org/index.php/forums?place=msg%2Fwandboard%2F1h8vmck0tsU%2Fsm6yFJphF9UJ

[www.wandboard.org]

Hi,

We just posted new Ubuntu images on the page with a bunch of fixes and added features.

Highlights in this release are:

- GPU 3D acceleration enabled

- Improved movie playback (DMA memory allocation fixes)

- Use of mainline 13.04 u-boot, with HDMI splashscreen

- Kernel brought up-to-date with Freescale jb4.2.2_1.0.0-ga release

- Many other fixes and improvements

[Otavio Salvador]

Did you apply any change in original 2013.04 U-Boot code? If yes,
please share the GIT tree so I can check the changes and integrate the
possible ones mainline so we have 2013.07 with an even smaller delta.

Regards,

[gerald hewes]

Thanks for adding the CPU 3D acceleration.

Note soon afterwards - I did an apt-install update / upgrade and it broke GPU 3D acceleration (back to Mesa software emulation)

To get it working I did the following:

- In /usr/lib/xorg/modules/extensions

   relink libdri.so -> libdriviv.so

- Somehow X11 was failing loading: /usr/lib/arm-linux-gnueabi/dri/vivante_dri.so

   so copied it from /

- Restored the .so in the image for /usr/lib/arm-linux-gnueabi/dri/

- Finally, rename the mesa and mesa-egl directories in  /usr/lib/arm-linux-gnueabi out of the way

I'm sure there is a smarter way to handle this ....

But now at least glmark2 gives me a score of 27 (and renders more nicely)

-- gerald

[Michele Adduci]

Hi

is it possible to find source code or .deb packages for vivante GPU (i have a Wandboard Quad)?
I am trying to build up a Ubuntu 13.04 image, starting from a rootfs but until now i just was able to set up all the OpenGL / mesa environment and get the following results:

" glxinfo | grep OpenGL " command produces:

libGL error: failed to load driver: i965
libGL error: Try again with LIBGL_DEBUG=verbose for more details.
OpenGL vendor string: Mesa Project
OpenGL renderer string: Software Rasterizer
OpenGL version string: 2.1 Mesa 9.1.3
OpenGL shading language version string: 1.20
OpenGL extensions:

and

/usr/lib/nux/unity_support_test -p

produces:

libEGL warning: failed to authenticate magic
libEGL warning: DRI2: failed to open i965 (search paths /usr/lib/arm-linux-gnueabihf/dri:${ORIGIN}/dri:/usr/lib/dri)
OpenGL vendor string:   Mesa Project
OpenGL renderer string: Software Rasterizer
OpenGL version string:  OpenGL ES 2.0 Mesa 9.1.3
Not software rendered:    no
Not blacklisted:          yes
GLX fbconfig:             no
GLX texture from pixmap:  no
GL npot or rect textures: no
GL OES EGL image:         no
EGL KHR image pixmap:     no
EGL version is 1.4+:      yes
Unity supported:          no

i don't understand why does it keep saying i have a i965 graphic card (an Intel one!).

Xorg log says:

(EE) modesetting(0): KMS doesn't support dumb interface

[   334.712] (EE) modesetting(0): KMS setup failed

      (EE) Screen(s) found, but none have a usable configuration.

         Fatal server error:

      [   334.712] no screens found

 

so i cannot start X (i've installed xfce from scratch.

Best regards

Michele

[Michele Adduci]

In addiction,

i can run glxgears from remote ssh and it goes at 20 FPS.
Any suggestion?
Best

Michele