problems while enabling avi support for OpenCORE

[Roopesh]

hi,
I am working on enabling avi support for OpenCORE. For this I did
exactly the same as for mp4 format present in OpenCORE. I was able to
create parser node, recognizer node and was able to connect it to the
player.
I am facing some minor problems while adding the functionality. The
avi file which I am using has mp4 video codec and mp3 audio codec. But
in the code, it looks for additional format specific info, which is
NULL in my video format. Because of which it is not recognizing the
video. Is anybody having an idea, of how to get it from the file??
One more I am not getting how to calculate the time stamp of the
frame. The information is not available in the header and also in the
data of the file. I checked the RFC of avi format, in that also
nowhere either in header/data structures, this field is not present.
Anybody having an idea on this format???

regards
Roopesh

[RaviY]

There were many threads in the android-framework forums regarding AVI
support. Please go through them and if those don't help, you may get
back here.

-Ravi

[Roopesh]

I checked in android-framework forum. But nobody has asked these
questions. Actually before starting working on it, I followed the
procedure mentioned in that forum. But again I am facing some minor
problems mentioned above. And as that forum is getting closed I am
posting this into current forum.

[RaviY]

What additional FSI is required? Can you brief your findings?

Isn't the frame duration present in the main header or the stream
header? With that you should be able to calculate, based on the frame
number, the timestamp of any frame.

-Ravi

[Roopesh]

hi Ravi,
Inorder to enable AVI support what I did is I just created a
copy of mp4 recognizer and mp4 parser code and then started modifying
it according to the spec of avi format. I have done changes almost
everything, but few are pending. I mp4 code in file
pvmf_mp4ffparser_node.cpp, in function RetrieveTrackData(), a
function getKeyMediaSampleNumAt() is called with a parameter iGau,
which is of type struct GAU. This function actually fills GAU. I am
unable to get how this can be modified to match for avi files.

regards
Roopesh

On Aug 6, 7:17 pm, RaviY <yend...@pv.com> wrote:
> What additional FSI is required? Can you brief your findings?
>

> Isn't theframeduration present in the main header or the stream

[RaviY]

You need to fill the GAU structure not just for getKeyMediaSampleNumAt
() call but for any such media retrieval call to the mp4 parser. If
you don't have all the information to fill in that structure, you may
write your own function definition that has only the required fields.

Starting from the mp4 parser node is a good idea, but trying to
maintain all the API signatures to be the same is not an ideal
solution, for any code development.

-Ravi

[leon]

Hi,

I also am doing this job. But there is no any progress.
I created a copy of wav recognizer and wav parser code and then
started modifying it. I think wav is more similar to avi.
But it is very difficult for me.

Could you share your solution and discuss it together? Thanks

Regards
Leon

On Aug 7, 9:06 pm, RaviY <yend...@pv.com> wrote:
> You need to fill the GAU structure not just for getKeyMediaSampleNumAt
> () call but for any such media retrieval call to the mp4 parser. If
> you don't have all the information to fill in that structure, you may
> write your own function definition that has only the required fields.
>
> Starting from the mp4 parser node is a good idea, but trying to
> maintain all the API signatures to be the same is not an ideal
> solution, for any code development.
>
> -Ravi
>
> On Aug 7, 4:49 am, Roopesh <roopesh....@gmail.com> wrote:
>
>
>
> > hi Ravi,

> >           Inorder to enableAVIsupportwhat I did is I just created a

> > copy of mp4 recognizer and mp4 parser code and then started modifying

> > it according to the spec ofaviformat. I have done changes almost

> > everything, but few are pending. I mp4 code in file
> > pvmf_mp4ffparser_node.cpp, in function RetrieveTrackData(),  a
> > function getKeyMediaSampleNumAt() is called with a parameter iGau,
> > which is of type struct GAU. This function actually fills GAU. I am
> > unable to get how this can be modified to match foravifiles.
>
> > regards
> > Roopesh
>
> > On Aug 6, 7:17 pm, RaviY <yend...@pv.com> wrote:
>
> > > What additional FSI is required? Can you brief your findings?
>
> > > Isn't theframeduration present in the main header or the stream
> > > header? With that you should be able tocalculate, based on theframe
> > > number, the timestamp of anyframe.
>
> > > -Ravi
>
> > > On Aug 5, 11:44 pm, Roopesh <roopesh....@gmail.com> wrote:
>
> > > > I checked in android-framework forum. But nobody has asked these
> > > > questions. Actually before starting working on it, I followed the
> > > > procedure mentioned in that forum. But again I am facing some minor

> > > >problemsmentioned above. And as that forum is getting closed I am

[Roopesh]

Hi Ravi,
Thanks for the reply. Yes its not an ideal solution to use
same api signatures. I am using only them which are applicable to the
current task. One more thing needed to ask that is there any plan from
PV to enable avi support???

regard
Roopesh

[RaviY]

Has anyone actually looked at external/opencore/fileformats/avi/parser/
src/ ...? The current implementation is very rudimentary and is being
used only for pvAuthor SDK testing. I am sure one could expand on this
to play AVI files on the player side. You could start off with the
current version, and write a node around it.

Regarding AVI support on OpenCORE, I don't have enough details to
share here.

-Ravi

[Roopesh]

I am currently using the existing parser code only to parser avi
files, and its successful also. I have created a node around it also.
But again as I told many functions modifications are under process, in
order to play the avi file.

regards
Roopesh

[RaviY]

What do you mean by "many functions modifications are under process"?

-Ravi

[Roopesh]

As i mentioned earlier, I am modifying mp4 fileformat to support avi
fileformats, by creating a copy of mp4 code.

regards
Roopesh

[RaviY]

I am sorry. I don't understand what help you need from me.

-Ravi

[Roopesh]

Some necessary functions, such as sampling, calculating time-stamp,
are not present in the existing avi parser. For mp4 each track is
divided into samples and then time-stamp is calculated for each
sample. But in case of avi, we have frames. I just had doubt that do
we need to sample each frame in order to calculate time-stamp???

regards
Roopesh

[leon]

How to define the avi's PVUuid? Thanks

Regards
Leon

[RaviY]

Yes. You would need to know the timestamp of every frame in the source
node.

-Ravi

[RaviY]

You can use any random GUID generator.

-Ravi

[leon]

Thanks!
I use the random PUID and it can find the pvaviparsernode.

But when I used the CreateAviFileParser to parer the avi file, the
following error happened:

PVAviFileStreamList::PVAviFileStreamList: ParseStreamFormat returned
error.

BTW, the information of the avi file as following:
400_240.avi
General
Complete name : 400_240.avi
Format : AVI
Format/Info : Audio Video Interleave
File size : 207 MiB
Duration : 29s 360ms
Overall bit rate : 59.0 Mbps
Video
Format : RGB
Codec ID : RGB
Codec ID/Info : Uncompressed RGB32
Duration : 29s 360ms
Bit rate : 57.6 Mbps
Width : 400 pixels
Height : 240 pixels
Display aspect ratio : 1.667
Frame rate : 25.000 fps
Resolution : 24 bits
Bits/(Pixel*Frame) : 24.000
Stream size : 202 MiB (98%)
Audio
Format : PCM
Format settings, Endianness : Little
Format settings, Sign : Unsigned
Codec ID : 1
Codec ID/Hint : Microsoft
Duration : 29s 333ms
Bit rate mode : Constant
Bit rate : 1 411.2 Kbps
Channel(s) : 2 channels
Sampling rate : 44.1 KHz
Resolution : 16 bits
Stream size : 4.93 MiB (2%)
Interleave, duration : 979 ms (24.47 video frames)
Interleave, preload duration : 1000 ms

On 8月13日, 下午7时10分, RaviY <yend...@pv.com> wrote:
> You can use any random GUID generator.
>
> -Ravi
>
> On Aug 13, 1:57 am, leon <leon.ku...@live.cn> wrote:
>
>
>

> > How to define theavi'sPVUuid? Thanks

>
> > Regards
> > Leon
>
> > On 8月11日, 上午11时29分, Roopesh <roopesh....@gmail.com> wrote:
>
> > > Some necessary functions, such as sampling, calculating time-stamp,

> > > are not present in the existingaviparser. For mp4 each track is

> > > divided into samples and then time-stamp is calculated for each

> > > sample. But in case ofavi, we have frames. I just had doubt that do

> > > > > > > > to playAVIfiles on the player side. You could start off with the

> > > > > > > > current version, and write a node around it.
>

> > > > > > > > RegardingAVIsupport on OpenCORE, I don't have enough details to

[RaviY]

I am sorry. I don't know what the problem is. As I have mentioned
before, use the AVI parser presented currently in OpenCORE at your own
risk. It is currently meant only for author engine unit tests.

-Ravi

[leon]

Yes.
However, it seems that it's parser is not a common parser.
I had a new progress in this issue, as following:
PVAviFileStreamlist::ParseStreamFormat(PVFile *aFp, uint32
aHdrSize) //Function name
if (bytesRead != aHdrSize)
{
return PV_AVI_FILE_PARSER_BYTE_COUNT_ERROR;
}

After finished the audio parser, the bytesRead is equal to 16 and
aHdrSize is equal to 18. So the error happened.
But , I don't know why?

[leon]

Hope that more people can join this development. Thanks

Regards
Leon

[Roopesh]

The size of WAVEFORMATEX header, which is the audio structure format
used in AVI parser is 18. There might be some problem with the file
you are using please check the format once and check where exactly
ERROR is coming. Try with another file.

regards
Roopesh

[leon]

Thanks a lot!
I will double check it according your idea.

I have another question , tjhat is whether the avi's paser in Android
only supports the wav audio steaming and rgb video streaming?

On 8月16日, 上午10时59分, Roopesh <roopesh....@gmail.com> wrote:
> The size of WAVEFORMATEX header, which is the audio structure format

> used inAVIparser is 18. There might be some problem with the file

> you are using please check the format once and check where exactly
> ERROR is coming. Try with another file.
>
> regards
> Roopesh
>
> On Aug 14, 12:36 pm, leon <leon.ku...@live.cn> wrote:
>
>
>
> > Hope that more people can join this development. Thanks
>
> > Regards
> > Leon
>
> > On 8月14日, 下午2时25分, leon <leon.ku...@live.cn> wrote:
>
> > > Yes.
> > > However, it seems that it's parser is not a common parser.
> > > I had a new progress in this issue, as following:
> > > PVAviFileStreamlist::ParseStreamFormat(PVFile *aFp, uint32
> > > aHdrSize) //Function name
> > > if (bytesRead != aHdrSize)
> > > {
> > > return PV_AVI_FILE_PARSER_BYTE_COUNT_ERROR;
>
> > > }
>
> > > After finished the audio parser, the bytesRead is equal to 16 and
> > > aHdrSize is equal to 18. So the error happened.
> > > But , I don't know why?
>
> > > On 8月14日, 上午10时34分, RaviY <yend...@pv.com> wrote:
>
> > > > I am sorry. I don't know what the problem is. As I have mentioned

> > > > before, use theAVIparser presented currently in OpenCORE at your own

> > > > risk. It is currently meant only for author engine unit tests.
>
> > > > -Ravi
>
> > > > On Aug 13, 8:35 pm, leon <leon.ku...@live.cn> wrote:
>
> > > > > Thanks!
> > > > > I use the random PUID and it can find the pvaviparsernode.
>

> > > > > But when I used the CreateAviFileParser to parer theavifile, the

> > > > > following error happened:
>
> > > > > PVAviFileStreamList::PVAviFileStreamList: ParseStreamFormat returned
> > > > > error.
>

> > > > > BTW, the information of theavifile as following:

[Roopesh]

Yes, As far as I know you are correct. I checked with the parser
code, and that only supports only wav, and rgb streaming.

regards
Roopesh

> ...
>
> read more >>

[OOD Tsen]

Dear RaviY;

Maybe we need a new parser node for AVI ,these node can be modified by
mp4 parser node.

-OOD

On Aug 7, 9:06 pm, RaviY <yend...@pv.com> wrote:

[Roopesh]

hi all,
I am trying to copy a variable of type uint32 into uint64. But
after copying the value(uint64) is not correct. Anybody having idea on
this???

regards
Roopesh

[leon]

Good idea!

I am working on it by modifying wav's parser node.
Now there is still some problems and I don't know how to resolve it.

The error log as following:
E/PV ( 727): PVLOG:TID
(0xd530):Time=3257:AndroidSurfaceOutput::setParametersSync() Video
Format Key, Value X-YUV-420
E/PV ( 727): PVLOG:TID
(0xd530):Time=3257:PVMediaOutputNode::SetClock: aClock=0x13568
E/PV ( 727): PVLOG:TID
(0xd530):Time=3258:AndroidSurfaceOutput::setParametersSync() Error,
unrecognized key = x-pvmf/mediaxfer/output/rate;type=rel;valtype=int32
E/PV ( 727): PVLOG:TID
(0xd530):Time=3258:PVMediaOutputNodePort::ChangeClockRate rate 1
E/PV ( 727): PVLOG:TID
(0xd530):Time=3258:PVMediaOutputNode:CommandComplete Id 8 Cmd 2 Status
1 Context 101124 EVData 126500 EVCode 0
E/PV ( 727): PVLOG:TID
(0xd530):Time=3258:PVPlayerDatapath::NodeCommandCompleted() In
E/PV ( 727): PVLOG:TID
(0xd530):Time=3258:PVPlayerDatapath::NodeCommandCompleted() Out
E/PV ( 727): PVLOG:TID(0xd530):Time=3259:PVMFAVIFFParserNode::Run
() In
E/PV ( 727): PVLOG:TID(0xd530):Time=3259:PVMFAVIFFParserNode::Run
() Out 5
E/PV ( 727): PVLOG:TID(0xd530):Time=3259:PVMFOMXVideoDecNode::Run
() In
E/PV ( 727): PVLOG:TID
(0xd530):Time=3259:PVMFOMXVideoDecNode::DoRequestPort() In
E/PV ( 727): PVLOG:TID
(0xd530):Time=3259:PVMFOMXVideoDecNode:CommandComplete Id 6003 Cmd 4
Status 1 Context 104688 Data 128376
E/PV ( 727): PVLOG:TID
(0xd530):Time=3260:PVPlayerDatapath::NodeCommandCompleted() In
E/PV ( 727): PVLOG:TID
(0xd530):Time=3260:PVPlayerDatapath::NodeCommandCompleted() Out
E/PV ( 727): PVLOG:TID(0xd530):Time=3260:PVMFOMXVideoDecNode::Run
() - rescheduling after process command
E/PV ( 727): PVLOG:TID(0xd530):Time=3260:PVMFOMXVideoDecNode::Run
() In
E/PV ( 727): PVLOG:TID
(0xd530):Time=3260:PVMFOMXVideoDecNode::DoRequestPort() In
E/PV ( 727): PVLOG:TID
(0xd530):Time=3272:PVMFOMXVideoDecNode:CommandComplete Id 6004 Cmd 4
Status 1 Context 125112 Data 129272
E/PV ( 727): PVLOG:TID
(0xd530):Time=3272:PVPlayerDatapath::NodeCommandCompleted() In
E/PV ( 727): PVLOG:TID
(0xd530):Time=3272:PVPlayerDatapath::NodeCommandCompleted() All node
RequestPort() requests completed successfully
E/PV ( 727): PVLOG:TID
(0xd530):Time=3273:PVPlayerDatapath::NodeCommandCompleted() Out
E/PV ( 727): PVLOG:TID(0xd530):Time=3273:PVPlayerDatapath::Run()
Processing PREPARE_CONNECT case for X-RGB-16
E/PV ( 727): PVLOG:TID(0xd530):Time=3273:PVSCHED:Scheduler
'AndroidPVWrapper', Thread 0xd530: Error! AO PVPlayerDatapath Error
104 not handled
E/PV ( 727): PVLOG:TID(0xd530):Time=3273:PVSCHED:Scheduler
'AndroidPVWrapper', Thread 0xd530: Error! Reason 104
E/PV ( 727): PVLOG:TID(0xd530):Time=3273:PVSCHED:Scheduler
'AndroidPVWrapper', Thread 0xd530: Exited PV Scheduling Loop
E/OsclErrorTrap( 727): Panic!! Category PVEXEC reason 65
I/DEBUG ( 551): *** *** *** *** *** *** *** *** *** *** *** *** ***
*** *** ***
I/DEBUG ( 551): Build fingerprint: 'generic/generic/generic/:1.5/
CUPCAKE/eng.vm.20090703.130618:eng/test-keys'
I/DEBUG ( 551): pid: 727, tid: 732 >>> /system/bin/mediaserver <<<
I/DEBUG ( 551): signal 11 (SIGSEGV), fault addr 00000000
I/DEBUG ( 551): r0 00000032 r1 40507e3c r2 2b160b31 r3 00000000
I/DEBUG ( 551): r4 00000041 r5 00000068 r6 0000d338 r7 a71b0641
I/DEBUG ( 551): r8 40307ab4 r9 afe39dd0 10 a9d2856d fp 00000001
I/DEBUG ( 551): ip afbc30c8 sp 40507e68 lr afbc1123 pc
a7529460 cpsr 60000030
I/DEBUG ( 551): #00 pc 00029460 /system/lib/
libopencorecommon.so
I/DEBUG ( 551): #01 pc 000295c0 /system/lib/
libopencorecommon.so
I/DEBUG ( 551): #02 pc 000314ae /system/lib/
libopencorecommon.so
I/DEBUG ( 551): #03 pc 001b058c /system/lib/
libopencoreplayer.so
I/DEBUG ( 551): #04 pc 001b0644 /system/lib/
libopencoreplayer.so
I/DEBUG ( 551): #05 pc 000285d4 /system/lib/libutils.so
I/DEBUG ( 551): #06 pc 0000f880 /system/lib/libc.so
I/DEBUG ( 551): #07 pc 0000f3f4 /system/lib/libc.so
I/DEBUG ( 551): stack:
I/DEBUG ( 551): 40507e28 0000d570 [heap]
I/DEBUG ( 551): 40507e2c 00000000
I/DEBUG ( 551): 40507e30 00000000
I/DEBUG ( 551): 40507e34 0000d570 [heap]
I/DEBUG ( 551): 40507e38 40307ab4
I/DEBUG ( 551): 40507e3c 2b160b31
I/DEBUG ( 551): 40507e40 0000d508 [heap]
I/DEBUG ( 551): 40507e44 00000041
I/DEBUG ( 551): 40507e48 00000068
I/DEBUG ( 551): 40507e4c 0000d338 [heap]
I/DEBUG ( 551): 40507e50 a71b0641 /system/lib/
libopencoreplayer.so
I/DEBUG ( 551): 40507e54 a752945d /system/lib/
libopencorecommon.so
I/DEBUG ( 551): 40507e58 a75652a8 /system/lib/
libopencorecommon.so
I/DEBUG ( 551): 40507e5c a75652c8 /system/lib/
libopencorecommon.so
I/DEBUG ( 551): 40507e60 df002777
I/DEBUG ( 551): 40507e64 e3a070ad
I/DEBUG ( 551): #00 40507e68 0000eec8 [heap]
I/DEBUG ( 551): 40507e6c a7529ad7 /system/lib/
libopencorecommon.so
I/DEBUG ( 551): 40507e70 00000068
I/DEBUG ( 551): 40507e74 a75295c5 /system/lib/
libopencorecommon.so
I/DEBUG ( 551): #01 40507e78 0000d338 [heap]
I/DEBUG ( 551): 40507e7c 00000000
I/DEBUG ( 551): 40507e80 00012bf0 [heap]
I/DEBUG ( 551): 40507e84 a75314b3 /system/lib/
libopencorecommon.so
W/MediaPlayer( 699): MediaPlayer server died!
E/MediaPlayer( 699): error (100, 0)
E/MediaPlayer( 699): Error (100,0)
D/VideoView( 699): Error: 100,0
W/AudioSystem( 577): AudioFlinger server died!
I/ServiceManager( 549): service 'media.audio_flinger' died
I/ServiceManager( 549): service 'media.camera' died
I/ServiceManager( 549): service 'media.player' died

On 8月17日, 下午5时52分, OOD Tsen <oodt...@gmail.com> wrote:
> Dear RaviY;
>

> Maybe we need a new parser node forAVI,these node can be modified by

> mp4 parser node.
>
> -OOD
>
> On Aug 7, 9:06 pm, RaviY <yend...@pv.com> wrote:
>
>
>
> > You need to fill the GAU structure not just for getKeyMediaSampleNumAt
> > () call but for any such media retrieval call to the mp4 parser. If
> > you don't have all the information to fill in that structure, you may
> > write your own function definition that has only the required fields.
>
> > Starting from the mp4 parser node is a good idea, but trying to
> > maintain all the API signatures to be the same is not an ideal
> > solution, for any code development.
>
> > -Ravi
>
> > On Aug 7, 4:49 am, Roopesh <roopesh....@gmail.com> wrote:
>
> > > hi Ravi,

> > > Inorder to enableAVIsupport what I did is I just created a

> > > copy of mp4 recognizer and mp4 parser code and then started modifying

> > > it according to the spec ofaviformat. I have done changes almost

[Shash]

All,

I also want to add AVI support into PV open core. Difference is that I
want to use my own AVI Parser (validated on different platforms like
Winmobile, WinCE, linux ...).

Just gone through PV frame work. it looks like I need to implement
recognizer & parser node for AVI and register the node with the PV
framework. Am I right?

If not can you provide me some direction towards it?

BTW, Have you guys got AVI fully working?

Thanks in advance.

Regards
Shash

On Aug 17, 2:52 pm, OOD Tsen <oodt...@gmail.com> wrote:

> > > > > posting this into current forum.- Hide quoted text -
>
> - Show quoted text -

[leon]

Yes, you need to add the recognizer and parser node into pv
framework.
My avi parser node still cannot work normally.

On 8月28日, 下午9时52分, Shash <shashank.itt...@gmail.com> wrote:
> All,
>

> I also want to addAVIsupport into PV open core. Difference is that I
> want to use my ownAVIParser (validated on different platforms like

> Winmobile, WinCE, linux ...).
>
> Just gone through PV frame work. it looks like I need to implement

> recognizer & parser node forAVIand register the node with the PV

> framework. Am I right?
>
> If not can you provide me some direction towards it?
>

> BTW, Have you guys gotAVIfully working?

>
> Thanks in advance.
>
> Regards
> Shash
>
> On Aug 17, 2:52 pm, OOD Tsen <oodt...@gmail.com> wrote:
>
>
>
> > Dear RaviY;
>

> > Maybe we need a new parser node forAVI,these node can be modified by

> > mp4 parser node.
>
> > -OOD
>
> > On Aug 7, 9:06 pm, RaviY <yend...@pv.com> wrote:
>
> > > You need to fill the GAU structure not just for getKeyMediaSampleNumAt
> > > () call but for any such media retrieval call to the mp4 parser. If
> > > you don't have all the information to fill in that structure, you may
> > > write your own function definition that has only the required fields.
>
> > > Starting from the mp4 parser node is a good idea, but trying to
> > > maintain all the API signatures to be the same is not an ideal
> > > solution, for any code development.
>
> > > -Ravi
>
> > > On Aug 7, 4:49 am, Roopesh <roopesh....@gmail.com> wrote:
>
> > > > hi Ravi,

> > > > Inorder to enableAVIsupport what I did is I just created a

> > > > copy of mp4 recognizer and mp4 parser code and then started modifying

> > > > it according to the spec ofaviformat. I have done changes almost

[Roopesh]

hi all,
I am trying to extract the stream data and map it into PV
Framework. In file m4v_config_parser.cpp function-iDecodeVOLHeader(),
while decoding video data, it looks for a start code
VISUAL_OBJECT_SEQUENCE_START_CODE (0x01B0). In case of my avi file, I
am not able to get this start code(my avi contains m4v video and mp3
audio). Anybody having any idea on this ???

regards
Roopesh

[leon]

It seems that the avi parser in opencore only supports raw video and
raw audio.

Now what is your status?

On 9月2日, 下午2时33分, Roopesh <roopesh....@gmail.com> wrote:
> hi all,
> I am trying to extract the stream data and map it into PV
> Framework. In file m4v_config_parser.cpp function-iDecodeVOLHeader(),
> while decoding video data, it looks for a start code

> VISUAL_OBJECT_SEQUENCE_START_CODE (0x01B0). In case of myavifile, I
> am not able to get this start code(myavicontains m4v video and mp3

> audio). Anybody having any idea on this ???
>
> regards
> Roopesh
>
> On Aug 31, 6:52 pm, leon <leon.ku...@live.cn> wrote:
>
>
>
> > Yes, you need to add the recognizer and parser node into pv
> > framework.

> > Myaviparser node still cannot work normally.