Quantcast

long pauses during rtsp playback

classic Classic list List threaded Threaded
21 messages Options
12
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

long pauses during rtsp playback

Doug Crawford
I am viewing a RTSP stream from an AXIS 241Q video server and displaying it on my OMAP3EVM board.  My gstreamer pipeline is: gst-launch rtspsrc location=rtsp://10.5.5.33/mpeg4/media.amp ! decodebin2 ! TIDmaiVideoSink videoStd=VGA videoOutput=LCD sync=false rotation=90

The video pauses for about 5 seconds then plays very fast for about 2 seconds and this keeps repeating over and over.  The rtsp source and my omap3evm are both on a local switch and the image is only QCIF so I don't think it is a bandwidth issue.  Any ideas?  
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Marco Ballesio
Hi,

On Sat, Oct 16, 2010 at 2:52 AM, Doug Crawford <[hidden email]> wrote:

I am viewing a RTSP stream from an AXIS 241Q video server and displaying it
on my OMAP3EVM board.  My gstreamer pipeline is: gst-launch rtspsrc
location=rtsp://10.5.5.33/mpeg4/media.amp ! decodebin2 ! TIDmaiVideoSink
videoStd=VGA videoOutput=LCD sync=false rotation=90

Not sure about how the TIDmaiVideoSink works, but I'd suggest to set the sync option to true. Is there any particular reason for which you're setting it to false?
 

The video pauses for about 5 seconds then plays very fast for about 2
seconds and this keeps repeating over and over.  The rtsp source and my
omap3evm are both on a local switch and the image is only QCIF so I don't
think it is a bandwidth issue.  Any ideas?

Video frames may be played back in bursts when timing information (for instance the RTP timestamp) is not honored by the sink. Usually, setting asynchronous output on a sink means that whenever a frame reaches it, it's rendered immediately. Any big enough buffering in the network (e.g. your camera is using MTAP aggregation mode for H264) or in the pipeline will thus cause such an effect.

Regards

 

--
View this message in context: http://gstreamer-devel.966125.n4.nabble.com/long-pauses-during-rtsp-playback-tp2997863p2997863.html
Sent from the GStreamer-devel mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel


------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Doug Crawford
I tried setting sync=true, but then I don't see any video image at all.  I am guessing this is the root of the problem.  Is there any element that might fix or help synchronize the RTP timestamps?  

I suspect the problem is in the TIDmaiVideoSink because if I run the gstreamer rtsp client on my Ubunutu box the video is very smooth (although it is delayed about 2 seconds which I believe is related to a latency parameter on the rtspsrc element).  I can only run the rtsp client on my ubuntu box using playbin2.  If I try to compose the pipeline using inidividual elements like: "gst-launch rtspsrc location=rtsp://10.5.5.33/mpeg4/media.amp ! rtpmp4vdepay ! ffdec_mpeg4 ! videoscale ! xvimagesink" then I get the following error:
/GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0/GstUDPSrc:udpsrc1: Internal data flow error.
Additional debug info:
gstbasesrc.c(2507): gst_base_src_loop (): /GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0/GstUDPSrc:udpsrc1:
streaming task paused, reason not-negotiated (-4)

Is there any way to see exactly what playbin2 is using for its pipeline.  There must be some other element that I am missing.  Also, if I try to play the video on my OMAP3EVM using playbin2 then I only see 1 frame and then the video pauses indefinitely.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Marco Ballesio
Hi,

On Sun, Oct 17, 2010 at 7:28 PM, Doug Crawford <[hidden email]> wrote:

I tried setting sync=true, but then I don't see any video image at all.

I suspect your video sink is discarding all the frames because they're arriving too in late. If the element (and the framework) has been compile with debug enabled, try
export GST_DEBUG=TIDmaiVideoSink:5 prior executing the pipeline and see whether any output in that sense is given.
 
I am
guessing this is the root of the problem.  Is there any element that might
fix or help synchronize the RTP timestamps?

This is a built-in design mechanism in GStreamer. See here:

http://cgit.freedesktop.org/gstreamer/gstreamer/tree/docs/design/part-qos.txt
(I guess you can safely skip to the GstBaseSink and buffer dropping description).

A possibility would be to try and reduce the jitter buffer depth in the rtspsrc element, but the default is normally good enough. Imo the video sink element you're using needs some improvements. I'm not too fond it'll work, but maybe you could try and replace it with v4l2sink. There are (scarce) possibilities fdbevsink will work.
 

I suspect the problem is in the TIDmaiVideoSink because if I run the
gstreamer rtsp client on my Ubunutu box the video is very smooth (although
it is delayed about 2 seconds which I believe is related to a latency
parameter on the rtspsrc element).  I can only run the rtsp client on my
ubuntu box using playbin2.

I share your idea about the video sink ;)
 
If I try to compose the pipeline using
inidividual elements like: "gst-launch rtspsrc
location=rtsp://10.5.5.33/mpeg4/media.amp ! rtpmp4vdepay ! ffdec_mpeg4 !
videoscale ! xvimagesink" then I get the following error:
/GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0/GstUDPSrc:udpsrc1: Internal data
flow error.
Additional debug info:
gstbasesrc.c(2507): gst_base_src_loop ():
/GstPipeline:pipeline0/GstRTSPSrc:rtspsrc0/GstUDPSrc:udpsrc1:
streaming task paused, reason not-negotiated (-4)

mmhhh, you should put a few caps for indicating at least the payload type, something like the examples in:

http://www.gstreamer.net/data/doc/gstreamer/head/gst-plugins-good-plugins/html/gst-plugins-good-plugins-gstrtpbin.html

for when the rtpbin is used as a source element.
 

Is there any way to see exactly what playbin2 is using for its pipeline.

if you're interested in the pipeline structure, you can dump a dot file (Google is your friend).
 
There must be some other element that I am missing.  Also, if I try to play
the video on my OMAP3EVM using playbin2 then I only see 1 frame and then the
video pauses indefinitely.

another symptom of a bad latency handling in the sink.. If it's not the case, _maybe_ adding a queue before the sink could help (I'm just wondering whether it could be a deadlock).

Regards
 
--
View this message in context: http://gstreamer-devel.966125.n4.nabble.com/long-pauses-during-rtsp-playback-tp2997863p2999165.html
Sent from the GStreamer-devel mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel


------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Gruenke, Matt
In reply to this post by Doug Crawford

-----Original Message-----
From: Doug Crawford [mailto:[hidden email]]
Sent: Sunday, October 17, 2010 12:28
To: [hidden email]
Subject: Re: [gst-devel] long pauses during rtsp playback


<snip/>

> Is there any way to see exactly what playbin2 is using for its
pipeline.

We've found it helpful to dump the pipeline as XML, using
gst_xml_write_file(), which we wrote a tool to visualize.

Unfortunately, I hear this functionality has now been deprecated.


<snip/>


Matt


------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Edward Hervey
On Mon, 2010-10-18 at 01:08 -0400, Gruenke, Matt wrote:

> -----Original Message-----
> From: Doug Crawford [mailto:[hidden email]]
> Sent: Sunday, October 17, 2010 12:28
> To: [hidden email]
> Subject: Re: [gst-devel] long pauses during rtsp playback
>
>
> <snip/>
>
> > Is there any way to see exactly what playbin2 is using for its
> pipeline.
>
> We've found it helpful to dump the pipeline as XML, using
> gst_xml_write_file(), which we wrote a tool to visualize.
>
> Unfortunately, I hear this functionality has now been deprecated.

  You can use the GST_DEBUG_BIN_TO_DOT feature instead
http://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#GST-DEBUG-BIN-TO-DOT-FILE:CAPS


>
>
> <snip/>
>
>
> Matt
>
>
> ------------------------------------------------------------------------------
> Download new Adobe(R) Flash(R) Builder(TM) 4
> The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
> Flex(R) Builder(TM)) enable the development of rich applications that run
> across multiple browsers and platforms. Download your free trials today!
> http://p.sf.net/sfu/adobe-dev2dev
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel



------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Gruenke, Matt
That's true, and we wrote a DOT conversion script before we knew about
that.  However, the XML output can potentially be used in ways not
possible with DOT output.  There's also the question of being able to
customize the way that pipelines are rendered.

I see that DOT output handles the typical case and is better than
nothing.  However, I'd much rather have XML (and convert to DOT, if I
need to).  I can understand why XML parsing was removed, but why get rid
of XML output?


Matt


-----Original Message-----
From: Edward Hervey [mailto:[hidden email]]
Sent: Monday, October 18, 2010 02:48
To: Discussion of the development of GStreamer
Subject: Re: [gst-devel] long pauses during rtsp playback

On Mon, 2010-10-18 at 01:08 -0400, Gruenke, Matt wrote:

> -----Original Message-----
> From: Doug Crawford [mailto:[hidden email]]
> Sent: Sunday, October 17, 2010 12:28
> To: [hidden email]
> Subject: Re: [gst-devel] long pauses during rtsp playback
>
>
> <snip/>
>
> > Is there any way to see exactly what playbin2 is using for its
> pipeline.
>
> We've found it helpful to dump the pipeline as XML, using
> gst_xml_write_file(), which we wrote a tool to visualize.
>
> Unfortunately, I hear this functionality has now been deprecated.

  You can use the GST_DEBUG_BIN_TO_DOT feature instead
http://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/
gstreamer-GstInfo.html#GST-DEBUG-BIN-TO-DOT-FILE:CAPS


>
>
> <snip/>
>
>
> Matt
>
>
>
------------------------------------------------------------------------
------
> Download new Adobe(R) Flash(R) Builder(TM) 4
> The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
> Flex(R) Builder(TM)) enable the development of rich applications that
run
> across multiple browsers and platforms. Download your free trials
today!
> http://p.sf.net/sfu/adobe-dev2dev
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel



------------------------------------------------------------------------
------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that
run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel

------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

wl2776
Administrator
In reply to this post by Doug Crawford
Doug Crawford wrote
Is there any element that might fix or help synchronize the RTP timestamps?  
It is already in there.
rtpbin includes rtpjitterbuffer.

I suspect it is its influence. It buffers 2sec of video by default.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Doug Crawford
I worked out all of the problems with displaying the video on my Ubuntu machine.  I had to change the sink from xvimagesink to ffmpegcolorspace ! ximagesink.  Now, if I set the latency=100 on the rtspsrc and set sync=true on ximagesink the video is stable with low lag.  If I set sync=false the video has no perceptible lag.  So I am conviced that my AXIS RTSP video source is good and I am back to my original problem of figuring out how to display the video on my OMAP3EVM board.

I tried this pipeline "gst-launch --gst-debug-level=2 rtspsrc location=rtsp://10.5.5.33/mpeg4/media.amp ! queue ! rtpmp4vdepay ! TIViddec2 codecName=mpeg4dec engineName=codecServer ! TIDmaiVideoSink videoStd=VGA videoOutput=LCD rotation=90 sync=false" with export GST_DEBUG=TIDmaiVideoSink:5.  The first warning I see is:

0:00:00.361450194  1628    0x54048 WARN         rtpjitterbuffer rtpjitterbuffer.c:198:calculate_skew: Clock rate changed from 4294967295 to 90000

Then the console output pauses for about 20 seconds and then I see bursts of the folllowing log messages from TIDmaiVideoSink:

0:00:22.691528319  1628   0x1041b0 LOG          TIDmaiVideoSink gsttidmaivideosink.c:1854:gst_tidmaivideosink_render: render  ******* < (168960 bytes, timestamp: 0:00:00.000000000, duration: 0:00:00.033366666, offset: -1, offset_end: -1, flags: 0) 0x100808

I see about 16 of these log messages that are almost identical.  Then  a 4 second pause, then another burst of about 16 of these log messages.

Doug

Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Ron McOuat
  Any chance you are out of CPU resources on the OMAP? If you go into
the Image and Video settings on the Axis you can turn down the framerate
for the default video feed (0 = as fast as it can produce frames) to as
low as 1 fps. The Rev 4 Axis cameras don't allow setting parameters on
the mp4 stream except by changing the default video parameters for when
you visit the camera using just the IP address and HTTP protocol which
of course results in MJPEG but what you see there is also used for mp4.

On 10-10-18 10:04 AM, Doug Crawford wrote:

> I worked out all of the problems with displaying the video on my Ubuntu
> machine.  I had to change the sink from xvimagesink to ffmpegcolorspace !
> ximagesink.  Now, if I set the latency=100 on the rtspsrc and set sync=true
> on ximagesink the video is stable with low lag.  If I set sync=false the
> video has no perceptible lag.  So I am conviced that my AXIS RTSP video
> source is good and I am back to my original problem of figuring out how to
> display the video on my OMAP3EVM board.
>
> I tried this pipeline "gst-launch --gst-debug-level=2 rtspsrc
> location=rtsp://10.5.5.33/mpeg4/media.amp ! queue ! rtpmp4vdepay ! TIViddec2
> codecName=mpeg4dec engineName=codecServer ! TIDmaiVideoSink videoStd=VGA
> videoOutput=LCD rotation=90 sync=false" with export
> GST_DEBUG=TIDmaiVideoSink:5.  The first warning I see is:
>
> 0:00:00.361450194  1628    0x54048 WARN         rtpjitterbuffer
> rtpjitterbuffer.c:198:calculate_skew: Clock rate changed from 4294967295 to
> 90000
>
> Then the console output pauses for about 20 seconds and then I see bursts of
> the folllowing log messages from TIDmaiVideoSink:
>
> 0:00:22.691528319  1628   0x1041b0 LOG          TIDmaiVideoSink
> gsttidmaivideosink.c:1854:gst_tidmaivideosink_render: render  *******<
> (168960 bytes, timestamp: 0:00:00.000000000, duration: 0:00:00.033366666,
> offset: -1, offset_end: -1, flags: 0) 0x100808
>
> I see about 16 of these log messages that are almost identical.  Then  a 4
> second pause, then another burst of about 16 of these log messages.
>
> Doug
>
>

------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Doug Crawford
I tried setting the framerate on the AXIS video server to 5 fps, but have the same bursty video.  The only difference is now after I run the gstreamer rtsp client on my OMAP3EVM there is an even longer pause of around 60 seconds until I see the first frame.  If I set the AXIS server to 30 fps then the delay is about 12 seconds before I see the first frame.  Also, the pause between bursts is more or less proportional to the framerate: 2-3 second@30fps, 8-10 seconds@5fps.

I have been able to successfully play regular mpeg4 and h.264 video files using the same TIDmaiVideoSink.  For example this pipeline displays a ntsc_1 video just fine: gst-launch --gst-debug=2 filesrc location=/opt/davincieffect_ntsc_1.m4v ! TIViddec2 codecName=mpeg4dec engineName=codecServer ! TIDmaiVideoSink videoStd=VGA videoOutput=LCD rotation=90 sync=false.

I am building the gstreamer framework using the TI Arago project targeting the OMAP3EVM evaluation board.
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Ron McOuat
  On the Axis Setup under Video and Image the MPEG4 section should have
a setting called GOV which I believe is the ratio of I frames to P
frames in the stream. On the lower end cameras the GOV can default to as
high as 128 so it can take a while before you see an I frame in the
stream to get the first complete frame. That might be what is causing
the long startup delays. Is your stream the only stream being pulled
from the camera? If your stream is in parallel with another I believe
you join a live stream in progress inside the camera. It is worth a try
to change this setting to see if that changes the startup time.

I would also look at the Simple vs Advanced profile. They are standard
profiles according to the standards bodies but I know Quicktime won't
play the Advanced profile. I haven't used the MP4 streams from Rev 4
Axis cameras with gstreamer much. Maybe I am stating the obvious but it
looks like something has a problem processing the timing headers. Very
odd. I have only looked at the stream on Linux systems which also works
fine for you reading earlier posts.

On 10-10-18 11:09 AM, Doug Crawford wrote:

> I tried setting the framerate on the AXIS video server to 5 fps, but have the
> same bursty video.  The only difference is now after I run the gstreamer
> rtsp client on my OMAP3EVM there is an even longer pause of around 60
> seconds until I see the first frame.  If I set the AXIS server to 30 fps
> then the delay is about 12 seconds before I see the first frame.  Also, the
> pause between bursts is more or less proportional to the framerate: 2-3
> second@30fps, 8-10 seconds@5fps.
>
> I have been able to successfully play regular mpeg4 and h.264 video files
> using the same TIDmaiVideoSink.  For example this pipeline displays a ntsc_1
> video just fine: gst-launch --gst-debug=2 filesrc
> location=/opt/davincieffect_ntsc_1.m4v ! TIViddec2 codecName=mpeg4dec
> engineName=codecServer ! TIDmaiVideoSink videoStd=VGA videoOutput=LCD
> rotation=90 sync=false.
>
> I am building the gstreamer framework using the TI Arago project targeting
> the OMAP3EVM evaluation board.

------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Doug Crawford
Ron, it sounds like you know a lot about axis video servers.  I am thinking about ordering one of the newer models that has h.264 compression (Axis Q7401) in hopes that it might resolve these issues.  I tried changing the profile from Advanced simple to simple, but no success.  The GOV options are "structure" (I or IP), and "Length".   Currently these are set to IP and 8.  When I run the gstreamer rtsp client under Ubuntu there is no initial delay and everything works smoothly.

I also changed TIDmaiVideoSink to v4l2sink on my OMAP3EVM and I am getting the same bursty video (fbdevsink did not work at all).  So I am now beginning to suspect that the problem is the TIViddec2 decoder since that is the only piece that is fundamentally different from my Ubuntu pipeline which uses ffdec_mpeg4.

Doug
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Ron McOuat
  I guess it was worth a try I think you might be on the right track
with the decoder being the problem. The newer Axis units as well as
producing H.264 use gstreamer for their internal working. I remember
during the introduction of the new units that the RTSP implementation
was said to be more compliant with standards. I guess using H.264 would
also enable you to switch to a different decoder.

On 10-10-18 12:40 PM, Doug Crawford wrote:

> Ron, it sounds like you know a lot about axis video servers.  I am thinking
> about ordering one of the newer models that has h.264 compression (Axis
> Q7401) in hopes that it might resolve these issues.  I tried changing the
> profile from Advanced simple to simple, but no success.  The GOV options are
> "structure" (I or IP), and "Length".   Currently these are set to IP and 8.
> When I run the gstreamer rtsp client under Ubuntu there is no initial delay
> and everything works smoothly.
>
> I also changed TIDmaiVideoSink to v4l2sink on my OMAP3EVM and I am getting
> the same bursty video (fbdevsink did not work at all).  So I am now
> beginning to suspect that the problem is the TIViddec2 decoder since that is
> the only piece that is fundamentally different from my Ubuntu pipeline which
> uses ffdec_mpeg4.
>
> Doug

------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Stefan Sauer
In reply to this post by Gruenke, Matt
Am 18.10.2010 10:03, schrieb Gruenke, Matt:

> That's true, and we wrote a DOT conversion script before we knew about
> that.  However, the XML output can potentially be used in ways not
> possible with DOT output.  There's also the question of being able to
> customize the way that pipelines are rendered.
>
> I see that DOT output handles the typical case and is better than
> nothing.  However, I'd much rather have XML (and convert to DOT, if I
> need to).  I can understand why XML parsing was removed, but why get rid
> of XML output?
>
XML dumping could be added back, but then we should simply printf the xml to
avoid a xml dependency.

If you feel adventurous try
http://cgit.freedesktop.org/~ensonic/gst-tracelib/

terminal 1:
gsttlui --log-port=8765

terminal 2:
GSTTL_LOG_SERVER=127.0.0.1:8765 gsttl <your-gst-app>

if gsttlui crashes its most likelöy the graphviz issue I am trying to figure
right now :/

Stefan

>
>
> Matt
>
>
> -----Original Message-----
> From: Edward Hervey [mailto:[hidden email]]
> Sent: Monday, October 18, 2010 02:48
> To: Discussion of the development of GStreamer
> Subject: Re: [gst-devel] long pauses during rtsp playback
>
> On Mon, 2010-10-18 at 01:08 -0400, Gruenke, Matt wrote:
>> -----Original Message-----
>> From: Doug Crawford [mailto:[hidden email]]
>> Sent: Sunday, October 17, 2010 12:28
>> To: [hidden email]
>> Subject: Re: [gst-devel] long pauses during rtsp playback
>>
>>
>> <snip/>
>>
>>> Is there any way to see exactly what playbin2 is using for its
>> pipeline.
>>
>> We've found it helpful to dump the pipeline as XML, using
>> gst_xml_write_file(), which we wrote a tool to visualize.
>>
>> Unfortunately, I hear this functionality has now been deprecated.
>
>   You can use the GST_DEBUG_BIN_TO_DOT feature instead
> http://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/
> gstreamer-GstInfo.html#GST-DEBUG-BIN-TO-DOT-FILE:CAPS
>
>
>>
>>
>> <snip/>
>>
>>
>> Matt
>>
>>
>>
> ------------------------------------------------------------------------
> ------
>> Download new Adobe(R) Flash(R) Builder(TM) 4
>> The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
>> Flex(R) Builder(TM)) enable the development of rich applications that
> run
>> across multiple browsers and platforms. Download your free trials
> today!
>> http://p.sf.net/sfu/adobe-dev2dev
>> _______________________________________________
>> gstreamer-devel mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>
>
>
> ------------------------------------------------------------------------
> ------
> Download new Adobe(R) Flash(R) Builder(TM) 4
> The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
> Flex(R) Builder(TM)) enable the development of rich applications that
> run
> across multiple browsers and platforms. Download your free trials today!
> http://p.sf.net/sfu/adobe-dev2dev
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
>
> ------------------------------------------------------------------------------
> Download new Adobe(R) Flash(R) Builder(TM) 4
> The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
> Flex(R) Builder(TM)) enable the development of rich applications that run
> across multiple browsers and platforms. Download your free trials today!
> http://p.sf.net/sfu/adobe-dev2dev
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel


------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Gruenke, Matt
-----Original Message-----
From: Stefan Kost [mailto:[hidden email]]
Sent: Monday, October 18, 2010 16:10
To: Discussion of the development of GStreamer
Cc: Gruenke, Matt
Subject: Re: [gst-devel] long pauses during rtsp playback

<snip/>

> XML dumping could be added back, but then we should simply printf
> the xml to avoid a xml dependency.

Are you saying you'd expect to accept a patch that re-enable XML duping,
it it doesn't re-add any previous XML library dependencies?

<snip/>


Thanks,
Matt


------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Marco Ballesio
In reply to this post by Doug Crawford
Hi,

On Mon, Oct 18, 2010 at 8:04 PM, Doug Crawford <[hidden email]> wrote:

I worked out all of the problems with displaying the video on my Ubuntu
machine.  I had to change the sink from xvimagesink to ffmpegcolorspace !
ximagesink.  Now, if I set the latency=100 on the rtspsrc and set sync=true
on ximagesink the video is stable with low lag.  If I set sync=false the
video has no perceptible lag.  So I am conviced that my AXIS RTSP video
source is good and I am back to my original problem of figuring out how to
display the video on my OMAP3EVM board.

I tried this pipeline "gst-launch --gst-debug-level=2 rtspsrc
location=rtsp://10.5.5.33/mpeg4/media.amp ! queue ! rtpmp4vdepay ! TIViddec2
codecName=mpeg4dec engineName=codecServer ! TIDmaiVideoSink videoStd=VGA
videoOutput=LCD rotation=90 sync=false" with export
GST_DEBUG=TIDmaiVideoSink:5.  The first warning I see is:

0:00:00.361450194  1628    0x54048 WARN         rtpjitterbuffer
rtpjitterbuffer.c:198:calculate_skew: Clock rate changed from 4294967295 to
90000

Then the console output pauses for about 20 seconds and then I see bursts of
the folllowing log messages from TIDmaiVideoSink:

0:00:22.691528319  1628   0x1041b0 LOG          TIDmaiVideoSink
gsttidmaivideosink.c:1854:gst_tidmaivideosink_render: render  ******* <
(168960 bytes, timestamp: 0:00:00.000000000, duration: 0:00:00.033366666,
offset: -1, offset_end: -1, flags: 0) 0x100808

If _all_ the messages mention a timestamp of 0 there may be actually something wrong with the decoder. Can you please attach (or put to pastebin) the output you get replacing the video sink with a fake sink and running gst-launch with the -v option?

Another test could be to put an identity between decoder and sink and setting its check-perfect property to true (indeed it must not be silent).

Regards
 

I see about 16 of these log messages that are almost identical.  Then  a 4
second pause, then another burst of about 16 of these log messages.

Doug


--
View this message in context: http://gstreamer-devel.966125.n4.nabble.com/long-pauses-during-rtsp-playback-tp2997863p3000648.html
Sent from the GStreamer-devel mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel


------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

xml api deprecations (was: Re: long pauses during rtsp playback)

Tim-Philipp Müller-2
In reply to this post by Gruenke, Matt
On Tue, 2010-10-19 at 00:08 -0400, Gruenke, Matt wrote:

> > XML dumping could be added back, but then we should simply printf
> > the xml to avoid a xml dependency.
>
> Are you saying you'd expect to accept a patch that re-enable XML duping,
> it it doesn't re-add any previous XML library dependencies?

Definitely no libxml dependency again, we want to get rid of that.

I don't entirely understand why parsing an xml dump of a pipeline is so
much easier than iterating the pipeline and extracting or serialising
whatever info you need yourself though.

Cheers
 -Tim


------------------------------------------------------------------------------
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Doug Crawford
In reply to this post by Marco Ballesio
I purchased an Axis M1011 network camera with h.264 support, but I still have the same bursty video: 2-3 seconds of faster than realtime video followed by a 3-4 second pause.

Here is the output of "gst-launch --gst-debug-level=2 -v rtspsrc location=rtsp://10.5.5.34/axis-media/media.amp ! rtph264depay ! TIViddec2 codecName=h264dec engineName=codecServer ! fakesink" http://pastebin.com/xzbMutQH

I tried adding an identity element "gst-launch --gst-debug-level=2 rtspsrc location=rtsp://10.5.5.34/axis-media/media.amp ! rtph264depay ! queue ! TIViddec2 codecName=h264dec engineName=codecServer ! identity check-perfect=true ! TIDmaiVideoSink videoStd=VGA videoOutput=LCD sync=false".  But identity was completely silent.

Here is an interesting post in the TI forums explaining why there is a big pause before seeing the first frame when using TIVideDec2 https://gstreamer.ti.com/gf/project/gstreamer_ti/forum/?_forum_action=ForumMessageBrowse&thread_id=3676&action=ForumBrowse&forum_id=187

Doug
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: long pauses during rtsp playback

Stefan Sauer
In reply to this post by Gruenke, Matt
Am 19.10.2010 07:08, schrieb Gruenke, Matt:

> -----Original Message-----
> From: Stefan Kost [mailto:[hidden email]]
> Sent: Monday, October 18, 2010 16:10
> To: Discussion of the development of GStreamer
> Cc: Gruenke, Matt
> Subject: Re: [gst-devel] long pauses during rtsp playback
>
> <snip/>
>
>> XML dumping could be added back, but then we should simply printf
>> the xml to avoid a xml dependency.
>
> Are you saying you'd expect to accept a patch that re-enable XML duping,
> it it doesn't re-add any previous XML library dependencies?
>


Yes like tim, said - no XML dependency again. I also thing it does not have to
be in core necessarily. Just start it as a external tool/library or have a look
at tracelib and see if we e.g. can integrate it there.

Stefan

>
> <snip/>
>
>
> Thanks,
> Matt
>
>
> ------------------------------------------------------------------------------
> Download new Adobe(R) Flash(R) Builder(TM) 4
> The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
> Flex(R) Builder(TM)) enable the development of rich applications that run
> across multiple browsers and platforms. Download your free trials today!
> http://p.sf.net/sfu/adobe-dev2dev
> _______________________________________________
> gstreamer-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/gstreamer-devel


------------------------------------------------------------------------------
Nokia and AT&T present the 2010 Calling All Innovators-North America contest
Create new apps & games for the Nokia N8 for consumers in  U.S. and Canada
$10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing
Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store
http://p.sf.net/sfu/nokia-dev2dev
_______________________________________________
gstreamer-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/gstreamer-devel
12
Loading...