View Issue Details

IDProjectCategoryView StatusLast Update
0000268JVT JM H.264/AVC reference softwareencoder and decoderpublic2011-06-21 08:27
ReporterSUNIL Assigned To 
PriorityhighSeveritymajorReproducibilityalways
Status newResolutionopen 
Product VersionJM 18.0 
Summary0000268: In two view mvc , non-base view is referring number of reference pictures(views) more than 8
DescriptionIn two view MVC , non-base view is referring number of reference pictures more than 8. It refers 9 reference pictures (8 - inter pictures and 1- inter-view picture). In two view MVC, for each view we should not refer more than 8 reference pictures as per standard specified.

In section H.10.2 point (f), standard mentioned an equation for DPB size [page 651]
Max_DPBSize = Min( mvcScaleFactor * MaxDpbMbs / ( PicWidthInMbs * FrameHeightInMbs ),
   Max( 1, Ceil( log2( NumViews ) ) ) * 16 );
                        [where Ceil( x ) the smallest integer greater than or equal to x].

max_num_ref_frames shall be less than or equal to MaxDpbFrames / mvcScaleFactor for each view component.

Can you please explain why JM is not giving any error for this case ?

Steps To ReproduceI have attached config files. Please generate stream using these files and check scenario.
TagsNo tags attached.

Activities

SUNIL

2011-06-20 17:04

reporter  

test_view1.cfg (8,032 bytes)

SUNIL

2011-06-20 17:05

reporter  

test_view0.cfg (48,537 bytes)

SUNIL

2011-06-20 17:06

reporter  

Issue.JPG (67,717 bytes)   
Issue.JPG (67,717 bytes)   

Alexis Michael Tourapis

2011-06-21 07:49

developer   ~0000491

The answer is simple. The contributors cared and spend considerable amount of time in making the software support the MVC framework which was honestly not an easy task (on the contrary). This feature is a trivial tweak, primarily relates to a rather extreme case, and obviously has no real implications in the software design.

Note that currently, it is far more important extending the JM to support multiple views (>2) than such items.

Btw, personally, I think the restriction was a poor choice given that the constraint was originally 16 for the non 3D profiles, and it seems that people still have misconceptions about what is a reference picture in a list and what is a stored reference in the DPB.

Ajay Basarur

2011-06-21 08:27

reporter   ~0000492

Hi Alexis,
           I agree with you regarding the priority for JM developmen towards multiple views support. Regarding the same bug, can bit clarify for the below questions


Two clarifications are required w.r.t to the draft version of AVC “ITU-T Rec. H.264 | ISO/IEC 14496-10”
? Value of the mvcScaleFactor, mentioned in the H.10.2 section of the standard mentioned as 2. This value will not get changed based on number of views. What I guess is the value of mvcScaleFactor should be set to the NumViews… right ?
? The max DPB size for 2 Views per frame stream will be equal to 16 [derived based on the equation given in the point f, mentioned in the section H.10.2.1]. So, the max_num_ref_frames will come as 8 per view [point x of the section H.10.2.1]. We are seeing one scenario where in.
o 2 Views are present per frame.
o After the N th frame decoding, DPB is full.
o In the (N+1) th frame decoding, all the views of the frame are unreferenced. [nal_ref_idc = 0 for all the NAL units of the frame]. But the inter_view_flag is ON.
o After the decoding of the first view of (N+1) th frame, the view should not be stored in the DPB right? Because what we think is, the DPB is full & the current view is unreferenced, so in this case it should not be stored. But if we do not store it, the second view decoding cannot be done. Is this scenario compliant to standard?
? In 2 view per frame case, can max_num_ref_frames exceed 8 & possess value 9 [8 inter frame & 1 inter-view]? Is this compliant to standard?

Regards
~AB

Issue History

Date Modified Username Field Change
2011-06-20 17:04 SUNIL New Issue
2011-06-20 17:04 SUNIL File Added: test_view1.cfg
2011-06-20 17:05 SUNIL File Added: test_view0.cfg
2011-06-20 17:06 SUNIL File Added: Issue.JPG
2011-06-21 07:49 Alexis Michael Tourapis Note Added: 0000491
2011-06-21 08:27 Ajay Basarur Note Added: 0000492