View Issue Details

IDProjectCategoryView StatusLast Update
0000024JVT JM H.264/AVC reference softwareencoderpublic2006-12-20 11:43
ReporterKrzysztof Ch Assigned ToKarsten Suehring  
PrioritynormalSeveritycrashReproducibilityalways
Status resolvedResolutionfixed 
Product VersionJM 11.0 
Fixed in VersionJM 12.0 
Summary0000024: Out of memory during HD encoding with fixed nalu size
Descriptionencoding 1280x720 sample with SliceMode=2 and SliceArgument = 1500 the usage of memory when encoding first slice jumps to 2GB. Encoding process crashs because of too big memory usage. With 352x288 samples encoding everythig works fine.
TagsNo tags attached.

Activities

Karsten Suehring

2006-12-20 11:43

administrator   ~0000035

In malloc_slice() we were allocating (more than) enough memory for storing the whole picture in each slice. This is not necessary in SliceMode 1 and 2:

Fix:
replace the buffer_size calculation with:

  int buffer_size;

  switch (input->slice_mode)
  {
  case 2:
    buffer_size = 2 * input->slice_argument;
    break;
  case 1:
    buffer_size = 500 + input->slice_argument * (128 + 256 * img->bitdepth_luma + 512 * img->bitdepth_chroma);;
    break;
  default:
    buffer_size = 500 + img->FrameSizeInMbs * (128 + 256 * img->bitdepth_luma + 512 * img->bitdepth_chroma);
    break;
  }

Issue History

Date Modified Username Field Change
2006-11-28 16:42 Krzysztof Ch New Issue
2006-12-20 11:39 Karsten Suehring Status new => assigned
2006-12-20 11:39 Karsten Suehring Assigned To => Karsten Suehring
2006-12-20 11:43 Karsten Suehring Status assigned => resolved
2006-12-20 11:43 Karsten Suehring Fixed in Version => JM 11.0-devel
2006-12-20 11:43 Karsten Suehring Resolution open => fixed
2006-12-20 11:43 Karsten Suehring Note Added: 0000035