Intermittent Crashes and OutOfMemoryException and Callback on garbage collected delegate in Parallel Magick.NET Image Processing

[DavidVTurley]

Windows 11
Intel Xeon (96 core)
Magick.Net Version 14.0.0
Q8

I have been having an issue. I have some code that works fine on my development pc, but as soon as I try to run it on the test server, it starts to crash. The testing server has 96 cores. However I limit the number of parallel threads are allowed to run.

I am running a large number of jpgs through the system. They are around 5-10mb's.

One of the errors I happens at any time throughout the process. It can happen on image 1, or it can happen on the last image.

Process terminated. A callback was made on a garbage collected delegate of type 'Magick.NET-Q8-AnyCPU!ImageMagick.MagickImage+TellStreamDelegate::Invoke'.
   at ImageMagick.MagickImage+NativeMethods+X86.MagickImage_Dispose(IntPtr)
   at ImageMagick.MagickImage.Dispose(Boolean)
   at ImageMagick.MagickImage.Finalize()
PS C:\Program_Files\Odontoceti>

The other error I recieve if I change the code so that I dont see this one oftern is an 'Out of Memory' error. This one generally crops up on the final image. However I dont know why this would happen concidering I am using and then imediatly disposing the image.

One of the fixes I tried was to reduce the parallel processing threads. However even when running on only 8 threads (Less that development pc), I was still getting the errors.

List<ProcessedImage> StartParellelProcessing(DirectoryInfo path, DirectoryInfo destination, CancellationToken cancellationToken)
{
	IEnumerable<FileInfo> files = path.GetFiles()
		.Where(file => Array.Exists(_generalSettings.FileFormat.ToArray(), ext => ext.Equals(Path.GetExtension(file.Extension), StringComparison.OrdinalIgnoreCase)));


	ParallelOptions parallelOptions = new ParallelOptions() 
	{ 
		CancellationToken = cancellationToken, 
		MaxDegreeOfParallelism = _generalSettings.MaxSimiltaniusImageProcessingCount 
	};
	_logger.LogDebug("Parallelism core count: {count}", _generalSettings.MaxSimiltaniusImageProcessingCount);
	List<FileInfo> croppedImages = [];
	Parallel.ForEach(files, parallelOptions, file =>
	{
		(MagickImage cropped, FileInfo destination) croppedFile = GetCroppedImage(file, destination);
		croppedFile.cropped.Write(s.destination);
		croppedFile.cropped.Dispose();
		croppedImages.Add(s.destination);
	});

        /// This is where the error seems to happen

	List<ProcessedImage> processedImages = [];
	Parallel.ForEach(croppedImages, croppedImage =>
	{
		processedImages.Add(GetProcessedImageInfo(croppedImage));
	});

	return processedImages.OrderBy(f => f.File.Name).ToList();
}

		private (MagickImage cropped, FileInfo destination) GetCroppedImage(FileInfo file, DirectoryInfo destination)
		{
			MagickImage image = new(file.FullName);
			Crop.UseCrop(image);

			FileInfo fileDestination = new(Path.Combine(destination.FullName, Path.GetFileName(file.FullName)));
			return (image, fileDestination);
		}

 public static void UseCrop(MagickImage image)
 {
     using IMagickImage imageClone = image.Clone();

     // Cropping Logic
      MagickGeometry geometry = new()
      {
          X = 100,
          Width = 100,
          Y = 100,
          Height = 100
      };

     imageClone.Dispose();

     image.Crop(geometry);
 }

[dlemstra]

What is happening inside GetProcessedImageInfo? And why are you creating a clone inside the UseCrop that you are not using?