Panorama Fisheye HDR Issues

[Michael Quigley]

Hi...

I'm trying to get a Meshroom pipeline together to stitch HDR panoramas from a Panasonic MFT camera with a 4mm Laowa fisheye lens on it (210 degree FOV). I'm working with a set of images that I've been able to stitch using PTGui, but haven't had any success with in Meshroom.

I'm basically starting with "New Pipeline > Panorama Fisheye HDR", and dropping my images in. It looks like the main node that needs configuration is the 'CameraInit' node. I've got 119 images total, so it shows '119 Viewpoints'. Under 'Intrinsics', it shows '1 elements'. By default the 'Focal Length' was coming up as '4152.447372...'  and the 'Initial Focal Length' was '-1'. I changed both of these to '8' (MFT has a 2x crop, and it's a 4mm lens). Not sure if the 'Sensor Width' paramater makes a difference, but it is defaulting to '17.3'? The width and height appear correct for my images.

All of the nodes appear to process successfully up to 'PanoramaInit', which fails with:

[14:39:21.969433][error] Failed to find circle

If I disable the 'Estimate Fisheye Circle' flag, and pick something that I think looks reasonable and re-run, the node graph succeeds up to 'PanoramaEstimation', which fails with:

[14:41:17.714722][warning] No matches file loaded in: D:/Sandbox\pano2\MeshroomCache\FeatureMatching\813cfbe4595b0e64221e299f5e91f037bf352bfa

[14:41:17.714722][warning]     - D:/Sandbox/pano2/MeshroomCache/FeatureMatching/813cfbe4595b0e64221e299f5e91f037bf352bfa

[14:41:17.714722][error] Unable to load matches files from: [D:/Sandbox/pano2/MeshroomCache/FeatureMatching/813cfbe4595b0e64221e299f5e91f037bf352bfa]

Looking backwards through the node graph, it looks like the 'FeatureExtraction' node is not finding any features:

[14:38:48.364162][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0002.exr'
[14:38:48.438762][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0004.exr' [cpu]
[14:38:48.499860][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0005.exr'
[14:38:48.634354][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0000.exr' [cpu]
[14:38:48.721277][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0003.exr' [cpu]
[14:38:58.040396][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0004.exr'
[14:38:58.310575][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0009.exr' [cpu]
[14:38:58.462581][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0012.exr'
[14:38:58.711823][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0016.exr' [cpu]
[14:38:58.871825][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0007.exr'
[14:38:59.036914][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0000.exr'
[14:38:59.103586][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0008.exr' [cpu]
[14:38:59.243513][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0006.exr' [cpu]
[14:38:59.255218][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0003.exr'
[14:38:59.427374][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0014.exr' [cpu]
[14:39:08.343033][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0009.exr'
[14:39:08.541537][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0010.exr' [cpu]
[14:39:08.895543][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0016.exr'
[14:39:09.448031][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0008.exr'
[14:39:09.723140][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0006.exr'
[14:39:09.964514][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0014.exr'
[14:39:10.094157][info] Extracting sift features from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0015.exr' [cpu]
[14:39:16.057299][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0010.exr'
[14:39:17.379988][info]       0 sift features extracted from view 'D:/Sandbox/pano2/MeshroomCache/LdrToHdrMerge/c32b7a7ebd0add6c60af14a8d4989f7bf38f65ec\hdr_0015.exr'
[14:39:17.382986][info] Task done in (s): 38.515000

I'm kind of at a loss about how to troubleshoot this next. I don't necessarily want to include a public link to my images, but I would be happy to share them with individuals who could help.

Any advice would be appreciated!

Michael