Trying to batch ingest a ZIP of very large files - that is, a 20 GB zip file of Large Images (TIFF), and each TIFF is between 300 and 600 MB.
When I try to process the zip, the following happens:
brandonw@bceln:/var/www/drupal7/sites$ drush -v -u 1 --uri=http://localhost islandora_batch_scan_preprocess --type=zip --content_models=islandora:sp_large_image_cmodel --parent=unbc:nbcdcmaps --namespace=unbc --target=/home/brandonw/stagedata/UNBC_Batch_2.zip
Initialized Drupal 7.54 root directory at /var/www/drupal7 [notice]
Initialized Drupal site localhost at sites/default [notice]
Invalid argument supplied for foreach() islandora_scan_batch.inc:134 [warning]
SetId: 2 [ok]
Command dispatch complete [notice]
And an empty batch set (zero items) is created.
There's nothing wrong with my drush command, as far as I can tell, and nothing wrong with the archive's structure. When I unzip and run the same command with --type=directory, the process works perfectly.
So - why is batch not working with the zip file? Is there an undocumented limitation on the size of zip archives in batch?
I do note that a note appeared beside one of the TIFFs during processing:
inflating: 2008_2_1_22.tif bad CRC fb13da74 (should be 88f607da)
The TIFF itself is fine, and ingested perfectly in the directory batch, so I don't think that was the issue.
Any ideas?
