Export Mapping Upload not working in CA 2.0 (Schema changed?)

LuCA

Hello,

adding a new export mapping doesn't seem to work on CA 2. Neither on the Demo system ( https://demo.collectiveaccess.org/manage/MetadataExport/Index )

The exact same mapping does work on CA 1.7. Did the schema for the mapping xlsx file change?

we recently updated from CA 1.7 to CA 2.0.5a.
When trying to upload a new export mapping, it's stuck at 100% without adding the export to the list. In the apache error log we get:
PHP Fatal error: Allowed memory size of 536870912 bytes exhausted (tried to allocate 83886080 bytes) in /local/www/html/ca/vendor/phpoffice/phpspreadsheet/src/PhpSpreadsheet/Collection/Memory/SimpleCache1.php on line 107, referer: https://smsbsag-tst.srv.mwn.de/ca/index.php/manage/MetadataExport/Index

(When upgrading from 1.7 to 2.0.5 the already existing mapping was automatically migrated, but this export doesn't work, therefore we tested uploading another mapping, which lead to this situation)

PHP 8.2 /.3 /.4 (All tested)
Ubuntu 24.04.2 LTS
Apache 2.4.58

Simple Mapping File:
ca_objects.object_inventarnr_container.obj_inv_number,ID,Parent ID,Element,Source,Options,Notes,Original values,Replacement values Constant,17,,TestElement,test text,,,, ,,,,,,,, ,,,,,,,, ,Setting,Setting Value,Description,Notes,,,, Setting,code,mapping_min,,,,,, Setting,name,Mapping Min,,,,,, Setting,table,ca_objects,,,,,, Setting,exporter_format,XML,,,,,, Setting,wrap_before,<rootElement>,,,,,, Setting,wrap_after,</rootElement>,,,,,,

Expected output (when exporting a set with three objects) [but adding the mapping doesn't even work therefore the export can't be run in the first place on CA 2.0]:
<rootElement> <TestElement>test text</TestElement> <TestElement>test text</TestElement> <TestElement>test text</TestElement> </rootElement>

seth

The exporter in v2.0 uses a JSON schema to check validity of the JSON option entries in a mapping. The pre 2.0 would tolerate invalid options, 2.0 does not. I'd look in the logs to see if there are errors.

With regards to the memory error, PHPSpreadsheet is a real memory hog. There may be something in your sheet that it causing excessive memory usage with current versions of PHPSpreadsheet. Try converting it to CSV and uploading that. Or send me the offending mapping and I'll see if I can figure out what is wrong.

LuCA

seth

Fix that worked now: Saving the xlsx mapping as csv and then converting it back to xlsx.
This fixed the upload mapping.

Further Information for anyone encountering the same problem.

I'd look in the logs
The apache2 logs? there is only the Error.

Try converting it to CSV and uploading that
After converting to CSV it displays: "Uploaded 0 worksheets; Skipped 1 worksheet" when trying to upload.
It does do the same on the CA 1.7 Server. (But on 1.7 it does add the mapping when it's a xlsx file, on 2.0.5 it gets stuck with the memory error when it's a xlsx file. [Before applying the fix to the xlsx file mentioned above])

LuCA

LuCA Correction: This fixed the ~~upload~~ export-mapping upload

LuCA

@seth Is it possible to edit this thread to remove the URL from the error log?