Task Queue Process script Error

Laith2001

In version 1.8, I have enabled the Task Queue on app.conf, and setup a cron job for processing the queue
* * * * * php /var/www/html/ca/support/bin/caUtils process-task-queue
Where do you insert the FTP user details to the program?

when the process-task-queue runs it gives this error:

PHP Warning:  ftp_put(): Could not create file. in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 148
PHP Warning:  Illegal string offset 'MIRROR_STATUS' in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 180
PHP Warning:  Illegal string offset 'MIRROR_STATUS' in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 180
PHP Warning:  Illegal string offset 'MIRROR_STATUS' in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 181
PHP Fatal error:  Uncaught Error: Cannot use string offset as an array in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php:181
Stack trace:
#0 /var/www/html/ca/app/lib/TaskQueue.php(328): WLPlugTaskQueueHandlerftpmirror->process()
#1 /var/www/html/ca/app/lib/Utils/CLIUtils/Cron.php(46): TaskQueue->processQueue()
#2 /var/www/html/ca/support/bin/caUtils(170): CLIUtils::process_task_queue()
#3 {main}
  thrown in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 181

monica

looks like you have set up ftpmirror in media_volume.conf. Not even sure that works in version 1.8

Laith2001

since the images are on the server itself, is there a way to not use ftp?

monica

Laith2001 Did you set up the mirror in media_volume.conf? unless you have a second server somewhere that you want to mirror your media, then you don't need this. If you do want to mirror your media to another server, then you will need it.

Laith2001

no I didnt want to send the images to another server
I just wanted to make sure the large images are being processed in the background instead of waiting for it to finish uploading

and the task queue kept asking for the ftp

monica

Laith2001 Did you edit the file media_volumes.conf in the app/conf directory? OR is there a file called media_volumbers.conf in the app/conf/local directory?

Laith2001

I tried the task queue and it failed, then
in app/conf/media_volumes.conf
I uncommented the accessUsingMirror and the my_mirror, and filled the variables with ftp variables.
then tried the task queue again and it failed with the error in the first message

monica

Laith2001 Put media_volumes.conf back to the way it was. It is not going to help your issue. And in future only do changes to .conf files inside the app/conf/local directory (Same file name with only the changes you want to override in the original conf changes), this will preserve your changes when you upgrade.

Once the media_volumes.conf file is back to the way it should be, then let us know the error it is throwing.

I also suggest you add the processing status widget to your dashboard so you can see the status of any background tasks.

Laith2001

when i try to add the widget, the page becomes dashboard without css, and doesn't add the widget.

I have put the media_volume.conf back as it was and tried
php /var/www/html/ca/support/bin/caUtils process-task-queue
got the same error

CollectiveAccess 1.8 (174/GIT) Utilities
(c) 2013-2021 Whirl-i-Gig

Processing queued tasks...
PHP Warning:  ftp_put(): Could not create file. in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 148
PHP Warning:  Illegal string offset 'MIRROR_STATUS' in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 180
PHP Warning:  Illegal string offset 'MIRROR_STATUS' in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 180
PHP Warning:  Illegal string offset 'MIRROR_STATUS' in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 181
PHP Fatal error:  Uncaught Error: Cannot use string offset as an array in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php:181
Stack trace:
#0 /var/www/html/ca/app/lib/TaskQueue.php(328): WLPlugTaskQueueHandlerftpmirror->process()
#1 /var/www/html/ca/app/lib/Utils/CLIUtils/Cron.php(46): TaskQueue->processQueue()
#2 /var/www/html/ca/support/bin/caUtils(170): CLIUtils::process_task_queue()
#3 {main}
  thrown in /var/www/html/ca/app/lib/Plugins/TaskQueueHandlers/ftpmirror.php on line 181

monica

Laith2001 clear caches and restart services. Look for errors in app/log files

Laith2001

I used php /var/www/html/ca/support/bin/caUtils clear-caches
log for 2025-03-03.txt

2025-03-03 0:01:01 - DEBUG --> Executing command: '/usr/bin/ffmpeg> /dev/null 2>&1'
2025-03-03 0:01:01 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 0:01:01 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 0:01:01 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 0:40:02 - DEBUG --> Executing command: '/usr/bin/gs -v 2> /dev/null'
2025-03-03 0:56:02 - DEBUG --> Executing command: '/usr/bin/mediainfo --Help > /dev/null'
2025-03-03 0:56:02 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 0:56:02 - DEBUG --> Executing command: '/usr/bin/identify 2> /dev/null'
2025-03-03 0:56:02 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 1:33:01 - DEBUG --> Executing command: '/usr/bin/ffmpeg> /dev/null 2>&1'
2025-03-03 1:33:01 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 1:33:01 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 1:53:01 - DEBUG --> Executing command: '/usr/bin/mediainfo --Help > /dev/null'
2025-03-03 1:53:01 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 1:53:01 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 1:53:01 - DEBUG --> Executing command: '/usr/bin/gs -v 2> /dev/null'
2025-03-03 2:31:02 - DEBUG --> Executing command: '/usr/bin/ffmpeg> /dev/null 2>&1'
2025-03-03 2:31:02 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 2:31:02 - DEBUG --> Executing command: '/usr/bin/identify 2> /dev/null'
2025-03-03 2:31:02 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 3:28:01 - DEBUG --> Executing command: '/usr/bin/ffmpeg> /dev/null 2>&1'
2025-03-03 3:28:01 - DEBUG --> Executing command: '/usr/bin/mediainfo --Help > /dev/null'
2025-03-03 3:28:01 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 3:28:01 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 3:28:01 - DEBUG --> Executing command: '/usr/bin/identify 2> /dev/null'
2025-03-03 3:28:01 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 3:28:01 - DEBUG --> Executing command: '/usr/bin/gs -v 2> /dev/null'
2025-03-03 3:28:01 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 4:25:01 - DEBUG --> Executing command: '/usr/bin/mediainfo --Help > /dev/null'
2025-03-03 4:25:02 - DEBUG --> Executing command: '/usr/bin/identify 2> /dev/null'
2025-03-03 4:25:02 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 4:25:02 - DEBUG --> Executing command: '/usr/bin/gs -v 2> /dev/null'
2025-03-03 4:25:02 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 4:38:02 - DEBUG --> Executing command: '/usr/bin/ffmpeg> /dev/null 2>&1'
2025-03-03 4:38:02 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 4:38:02 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 5:19:01 - DEBUG --> Executing command: '/usr/bin/mediainfo --Help > /dev/null'
2025-03-03 5:19:01 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 6:18:02 - DEBUG --> Executing command: '/usr/bin/ffmpeg> /dev/null 2>&1'
2025-03-03 6:18:02 - DEBUG --> Executing command: '/usr/bin/mediainfo --Help > /dev/null'
2025-03-03 6:18:02 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 6:18:02 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 6:18:02 - DEBUG --> Executing command: '/usr/bin/identify 2> /dev/null'
2025-03-03 6:18:02 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 6:18:02 - DEBUG --> Executing command: '/usr/bin/gs -v 2> /dev/null'
2025-03-03 6:18:02 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 7:14:02 - DEBUG --> Executing command: '/usr/bin/ffmpeg> /dev/null 2>&1'
2025-03-03 7:14:02 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 7:14:02 - DEBUG --> Executing command: '/usr/bin/identify 2> /dev/null'
2025-03-03 7:14:02 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 7:14:02 - DEBUG --> Executing command: '/usr/bin/gs -v 2> /dev/null'
2025-03-03 7:14:02 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 8:06:01 - DEBUG --> Executing command: '/usr/bin/ffmpeg> /dev/null 2>&1'
2025-03-03 8:06:01 - DEBUG --> Executing command: '/usr/bin/mediainfo --Help > /dev/null'
2025-03-03 8:06:02 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 8:06:02 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 8:06:02 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 8:10:02 - DEBUG --> Executing command: '/usr/bin/identify 2> /dev/null'
2025-03-03 9:05:01 - DEBUG --> Executing command: '/usr/bin/ffmpeg> /dev/null 2>&1'
2025-03-03 9:05:01 - DEBUG --> Executing command: '/usr/bin/mediainfo --Help > /dev/null'
2025-03-03 9:05:01 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 9:05:01 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 9:05:01 - DEBUG --> Executing command: '/usr/bin/identify 2> /dev/null'
2025-03-03 9:05:01 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 9:05:01 - DEBUG --> Executing command: '/usr/bin/gs -v 2> /dev/null'
2025-03-03 9:05:01 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 10:58:02 - DEBUG --> Executing command: '/usr/bin/mediainfo --Help > /dev/null'
2025-03-03 10:58:02 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 10:58:02 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 10:58:02 - DEBUG --> Executing command: '/usr/bin/identify 2> /dev/null'
2025-03-03 10:58:02 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 11:40:02 - DEBUG --> Executing command: '/usr/bin/gs -v 2> /dev/null'
2025-03-03 11:40:02 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'
2025-03-03 11:51:02 - DEBUG --> Executing command: '/usr/bin/gm 2> /dev/null'
2025-03-03 11:51:02 - DEBUG --> Executing command: '/usr/bin/dcraw -i 2> /dev/null'
2025-03-03 12:37:02 - DEBUG --> Executing command: '/usr/bin/libreoffice --version 2> /dev/null'
2025-03-03 12:37:02 - DEBUG --> Executing command: '/usr/bin/gs -v 2> /dev/null'
2025-03-03 12:37:02 - DEBUG --> Executing command: '/usr/bin/pdftotext -v 2> /dev/null'

still same error when i try process-task-queue

Laith2001

I was looking at the app.conf, and found that background_process_mode is missing.
does 1.8 not support background processing?

seth

Please update to the current version. The 1.8 version you're using is very out of date. It does not include background_process_mode - that was added later.

With regards to ftpmirror, that feature was added 10+ years ago and isn't in active use for some time. It hasn't been on our testing program for a while now; we'll take a look at the errors you have reported this week.

Laith2001

I will let my supervisors know that we need to update.
thank you