Error with Emoji in PDF

tns_jd

We are trying to add a PDF that has an emoji in it (😂). We get the same error through the import media function as well as the add representation function:
"Incorrect string value: '\xF0\x9F\x98\x82.\x0A...' for column 'media_content' at row 1 in /collectiveaccess/pawtucket-dev/admin/app/lib/Db/mysqli.php line 316:" I've copied the full error message below. It seems to be affecting the media_content column of the ca_object_representations table.

I've checked the DB, table, column, and connection variables; they are set to utf8mb4 and the collation is utf8mb4_unicode_ci. I've tried several other utf8mb4 collations and I still get the same error. If I remove the emoji from the PDF, it works fine. I can also manually update the media_content value with the emoji using the MySQL8 cli and it will appear fine in the DB. So it seems MySQL on the server is fine with the emoji, but it's something in between that causing issues. The default charset for php is set to utf-8.

Any idea of where to look next? Thanks!

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
In Db_mysqli->execute() in DbStatement line 151

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At DbStatement->executeWithParamsAsArray() in Db line 261

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At Db->query() in BaseModel line 2652

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At BaseModel->insert() in BaseModelWithAttributes line 508

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At BaseModelWithAttributes->insert() in BundlableLabelableBaseModelWithAttributes line 256

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At BundlableLabelableBaseModelWithAttributes->insert() in ca_object_representations line 414

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At ca_object_representations->insert() in RepresentableBaseModel line 570

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At RepresentableBaseModel->addRepresentation() in BundlableLabelableBaseModelWithAttributes line 4151

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At BaseEditorController->Save() in RequestDispatcher line 273

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At RequestDispatcher->dispatch() in AppController line 113

Warning: join(): Invalid arguments passed in /collectiveaccess/pawtucket-dev/admin/themes/default/views/system/fatal_error_html.php on line 52
At AppController->dispatch() in index line 120

seth

You'll need to make sure both the database and each table is set to use the character set utf8mb4 and collation utf8mb4_general_ci

The SQL to do this for the database is:

ALTER DATABASE$DBCHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci;

Where $DB is your database name.

For the tables:
ALTER TABLE$TABLECONVERT TO CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci;

Where $TABLE is a given table name. You'd best automate this with a shell script.

tns_jd

I made all tables and columns utf8mb4 and was still getting the same error. To eliminate other potential issue, I made a completely fresh install and initiated a new DB using the collective access installer and the test DB schema. I then converted this to utf8mb4 and confirmed that by reading through the SQL file dump of the new database. I'm still getting the same error with the new instance and DB when trying to upload a PDF with emoji. Where else can I look?

seth

Try uploading the PDF to the demo at https://demo.collectiveaccess.org
Does it work there? If not then please send me the PDF. If so, then there's something with your database.