Updating instertitial fields running an import

rahenrique

Hi everyone!

Is the existing record policy intended to update fields inside interstitial of relationships? We have a lot of records with relationships containing interstitial data. All of this info was successfully imported, with no problem. But now, we found some errors in the interstitial fields of some of these records (with various relationship types, between various authorities), so our strategy is to run again the importer, with only the data needed to be updated.

But it seems the data inside the insterstitial of relationships is not being updated. 

For the sake of a test, we run another update with just a regular entity field to be updated, and it worked. This problem is just occurring when updating interstitial fields. Any advice?

Attached is our mapping and a sample data.

Running Providence v1.6.3

Thanks in advance,

Rafael Henrique

Julia

What does the debug log say? What happens if you remove dontCreate?

rahenrique

The debug log says:

2017-03-27 11:54:32 - INFO --> Started import of C:\wamp64\tmp\phpCAB9.tmp using mapping mapping_3003 2017-03-27 11:54:32 - DEBUG --> Finished reading input source at 0.0544 seconds 2017-03-27 11:54:32 - DEBUG --> Found 2 rows in input source 2017-03-27 11:54:32 - DEBUG --> Finished analyzing mapping at 0.0588 seconds 2017-03-27 11:54:32 - DEBUG --> Skipped initial row 0 of 1 2017-03-27 11:54:32 - DEBUG --> Started reading row 2 at 0.0000 seconds 2017-03-27 11:54:32 - INFO --> [ent_caciporetorres] Merged with existing record matched on identifer by policy merge_on_idno_with_replace 2017-03-27 11:54:32 - DEBUG --> Finished building content tree for ent_caciporetorres at 0.0548 seconds [2] 2017-03-27 11:54:32 - DEBUG --> Content tree is Array ( [ca_occurrences] => Array ( [0] => Array ( [_type] => event [idno] => Array ( [idno] => ev_21biendesaopaul_1722 ) [_interstitial] => Array ( [ocurrencexentity_entityrole] => entrole_medacotedear_ct [ocurrencexentity_notes] => [ocurrencexentity_curatorplace] => ) [_interstitial_table] => ca_entities_x_occurrences [_relationship_type] => comissao [preferred_labels] => Array ( [name] => ev_21biendesaopaul_1722 ) [_matchOn] => Array ( [0] => idno ) [_dontCreate] => 1 [_errorPolicy] => ignore ) ) )

the line: [ocurrencexentity_entityrole] => entrole_medacotedear_ct seems to have no effect. The relationship is there, with no interstitial data.

Removing dontCreate for the mapping also does not have any effect here, because all of the related occurrences already exists. We put it in there in the first place to prevent any non-existant occurrence to be created by this import. We have another mapping and datasheet for creating occurrences (we believe this was the secure way to do it, in case we had any errors in our mappings and data).

Julia

And you mentioned the mapping works for other existingRecordPolicies? Sounds like an issue on our end. Could you create a JIRA for this and assign it to me? http://clangers.collectiveaccess.org/jira

rahenrique

Created! 

<font face="Arial, Verdana">http://clangers.collectiveaccess.org/jira/browse/PROV-2060</span></font><br/></div><div style="font-family: Arial, Verdana; font-size: 10pt; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal;">But it seems to be assigned to Seth, sorry... How can I change it?

Thanks, Julia!

For now, we just reverted our database to a previous version without the relationships, and imported all the relationships with the interstitial data in one run.

Julia

Ok, thank you!

jeffschneider

Is it possible to update interstitial data via an import?

I am in the same situation as the original poster - initial importing of adding interstitial data was fine, but now I need to update it and it doesn't take.

The mapping is below, with the source pointing to the ID of the entity, and it is set to merge_on_idno_with_replace

Mapping 2 ca_entities entitySplitter {"relationshipType": "depicted", "entityType" : "individuals","delimiter": ";",“interstitial”: {“rectangle_coords”: “^3”}}

mbutel

Which version are you using? I've had trouble updating records in general in 1.8

jeffschneider

dev/php8 branch from May 2024

Updating records in general is fine on my end when using merge_on_idno_with_replace.
The interstitial is not working

I noticed that if I manually remove the related entities for a record and then run the import, it re-adds the entity with the interstitial data. I would go with this but I don't know how to bulk remove related entities to begin the process. It doesn't seem possible via an import update. I tried doing this through a set where there was an option to remove all related entities, but that didn't work.