Missing data

[PerpSearch]

I'm not sure you'll be able to replicate it because I've tried and haven't been able to.
I've been adding items and editing items and several times a week I check to see if everything is still there. It has been pretty sable since the last release anyway. I was just checking now and noticed an item that lost all data in 14 fields, but not the primary image nor the tags I had attached. The missing data fields were populated by choice list selections, a couple were just text entries, one date, one price, one rating, and one check box.
I checked the history and it shows "the item was created 2 weeks ago" and the container's been up since 05/15 with 1.5.9 running. I can easily replace the data as I back up the container twice a day, but I assumed you'd want to track it.

(edit) This was the only odd (and last) entry in the log file
[15-May-2024 16:39:57] NOTICE: PHP message: PHP Warning: Can't preload unlinked class Zenstruck\Foundry\Factory@anonymous: Unknown parent Zenstruck\Foundry\Factory in /var/www/koillection/vendor/zenstruck/foundry/src/functions.php on line 45

That said, the data was there yesterday.

[benjaminjonard]

Hello, it's weird because data fields other than select list are absolutely independent, nothing should be messing with them besides editing the related item.
If you have some time (or next time it happens), I'd like to check if the data is still there in the database and i'd like to see what the API responds when asked to return an item's data.

First off all, connect to the API by executing the following command (just replace "YOUR_KOILLECTION_INSTANCE_URL", "YOUR_USERNAME" and "YOUR_PASSWORD"

curl --request POST \
  --url https://YOUR_KOILLECTION_INSTANCE_URL/api/authentication_token \
  --header 'Content-Type: application/json' \
  --header 'accept: application/json' \
  --data '{
    "username": "YOUR_USERNAME",
    "password": "YOUR_PASSWORD"
}'

You should get a token in the answer (something like "eyJ0eXAiOiJKV1Q...mDTPA")

Then query the item's data, copy paste the previous token in place of "YOUR_TOKEN" and put your item id in place of "YOUR_ITEM_ID"

curl --request GET \
  --url https://YOUR_KOILLECTION_INSTANCE_URL/api/items/YOUR_ITEM_ID/data \
  --header 'Authorization: Bearer YOUR_TOKEN' \
  --header 'Content-Type: application/json' \
  --header 'accept: application/json' \
  --data '{
}'

If you can please copy paste the result here

Thanks !

[PerpSearch]

I am amazed I got as far as I did, but I ran into this so I presume I did something wrong

[PerpSearch]

. . . so assuming the Datum Identifier is the hash value or whatever I used it and got this

Which doesn't look right. Pretty interesting though.

[benjaminjonard]

You are close but you use the wrong endpoint. I think you are using /api/collections/{id}/data instead of /api/items/{id}/data

The id you should use is the item ID, you can find it in the URL when looking at the item page.
(something like that https://localhost/items/cac1ea23-a29b-461e-8f9c-b9b130d7a3e0 the ID would be cac1ea23-a29b-461e-8f9c-b9b130d7a3e0)

[PerpSearch]

Well, I just came up with 2 items missing data. I was able to follow your tutorial (I think) and have copied the response. This is what it looks like on my screen:

and the part you're looking for is attached.
response_1716954301695.json

Hope this helps and thanks for looking into it and let me know if there's anything else you need. I'm going to leave things they way they until you're done poking around.
Thanks again.

Charley

[benjaminjonard]

I won't be home for the next couple of days, I'll have a closer look when I'm back.
I just noticed that most of the data fields seem to have been updated at this date 2024-05-28 19:52:42. Do you remember doing anything on Koillection around that time ?

[PerpSearch]

I was working with it quite a bit yesterday, but I wasn't editing the items that were affected. I added a few things and edited a couple of other items, but the two that were affected I hadn't touched. I'm in no rush. I'm just happy I was able to follow your directions to report back. Chat later

[azuravian]

I'm a new user and this has been happening to me in real time. I have a collection with a template attached. I'm filling in entries. Every so often when I add one, after clicking submit and returning to the list view, a different one will have all of its data removed. The image below shows an example. I had added Majisto's Magical Workshop with all fields complete. I then added the Harry Potter & Cho Chang set and Majisto's row was as seen below.

Edit: Quick update, it just happened again. I added the Star Wars Diorama entry and immediately the Kingsley Shacklebolt entry (that was complete in the first image) is now clear of all data except name and images. Although not shown, there is a secondary image that is part of the template. That image also stays, but all other fields that are part of the template disappear.

[PerpSearch]

Interesting. Sounds like the problem I had a couple times, but I've been unable to replicate it.

[benjaminjonard]

Hello, I may have found the issue. Did you use the "Load common fields" feature ?

[azuravian]

I did not. I was utilizing Power Automate, but it is just operating as a scraper and then clicking the new item button and entering data in. Basically performing the same options I would do by hand. After it clicks the submit button and goes back to the collection screen, I'll immediately see the data missing. It also seems to be completely random as far as which entry is effected. For example, it's not necessarily the most recent previous entry.

[azuravian]

OK, I was able to run the commands you specified earlier. I'll post the returned json below. It looks like each field shows both the date it was created (yesterday) and has an updated date (a few minutes ago). The new entry has a creation date of very close to the updated date of the corrupted one, but they are about 9 seconds apart. Interestingly, 9 seconds is about how long the new entry page is open to fill in everything.

corrupted entry.json
new entry.json

[benjaminjonard]

The last release includes a fix for disappearing data fields. It would affect a random item within a collection when adding a new item, producing the same result as described here. Hopefully it will fix this issue