Error in submission upload SyntaxError: "undefined" is not valid JSON

[gifale95]

Hello,

I am one of the organizers of competition 4313. Since March 9, we get the following error when uploading a submission:

Error in submission upload SyntaxError: "undefined" is not valid JSON

Nothing changed in the scoring step, or in the setting of the competition, and the error also occurs for the same submission files that have been previously working.

Could you help us in this?

Thank you,
Ale

[ihsaan-ullah]

Hi @gifale95,

Can you provide more information:

• Are you the only one getting this error?
• Can you attach a file the leads to this error

[gifale95]

Hi @ihsaan-ullah

The error was reported by some participants of competition 4313, and I could also reproduce it myself. The submission file is quite large (~320 MB), and you can download it from Google Drive at:

https://drive.google.com/file/d/1kmrv1kYzFjaCnsJeiSLzrx0wH-4bHOnT/view?usp=sharing

(btw, submissions with this very same file have been working until we noticed the error a few days ago).

[ihsaan-ullah]

I tried the following:

• Your file without any change -> Got the same error
• Another file Iris submission -> No error
• Uploaded your file but changed the file name -> No error

Can you try with renaming your file to check if you get any error?

+

The error is not informative and needs improvement

[gifale95]

I uploaded the file changing the name to aaa.zip, and still got the error. Were you just renaming the zip file to aaa.zip, or did you unzip it first, renamed the unzipped file, and then zipped it again? And if the latter, which procedure did you use for zipping the file?

[stomfaig]

I have the same error with a ~20MB file. Tried changing file name (to aaa.zip, iris_submission.zip among others), still not working. It seems though, that the upload is interrupted at different points, i.e. sometimes right away, sometimes halfway through uploading the submission.

[ihsaan-ullah]

I think this is some kind of network interruption. Showing the real error will give us more clues.

@ObadaS can we check the logs to see if we can catch any error?

[ObadaS]

I would need to be able to reproduce the problem to get logs. I tried to reproduce it but uploading the file worked correctly on my end.

We also have not changed anything on March 9, so I'm not sure why the problem would start appearing then.

[gifale95]

@ObadaS did you upload the file I linked above (https://drive.google.com/file/d/1kmrv1kYzFjaCnsJeiSLzrx0wH-4bHOnT/view?usp=sharing) without any name edits?

When uploading this file, I still get the same error:

Error in submission upload SyntaxError: "undefined" is not valid JSON

Do you have a list of the conditions that lead to this error being raised?

[ObadaS]

Yes, although I did not try in your competition specifically, but a test one I made locally. If it's Ok with you, I can sign up to your competition and submit this file to see if it also works correctly on my end or not.

[gifale95]

@ObadaS yes, I would appreciate it if you could sign up and test the file submission.

[ObadaS]

So, after joining the competition and trying to upload the file you provided, I get this error (which seems to be different from the one you are getting)

Renaming the file also does not seem to work.
Unfortunately, this particular problem seems to produce no logs, which does not help us understand the problem better.

[gifale95]

Do you know what JSON files the error is referring to? The zipped submission doesn't include JSON files, so I guess it must be some file internal to Codabench that is used by default during each submission?

[ihsaan-ullah]

Don't get confused by the error, the error is not showing the problem with the submission. It shows a problem in parsing the error that is coming from the backend. From the browser network tab I can just see that there is a 500 error occuring

[gifale95]

I see. What steps can then be taken to understand why the error arises, and how to fix it? Obviously this is rather urgent, as as we are in the middle of an ongoing competition.

[ObadaS]

I did some more tests. I keep trying to submit the file, and it does fail at different % uploaded.
I also tried to reduce the file size to 50 MB, it seems to succeed more often (but still fails a lot) when trying to upload it.