Submission Failed Crunch 2

When trying to submit via Crunch 2, I’m getting Disk full error. The code runs succesfully on Local PC.

Running pip… Toggle ‘Show advanced logs’ in order to see more details
fixing gpu requirements…
downloading data…
/context/data/obesity_challenge_2.h5ad.zip: download from https:crunchdao–competition–production.s3-accelerate.amazonaws.com/data-releases/221/obesity_challenge_2.h5ad.zip (1664230640 bytes)
/context/data/obesity_challenge_2.h5ad.zip: uncompress into /context/data/obesity_challenge_2.h5ad.zip.fbmx8fvu
/context/data/predict_perturbations_2.txt: download from https:crunchdao–competition–production.s3-accelerate.amazonaws.com/data-releases/221/predict_perturbations_2.txt (727 bytes)
/context/data/predict_genes_2.txt: download from https:crunchdao–competition–production.s3-accelerate.amazonaws.com/data-releases/221/predict_genes_2.txt (307959 bytes)
/context/data/obesity_challenge_2_local_gtruth.h5ad.zip: download from https:crunchdao–competition–production.s3-accelerate.amazonaws.com/data-releases/221/obesity_challenge_2_local_gtruth.h5ad.zip (226734138 bytes)
/context/data/obesity_challenge_2_local_gtruth.h5ad.zip: uncompress into /context/data/obesity_challenge_2_local_gtruth.h5ad.zip.ylf03lau
/context/data/obesity_challenge_2_local_gtruth.h5ad.zip.ylf03lau/obesity_challenge_2_local_gtruth.h5ad: write error (disk full?). Continue? (y/n/^C)
warning: /context/data/obesity_challenge_2_local_gtruth.h5ad.zip.ylf03lau/obesity_challenge_2_local_gtruth.h5ad is probably truncated
Traceback (most recent call last):
File “”, line 198, in _run_module_as_main
File “”, line 88, in _run_code
File “/usr/local/lib/python3.11/dist-packages/crunch/_main_.py”, line 3, in
cli()
File “/usr/local/lib/python3.11/dist-packages/click/core.py”, line 1485, in _call_
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/click/core.py”, line 1406, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/click/core.py”, line 1873, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/click/core.py”, line 1873, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/click/core.py”, line 1269, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/click/core.py”, line 824, in invoke
return callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/crunch/cli.py”, line 735, in cloud
runner.start()
File “/usr/local/lib/python3.11/dist-packages/crunch/runner/cloud.py”, line 161, in start
super().start()
File “/usr/local/lib/python3.11/dist-packages/crunch/runner/runner.py”, line 37, in start
) = self.initialize()
^^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/crunch/runner/cloud.py”, line 286, in initialize
self.prepare_data()
File “/usr/local/lib/python3.11/dist-packages/crunch/runner/cloud.py”, line 806, in prepare_data
file_paths = save_all(
^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/crunch/downloader.py”, line 189, in save_all
save_one(data_file, force, print, progress_bar)
File “/usr/local/lib/python3.11/dist-packages/crunch/downloader.py”, line 158, in save_one
_uncompress(file_path, temporary_directory_path)
File “/usr/local/lib/python3.11/dist-packages/crunch/downloader.py”, line 235, in _uncompress
raise zipfile.BadZipFile(f"unzip failed with code: {return_code}")
zipfile.BadZipFile: unzip failed with code: 50
Changed status: CLEANING

The error seems to be problem from Crunch side. Please resolve this error.

I am also getting the same error while submission. Please look into it.

Thanks for reporting the issue, I suggest you use the Legacy GPU runs for now. Investigating is taking way longer than expected.

Alright, the runs worked with legacy GPU, but the issue is the time for this week checkpoint got over, before we got your reply. Can you please let the score update based on the runs. This will really helpful for further tuning the models.

That fair.

Run ID L1-Distance MMD Pearson Delta
68899 0.119 0.082 0.063
69142 0.117 0.079 0.045

Thanks for this, but my run ID is different. #70225

Thankyou for your reply. By my run ID is: Run #70223. Could you give our scores for these runs?

You are right, sorry, I somehow use the wrong user.

Run ID L1-Distance MMD Pearson Delta
70225 0.182 0.190 0.135
Run ID L1-Distance MMD Pearson Delta
70223 0.160 0.120 0.094