Hi enzo, since this evening (Sept 9, from about 19:40 CEST) every new Synth deployment of mine fails the same way. Build succeeds, runner starts, finds the class, “Setup successfully complete”, then the log stops and 4-5 minutes later the deployment is marked RUN_FAILED. No traceback at all. Deployments 21393, 21395, 21398 (high-sheep, model 17069) and 21394, 21396, 21397 (reliable-monkey, model 17076). To rule out my code I deployed the unmodified GaussianStepTracker example from crunch-synth as 21397, same result. My tracker also runs fine locally through crunch-model-runner 0.4.2 with the full 30-day tick. Now high-sheep submission 2 is IN_QUARANTINE because of those crashes. Could you check the runner side and lift the quarantine? I have uploaded submission 3 (identical code) and will not redeploy until you say it is safe. status.crunchdao.com also returns 502 right now. Thanks.
Hello Philipp,
Apologies for the very delayed response. Tracking down the issue was quite challenging, but after testing it for two days, everything looks stable now.
The quarantine only applies to submissions. If you resubmit the same submission, you will be able to deploy your model without issue.
We removed the status page since it didn’t provide much information anyway, and we only have the tournament platform now.