CET is stuck
For our latest CET run, the CET has completed validation and QC, but has been stuck processing the output since last Friday.
- Select the module in CEDARS
- Select user type
For our latest CET run, the CET has completed validation and QC, but has been stuck processing the output since last Friday.
Log in to comment and vote
Comments8
Kevin Truong (TEC)
Jul 6
I forgot to add but wanted to clarify and document here: this is specifically for staging. The CET module in production has been functioning without any issues since I submitted this ticket.
Derya Gumustel
Jul 6
Hi @Kevin Truong (TEC), is there a reason you’re doing this run on staging/cedars-2 instead of production? It looks like the queue for cedars-2 got a little backed up, I’m trying to get files to process now but I’m not sure how long it’ll take.
Kevin Truong (TEC)
Jul 6
I’ve defaulted to running the CET in CEDARS-2 for the past couple of weeks for the avoided cost update, but since that has also been updated in production, I was able to get what I needed there.
Derya Gumustel
Jul 6
Great, in that case I’m going to close this ticket as complete. Thank you and let us know if you have any other trouble with CET runs!
cedars team
Jul 6
Hi @BayREN_TEC ,
Job ID 118575 appears to be stuck on the CET side. This may be related to the recent clone to cedars-2 that was done on Friday.
Could you please cancel the job and reupload it when you have a chance?
Thank you,
Erika
Kevin Truong (TEC)
Jul 6
Hello, I’ve canceled Job 118575 and reuploaded as Job 118576 about a couple hours ago. Similarly, it has validated and passed QC, but is still processing the output.
Derya Gumustel
Jul 6
Hi @Kevin Truong (TEC)@BayREN_TEC, thanks for your patience on this one. It looks like cedars-2 fell behind of recent updates to production and the default CET run settings were out of sync with what the CET was expecting, causing runs on cedars-2 to get stuck without ever completing. I’ve updated the default run parameters on cedars-2, so new runs should now complete. Please give it one more try and I’ll keep an eye on it from our side.
Kevin Truong (TEC)
Jul 6
I started a new run, and that finished processing outputs without any issues. Thanks everyone for reviewing this!