Task 5459577

Name	RF_SAVE_ALL_OUT_NOJRAN_IGNORE_THE_REST_validation_env_f_pred_256_16902_2_1
Workunit	4848127
Created	13 Jun 2024, 8:36:06 UTC
Sent	13 Jun 2024, 10:19:48 UTC
Report deadline	14 Jun 2024, 10:19:48 UTC
Received	13 Jun 2024, 11:32:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	12 (0x0000000C) Unknown error code
Computer ID	43234
Run time	1 hours 6 min 20 sec
CPU time
Validate state	Invalid
Credit	0.00
Device peak FLOPS	3.38 GFLOPS
Application version	Generalized biomolecular modeling and design with RoseTTAFold All-Atom v0.02 (nvidia_alpha) windows_x86_64
Peak working set size	3,456.07 MB
Peak swap size	8,728.49 MB
Peak disk usage	2.09 MB

Stderr output

<core_client_version>7.24.1</core_client_version> <![CDATA[ <message> The access code is invalid. (0xc) - exit code 12 (0xc)</message> <stderr_txt> fatal : Memory allocation failure Traceback (most recent call last): File "B:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\predict.py", line 708, in <module> pred.predict(out_name+f'_{n}', File "B:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\predict.py", line 514, in predict t2d = xyz_to_t2d(xyz_t_frames, mask_t_2d) File "B:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\kinematics.py", line 89, in xyz_to_t2d c6d = xyz_to_c6d(xyz_t[:,:,:,:3].view(B*T,L,3,3), params=params) File "B:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\kinematics.py", line 71, in xyz_to_c6d dist = get_pair_dist(Ca,Ca) File "B:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\kinematics.py", line 21, in get_pair_dist dist = torch.cdist(a, b, p=2) File "B:\ProgramData\BOINC\projects\ralph.bakerlab.org\ev0\lib\site-packages\torch\functional.py", line 1049, in cdist return _VF.cdist(x1, x2, p, None) # type: ignore[attr-defined] RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling `cublasCreate(handle)` </stderr_txt> ]]>