Task 5459264

Name	RF_SAVE_ALL_OUT_NOJRAN_IGNORE_THE_REST_validation_env_f_pred_228_16902_6_1
Workunit	4847986
Created	13 Jun 2024, 6:45:40 UTC
Sent	13 Jun 2024, 9:03:38 UTC
Report deadline	14 Jun 2024, 9:03:38 UTC
Received	13 Jun 2024, 15:02:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	12 (0x0000000C) Unknown error code
Computer ID	49793
Run time	4 hours 58 min 19 sec
CPU time	42 min 17 sec
Validate state	Invalid
Credit	0.00
Device peak FLOPS	4.33 GFLOPS
Application version	Generalized biomolecular modeling and design with RoseTTAFold All-Atom v0.02 (nvidia_alpha) windows_x86_64
Peak working set size	2,921.95 MB
Peak swap size	8,846.80 MB
Peak disk usage	2.10 MB

Stderr output

<core_client_version>8.0.2</core_client_version> <![CDATA[ <message> The access code is invalid. (0xc) - exit code 12 (0xc)</message> <stderr_txt> CreateToolhelp32Snapshot failed CreateToolhelp32Snapshot failed CreateToolhelp32Snapshot failed CreateToolhelp32Snapshot failed CreateToolhelp32Snapshot failed CreateToolhelp32Snapshot failed fatal : Memory allocation failure CreateToolhelp32Snapshot failed Traceback (most recent call last): File "C:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\predict.py", line 708, in <module> pred.predict(out_name+f'_{n}', File "C:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\predict.py", line 514, in predict t2d = xyz_to_t2d(xyz_t_frames, mask_t_2d) File "C:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\kinematics.py", line 89, in xyz_to_t2d c6d = xyz_to_c6d(xyz_t[:,:,:,:3].view(B*T,L,3,3), params=params) File "C:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\kinematics.py", line 71, in xyz_to_c6d dist = get_pair_dist(Ca,Ca) File "C:\ProgramData\BOINC\projects\ralph.bakerlab.org\cv2\rf2aa\kinematics.py", line 21, in get_pair_dist dist = torch.cdist(a, b, p=2) File "C:\ProgramData\BOINC\projects\ralph.bakerlab.org\ev0\lib\site-packages\torch\functional.py", line 1049, in cdist return _VF.cdist(x1, x2, p, None) # type: ignore[attr-defined] RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling `cublasCreate(handle)` </stderr_txt> ]]>