Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cuda is not available in the system. fall back to 'cpu' #686

Open
sirangisaicharangupta opened this issue Jan 6, 2025 · 3 comments
Open
Labels
help wanted Extra attention is needed question Further information is requested

Comments

@sirangisaicharangupta
Copy link

Question

Not Sure if its just me but i am not able use gpu for docling.
tried manually adding cuda as default in accerator as well no luck

Error
cuda is not available in the system. fall back to 'cpu'

@sirangisaicharangupta sirangisaicharangupta added the question Further information is requested label Jan 6, 2025
@cau-git
Copy link
Contributor

cau-git commented Jan 7, 2025

@sirangisaicharangupta Can you please provide more information on which environment and hardware you are running Docling?

@sirangisaicharangupta
Copy link
Author

(locally) Virtual environment - win10 enterprise , its a dell workstation
64gb RAM, NVDIA RTX A1000 6Gb Laptop GPU , Cuda compilation tools, release 12.5, V12.5.82 Build cuda_12.5.r12.5/compiler.34385749_0

@cau-git cau-git added the help wanted Extra attention is needed label Jan 9, 2025
@cau-git
Copy link
Contributor

cau-git commented Jan 9, 2025

Since we have no Windows setup with CUDA in our development team, I would be glad if anyone with such resources could confirm this and help debug.

To provide some basic context, please provide the response of torch.cuda.is_available() in your environment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants