Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

the minimum and recommended hardware requirements for deployment #15

Open
John23336666 opened this issue Jan 25, 2025 · 1 comment
Open

Comments

@John23336666
Copy link

First of all, thank you for your incredible work on this project! I appreciate the time and effort you have put into making this project accessible to the community.

Does this project use large models running locally, or does it use APIs?

Given the condition of using ai large models running locally, I have the following questions.
Could you kindly suggest the minimum and recommended hardware requirements for deployment on a wheeled robot and in the simulation respectively, including recommendations for GPU memory, RAM, and CPU? Could it run on GPU lower than 4090? Your guidance would be extremely helpful in determining the optimal hardware configuration.

Once again, thank you for your incredible work and support. It’s a privilege to learn from your contributions!

@GengzeZhou
Copy link
Owner

This project utilizes OpenAI's APIs.

For local deployment with open-source models, it is recommended to explore VLN-specialized models, typically lightweight transformers with fewer than 200M parameters, which are capable of running on a 2080 GPU. However, further research and design considerations are necessary to address the sim-to-real gap effectively.

For LLM-based models, it is advisable to deploy them on a server and establish communication with the terminal robot, as most current research relies on 7B models without quantization.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants