AI4CE Lab @ NYU

All

49 repositories

FusionSense
Public
Integrates the vision, touch, and common-sense information of foundational models, customized to the agent's perceptual needs.
robotics 3d-reconstruction tactile novel-view-synthesis tactile-sensor novel-viewpoint-synthesis tactile-perception tactile-sensing 3d-gaussian-splatting 3d-gaussian-splat
Python
•
Apache License 2.0
•1•21•0•0•Updated Nov 15, 2024Nov 15, 2024
SeeDo
Public
Human Demo Videos to Robot Action Plans
robotics learning-from-demonstration task-planning vlm
Python
•5•27•0•0•Updated Nov 14, 2024Nov 14, 2024
UNav-Server
Public
Python
•0•1•0•2•Updated Nov 7, 2024Nov 7, 2024
MSG
Public
[NeurIPS2024] Multiview Scene Graph (topologically representing a scene from unposed images by interconnected place and object nodes)
computer-vision deep-learning scene-graph multiview visual-navigation scene-representations neurips-2024
Python
•2•45•0•0•Updated Nov 6, 2024Nov 6, 2024
LoQI-VPR
Public
Python
•0•2•0•0•Updated Nov 4, 2024Nov 4, 2024
vis_nav_game_public
Public
Public version of vis_nav_game
Python
•
MIT License
•0•0•0•0•Updated Oct 23, 2024Oct 23, 2024
NYC-Event-VPR
Public
nyc dataset vpr nyc-opendata event-camera
Python
•0•9•0•0•Updated Oct 21, 2024Oct 21, 2024
LUWA
Public
computer-vision archeology anthropology ai4science large-vision-language-model
Jupyter Notebook
•0•2•0•0•Updated Oct 18, 2024Oct 18, 2024
vis_nav_player
Public
[ROB-GY 6203] Example Visual Navigation Player Code for Course Project
robotics visual-navigation
Python
•16•5•0•0•Updated Oct 12, 2024Oct 12, 2024
EgoPAT3Dv2
Public
[ICRA 2024] Official Implementation of EgoPAT3Dv2: Predicting 3D Action Target from 2D Egocentric Vision for Human-Robot Interaction
computer-vision robotics dataset human-robot-interaction human-robot-collaboration egocentric-vision
Python
•0•2•0•0•Updated Oct 10, 2024Oct 10, 2024
Occ4cast
Public
Occ4cast: LiDAR-based 4D Occupancy Completion and Forecasting
machine-learning computer-vision point-cloud artificial-intelligence dataset lidar autonomous-driving autonomous-vehicles occupancy-grid-map occupancy-prediction
Python
•
Apache License 2.0
•8•123•2•0•Updated Oct 8, 2024Oct 8, 2024
folder2hdf5
Public
A sample codebase for converting folder dataset to a hdf5 dataset
Python
•0•0•0•0•Updated Oct 5, 2024Oct 5, 2024
SSCBench
Public
SSCBench: A Large-Scale 3D Semantic Scene Completion Benchmark for Autonomous Driving
machine-learning computer-vision artificial-intelligence dataset autonomous-driving autonomous-vehicles occupancy-grid-map semantic-scene-understanding 2d-to-3d 3d-perception
Python
•11•176•10•0•Updated Sep 24, 2024Sep 24, 2024
realsense_ROS2_interface
Public
This package interfaces the robot/joystick with the realsense ROS2 wrapper
Python
•0•0•0•0•Updated Sep 20, 2024Sep 20, 2024
joy_hand_eye_ROS2
Public
This minimal package can be used to perform hand-eye-calibration in a ROS2 environment with a joystick
robotics hand-eye-calibration ros2
Python
•0•0•1•0•Updated Sep 20, 2024Sep 20, 2024
ur_ros2
Public
This package is some additions to the official UR ROS2 driver that enables teleoperation and some more visualization. Developed at AI4CE Lab at NYU.
robotics universal-robots ros2 teleoperation
Python
•0•0•1•0•Updated Sep 18, 2024Sep 18, 2024
xarm_ros2
Public
This package is the official xarm ROS2 package with modifications from AI4CE lab at NYU
robotics ros2 teleoperation xarm ufactory
Python
•0•0•0•0•Updated Sep 11, 2024Sep 11, 2024
insta360_ros_driver
Public
A ROS driver for Insta360 cameras, enabling real-time image capture, processing, and publishing in ROS environments.
driver ros webcam 360-camera insta360 insta360-one-x2 insta360-one-x3 insta360-sdk
Python
•
Apache License 2.0
•3•34•5•0•Updated Aug 29, 2024Aug 29, 2024
usbcam_ROS2_interface
Public
This package interfaces the robot/joystick with a USB cam
robotics ros2 usbcamera
Python
•0•0•0•0•Updated Aug 18, 2024Aug 18, 2024
ai4ce_robot_ROS2_drivers
Public
This repo contains all the ROS2 driver packages modified at AI4CE lab for working with various robots
robotics universal-robots ros2 ufactory
0•1•0•0•Updated Aug 10, 2024Aug 10, 2024
DeepMapping
Public
[CVPR2019 Oral] Self-supervised Point Cloud Map Estimation
mapping registration unsupervised-learning deep-learning point-cloud
Python
•
Other
•44•193•0•1•Updated Jul 25, 2024Jul 25, 2024
ai4ce_sensor_ROS2_interfaces
Public
This repo contains all the ROS2 packages developed at AI4CE lab for interfacing with various specialized sensors
robotics hand-eye-calibration sensors realsense ros2 tactile-sensor tactile-sensing gelsight gelsight-mini
0•0•0•0•Updated Jul 23, 2024Jul 23, 2024
UNav_demo
Public
Jupyter Notebook
•0•0•0•0•Updated Jul 22, 2024Jul 22, 2024
SPARE3D
Public
[CVPR2020] A Dataset for SPAtial REasoning on Three-View Line Drawings
reasoning spatial-reasoning line-drawings line-drawing pythonocc deep-learning
Python
•9•52•1•2•Updated Jul 18, 2024Jul 18, 2024
NYC-Indoor-VPR
Public
Python
•0•9•0•0•Updated Jul 5, 2024Jul 5, 2024
DeepMapping2
Public
[CVPR2023] DeepMapping2: Self-Supervised Large-Scale LiDAR Map Optimization
mapping lidar slam lidar-slam lidar-mapping training-as-optimization deepmapping large-scale-mapping
Python
•
MIT License
•17•157•0•1•Updated Jun 26, 2024Jun 26, 2024
LLM4VPR
Public
Can multimodal LLM help visual place recognition?
robotics visual-place-recognition vpr vision-and-language llm vision-language-model
Python
•1•30•0•0•Updated Jun 26, 2024Jun 26, 2024
MARS
Public
[CVPR2024] Multiagent Multitraversal Multimodal Self-Driving: Open MARS Dataset
dataset multiagent nerf self-driving multimodal-deep-learning collaborative-perception cvpr2024 3dgs coperception
Python
•0•42•2•0•Updated Jun 25, 2024Jun 25, 2024
DeepExplorer
Public
[RSS2023] Metric-Free Exploration for Topological Mapping by Task and Motion Imitation in Feature Space
visual-navigation embodied-ai visual-exploration topological-map habitat-sim task-and-motion-planning
Python
•
Apache License 2.0
•2•27•0•0•Updated Mar 18, 2024Mar 18, 2024
livox_ros_driver2
Public
Livox device driver under Ros(Compatible with ros and ros2), support Lidar HAP and Mid-360.
C++
•
Other
•230•0•0•0•Updated Feb 1, 2024Feb 1, 2024