Skip to content

william-Dic/ErrGAN

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ErrGAN: Error Recognition and Intention Guided GAN

Overview

ErrGAN is a novel approach designed to detect and fix errors in imitation learning tasks. By leveraging Generative Adversarial Networks (GANs), this framework not only identifies errors but also backtracks to pinpoint the root cause and correct it using an intention-guided mechanism.

The framework consists of two main components:

  1. V_GAN: Discriminator that evaluates the value of the current trajectory using state sequences, image sequences, and language embeddings.
  2. Q_GAN: Generator that predicts the optimal action for the current trajectory based on state sequences, image sequences, and language embeddings.

Workflow

  1. Error Detection: The discriminator (V_GAN) identifies errors in the trajectory.
  2. Backtracking: The system backtracks 20 steps before the detected error to understand the error intention and its root cause.
  3. Intention-Guided Correction: The generator (Q_GAN) proposes corrective actions to guide the trajectory back on track.

Visual Examples

Intention Guided

Intention Guided

Error + Backtracking

Error + Backtracking

About

ErrGAN used on imitation learning

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published