Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
shaoanlu committed Apr 25, 2024
1 parent 06f1c2f commit ecfb10e
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 1 deletion.
9 changes: 8 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,8 @@
This repository provides a demonstration of imitation learning using a diffusion policy. The implementation is adapted from the official Diffusion Policy [repository](https://github.com/real-stanford/diffusion_policy).

## Result
The animation shows the denoising process of the diffusion policy predicting future trajectory and applying actions.

<img src="assets/result_anim.gif" alt="drawing" width="380"/> <img src="assets/result_plot.png" alt="drawing" width="370"/>


Expand All @@ -14,4 +16,9 @@ The program was developed and tested in the following environment.
- `diffusers==0.18.2`
- `torchvision==0.14.1`
- `gdown` (to download pre-trained weights)
- `joblib` (format of training data)
- `joblib` (format of training data)

## Diffusion policy
The policy takes 1) the latest N step of observation (position and velocity) and 2) encoding of obstacle information (7x7 grid with obstacle radius as values) as input and outputs N steps of actions (future position and future velocity).

<img src="assets/model_input.jpg" alt="drawing" width="480"/>
Binary file added assets/model_input.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit ecfb10e

Please sign in to comment.