Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug in state and action prediction #53

Open
ezhang7423 opened this issue Jan 6, 2023 · 0 comments
Open

Bug in state and action prediction #53

ezhang7423 opened this issue Jan 6, 2023 · 0 comments

Comments

@ezhang7423
Copy link

Although decision transformer does not predict states or returns, if one were to add these losses the following prediction appears to be broken as the predict_return and predict_state projections do not take in the state, but only the action.

return_preds = self.predict_return(x[:,2]) # predict next return given state and action

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant