Issues

• Possible bug: pg_fisher_loss = -action_log_probs.mean()

  ikostrikov/pytorch-a2c-ppo-acktr-gail#304 · Filter by author mingfeisun opened on Dec 29, 2025

• ACKTR - Support max_grad_norm

  ikostrikov/pytorch-a2c-ppo-acktr-gail#303 · Filter by author CVHvn opened on Jun 23, 2025

• KFAC - torch.symeig - Torch version & Possible bug

  ikostrikov/pytorch-a2c-ppo-acktr-gail#302 · Filter by author CVHvn opened on Jun 23, 2025

• a2c_ppo_acktr /storage.py self.returns[step] is wrong

  ikostrikov/pytorch-a2c-ppo-acktr-gail#301 · Filter by author fatalfeel opened on Jun 4, 2025

• assert error

  ikostrikov/pytorch-a2c-ppo-acktr-gail#299 · Filter by author linyufeishi opened on Dec 31, 2024

• Updates: Support the latest Atari environment and state entropy maximization-based exploration.

  ikostrikov/pytorch-a2c-ppo-acktr-gail#296 · Filter by author friedrichyuan opened on May 28, 2022

• Why didn't run to generate log?

  ikostrikov/pytorch-a2c-ppo-acktr-gail#294 · Filter by author Can-no opened on May 8, 2022

• Why is episode_rewards negative when running ant_v3 with PPO?

  ikostrikov/pytorch-a2c-ppo-acktr-gail#293 · Filter by author Can-no opened on May 7, 2022

• Where are the experts data for GAIL get from?

  ikostrikov/pytorch-a2c-ppo-acktr-gail#292 · Filter by author YY-GX opened on Apr 12, 2022

• setup.py and requirements.py have same dependencies except for h5py

  ikostrikov/pytorch-a2c-ppo-acktr-gail#291 · Filter by author andyk opened on Mar 25, 2022

• [Question]Can I use Recurrent_policy for GAIL at this implementation?

  ikostrikov/pytorch-a2c-ppo-acktr-gail#288 · Filter by author LongchaoDa opened on Feb 16, 2022

• why PPO needs to store action_log_probs instead of using stop_gradient for better efficiency?

  ikostrikov/pytorch-a2c-ppo-acktr-gail#284 · Filter by author Emerald01 opened on Oct 15, 2021
  1

• object has no attribute 'steps' in acktr

  ikostrikov/pytorch-a2c-ppo-acktr-gail#283 · Filter by author sungreong opened on Oct 7, 2021

• No softmax before categorical loss?

  ikostrikov/pytorch-a2c-ppo-acktr-gail#282 · Filter by author nirweingarten opened on Jul 11, 2021

• Operations that have no effect

  ikostrikov/pytorch-a2c-ppo-acktr-gail#281 · Filter by author ArashVahabpour opened on Jul 10, 2021

• CNN Architecture

  ikostrikov/pytorch-a2c-ppo-acktr-gail#280 · Filter by author araffin opened on Jul 6, 2021

• Possible bug on the sign of policy log prob. in Fisher computation

  ikostrikov/pytorch-a2c-ppo-acktr-gail#279 · Filter by author daniloefl opened on Jun 25, 2021

• Stale hidden states

  ikostrikov/pytorch-a2c-ppo-acktr-gail#278 · Filter by author aklein1995 opened on Jun 9, 2021

• Can not run enjoy.py

  ikostrikov/pytorch-a2c-ppo-acktr-gail#277 · Filter by author juanjuan2 opened on May 26, 2021

• Can I train in my own game

  ikostrikov/pytorch-a2c-ppo-acktr-gail#276 · Filter by author hhhcwb38712 opened on May 26, 2021

• Why acktr algorithm cannot be used in Mujoco settings?

  ikostrikov/pytorch-a2c-ppo-acktr-gail#275 · Filter by author ChenDRAG opened on Apr 26, 2021

• observation reset before insert

  ikostrikov/pytorch-a2c-ppo-acktr-gail#274 · Filter by author seed851218 opened on Apr 21, 2021

• does mask introduce bias in the gail implementation ?

  ikostrikov/pytorch-a2c-ppo-acktr-gail#272 · Filter by author HareshKarnan opened on Apr 13, 2021

• Error after python main.py --env-name "PongNoFrameskip-v4"

  ikostrikov/pytorch-a2c-ppo-acktr-gail#271 · Filter by author FulChou opened on Apr 8, 2021
  3

• Combine Acktr model with grad-cam

  ikostrikov/pytorch-a2c-ppo-acktr-gail#268 · Filter by author seed851218 opened on Mar 3, 2021
  2