Actor/Critic inputs and outputs, replay buffer, exploration noise, and the key differences in each update.
rl