class FooEnv(gym.Env):
metadata = {'render.modes': ['human']}
def __init__(self):
pass
def _step(self, action):
"""
Parameters
----------
action :
Returns
-------
ob, reward, episode_over, info : tuple
ob (object) :
an environment-specific object representing your observation of
the environment.
reward (float) :
amount of reward achieved by the previous action. The scale
varies between environments, but the goal is always to increase
your total reward.
episode_over (bool) :
whether it's time to reset the environment again. Most (but not
all) tasks are divided up into well-defined episodes, and done
being True indicates the episode has terminated. (For example,
perhaps the pole tipped too far, or you lost your last life.)
info (dict) :
diagnostic information useful for debugging. It can sometimes
be useful for learning (for example, it might contain the raw
probabilities behind the environment's last state change).
However, official evaluations of your agent are not allowed to
use this for learning.
"""
self._take_action(action)
self.status = self.env.step()
reward = self._get_reward()
ob = self.env.getState()
episode_over = self.status != hfo_py.IN_GAME
return ob, reward, episode_over, {}
def _reset(self):
pass
def _render(self, mode='human', close=False):
pass
def _take_action(self, action):
pass
def _get_reward(self):
""" Reward is given for XY. """
if self.status == FOOBAR:
return 1
elif self.status == ABC:
return self.somestate ** 2
else:
return 0
2 回答
在极小的环境中查看我的banana-gym .
创建新环境
请参阅存储库的主页面:
https://github.com/openai/gym/tree/master/gym/envs#how-to-create-new-environments-for-gym
步骤是:
它看起来应该是这样的
有关其内容,请点击上面的链接 . 那里没有提到的细节特别是
foo_env.py
中的某些函数应该是什么样子 . 查看示例和gym.openai.com/docs/有帮助 . 这是一个例子:使用您的环境
例子
https://github.com/openai/gym-soccer
https://github.com/openai/gym-wikinav
https://github.com/alibaba/gym-starcraft
https://github.com/endgameinc/gym-malware
https://github.com/hackthemarket/gym-trading
https://github.com/tambetm/gym-minecraft
https://github.com/ppaquette/gym-doom
https://github.com/ppaquette/gym-super-mario
https://github.com/tuzzer/gym-maze
绝对有可能 . 他们在文档页面中这么说,接近结尾 .
https://gym.openai.com/docs
至于如何做,你应该看一下现有环境的源代码以获得灵感 . 它在github中可用:
https://github.com/openai/gym#installation
他们的大多数环境都没有从头开始实现,而是围绕现有环境创建了一个包装器,并为其提供了一个便于强化学习的界面 .
如果你想自己做,你应该朝这个方向努力,并尝试适应健身房界面已经存在的东西 . 虽然很有可能这非常耗时 .
There is another option that may be interesting for your purpose. It's OpenAI's Universe
https://universe.openai.com/
它可以与网站集成,以便您在kongregate游戏中训练模型 . 但宇宙并不像健身房那么容易使用 .
如果您是初学者,我的建议是您从标准环境中的vanilla实现开始 . 在你通过基础知识的问题后,继续增加......