.. DO NOT EDIT.
.. THIS FILE WAS AUTOMATICALLY GENERATED BY SPHINX-GALLERY.
.. TO MAKE CHANGES, EDIT THE SOURCE PYTHON FILE:
.. "auto_examples/demo_env/video_plot_springcartpole.py"
.. LINE NUMBERS ARE GIVEN BELOW.

.. only:: html

    .. note::
        :class: sphx-glr-download-link-note

        :ref:`Go to the end <sphx_glr_download_auto_examples_demo_env_video_plot_springcartpole.py>`
        to download the full example code

.. rst-class:: sphx-glr-example-title

.. _sphx_glr_auto_examples_demo_env_video_plot_springcartpole.py:


===============================================
A demo of SpringCartPole environment with DQNAgent
===============================================
Illustration of the training and video rendering of DQN Agent in
SpringCartPole environment.

Agent is slightly tuned, but not optimal. This is just for illustration purpose.

.. video:: ../../video_plot_springcartpole.mp4
   :width: 600

.. GENERATED FROM PYTHON SOURCE LINES 14-47

.. code-block:: python3


    from rlberry_research.envs.classic_control import SpringCartPole
    from rlberry_research.agents.torch import DQNAgent
    from gymnasium.wrappers.time_limit import TimeLimit

    model_configs = {
        "type": "MultiLayerPerceptron",
        "layer_sizes": (256, 256),
        "reshape": False,
    }

    init_kwargs = dict(
        q_net_constructor="rlberry_research.agents.torch.utils.training.model_factory_from_env",
        q_net_kwargs=model_configs,
    )

    env = SpringCartPole(obs_trans=False, swing_up=True)
    env = TimeLimit(env, max_episode_steps=500)
    agent = DQNAgent(env, **init_kwargs)
    agent.fit(budget=1e5)

    env.enable_rendering()
    observation, info = env.reset()

    for tt in range(1000):
        action = agent.policy(observation)
        observation, reward, terminated, truncated, info = env.step(action)
        done = terminated or truncated
        if done:
            observation, info = env.reset()

    # Save video
    video = env.save_video("_video/video_plot_springcartpole.mp4")


.. rst-class:: sphx-glr-timing

   **Total running time of the script:** (0 minutes 0.000 seconds)


.. _sphx_glr_download_auto_examples_demo_env_video_plot_springcartpole.py:

.. only:: html

  .. container:: sphx-glr-footer sphx-glr-footer-example




    .. container:: sphx-glr-download sphx-glr-download-python

      :download:`Download Python source code: video_plot_springcartpole.py <video_plot_springcartpole.py>`

    .. container:: sphx-glr-download sphx-glr-download-jupyter

      :download:`Download Jupyter notebook: video_plot_springcartpole.ipynb <video_plot_springcartpole.ipynb>`


.. only:: html

 .. rst-class:: sphx-glr-signature

    `Gallery generated by Sphinx-Gallery <https://sphinx-gallery.github.io>`_