Skip to content

Commit

Permalink
Deploying to gh-pages from @ 503dbf0 🚀
Browse files Browse the repository at this point in the history
  • Loading branch information
ffelten committed Apr 15, 2024
1 parent 7df3ebf commit f02a040
Show file tree
Hide file tree
Showing 4 changed files with 8 additions and 5 deletions.
2 changes: 1 addition & 1 deletion main/.buildinfo
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Sphinx build info version 1
# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
config: 4ef59d6323d81594d2ace640fda32d44
config: 72d479f674aea13a8e92cbf9c771e260
tags: d77d1c0d9ca2f4c8421862c7c5a0d620
7 changes: 5 additions & 2 deletions main/environments/breakable-bottles/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -332,7 +332,7 @@ <h1>Breakable-Bottles<a class="headerlink" href="#breakable-bottles" title="Link
<td><p>Discrete(3)</p></td>
</tr>
<tr class="row-odd"><td><p>Observation Space</p></td>
<td><p>Dict(‘bottles_carrying’: Discrete(3), ‘bottles_delivered’: Discrete(2), ‘bottles_dropped’: MultiBinary(3), ‘location’: Discrete(5))</p></td>
<td><p>Dict(‘bottles_carrying’: Discrete(3), ‘bottles_delivered’: Discrete(3), ‘bottles_dropped’: MultiBinary(3), ‘location’: Discrete(5))</p></td>
</tr>
<tr class="row-even"><td><p>Reward Shape</p></td>
<td><p>(3,)</p></td>
Expand Down Expand Up @@ -369,9 +369,12 @@ <h2>Observation Space<a class="headerlink" href="#observation-space" title="Link
<ul class="simple">
<li><p>location: the current location of the agent</p></li>
<li><p>bottles_carrying: the number of bottles the agent is currently carrying (0, 1 or 2)</p></li>
<li><p>bottles_delivered: the number of bottles the agent has delivered (0 or 1)</p></li>
<li><p>bottles_delivered: the number of bottles the agent has delivered (0, 1 or 2)</p></li>
<li><p>bottles_dropped: for each location, a boolean flag indicating if that location currently contains a bottle</p></li>
</ul>
<p>Note that this observation space is different from that listed in the paper above. In the paper, bottles_delivered’s possible values are listed as (0 or 1),
rather than (0, 1 or 2). This is because the paper did not take the terminal state, in which 2 bottles have been delivered, into account when calculating
the observation space. As such, the observation space of this implementation is larger than specified in the paper, having 360 possible states instead of 240.</p>
</section>
<section id="reward-space">
<h2>Reward Space<a class="headerlink" href="#reward-space" title="Link to this heading">#</a></h2>
Expand Down
2 changes: 1 addition & 1 deletion main/release_notes/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -390,7 +390,7 @@ <h1>MO-Gymnasium 1.0.0 Release Notes</h1>
<span class="pl-s1">reward</span> <span class="pl-c1">=</span> <span class="pl-s1">forward_reward</span> <span class="pl-c1">-</span> <span class="pl-s1">ctrl_cost</span></pre></div>
<p>With MORL, users have the flexibility to determine the compromises they desire based on their preferences for each objective. Consequently, the environments in MO-Gymnasium do not have predefined weights. Thus, MO-Gymnasium extends the capabilities of <a href="https://gymnasium.farama.org/" rel="nofollow">Gymnasium</a> to the multi-objective setting, where the agents receives a vectorial reward.</p>
<p>For example, here is an illustration of the multiple policies learned by an MORL agent for the <code>mo-halfcheetah</code> domain, balancing between saving battery and speed:</p>
<a target="_blank" rel="noopener noreferrer" href="https://private-user-images.githubusercontent.com/11799929/245189948-10796cae-6f84-4690-8e17-d23f792c32c2.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTA3ODI4OTEsIm5iZiI6MTcxMDc4MjU5MSwicGF0aCI6Ii8xMTc5OTkyOS8yNDUxODk5NDgtMTA3OTZjYWUtNmY4NC00NjkwLThlMTctZDIzZjc5MmMzMmMyLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDAzMTglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwMzE4VDE3MjMxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWUxMmQyZDZhNWNlMzdmNjJjN2JjNTRmYTc0MDg1NGNlMzQzYzI2ZjlkYTcyZDkyOWZlOTVmNzVlZGM3ZWEyODYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.qJi9K5AeF-JptMPSfC2I4-0tdAYFVjqMnsbGnVjIQ-s"><img src="https://private-user-images.githubusercontent.com/11799929/245189948-10796cae-6f84-4690-8e17-d23f792c32c2.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTA3ODI4OTEsIm5iZiI6MTcxMDc4MjU5MSwicGF0aCI6Ii8xMTc5OTkyOS8yNDUxODk5NDgtMTA3OTZjYWUtNmY4NC00NjkwLThlMTctZDIzZjc5MmMzMmMyLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDAzMTglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwMzE4VDE3MjMxMVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWUxMmQyZDZhNWNlMzdmNjJjN2JjNTRmYTc0MDg1NGNlMzQzYzI2ZjlkYTcyZDkyOWZlOTVmNzVlZGM3ZWEyODYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.qJi9K5AeF-JptMPSfC2I4-0tdAYFVjqMnsbGnVjIQ-s" width="400" content-type-secured-asset="image/gif" style="max-width: 100%;"></a>
<a target="_blank" rel="noopener noreferrer" href="https://private-user-images.githubusercontent.com/11799929/245189948-10796cae-6f84-4690-8e17-d23f792c32c2.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTMxNjUzNDEsIm5iZiI6MTcxMzE2NTA0MSwicGF0aCI6Ii8xMTc5OTkyOS8yNDUxODk5NDgtMTA3OTZjYWUtNmY4NC00NjkwLThlMTctZDIzZjc5MmMzMmMyLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA0MTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNDE1VDA3MTA0MVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTUxOTM5MmY3OTMwY2E0YjIwOTlkN2ViZmI4ZjkxYWRhMjgwZTkzNmIzN2RkMTE3MzIzN2M4ZTk5ZWZlODc4NjcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.XuL6KGCVdDeLGdDtLaWFn0GxO8leSj9sa3OQMFgHFUs"><img src="https://private-user-images.githubusercontent.com/11799929/245189948-10796cae-6f84-4690-8e17-d23f792c32c2.gif?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTMxNjUzNDEsIm5iZiI6MTcxMzE2NTA0MSwicGF0aCI6Ii8xMTc5OTkyOS8yNDUxODk5NDgtMTA3OTZjYWUtNmY4NC00NjkwLThlMTctZDIzZjc5MmMzMmMyLmdpZj9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA0MTUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNDE1VDA3MTA0MVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTUxOTM5MmY3OTMwY2E0YjIwOTlkN2ViZmI4ZjkxYWRhMjgwZTkzNmIzN2RkMTE3MzIzN2M4ZTk5ZWZlODc4NjcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.XuL6KGCVdDeLGdDtLaWFn0GxO8leSj9sa3OQMFgHFUs" width="400" content-type-secured-asset="image/gif" style="max-width: 100%;"></a>
<p>This release marks the first mature version of MO-Gymnasium within Farama, indicating that the API is stable, and we have achieved a high level of quality in this library.</p>
<h2>API</h2>
<div class="highlight highlight-source-python notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="import gymnasium as gym
Expand Down
2 changes: 1 addition & 1 deletion main/searchindex.js

Large diffs are not rendered by default.

0 comments on commit f02a040

Please sign in to comment.