Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
200 commits
Select commit Hold shift + click to select a range
12eec3f
Merge pull request #50 from automl/dev
amsks Aug 14, 2024
2101cce
Changed Mighty-DACS to Mighty
amsks Aug 14, 2024
608316b
move workflows to workflows
TheEimer Aug 14, 2024
09277e6
some small fixes to makefile issues
TheEimer Aug 16, 2024
1c6fc79
add pytest dependency
TheEimer Aug 16, 2024
98689d9
removed carl ref
TheEimer Aug 16, 2024
ebb094d
extra dependencies for carl and dacbench
TheEimer Sep 3, 2024
f7915e9
dependencies in doc workflow
TheEimer Sep 3, 2024
54ddf0a
doc workflow adjustment
TheEimer Sep 3, 2024
ca0868a
correct carl package name
TheEimer Sep 3, 2024
6e8beec
no dacbench install in workflows
TheEimer Sep 3, 2024
32d5cfe
adding dacbench installation back in to test
TheEimer Sep 3, 2024
f8314ea
debugging docs
TheEimer Sep 3, 2024
d327479
pufferlib dependency
TheEimer Sep 3, 2024
8f80936
more duc debugging
TheEimer Sep 3, 2024
64dea2e
fix tests
TheEimer Sep 3, 2024
6d14157
further doc debugging
TheEimer Sep 3, 2024
7385c7a
fix jax for remote testing
TheEimer Sep 3, 2024
9ebd4c0
more doc debugging
TheEimer Sep 3, 2024
0155529
fix pyproject
TheEimer Sep 3, 2024
64b4f91
typo in doc workflow
TheEimer Sep 3, 2024
1cbce84
versioning docs theme
TheEimer Sep 3, 2024
267e337
unbreak docs locally
TheEimer Sep 3, 2024
351452f
delete execution times in docs
TheEimer Sep 16, 2024
77e6919
test workflow command to match local version
TheEimer Sep 16, 2024
19f16af
drop deprecated her
TheEimer Sep 16, 2024
375c7e4
dependency update
TheEimer Sep 16, 2024
9ddb4f9
disable gallery plot
TheEimer Sep 16, 2024
6782052
don't build doc examples
TheEimer Sep 16, 2024
01ccdbf
doc debugging
TheEimer Sep 16, 2024
c24e6be
more debugging
TheEimer Sep 16, 2024
c6368c7
Rename Readme.md to README.md
TheEimer Sep 16, 2024
46b12ec
debug remote test
TheEimer Oct 1, 2024
5ea74db
further remote test debugging
TheEimer Oct 2, 2024
00550d6
more remote debugging
TheEimer Oct 2, 2024
1ed7ca5
updated dependencies for new dacbench version
TheEimer Oct 2, 2024
ddcfeba
fix test locally
TheEimer Oct 2, 2024
9422226
revert to proper dacbench installation
TheEimer Oct 2, 2024
148480c
separate pufferlib install due to older numpy version
TheEimer Oct 2, 2024
cd05a57
separate dacbench installation due to scipy conflict
TheEimer Oct 2, 2024
18ac453
avoid package conflicts in install-dev
TheEimer Oct 2, 2024
5d65a5f
don't install all with basic install
TheEimer Oct 2, 2024
7671567
formatting
TheEimer Oct 2, 2024
f2b02b9
debugging implementation start
TheEimer Oct 2, 2024
68ce156
removed unnecessary dir deletion
TheEimer Oct 2, 2024
a3ec555
correct placement of hydra files
TheEimer Oct 2, 2024
fe6f489
logging change, test update, switch to uv, dependency resolution, pre…
TheEimer Feb 4, 2025
ffe097c
fix: use uv for actions
TheEimer Apr 14, 2025
f0a8c2c
fix: enable uv pip in actions
TheEimer Apr 14, 2025
0e2a3ba
moved docs to mkdocs
TheEimer Apr 14, 2025
7c6c965
test docs in workflow
TheEimer Apr 14, 2025
9b3c48f
add uv python to docs test
TheEimer Apr 14, 2025
48b73fd
add concurrency limit to test action
TheEimer Apr 14, 2025
663ccc7
install issues: try to remove mujoco version
TheEimer Apr 14, 2025
28294a4
simplify install
TheEimer Apr 14, 2025
20efcac
update doc building & release workflow
TheEimer Apr 14, 2025
93dd41d
require smaller python
TheEimer Apr 14, 2025
50189a3
fix pufferlib version
TheEimer Apr 14, 2025
61d1b23
fix: import locations after util restructure
TheEimer Apr 14, 2025
028586a
update doc build status badge
TheEimer Apr 14, 2025
e7f1de0
run cli test explicitly with uv
TheEimer Apr 14, 2025
4c5d577
force when deploying docs
TheEimer Apr 14, 2025
63c041a
Delete uv.lock
TheEimer Apr 14, 2025
0bf2af4
don't run cli test from github
TheEimer Apr 14, 2025
b99034c
Update readme
TheEimer Apr 14, 2025
f39c77e
added pypi release
TheEimer Apr 14, 2025
6de923f
remove experiment notebooks
TheEimer Apr 14, 2025
25efb5d
add doc content
TheEimer Apr 14, 2025
b66b2b8
review needed: moved gradient steps + batch sampling to base agent
TheEimer Apr 16, 2025
d399f9a
fixed tests
TheEimer Apr 16, 2025
752557f
fixed wrong batch accumulation for metrics dict
TheEimer Apr 16, 2025
c24387a
updated main project for make install
amsks May 7, 2025
1e352ac
PPO current state
amsks May 21, 2025
eb5bad1
restructure PPO batch mess
TheEimer May 21, 2025
e4e3c45
fix: detach log probs
TheEimer May 21, 2025
d5aedc2
configs+tests for RND
TheEimer May 21, 2025
5a40d88
examples update
TheEimer May 26, 2025
b81cdcb
remove print statement
TheEimer May 26, 2025
801b03b
updated FIXMEs for EWRL and stable PPO
amsks May 27, 2025
03d61a3
Merge branch 'main' of https://github.com/automl/Mighty
amsks May 27, 2025
2b19b1c
BUGFIX: Nans in continuous control with PPO
amsks May 27, 2025
a244da5
doc structure
TheEimer May 28, 2025
1d3f0e6
bugfixes in carl vec env wrapper
TheEimer May 28, 2025
919f0b7
fix dim error in space test
TheEimer May 28, 2025
35d9611
pretty console
TheEimer May 28, 2025
3febbd0
add uniplot dependency
TheEimer May 30, 2025
86483e8
example extension
TheEimer May 30, 2025
e74530f
updated SAC + Formatting
amsks May 30, 2025
f10e5f9
Merge branch 'main' of https://github.com/automl/Mighty
amsks May 30, 2025
60115db
finish examples
TheEimer May 30, 2025
4cb7b64
Update: Type annotations for doc building
amsks May 30, 2025
fa167dd
update docs
TheEimer May 30, 2025
0cf330b
finish methods docs
TheEimer May 30, 2025
6b1f702
list rendering in docs
TheEimer May 30, 2025
d600221
fix rest of docs lists
TheEimer May 30, 2025
2ad223d
SAC solves mountain car continuous
amsks May 31, 2025
c0a4cc6
added properties to agents
amsks May 31, 2025
4626e45
moved polyak update to utils
amsks May 31, 2025
bb2ed1b
removed search space handling
amsks May 31, 2025
9c99d52
Fixed ppo action mismatch + Rollout Buffer
amsks Jun 1, 2025
d40e37d
added device to buffers
amsks Jun 1, 2025
2536d04
removed property agent_types
amsks Jun 1, 2025
ca52320
moved prioritized replay to a seperate file
amsks Jun 1, 2025
89d770e
updated DQN + DDQN args and target handling
amsks Jun 1, 2025
41658e8
Exploration: Added epsilon decay
amsks Jun 1, 2025
96617b6
updated to DQN HPs
amsks Jun 1, 2025
41ee98d
current state
amsks Jun 2, 2025
b3f4e2a
More seeding in base agent
amsks Jun 2, 2025
1d189d0
DQN solves CartPole
amsks Jun 2, 2025
0e60cd3
added cartpole steps
amsks Jun 2, 2025
0ecf423
updated SAC
amsks Jun 3, 2025
4321abf
updated individual configs
amsks Jun 3, 2025
d5ff9c3
update:Priority and agent creation tests working
amsks Jun 3, 2025
5f1965f
Delete mighty/configs/curricula directory
TheEimer Jun 3, 2025
2631f57
debugging carl interface
TheEimer Jun 3, 2025
ce516dc
probably correct PLR
TheEimer Jun 3, 2025
972286a
fix context assignment
TheEimer Jun 3, 2025
1fa5ba9
remove logging from config
TheEimer Jun 4, 2025
a46077c
update
amsks Jun 4, 2025
e3eabf3
feat: enable carl context selector switching via keyword
TheEimer Jun 20, 2025
85d0923
upgrade carl/brax versions
TheEimer Jun 20, 2025
7c7873c
remove pathing issues from test workflow
TheEimer Jun 20, 2025
f36cc30
PPO and SAC tests
amsks Jun 25, 2025
25cb848
Tests for PPO, SAC and Rollout
amsks Jun 25, 2025
5591e54
updated DQN test
amsks Jun 26, 2025
04082c0
Base agent update tests completed
amsks Jun 26, 2025
1de8620
Meta Modules Tests Fixed
amsks Jun 26, 2025
eb2fc81
ES Runner Tests Fixed. Might want to revisit
amsks Jun 26, 2025
ff971c5
Fixed buffer test
amsks Jun 30, 2025
5a1c856
Rename migthy_types to mighty_types and delete second init file
TheEimer Jul 3, 2025
150cf9c
use shape instead of len() for mask
TheEimer Jul 7, 2025
65b625e
Merge pull request #64 from automl/fix-rnd-loss-mask-shape
amsks Jul 12, 2025
9606315
Merge pull request #59 from automl/fix-types-typo
amsks Jul 12, 2025
f03ba55
Restructure example Readme
TheEimer Jul 17, 2025
144c035
fix code rendering in collapsed sections
TheEimer Jul 17, 2025
1d4c193
Heading scaling
TheEimer Jul 17, 2025
7b88fdd
close runner file section by default
TheEimer Jul 17, 2025
0effb7b
don't check coverage for test helpers & plotting
TheEimer Jul 17, 2025
c0cd39c
delete unfinished MAML runners
TheEimer Jul 17, 2025
5bc0af7
Add links to template and example repos
TheEimer Jul 17, 2025
15c9bec
add optional isaacgym make
TheEimer Jul 21, 2025
4e16399
instead of adding isaacgym, extend runner init by optional env
TheEimer Jul 21, 2025
adf7bb8
format
TheEimer Jul 21, 2025
0446b94
Merge pull request #67 from automl/fix-coverage
amsks Jul 25, 2025
34f2102
Stable SAC for HalfCheetah
amsks Jul 28, 2025
cc14d83
added sac configs
amsks Jul 29, 2025
056cd72
change to bsd
TheEimer Jul 29, 2025
e49d3ff
added flow diagram
TheEimer Jul 29, 2025
c9130ed
content overview
TheEimer Jul 29, 2025
306a224
finetune figures
TheEimer Jul 29, 2025
6d8528a
improve theming
TheEimer Jul 30, 2025
9fb4456
Added Rescaling of Actions
amsks Jul 30, 2025
8fa263d
FIX for Latents
amsks Jul 30, 2025
d25c668
FIX: Weighted Log Probs
amsks Jul 30, 2025
337db46
Removed in place advantga computation
amsks Jul 30, 2025
95b57a5
Added Dual Model with/out Tanh Squashing and Rescaling
amsks Jul 30, 2025
8456403
Updated default configs for ppo and sac
amsks Jul 30, 2025
56411bb
Merge pull request #82 from automl/PPO_Changes_2
amsks Jul 30, 2025
3c6969f
deleted additional condigs
amsks Jul 30, 2025
fd643bf
Merge pull request #83 from automl/SAC_Debug
amsks Jul 30, 2025
938c62e
Updated tests for new interface: PPO + SAC
amsks Jul 30, 2025
8f2277b
upgrade to new dacbench version, fix readme
TheEimer Jul 30, 2025
8b0a93f
replace old logos with svg
TheEimer Jul 30, 2025
ecbbff1
Remove unnecessary comment
TheEimer Jul 30, 2025
85955bb
renamed mighty types and refactored
amsks Jul 30, 2025
ea2ce99
mighty agents ready for merge
amsks Jul 30, 2025
fded961
numpy + logging update
TheEimer Jul 30, 2025
c3a7b2b
Exploration Policies ready to merge
amsks Jul 30, 2025
6747b4d
models and meta modules ready for merge
amsks Jul 30, 2025
e194cbc
Runners ready to merge
amsks Jul 30, 2025
2e85993
Replay Formatted
amsks Jul 30, 2025
b1ffee2
Update functions ready to merge
amsks Jul 30, 2025
14f74e8
test + utils ready to merge
amsks Jul 30, 2025
ed25634
Formatting and Linting
amsks Jul 30, 2025
79c5ea7
More formatting
amsks Jul 30, 2025
3f16c3a
Removed redundant Folder
amsks Jul 30, 2025
27d78b0
Merge branch 'main' into Debug_RolloutBuffer
amsks Jul 30, 2025
0cb28b5
Removed FIX comments -- only FIXME remain
amsks Jul 30, 2025
07ce2a5
Merge branch 'Debug_RolloutBuffer' of https://github.com/automl/Might…
amsks Jul 30, 2025
b94b318
Removed Debug statements
amsks Jul 30, 2025
a03e6b4
Merge pull request #56 from automl/Debug_RolloutBuffer
amsks Jul 30, 2025
7820371
Merge branch 'main' into minor-logging-fix
amsks Jul 30, 2025
60c984a
Merge pull request #85 from automl/minor-logging-fix
amsks Jul 30, 2025
4980d9c
Merge branch 'main' into improve-examples
amsks Jul 30, 2025
f28b2d4
Merge pull request #66 from automl/improve-examples
amsks Jul 30, 2025
83e2f21
Merge pull request #84 from automl/readme-fix
amsks Jul 30, 2025
04d4865
Merge remote-tracking branch 'origin/add-isaacgym'
amsks Jul 30, 2025
d84eaf3
Merge pull request #76 from automl/license-switch
amsks Jul 30, 2025
1e6bb87
Merge pull request #81 from automl/doc-enhancement
amsks Jul 30, 2025
e45ea4c
extended batch size in td comparison
TheEimer Jul 31, 2025
b10e74c
added rough versioning to packages
TheEimer Jul 31, 2025
97fadf0
fix td test, add reproducibility test
TheEimer Jul 31, 2025
d65f46e
ugrade python, format, lint
TheEimer Jul 31, 2025
3f8b2de
dacbench need torchvision
TheEimer Jul 31, 2025
8c587b7
Merge pull request #88 from automl/test-fix
amsks Jul 31, 2025
5aaf3f4
MAML Runner removed + minor changes
amsks Jul 31, 2025
fd679b9
Merge pull request #89 from automl/remove-maml-runner
amsks Jul 31, 2025
cbfab0a
readme + example check
TheEimer Jul 31, 2025
dcd0247
fix policy kwargs init
TheEimer Jul 31, 2025
9d283a0
Merge pull request #90 from automl/test-fix
amsks Jul 31, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
66 changes: 0 additions & 66 deletions .github/docs.yaml

This file was deleted.

82 changes: 0 additions & 82 deletions .github/publish-release.yaml

This file was deleted.

42 changes: 42 additions & 0 deletions .github/workflows/docs_test.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
# This workflow is to test that the docs build successfully.
name: test-docs
env:
package-name: "mighty"
UV_SYSTEM_PYTHON: 1

concurrency:
group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
cancel-in-progress: true
on:
workflow_dispatch:
push:
branches:
- main
pull_request:
branches:
- main
permissions:
contents: write
jobs:
build:
runs-on: ubuntu-latest
steps:
- name: Checkout
uses: actions/checkout@v4

- name: Install uv
uses: astral-sh/setup-uv@v5
with:
# Install a specific version of uv.
version: "0.6.14"

- name: "Set up Python"
uses: actions/setup-python@v5
with:
python-version-file: "pyproject.toml"

- name: Install Mighty
run: make install-dev

- name: "Build Docs"
run: mkdocs build --clean --strict
74 changes: 74 additions & 0 deletions .github/workflows/publish-release.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,74 @@
name: Publish Python Package
permissions:
id-token: write

env:
package-name: "mighty"
UV_SYSTEM_PYTHON: 1

on:
# Manually triggerable in github
workflow_dispatch:
release:
types: [created]

jobs:
test:
name: publish-release
runs-on: "ubuntu-latest"

steps:
- name: Checkout
uses: actions/checkout@v4

- name: Install uv
uses: astral-sh/setup-uv@v5
with:
# Install a specific version of uv.
version: "0.6.14"

- name: "Set up Python"
uses: actions/setup-python@v5
with:
python-version-file: "pyproject.toml"

- name: Install ${{ env.package-name }}
run: make install-dev

- name: Store git status
id: status-before
shell: bash
run: |
echo "::set-output name=BEFORE::$(git status --porcelain -b)"

- name: Tests
run: make test

pypi-publish:
name: Upload release to PyPI
runs-on: ubuntu-latest
environment:
name: pypi
url: https://pypi.org/p/mighty
steps:
- name: Checkout
uses: actions/checkout@v4

- name: Install uv
uses: astral-sh/setup-uv@v5
with:
# Install a specific version of uv.
version: "0.6.14"

- name: "Set up Python"
uses: actions/setup-python@v5
with:
python-version-file: "pyproject.toml"

- name: Install ${{ env.package-name }}
run: make install-dev
- name: Build package
run: uv build

- name: Publish package distributions to PyPI
run: uv publish
34 changes: 16 additions & 18 deletions .github/test.yaml → .github/workflows/test.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,8 @@

name: Tests
concurrency:
group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.ref }}
cancel-in-progress: true

on:
workflow_dispatch: # Manually trigger the workflow
Expand All @@ -18,38 +21,34 @@ on:
env:
package-name: "mighty"
test-dir: test
extra-requires: "[dev]" # "" for no extra_requires

# Arguments used for pytest
pytest-args: >-
--durations=20
-v
UV_SYSTEM_PYTHON: 1

jobs:

# General unit tests
source-test:
name: test

runs-on: "ubuntu-latest"
defaults:
run:
shell: bash # Default to using bash on all

steps:
- name: Checkout
uses: actions/checkout@v2
uses: actions/checkout@v4

- name: Setup Python
uses: actions/setup-python@v2
- name: Install uv
uses: astral-sh/setup-uv@v5
with:
python-version: "3.10"
# Install a specific version of uv.
version: "0.6.14"

- name: "Set up Python"
uses: actions/setup-python@v5
with:
python-version-file: "pyproject.toml"

- name: Install ${{ env.package-name }}
run: |
python -m pip install --upgrade pip
python -m pip install wheel
python -m pip install -e ".${{ env.extra-requires }}"
run: make install-dev

- name: Store git status
id: status-before
Expand All @@ -58,8 +57,7 @@ jobs:
echo "::set-output name=BEFORE::$(git status --porcelain -b)"

- name: Tests
run: |
pytest ${{ env.pytest-args }} ${{ env.test-dir }}
run: python -m pytest -v --disable-pytest-warnings --cov=mighty test --durations=20 --cov-report html

- name: Check for files left behind by test
run: |
Expand Down
7 changes: 6 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -94,6 +94,7 @@ ipython_config.py
# having no cross-platform support, pipenv may install dependencies that don't work, or not
# install all needed dependencies.
#Pipfile.lock
uv.lock

# PEP 582; used by e.g. github.com/David-OConnor/pyflow
__pypackages__/
Expand Down Expand Up @@ -132,4 +133,8 @@ dmypy.json
# Pyre type checker
.pyre/

runs
runs/*
docs/build/*
docs/api/*
docs/examples/*
site/*
15 changes: 7 additions & 8 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
@@ -1,10 +1,9 @@
repos:
- repo: https://github.com/psf/black
rev: stable
- repo: local
hooks:
- id: black
language_version: python3.10
- repo: https://gitlab.com/pycqa/flake8
rev: 3.8.4
hooks:
- id: flake8
- id: formatting
name: formatting
entry: make
args: ["format"]
language: system
pass_filenames: false
Loading
Loading