From 67027e890540eed7dd0c124720b6f4007ba9a106 Mon Sep 17 00:00:00 2001 From: Tibo De Peuter Date: Wed, 8 Apr 2026 15:43:12 +0200 Subject: [PATCH] fix: update file link --- docs/README.md | 2 +- docs/design/actor-critic.md | 3 --- 2 files changed, 1 insertion(+), 4 deletions(-) diff --git a/docs/README.md b/docs/README.md index ac56e31..a4f4ea0 100644 --- a/docs/README.md +++ b/docs/README.md @@ -2,11 +2,11 @@ ## Design & architecture ([`/design`](./design/)) +- [Actor/critic architecture](./design/actor-critic.md): Description of the actor-critic pipeline. - [Communication](./design/communication.md): Message propagation, Nerve-Net style. - [Controllers](./design/controllers.md): Macroscopig brain toplogy, centralized, arm-level, segment-level. - [Input/output](./design/input_action_spaces.md): Description of the model's input and output. - [Learning algorithm](./design/learning_algorithm.md): RL techniques, i.e. PPO. -- [MLP architecture](./design/mlp_architecture.md): Module wiring, state/action spaces, and actor-critic pipeline. - [Reward function](./design/learning_algorithm.md): Goals, fitness tracking, and reward structures. ## API reference ([`/api`](./api/)) diff --git a/docs/design/actor-critic.md b/docs/design/actor-critic.md index e01ea96..245fefd 100644 --- a/docs/design/actor-critic.md +++ b/docs/design/actor-critic.md @@ -20,7 +20,6 @@ This pipeline treats the agent as a single entity and uses standard Proximal Pol Our policy and value networks use separate input networks/feature extractors as advised by the SEL3 course assistants and the blog. For continuous actions this should allow better learning at a small cost. ```mermaid -%%{ init: { 'flowchart': {'defaultRenderer': 'elk' } } }%% graph TD Obs([Global Observation]) @@ -69,7 +68,6 @@ critic for all nodes at once, for the following reasons: mathematically equivalent. ```mermaid -%%{ init: { 'flowchart': {'defaultRenderer': 'elk' } } }%% graph TD Obs([Local Observation]) @@ -96,7 +94,6 @@ graph TD Crit --> OutCrit Prop -.->|"message passing"|Prop - ``` ## Implementation Details (Network Depth)