Skip to content

Commit

Permalink
Added explanation of garnet MDPs
Browse files Browse the repository at this point in the history
  • Loading branch information
keithbadger committed Jul 9, 2024
1 parent e023389 commit 01d1058
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions src/domains/garnet.jl
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,11 @@ struct GarnetMDP <: TabMDP
# TODO: add a constructor that checks for consistency
end

"""
A Garnet MDP is a tabular MDP where the number of next states available from any current state is a fixed proportion of the total number of states in the model.
This proportion is called "nbranch" and it must between 0 and 1.
"""

function make_garnet(S::Integer, A::AbstractVector{Int}, nbranch::Number, min_reward::Integer, max_reward::Integer)

0.0 nbranch 1.0 || error("nbranch must be in [0,1]")
Expand Down

0 comments on commit 01d1058

Please sign in to comment.