Learn R Programming

pomdp (version 1.2.4)

pomdp-package: pomdp: Infrastructure for Partially Observable Markov Decision Processes (POMDP)

Description

Provides the infrastructure to define and analyze the solutions of Partially Observable Markov Decision Process (POMDP) models. Interfaces for various exact and approximate solution algorithms are available including value iteration, point-based value iteration and SARSOP. Smallwood and Sondik (1973) tools:::Rd_expr_doi("10.1287/opre.21.5.1071").

Arguments

Key functions

  • Problem specification: POMDP, MDP

  • Solvers: solve_POMDP(), solve_MDP(), solve_SARSOP()

Author

Maintainer: Michael Hahsler mhahsler@lyle.smu.edu (ORCID) [copyright holder]

Other contributors:

  • Hossein Kamalzadeh [contributor]

See Also