* Added POMDP value iteration

* Added plot_pomdp_utility function

* Added tests for pomdp-value-iteration

* Updated README.md

* Fixed notebook import

* Changed colors

* Added notebook sections for POMDP and pomdp_value_iteration

* Fixed notebook parsing error

* Replace pomdp.ipynb

* Updated README.md

* Fixed line endings

* Fixed line endings

* Fixed line endings

* Fixed line endings

* Removed numpy dependency

* Added docstrings

* Fix tests

* Added a test for pomdp_value_iteration

* Remove numpy dependencies from mdp.ipynb

* Added POMDP to mdp_apps.ipynb

* Resolved merge conflicts

* Rerun

* Metadata restored

* Fixed typos and added inline LaTeX

* Fixed backslash for inline LaTeX

* Fixed more backslashes

* generalised MDP class and created POMDP notebook

* Fixed consistency issues with base MDP class

* Small fix on CustomMDP

* Set default args to pass tests

* Added TableDrivenAgentProgram tests (#777)

* Add tests for TableDrivenAgentProgram

* Add tests for TableDrivenAgentProgram

* Check environment status at every step

* Check environment status at every step of TableDrivenAgentProgram

* Fixing tests

* fixed test_rl

* removed redundant code, fixed a comment

* Fixed typos and added inline LaTeX

* Fixed more backslashes

* Enhanced explanation of value iteration

* Fixed minor typo

* Added Policy Iteration section

* Removed ambiguous test

* Capitalized header

* Added images

* Added section for sequential decision problems

* Added GridMDP editor to create and solve grid-world problems

* Added reference to grid_mdp.py in mdp.ipynb

* Replacing %psource with psource function

* Print matrix to console as well

* fixed Key Error bug in CustomMDP and reordered the return values of T function to be consistent with GridMDP

* removing idea files from git

* Update notebook.py

- remove duplicate psource
- add section headers
- add mdp visualization code

* Update nlp_apps.ipynb

* Update csp.ipynb

* Update mdp.ipynb

* Update games.ipynb

* Update csp.ipynb

* Update mdp.ipynb

* Intro and representation of MDPs in code

* Added Image for MDP

- Fix relative imports in base of is a package or not
- Fix not working notebooks
- Add notebooks to packages sources