* Added POMDP value iteration

* Added plot_pomdp_utility function

* Added tests for pomdp-value-iteration

* Updated README.md

* Fixed notebook import

* Changed colors

* Added notebook sections for POMDP and pomdp_value_iteration

* Fixed notebook parsing error

* Replace pomdp.ipynb

* Updated README.md

* Fixed line endings

* Fixed line endings

* Fixed line endings

* Fixed line endings

* Removed numpy dependency

* Added docstrings

* Fix tests

* Added a test for pomdp_value_iteration

* Remove numpy dependencies from mdp.ipynb

* Added POMDP to mdp_apps.ipynb

* Added MDP2 class

* Updated loop termination condition in value_iteration

* styling changes and bug fixes in learning.py

* Fix #833 and other pep corrections in mdp.py

* minor change mdp.py

* renamed train_and_test() to train_test_split() #55 #830

* typo fix

* Fixed typos and added inline LaTeX

* Fixed backslash for inline LaTeX

* Fixed more backslashes

* generalised MDP class and created POMDP notebook

* Fixed consistency issues with base MDP class

* Small fix on CustomMDP

* Set default args to pass tests

* Added TableDrivenAgentProgram tests (#777)

* Add tests for TableDrivenAgentProgram

* Add tests for TableDrivenAgentProgram

* Check environment status at every step

* Check environment status at every step of TableDrivenAgentProgram

* Fixing tests

* fixed test_rl

* removed redundant code, fixed a comment

* Delete test_grid.py

* Delete grid.ipynb

* Delete grid.py

* Move grid functions to utils

* Move grid tests to utils

* Update agents.py

* Update mdp.py

* Update search.py

* Update rl.py

* Update mdp.py

* Minor changed to rl notebook

* Update test_mdp.py

* Update mdp.py

* Fix flake8 warnings

* Remove unnecessary #noqa

* Fix doctest

* Exclude test files from flake8 check

* Fix flake8 for main files

* Add flake8 check to build

* Update search.py

Commenting issues fixed (spacing and punctuation was off sometimes).

* Update agents.py

* Update canvas.py

Grammar

* Update grid.py

* Update learning.py

Added period

* Update logic.py

Fix quoting

* Update mdp.py

Fixed quoting

* Update nlp.py

Capitalization and punctuation fixes

* Update planning.py

* Update probability.py

* Update rl.py

'th' to 'the'

* Update search.py

* Update text.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update learning.py

Typo

* Update utils.py

Style: delete excess parentheses. In some of these cases you need to read ahead to see that the paren is not introducing a tuple, for example.

* modifies Fig. to Figure all over the repository

* fixed a small type in logic.py

* removes obsolete Fig dictionary from utils.py

* modified rl notebook according to the new Figure conventions

* removes 'import Fig' and changed the names of Figures

* fixes a small error (by me) in executing the cells in rl notebook

* Made Log Usage Consistent in text.py

* Added Explicit Imports from utils

Apparently, set() does not equal {}

Problems fixed:
Replaced cmp: 1 instance in line 323 of search.py
Convert set() to {}: 3 instances in line 29 of MDP.py, line 181 and 215
of search.py
Convert .sort() to sorted(): 1 instance in line 150 of text.py
Cast map to list: 1 instance in line 47 of grid.py

- Fix relative imports in base of is a package or not
- Fix not working notebooks
- Add notebooks to packages sources

Used tool 2to3 to finish the porting to Python 3 plus some fixes by
hand.

Fixes Issue #29.

use “raise NotImplementedError” for abstract methods