* test commit

* agents.ipynb

* agents.ipynb

* Fixed all the instances of issue #833

* minor fix and cleared change in agents.ipynb

* Ignoring .DS_Store for macOS

* Added Direct Utility Estimation code and fixed notebook

* Added implementation to README.md

* Fixed typos and added inline LaTeX

* Fixed backslash for inline LaTeX

* Fixed more backslashes

* generalised MDP class and created POMDP notebook

* Fixed consistency issues with base MDP class

* Small fix on CustomMDP

* Set default args to pass tests

* Added TableDrivenAgentProgram tests (#777)

* Add tests for TableDrivenAgentProgram

* Add tests for TableDrivenAgentProgram

* Check environment status at every step

* Check environment status at every step of TableDrivenAgentProgram

* Fixing tests

* fixed test_rl

* removed redundant code, fixed a comment

* Update rl.py

* Update mdp.py

* Minor changed to rl notebook

* Exclude test files from flake8 check

* Fix flake8 for main files

* Add flake8 check to build

* Update test_agents.py

pep8 changes, showed flake8 errors

* Update test_agents.py

* Update test_agents.py

* Update test_agents.py

* Update test_text.py

added missing whitespace after comma

* Update utils.py

added space after comma

* Update search.py

added space after comma

* Update probability.py

added space after comma

* Update learning.py

added space after comma

* Update planning.py

added double_tennis_problem

* Update rl.py

In the pseudocode figure 21.8, the first 'if' starts with argument 's', which is the previous state, not s1(i.e, the current state).

* Update search.py

the 'uniform_cost_search' in notebook 'search-4e.ipynb' resembles more to the pseudocode in book.

* Update search.py

* Update search.py

* Update search.py

* Update search.py

Commenting issues fixed (spacing and punctuation was off sometimes).

* Update agents.py

* Update canvas.py

Grammar

* Update grid.py

* Update learning.py

Added period

* Update logic.py

Fix quoting

* Update mdp.py

Fixed quoting

* Update nlp.py

Capitalization and punctuation fixes

* Update planning.py

* Update probability.py

* Update rl.py

'th' to 'the'

* Update search.py

* Update text.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update learning.py

Typo

* Update utils.py

* modifies Fig. to Figure all over the repository

* fixed a small type in logic.py

* Change variable names from s_prime to s1, current_state to s1

* Sane default for update_state

* Implemented QLearningAgent

* Added QLearningAgent in Index

*  Used isclose from utils to maintain compatibilty for 3.4

* Removed redundant distancesquared function

* Removed duplicate definition of clip in grid.py and used import from instead.

* Fixed spelling typo

* Made Log Usage Consistent in text.py

* Added Explicit Imports from utils

- Fix relative imports in base of is a package or not
- Fix not working notebooks
- Add notebooks to packages sources