Publications

 



  2. • Maei, H.R. (2011).  Gradient Temporal-Difference Learning Algorithms. PhD Thesis, University of Alberta. [PDF]

  3. • Maei, H.R., Szepesvári, Cs., Bhatnagar S., Sutton R.S. (2010).  Toward Off-Policy Learning Control with Function Approximation.  To appear in Proceedings of the 27th International Conference on Machine Learning (ICML-10). Haifa, Israel. [PDF]

    1. •Acceptance rate: 25%.


  5. •Maei, H. R., Sutton, R. S. (2010). GQ(λ): A general gradient algorithm for temporal-difference prediction learning with eligibility traces. In Proceedings of the Third Conference on Artificial General Intelligence (AGI-10), Lugano, Switzerland. [PDF]


  1. • Maei, H. R, Szepesvari, Cs, Bhatnagar, S., Precup, D., Silver D., Sutton, R. S. (2009). "Convergent Temporal-Difference Learning with Arbitrary Smooth  Function Approximation."  In Advances in Neural Information Processing Systems 22 (NIPS-09), Vancouver, BC. December 2009. MIT Press. [PDF], [Correction]

    1. • Acceptance rate with spotlight: 8%. 


  3. • Sutton, R. S., Maei, H. R., Precup, D., Bhatnagar, S., Silver, D., Szepesvari, Cs., Wiewiora, E. (2009). "Fast gradient-descent methods for temporal-difference learning with linear function approximation." In Proceedings of the 26th International Conference on Machine Learning (ICML-09), Montreal, Canada. [PDF]

    1. • Acceptance rate: 25%.


  5. • Sutton, R. S., Szepesvari, Cs., Maei, H. R. (2009). A Convergent O(n) Algorithm for Off-policy Temporal-difference Learning with Linear Function Approximation. In Advances in Neural Information Processing Systems 21(NIPS-09), Vancouver, BC. December 2008. MIT Press. [PDF]

    1. • Acceptance rate: 24%.


  7. • Maei, H.R., Zaslavsky, K., Wang, A.H., Yiu, A.P.,  Teixeira, C.M.,  Josselyn, S.A.,  Frankland, P.W. (2009). Development and validation of a sensitive entropy-based measure for the water maze. Front Integr Neurosci. 3:33. Epub. [PDF]


  1. • Maei, H.R., Zaslavsky, K., Teixeira, C.M.,  Frankland, P.W. (2009). What is the most sensitive measure of water maze probe test performance? Front Integr Neurosci. 3:4. Epub. [PDF]


  1. • Teixeira, C.M.,  Pomedli, S.R.,  Maei, H.R., Kee, N.,  Frankland, P.W. (2006). Involvement of the anterior cingulate cortex in the expression of remote spatial memory. Journal of Neuroscience. 26 (29):  7555-64. [PDF]


  1. • Sandler, N., Maei, H.R., Kondev, J. (2004). Correlated quantum percolation in the lowest Landau level.  Physical Rev. B. 70, 045309 [PDF]


  1. • Sandler, N.,  Maei, H.R., Kondev, J. (2003). Quantum and classical localization in the lowest Landau level. Physical Rev. B. 68, 205315. [PDF]


Master's Thesis and miscellaneous:


  1. •Maei, H.R. (2005). How can realistic networks process time-varying signals?  M.Phil. Thesis,  Gatsby Computational Neuroscience Unit, University College London. [PDF]

  2.    Also see Society for Neuroscience poster (2004) [PDF]

  3.    REF: How can realistic networks process time-varying signals?

  4.            H.R. Maei and P.E. Latham. How can realistic networks process time-varying signals?

  5.            Soc. Neurosc. Abstr. 30:648.4 (2004). 


  1. • Maei, H.R. (2006). Productivity is not simple to evaluate. Nature 443, 906  (Letter in nature

  2.  correspondence).