João Cunha

Subject	Reinforcement Learning
Advisor	Nuno Lau, António J. R. Neves
Group	Intelligent Robotics and Systems
Status	PhD student
Starts	2010/02/01
Ends	2015/05/28
Country	Portugal
Projects
Past projects	CAMBADA, LUL
Events
Proposals
Personal page

Publications

Articles in international journals listed in the ISI

• João Cunha, Rui Serra, Nuno Lau, Luís Seabra Lopes, António J. R. Neves. Batch Reinforcement Learning for Robotic Soccer Using the Q-Batch Update-Rule. Journal of Intelligent & Robotic Systems, vol. 80, no. 3, p. 385-399, December 2015 [IF 2015: 0.932 (Q3, 16/25)] [IF 2018: 2.020 (Q3, 17/26)]
• João Cunha, Rui Ferreira, Nuno Lau. Computer vision and robotic manipulation for automated feeding of cork drillers. Materials & Design, vol. 82, p. 290-296, October 2015 [IF 2015: 3.997 (Q1, 45/271)]

Other articles in journals

• João Cunha. A survey on Machine Learning in Mobile Robotics. Electrónica e Telecomunicações, vol. 5, no. 3, p. 304-308, June 2011

Chapters in books

• João Cunha, Eurico Pedrosa, Cristovão Cruz, Nuno Lau, António J. R. Neves, Bernardo Cunha, José Luís Azevedo, Artur Pereira, Ciro Martins, António J. S. Teixeira. Robô de Assistência no Domicílio. Laboratório Vivo de Usabilidade (Living Usability Lab), ARC Publishing, p. 183-199, October 2013

Articles in conference proceedings

• João Cunha, Rui Serra, Nuno Lau, Luís Seabra Lopes, António J. R. Neves. Learning robotic soccer controllers with the Q-Batch update-rule. 2014 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), Espinho, Portugal, p. 134-139, May 2014
• Luis Ferreira, António J. R. Neves, Artur Pereira, Eurico Pedrosa, João Cunha. Human detection and tracking using a Kinect camera for an autonomous service robot. IROBOT 2013 5th International Workshop on Intelligent Robotics, Angra do Heroísmo, Azores, Portugal, p. 276-288, September 2013
• João Cunha, Nuno Lau, António J. R. Neves. Q-Batch: initial results with a novel update rule for Batch Reinforcement Learning. Advances in Aritificial Intelligence - Local Proceedings, EPIA 2013 - XVI Portuguese Conference on Artificial Intelligence, Angra do Heroismo, Azores, Portugal, 9-12 September, Angra do Heroísmo, Azores, Portugal, p. 240-251, September 2013
• Gustavo Corrente, João Cunha, Ricardo Sequeira and Nuno Lau. Cooperative Robotics: Passes in Robotic Soccer. Proc. of 13th International Conference on Autonomous Robot Systems and Competitions, Lisbon, Portugal, p. 82-87, April 2013
• Luis Ferreira, Ricardo Dias, João Cunha, António J. R. Neves, José Luís Azevedo, Bernardo Cunha. Robotic Soccer: a real challenge for cooperative robotics. Proc. of the 18th Portuguese Conf. on Pattern Recognition, RecPad 2012, Coimbra, Portugal, October 2012
• João Cunha, Eurico Pedrosa, Cristóvão Cruz, António J. R. Neves, Nuno Lau, Artur Pereira, Ciro Martins, Nuno Almeida, Bernardo Cunha, José Luís Azevedo, Pedro Fonseca, António J. S. Teixeira. From an autonomous soccer robot to a robotic platform for eldery care. AAL 2012 - 2nd International Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications (In conjuction with BIOSTEC 2012), Vilamoura, Portugal, February 2012
• João Cunha, Eurico Pedrosa, Cristóvão Cruz, António J. R. Neves, Nuno Lau. A mobile service robot for elderly assistance. Proceedings of RecPad2011, Porto, Portugal, October 2011
• João Cunha, Eurico Pedrosa, Cristóvão Cruz, António J. R. Neves, Nuno Lau. Indoor Robot Localization and Navigation Using a Depth Camera. 15th Portuguese Conference on Artificial Intelligence - IROBOT, Lisbon, Portugal, October 2011
• João Cunha, Nuno Lau, João M. O. S. Rodrigues. Ball Interception Behaviour in Robotic Soccer. RoboCup 2011: Robot Soccer World Cup XV, Istanbul, Turkey, p. 114-125, July 2011
• João Cunha, Eurico Pedrosa, Cristóvão Cruz, António J. R. Neves, Nuno Lau. Using a Depth Camera for Indoor Robot Localization and Navigation. Robotics Science and Systems 2011 Workshop on Advanced Reasoning with Depth Cameras, Los Angeles, California, USA, July 2011
• João Cunha, António J. R. Neves, José Luís Azevedo, Bernardo Cunha, Nuno Lau, Artur Pereira, António J. S. Teixeira. A Mobile Robotic Platform for Elderly Care. AAL 2011 - 1st Int. Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications (In conjuction with BIOSTEC 2011), Rome, p. 36-45, January 2011
• António J. S. Teixeira, Nelson Rocha, Miguel Sales Dias, Daniela Braga, Alexandra Queirós, Osvaldo Pacheco, José Alberto Fonseca, Joaquim Sousa Pinto, Hugo Gamboa, Luós Corte-Real, João Fonseca, Joaquim Arnaldo Martins, António J. R. Neves, Paulo Bartolomeu, Catarina Oliveira, João Cunha, Carlos Pereira. A New Living Lab for Usability Evaluation of ICT and Next Generation Networks for Elderly@Home. AAL 2011 - 1st Int. Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications (In conjuction with BIOSTEC 2011), Rome, p. 85-97, January 2011
• João Cunha, Nuno Lau, João M. O. S. Rodrigues, Bernardo Cunha, José Luís Azevedo. Predictive Control for Behavior Generation of Omni-Directional Robots. Progress in Artificial Intelligence, 14th Portuguese Conference on Artificial Intelligence, vol. LNAI 5816, p. 275-286, October 2009

PhD thesis

• João Cunha. Techniques for Batch Reinforcement Learning in Robotics. PhD Thesis, Universidade de Aveiro, May 2015

Masters thesis

• João Cunha. Holonomic Control and Behaviours for the CAMBADA robotic soccer team. Masters Thesis, Universidade de Aveiro, July 2009