Luis Paulo Reis

Position	Associate professor
Affiliation	University of Minho
Group	Intelligent Robotics and Systems
Status	Researcher with PhD
Country	Portugal
Students	Fernando Duarte, Miguel Abreu
Former PhD students	Abbas Abdolmaleki, Luís Henrique R. Mota, Nima Shafii, David Simões
Former masters students
Courses
Projects
Past projects	ACORD, EUROC, FCP Rescue, FCPortugal, FCPortugal FCT, IntellWheels
Events	EPIA2013
Proposals
ORCID	0000-0002-4709-1718
Personal page

Publications

Books

• Luis Paulo Reis, Luís Correia, Nuno Lau, Reinaldo Bianchi. IROBOT 2008 - 3rd International Workshop on Intelligent Robotics. Lisbon University Institute – ISCTE, October 2008

Articles in international journals listed in the ISI

• Simão Reis, Luis Paulo Reis, Nuno Lau. Game Adaptation by Using Reinforcement Learning Over Meta Games. Group Decision and Negotiation, January 2020 [IF 2018: 2.010 (Q1, 21/104), 2.010 (Q1, 21/104)]
• David Simões, Nuno Lau, Luis Paulo Reis. Multi-agent actor centralized-critic with communication. Neurocomputing, January 2020 [IF 2018: 4.072 (Q1, 28/134)]
• Abbas Abdolmaleki, David Simões, Nuno Lau, Luis Paulo Reis, Gerhard Neumann. Contextual Direct Policy Search: With Regularized Covariance Matrix Estimation. Journal of Intelligent & Robotic Systems, vol. 96, no. 2, p. 141-157, November 2019 [IF 2018: 2.020 (Q3, 17/26)]
• Abbas Abdolmaleki, Nuno Lau, Luis Paulo Reis, Jan Peters, Gerhard Neumann. Contextual policy search for linear and nonlinear generalization of a humanoid walking controller. Journal of Intelligent & Robotic Systems, vol. 83, no. 3, p. 393-408, September 2016 [IF 2016: 1.512 (Q3, 17/26)] [IF 2018: 2.020 (Q3, 17/26)]
• Brígida Mónica Faria, Luis Paulo Reis, Nuno Lau. A Methodology for Creating an Adapted Command Language for Driving an Intelligent Wheelchair. Journal of Intelligent & Robotic Systems, vol. 80, no. 3, p. 609-623, December 2015 [IF 2015: 0.932 (Q3, 16/25)] [IF 2018: 2.020 (Q3, 17/26)]
• Nima Shafii, Abbas Abdolmaleki, Nuno Lau, Luis Paulo Reis. Development of an Omnidirectional Walk Engine for Soccer Humanoid Robots. International Journal of Advanced Robotic Systems, vol. 12, no. 193, December 2015 [IF 2015: 0.615 (Q4, 19/25)]
• Nima Shafii, Nuno Lau, Luis Paulo Reis. Learning to Walk Fast: Optimized Hip Height Movement for Simulated and Real Humanoid Robots. Journal of Intelligent & Robotic Systems, vol. 80, no. 3, p. 555-571, December 2015 [IF 2015: 0.932 (Q3, 16/25)] [IF 2018: 2.020 (Q3, 17/26)]
• Brígida Mónica Faria, Luis Paulo Reis, Nuno Lau. Adapted Control Methods for Cerebral Palsy Users of an Intelligent Wheelchair. Journal of Intelligent & Robotic Systems, vol. 77, no. 2, p. 299-312, February 2015 [IF 2015: 0.932 (Q3, 16/25)] [IF 2018: 2.020 (Q3, 17/26)]
• João Cravo, Fernando Almeida, Pedro Henriques Abreu, Luis Paulo Reis, Nuno Lau, Luís Mota. Strategy planner: Graphical definition of soccer set-plays. Data & Knowledge Engineering, vol. 94, Part A, p. 110-131, November 2014 [IF 2014: 1.115 (Q2, 61/139)]
• Fernando Almeida, Pedro Henriques Abreu, Nuno Lau, Luis Paulo Reis. An automatic approach to extract goal plans from soccer simulated matches. Soft Computing, vol. 17, no. 5, p. 835-848, May 2013 [IF 2013: 1.304 (Q2, 59/121)] [IF 2018: 2.784 (Q2, 53/134)]
• Brígida Mónica Faria, Sérgio Vasconcelos, Luis Paulo Reis, Nuno Lau. Evaluation of Distinct Input Methods of an Intelligent Wheelchair in Simulated and Real Environments: A Performance and Usability Study. Assistive Technology, vol. 25, no. 2, p. 88-98, May 2013 [IF 2013: 1.300 (Q2, 26/69)]
• Luís Mota, Luis Paulo Reis, Nuno Lau. Multi-robot coordination using setplays in the middle-size and simulation leagues. Mechatronics, vol. 21, no. 2, p. 434-444, March 2011 [IF 2011: 1.255 (Q1, 28/122)]

Other articles in journals

• Brígida Mónica Faria, Luis Paulo Reis, Nuno Lau. Knowledge Discovery and Multimodal Inputs for Driving an Intelligent Wheelchair. International Journal of Knowledge Discovery in Bioinformatics (IJKDB), vol. 2, no. 4, October 2012
• Luis Rei, Luis Paulo Reis, Nuno Lau. Optimizing a Humanoid Robot Skill. Robotica - Automação Controlo Instrumentação, no. 86, p. 10-15, January 2012
• Brígida Mónica Faria, Gladys Castillo, Nuno Lau, Luis Paulo Reis. Classification of FC Portugal Robotic Soccer Formations: a Comparative Study of Machine Learning Algorithms. Robótica, no. 92, p. 4-9, October 2011
• Nuno Lau, Luis Paulo Reis, João Certo. FC Portugal Rescue: High Level Coordination in the RoboCup Rescue Simulation. Electrónica e Telecomunicações, September 2008

Chapters in books

• Luis Paulo Reis, Fernando Almeida, Luis Mota, Nuno Lau. Coordination in Multi-robot systems: Applications in robotic soccer. Agents and Artificial Intelligence, Joaquim Filipe, Ana Fred (Ed.), Springer Berlin Heidelberg, vol. Communications in Computer and Information Science 358, p. 3-21, 2013
• Nuno Lau, Luis Paulo Reis. FC Portugal - High-level Coordination Methodologies in Soccer Robotics. Robotic Soccer, Pedro Lima, ISBN 978-3-902613-21-9 (Ed.), I-Tech Education and Publishing, p. 167 - 192, December 2007
• Nuno Lau, Luis Paulo Reis, João Certo. Understanding Dynamic Agent’s Reasoning. Progress in Artificial Intelligence, 13th Portuguese Conference on Artificial Intelligence, EPIA 2007, Guimarães, Portugal, December 3-6, 2007, José Maia Neves, Manuel Filipe Santos, José Manuel Machado (Ed.), Springer, vol. LNCS 4874, p. 542-551, December 2007
• João Certo, Nuno Lau, Luis Paulo Reis. A Generic Strategic Layer for Collaborative Networks. Establishing the Foundations for Collaborative Networks, L. Camarinha-Matos, H. Afsarmanesh, P. Novais, C. Analide (Ed.), Springer, Boston, p. 273-282, September 2007

Articles in conference proceedings

• Fernando Duarte, Nuno Lau, Artur Pereira, Luis Paulo Reis. Benchmarking Deep and Non-deep Reinforcement Learning Algorithms for Discrete Environments. Robot 2019: Fourth Iberian Robotics Conference, vol. Advances in Intelligent Systems and Computing, vol 1093, p. 263-275, 2020
• David Simões, Pedro Amaro, Tiago Silva, Nuno Lau, Luis Paulo Reis. Learning Low-Level Behaviors and High-Level Strategies in Humanoid Soccer. Robot 2019: Fourth Iberian Robotics Conference, vol. Advances in Intelligent Systems and Computing, vol 1093, p. 537-548, 2020
• David Simões, Nuno Lau, Luis Paulo Reis. Adjusted Bounded Weighted Policy Learner. RoboCup 2018: Robot World Cup XXII, Montreal, vol. LNCS 11374, Springer, p. 324-336, 2019
• Miguel Abreu, Luis Paulo Reis, Nuno Lau. Learning to Run Faster in a Humanoid Robot Soccer Environment Through Reinforcement Learning. RoboCup 2019: Robot World Cup XXIII, Sydney, vol. LNCS 11531, Springer, p. 3-15, 2019
• David Simões, Nuno Lau, Luis Paulo Reis. Multi-Agent Deep Reinforcement Learning with Emergent Communication. IJCNN 2019 - International Joint Conference on Neural NetworksProceedings, Budapest, Hungary, July 2019
• Simão Reis, Luis Paulo Reis, Nuno Lau. Automatic Generation of a Sub-optimal Agent Population with Learning. WorldCIST'19 - New Knowledge in Information Systems and Technologies, La Toja, Spain, vol. Springer AISC 931, p. 65-74, April 2019
• Miguel Abreu, Nuno Lau, Armando Sousa, Luis Paulo Reis. Learning low level skills from scratch for humanoid robot soccer using deep reinforcement learning. ICARSC 2019: 19TH IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, Gondomar, Portugal, vol. IEEE, April 2019
• David Simões, Nuno Lau, Luis Paulo Reis. Multi-agent Neural Reinforcement-Learning System with Communication. WorldCIST'19 - New Knowledge in Information Systems and Technologies, La Toja, Spain, vol. Springer AISC 931, p. 3-12, April 2019
• Simão Reis, Luis Paulo Reis, Nuno Lau. Player Engagement Enhancement with Video Games. WorldCIST'19 - New Knowledge in Information Systems and Technologies, La Toja, Spain, vol. Springer AISC 931, p. 263-272, April 2019
• David Simões, Nuno Lau, Luis Paulo Reis. Guided Deep Reinforcement Learning in the GeoFriends2 Environment. IJCNN 2018 : International Joint Conference on Neural Networks, Rio de Janeiro, Brazil, July 2018
• Abbas Abdolmaleki, David Simões, Nuno Lau, Luis Paulo Reis, Bob Price, Gerhard Neumann. Stochastic Search In Changing Situations. The AAAI-17 Workshop on Human-Machine Collaborative Learning, p. 636-642, 2017
• Valter Costa, João Resende, Patrícia Sousa, Armando Sousa, Luis Paulo Reis, Nuno Lau. Fostering Efficient Learning in the Technical Field of Robotics by Changing the Autonomous Driving Competition of the Portuguese Robotics Open. 10th annual International Conference of Education, Research and Innovation, Seville, Spain, p. 7705-7711, November 2017
• Gi Hyun Lim, Eurico Pedrosa, Filipe Amaral, Ricardo Dias, Artur Pereira, Nuno Lau, José Luís Azevedo, Bernardo Cunha, Luis Paulo Reis. Human-Robot Collaboration and Safety Management for Logistics and Manipulation Tasks. Robot 2017: Third Iberian Robotics Conference, Seville, Spain, p. 871-882, November 2017
• David Simões, Nuno Lau, Luis Paulo Reis. Mixed-Policy Asynchronous Deep Q-Learning. Robot2017: Third Iberian Robotics Conference, Seville, Spain, p. 976-987, November 2017
• David Simões, Nuno Lau, Luis Paulo Reis. Multi-agent Double Deep Q-Networks. Progress in Artificial Intelligence 18th EPIA Conference on Artificial Intelligence, EPIA 2017 Porto, Portugal, September 5–8, 2017 Proceedings, Porto, Portugal, vol. LNCS 10423, p. 123-134, September 2017
• Abbas Abdolmaleki, Bob Price, Nuno Lau, Luis Paulo Reis, Gerhard Neumann. Contextual Covariance Matrix Adaptation Evolutionary Strategies. Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI-17), Melbourne, Australia, p. 1378-1385, August 2017
• Abbas Abdolmaleki, Bob Price, Nuno Lau, Luis Paulo Reis, Gerhard Neumann. Deriving and Improving CMA-ES with Information Geometric Trust Regions. GECCO - The Genetic and Evolutionary Computation Conference, Berlin, Germany, July 2017
• Gi Hyun Lim, Eurico Pedrosa, Filipe Amaral, Nuno Lau, Artur Pereira, Paulo Dias, José Luís Azevedo, Bernardo Cunha, Luis Paulo Reis. Rich and Robust Human-Robot Interaction on Gesture Recognition for Assembly Tasks. 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC) April 26-, Coimbra, Portugal, p. 159-164, April 2017
• Filipe Amaral, Eurico Pedrosa, Gi Hyun Lim, Nima Shafii, Artur Pereira, José Luís Azevedo, Bernardo Cunha, Luis Paulo Reis, Simone Badini, Nuno Lau. Skill-based Anytime Agent Architecture for Logistics and Manipulation Tasks EuRoC Challenge 2, Stage II – REALISTIC LABS: Benchmarking. 2017 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), Coimbra, Portugal, p. 198-203, April 2017
• Abbas Abdolmaleki, Nuno Lau, Luis Paulo Reis, Gerhard Neumann. Non-parametric contextual stochastic search. (2016) IEEE International Conference on Intelligent Robots and Systems, South Korea, p. 2643-2648, November 2016
• ...further results