Norwegian version of this page

EPEC - Engineering Predictability with Embodied Cognition

How can multimodal systems sense, learn, and predict future events?

EPEC: engineering predictability with embodied cognition

Humans are superior to computers and robots when it comes to perceiving with eyes, ears and other senses as well as combining perception with learned knowledge to choose the best actions. This project aims to develop human-inspired models of behaviour and perception and to show that these models can predict future actions accurately.

Our inspiration comes from embodied cognition, a concept from psychology proposing that our bodies, perceptions, abilities, and form, influences how we think. Our goal is to exploit the form of various systems to develop predictive reasoning models as alternatives to traditional reactive systems. These models will be applied in interdisciplinary fields of music technology and robotics. In music, we aim to provide everyday people new ways to move within musical spaces. Our models learn about their interactions with smartphones to proactively assist with their future actions. In robotics, we are developing robots with dynamic forms that can change their thinking in response to new body shapes.

EPEC explores applications in musical interaction on smartphones and robotics
Musical interaction on smartphones and robotic systems, are EPEC's application areas for new predictive models.

EPEC is directed by Professor Jim Tørresen, who also leads the ROBIN research group in the Department of Informatics. The project employs two post doctoral fellows, Kai Olav Ellefsen and Charles Martin, and PhD researcher Tønnes Nygaard. The project also includes Associate Professor Kyrre Glette, PhD researcher Jørgen Nordmoen, and a number of masters students in machine learning, robotics and music technology.

Objectives

Design, implement and evaluate multimodal systems that are able to sense, learn and predict future events.

Sub-projects

  • Internal Models: Predicting real-world effects through internal simulations
  • DyRET: Dynamic Robot for Embodied Testing
  • Interactive music systems: Computer systems for extending and enhancing musical listening, performance and collaboration.

Master Projects

Researchers from the EPEC group supervise master projects in robotics, music technology, and machine learning. Come work with us on predictive models, embodied interactive systems and new robotic interactions! More information available here.

Funding

Supported by The Research Council of Norway under FRINATEK grant agreement 240862 from 2015 to 2019. The grant funds 1 PhD and 2 post-doc positions (10% of prop. funded).

Publications

  • Charles Patrick Martin; Alexander Refsum Jensenius & Jim Tørresen (2018). Composing an ensemble standstill work for Myo and Bela, In Doug Bowman; Tom Martin & Luke Dahl (ed.),  Proceedings of the International Conference On New Interfaces For Musical Expression.  Virginia Tech.  KAPITTEL.  s 196 - 197
  • Tønnes Frostad Nygaard; Charles Patrick Martin; Eivind Samuelsen; Jim Tørresen & Kyrre Glette (2018). Real-world evolution adapts robot morphology and control to hardware limitations, In hernan aguirre (ed.),  GECCO '18: Proceedings of the Genetic and Evolutionary Computation Conference.  ACM Digital Library.  ISBN 978-1-4503-5618-3.  1.  s 125 - 132
  • Jørgen Halvorsen Nordmoen; Eivind Samuelsen; Kai Olav Ellefsen & Kyrre Glette (2018). Dynamic mutation in MAP-Elites for robotic repertoire generation, In  The 2018 Conference on Artificial Life.  MIT Press.  ISBN 9780262339360.  Konferanseartikkel.  s 598 - 605
  • Jørgen Halvorsen Nordmoen; Kai Olav Ellefsen & Kyrre Glette (2018). Combining MAP-Elites and Incremental Evolution to Generate Gaits for a Mammalian Quadruped Robot. Lecture Notes in Computer Science.  ISSN 0302-9743.  10784 LNCS, s 719- 733
  • Charles Patrick Martin & Jim Torresen (2018). RoboJam: A musical mixture density network for collaborative touchscreen interaction. Lecture Notes in Computer Science.  ISSN 0302-9743.  10783 LNCS, s 161- 176
  • Jim Tørresen (2018). A Review of Future and Ethical Perspectives of Robotics and AI. Frontiers in Robotics and AI.  ISSN 2296-9144.  4
  • Charles Patrick Martin & Jim Tørresen (2017). MicroJam: An App for Sharing Tiny Touch-Screen Performances, In Cumhur Erkut (ed.),  Proceedings of the International Conference on New Interfaces for Musical Expression.  Aalborg University Copenhagen.  Chapter.  s 495 - 496
  • Charles Patrick Martin & Jim Tørresen (2017). Exploring Social Mobile Music with Tiny Touch-Screen Performances, In Jukka Pätynen; Tapio Lokki & Vesa Välimäki (ed.),  Proceedings of the 14th Sound and Music Computing Conference 2017.  Aalto University.  ISBN 978-952-60-3729-5.  Conference Paper.  s 175 - 180
  • Kai Olav Ellefsen & Jim Tørresen (2017). Evolving neural networks with multiple internal models, In Jonathan Rouzaud-Cornabas; Dusan Misevic; Guillaume Beslon; Carole Knibbe; David Parsons; Hedi Soula; Olivier Simonin; Salima Hassas & Nicolas Bredèche (ed.),  Proceedings of the European Conference on Artificial Life 2017.  MIT Press.  ISBN 978-0-262-34633-7.  Artikkel.  s 138 - 145
  • Torkil Aamodt & Jim Tørresen (2017). Comparing Neural Networks for Predicting Stock Markets, In Giacomo Boracchi; Aristidis Likas; Lazaros Iliadis & Chrisina Jayne (ed.),  Proceedings of 18th International Conference, EANN 2017, Athens, Greece, August 25–27, 2017.  Springer.  ISBN 978-3-319-651712.  Artikkel.  s 363 - 375
  • Charles Patrick Martin; Kai Olav Ellefsen & Jim Tørresen (2017). Deep Models for Ensemble Touch-Screen Improvisation, In Tony Stockman; George Fazekas & Mathieu Barthet (ed.),  Proceedings of the 12th International Audio Mostly Conference: Augmented and Participatory Sound and Music Experiences.  Association for Computing Machinery (ACM).  ISBN 978-1-4503-5373-1.  Conference paper.
  • Kai Olav Ellefsen; Herman Lepikson & Jan Albiez (2017). Multiobjective Coverage Path Planning: Enabling Automated Inspection of Complex, Real-World Structures. Applied Soft Computing.  ISSN 1568-4946.  s 264- 282
  • Tønnes Frostad Nygaard; Eivind Samuelsen & Kyrre Glette (2017). Overcoming initial convergence in multi-objective evolution of robot control and morphology using a two-phase approach. Lecture Notes in Computer Science.  ISSN 0302-9743.  10199 LNCS, s 825- 836
  • Charles Patrick Martin (2017). Percussionist-Centred Design for Touchscreen Digital Musical Instruments. Contemporary Music Review.  ISSN 0749-4467.  36, s 64- 85
  • Kristian Nymoen; Arjun Chandra & Jim Tørresen (2016). Self-awareness in Active Music Systems, In Jim Tørresen; Marco Platzner; Xin Yao; Peter R. Lewis & Bernhard Rinner (ed.),  Self-aware Computing Systems.  Springer.  ISBN 978-3-319-39674-3.  Kapittel 14.  s 279 - 296
  • Justinas Miseikis; Kyrre Glette; Ole Jakob Elle & Jim Tørresen (2016). Automatic Calibration of a Robot Manipulator and Multi 3D Camera System, In Yasuhisa Hirata (ed.),  Proc. of 2016 IEEE/SICE International Symposium on System Integration.  IEEE conference proceedings.  ISBN 978-1-5090-3329-4.  Artikkel.  s 735 - 741
  • Tønnes Frostad Nygaard; Jim Tørresen & Kyrre Glette (2016). Multi-objective Evolution of Fast and Stable Gaits on a Physical Quadruped Robotic Platform, In Yaochu Jin & Stefanos Kollias (ed.),  Proc. of 2016 IEEE Symposium Series on Computational Intelligence (SSCI).  IEEE conference proceedings.  ISBN 978-1-5090-4240-1.  Artikkel.
  • Jim Tørresen; Andreas Høyer Iversen & Ralf Greisiger (2016). Data from Past Patients used to Streamline Adjustment of Levels for Cochlear Implant for New Patients, In Stefanos Kollias & Yaochu Jin (ed.),  Proc. of 2016 IEEE Symposium Series on Computational Intelligence (SSCI).  IEEE conference proceedings.  ISBN 978-1-5090-4240-1.  Artikkel.
  • Andreas Færøvig Olsen & Jim Tørresen (2016). Smartphone Accelerometer Data used for Detecting Human Emotions, In Xiang Fei & Lipo Wang (ed.),  Proceedings of 2016 3rd International Conference on Systems and Informatics.  IEEE conference proceedings.  ISBN 978-1-5090-5520-3.  Artikkel.  s 410 - 415
  • Justinas Miseikis; Kyrre Glette; Ole Jakob Elle & Jim Tørresen (2016). Multi 3D Camera Mapping for Predictive and Reflexive Robot Manipulator Trajectory Estimation, In Yaochu Jin & Stefanos Kollias (ed.),  Proc. of 2016 IEEE Symposium Series on Computational Intelligence (SSCI).  IEEE conference proceedings.  ISBN 978-1-5090-4240-1.  1.

View all works in Cristin

  • Tønnes Frostad Nygaard; Vegard Dønnem Søyseth; Jørgen Halvorsen Nordmoen & Kyrre Glette (2018). Stand with the DyRET robot.
  • Charles Patrick Martin (2018). Deep Predictive Models in Interactive Music.
  • Jim Tørresen (2018). Artificial Intelligence – State-of-the-art.
  • Jim Tørresen (2018). Roboter kommer nærmere – skal vi glede eller grue oss?.
  • Jim Tørresen (2018). Kunstig Intelligens – Lærende og tilpasningsdyktig teknologi.
  • Jim Tørresen (2018). Remote Lab and Applications for High Performance and Embedded Architectures.
  • Charles Patrick Martin; Alexander Refsum Jensenius & Jim Tørresen (2018). Composing an ensemble standstill work for Myo and Bela.
  • Charles Patrick Martin; Kyrre Glette; Tønnes Frostad Nygaard & Jim Tørresen (2018). Self-Awareness in a Cyber-Physical Predictive Musical Interface.
  • Charles Patrick Martin (2018). Predictive Music Systems for Interactive Performance.
  • Charles Patrick Martin; Kyrre Glette & Jim Tørresen (2018). Creative Prediction with Neural Networks.
  • Enrique Alejandro Garcia Ceja; Kai Olav Ellefsen; Charles Patrick Martin & Jim Tørresen (2018). Prediction, Interaction, and User Behaviour.
  • Tønnes Frostad Nygaard (2018). Real-World Evolution Adapts Robot Morphology and Control to Hardware Limitations.
  • Kyrre Glette (2018). Automatic design of bodies and behaviors for real-world robots.
  • Tønnes Frostad Nygaard; Charles Patrick Martin; Jim Tørresen & Kyrre Glette (2018). Exploring Mechanically Self-Reconfiguring Robots for Autonomous Design.
  • Jim Tørresen; Enrique Alejandro Garcia Ceja; Kai Olav Ellefsen & Charles Patrick Martin (2018). Equipping Systems with Forecasting Capabilities.
  • Jim Tørresen (2018). Intelligent Systems for Medical and Healthcare Applications.
  • Jim Tørresen (2018). Ethical Robots and Autonomous Systems.
  •  (2018). Stillness under Tension.
  •  (2018). Stillness under Tension.
  •  (2018). How Roboticists Are Copying Nature To Make Fantastical Machines.
  •  (2018). How a shape-shifting robot is learning from its mistakes.
  •  (2018). The shape-shifting robot that evolves by falling down.
  •  (2018). New Evolving Robot Teaches Itself to Walk Through Trial and Error.
  •  (2018). This robot taught itself how to walk and it’s as clumsy as a newborn deer.
  •  (2018). How a Flock of Drones Developed Collective Intelligence.
  •  (2018). Fem felt der vi får en førerløs fremtid.
  •  (2018). Dynamic Robot for Embodied Testing, Open Source Material.
  •  (2018). MicroJam.
  • Bjørn Ivar Teigen (2018). An Active Learning Perspective on Exploration in Reinforcement Learning.
  • Matias Hermanrud Fjeld (2018). 3D Spatial Navigation in Octrees with Reinforcement Learning.
  • Henrik Brustad (2018). Digital Audio Generation with Neural Networks.
  • Benedikte Wallace (2018). Predictive songwriting with concatenative accompaniment.
  • Jim Tørresen (2018). Når etikk betyr alt. Dagens næringsliv.  ISSN 0803-9372.
  • Kai Olav Ellefsen (2017). Evolutionary Robotics: Automatic design of robot bodies and control.
  • Kai Olav Ellefsen (2017). Automating Robot Design with Evolutionary Algorithms.
  • Jim Tørresen (2017). Artificial Intelligence by Nature Inspired Computing.
  • Jim Tørresen (2017). Unleashing Artificial Intelligence in the Real World.
  • Jim Tørresen (2017). Sensing and Reasoning Technology Applied within Mental Health Treatment and Elderly Care Robot Companions.
  • Jim Tørresen (2017). Robotics activity at Robotics and Intelligent Systems Group University of Oslo.
  • Jim Tørresen (2017). Making Systems Intelligent by Biologically Inspired Computing.
  • Jim Tørresen (2017). Opportunities and Challenges with Artificial Intelligence.
  • Jim Tørresen (2017). Making Technology Adaptive by Biologically Inspired Computing.
  • Tønnes Frostad Nygaard (2017). Presentation on Robotics: Today and the future.
  • Jim Tørresen (2017). Brazilian Student Exchange Opportunities to University of Oslo.
  • Charles Patrick Martin (2017). MicroJam: A Social App for Making Music.
  • Jim Tørresen (2017). Artificial Intelligence – What is it and what can it be applied to?.
  • Charles Patrick Martin (2017). Making Social Music with MicroJam.
  • Charles Patrick Martin (2017). Virtuosic Interactions / Performing with a Neural iPad Band.
  • Kai Olav Ellefsen & Jim Tørresen (2017). Evolving neural networks with multiple internal models.
  • Kyrre Glette (2017). Self-teaching robots.
  • Charles Patrick Martin (2017). Musical Networks: Using Recurrent Neural Networks to Model and Complement Musical Creativity.
  • Jim Tørresen (2017). Artificial Intelligence and Examples of Real-world Applications.
  • Jim Tørresen (2017). Intelligent Machines – Opportunities and Challenges.
  • Jim Tørresen (2017). Ethical Concerns in Artificial Intelligence and Robotics Deployments.
  •  (2017). Ensemble Metatone - Improvised Touchscreen Performance.
  •  (2017). Sverm-Muscle.
  •  (2017). Robotane må tilpasse seg oss menneske.
  • Tannaz Navaie Roshandel (2017). System Control for Safe Autonomous Navigation of Robot Systems for Elderly Care.
  • Lexu Qi (2017). Using Skeleton Information for Human Identification for Elderly Care and Alarm System with the XBox One Kinect Sensor.
  • Mathias Ciarlo Thorstensen (2017). Visualization of Robotic Sensor Data with Augmented Reality.
  • Hans Fredrik Fahle (2017). Predicting Gaits Based on Prior Experience.
  • Jiader Chou (2017). Terrain classification using 3D optical tactile sensor.
  • Jim Tørresen (2016). Artificial intelligence in autonomous systems.
  • Jim Tørresen (2016). Teknologi som kan tilpasse seg gjennom læring.
  • Kyrre Glette (2016). Self-teaching robots.
  • Jim Tørresen (2016). Smartphone Analysis of Human Behaviour for Interactive Music Systems.
  •  (2016). Nå kommer robotene som lærer som et menneske.
  • Jim Tørresen (2016). Maskiner som tenker. Psykologisk tidsskrift.  ISSN 1501-7508.  20, s 36- 40
  •  (2015). Alan Turing opp til prøve.

View all works in Cristin

Tags: machine learning, robotics, interactive music
Published May 24, 2016 3:38 PM - Last modified July 8, 2018 4:03 PM