This is an old revision of the document!


Daniel Nyga, M.Sc. (TUM)

daniel_nyga.jpg
Research Staff

Room: 1.77
Tel: –49 -421 218 64008
Fax: –49 -421 218 64047
Mail: nyga(at)cs[dot]uni-bremen[dot]de

About

Before I joined the Institute for Artificial Intelligence, I studied Computer Science at Technische Universität München, where I received my Master's degree in 2010 (with distinction). In February 2011 I started my PhD supervised by Prof. Michael Beetz at the Intelligent Autonomous Systems group at TUM, which I am now continuing at the IAI, University of Bremen.

I'm working on the import of action-specific knowledge from the World Wide Web into the knowledge bases of our mobile robots. In particular, my current research focuses on understanding natural language, in order to enable a robot to autonomously acquire new high-level skills by querying web pages such as eHow.com or wikiHow.com.

My work aims at building up action-specific knowledge bases from various knowledge sources, such as natural language, interactive computer games, observations of humans performing everyday activity or experience data of a robot.

Knowledge about actions and objects is represented as Probabilistic Robot Action Cores (PRAC), which can be thought of generic event patterns that enable a robot to infer important information that is missing in an original natural-language instruction. PRAC models are represented in Markov Logic Networks, a powerful knowlegde represenation formalism combing first-order logic and probability theory.

I am involved in the European research projects RoboHow (http://www.robohow.org) and ACAT.

I am also the lead developer in the projects pracmln and PRAC.

If you are interested in a student project in any of the above topics, please contact me via E-Mail or just drop into my office.

Fields of Interest

  • Artificial Intelligence
  • Probability Theory
  • Probabilistic Knowledge Processing
  • Machine Learning
  • Statistical Relational Learning
  • Data Mining/Knowledge Discovery
  • Automated Learning/Understanding of WWW information
  • Natural-Language Understanding

Teaching

  • AI: Knowledge Acquisition and Representation (WS2016/17) (Lecturer)
  • AI: Knowledge Acquisition and Representation (WS2015/16) (Lecturer)
  • Foundations of Artificial Intelligence (SS2015) (Tutorial/Co-Lecturer)
  • AI: Knowledge Acquisition and Representation (WS2014/15) (Lecturer)
  • Foundations of Artificial Intelligence (SS2014) (Tutorial)
  • AI: Knowledge Acquisition and Representation (WS2013/14) (Co-Lecturer)
  • Foundations of Artificial Intelligence (SS2013) (Tutorial)
  • Technical Cognitive Systems (Lecture & Tutorial, at TUM) (SS2012)
  • Techniques in Artificial Intelligence (Tutorial, at TUM) (WS2011/12)
  • Discrete Probability Theory (Tutorial, at TUM) (SS2011)

Supervised Theses

  • Lifelong Learning of First-order Probabilistic Models for Everyday Robot Manipulation (Master's Thesis, Marc Niehaus)
  • Scaling Probabilistic Completion of Robot Instructions through Semantic Information Retrieval (Master's Thesis, Sebastian Koralewski)
  • To see what no robot has seen before - Recognizing objects based on natural-language descriptions (Master's Thesis, Mareike Picklum)
  • Web-enabled Learning of Models for Word Sense Disambiguation (Bachelor Thesis, Stephan Epping)
  • Grounding Words to Objects: A Joint Model for Co-reference and Entity Resolution Using Markov Logic Networks for Robot Instruction Processing (Diploma Thesis, Florian Meyer)

Publications

Journal Articles and Book Chapters
[1]Beetz, Michael, Bálint-Benczédi, Ferenc, Blodow, Nico, Kerl, Christian, Márton, Zoltán-Csaba, Nyga, Daniel, Seidel, Florian, Wiedemeyer, Thiemo and Worch, Jan-Hendrik, "RoboSherlock: Unstructured Information Processing Framework for Robotic Perception", In Handling Uncertainty and Networked Structure in Robot Control, Springer International Publishing, Cham, pp. 181–208, 2015. [bibtex] [url] [doi]
[2]Michael Beetz, Hagen Langer and Daniel Nyga, "Planning Everyday Manipulation Tasks–Prediction-based Transformation of Structured Activity Descriptions", Chapter in Exploring Cybernetics, Springer, pp. 63–83, 2015. [bibtex]
[3]Nyga, Daniel and Beetz, Michael, "Cloud-based Probabilistic Knowledge Services for Instruction Interpretation", Chapter in Robotics Research, Springer, vol. 2, pp. 649–664, 2018. [bibtex]
Conference Papers
[4]Moritz Tenorth, Daniel Nyga and Michael Beetz, "Understanding and Executing Instructions for Everyday Manipulation Tasks from the World Wide Web", In IEEE International Conference on Robotics and Automation (ICRA), Anchorage, AK, USA, pp. 1486–1491, 2010. [bibtex] [url]
[5]Daniel Nyga, Moritz Tenorth and Michael Beetz, "How-Models of Human Reaching Movements in the Context of Everyday Manipulation Activities", In IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 2011. [bibtex] [url]
[6]Daniel Nyga and Michael Beetz, "Everything Robots Always Wanted to Know about Housework (But were afraid to ask)", In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal, 2012. [bibtex] [url]
[7]Daniel Nyga, Ferenc Balint-Benczedi and Michael Beetz, "PR2 Looking at Things: Ensemble Learning for Unstructured Information Processing with Markov Logic Networks", In IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China, 2014. [bibtex] [url]
[8]Nicholas Hubert Kirk, Daniel Nyga and Michael Beetz, "Controlled Natural Languages for Language Generation in Artificial Cognition", In IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China, 2014. [bibtex] [url]
[9]Michael Beetz, Ferenc Balint-Benczedi, Nico Blodow, Daniel Nyga, Thiemo Wiedemeyer and Zoltan-Csaba Marton, "RoboSherlock: Unstructured Information Processing for Robot Perception", In IEEE International Conference on Robotics and Automation (ICRA), Seattle, Washington, USA, 2015. Best Service Robotics Paper Award [bibtex] [pdf]
[10]Gheorghe Lisca, Daniel Nyga, Ferenc Bálint-Benczédi, Hagen Langer and Michael Beetz, "Towards Robots Conducting Chemical Experiments", In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 2015. [bibtex] [url]
[11]Daniel Nyga and Michael Beetz, "Reasoning about Unmodelled Concepts – Incorporating Class Taxonomies in Probabilistic Relational Models", In Arxiv.org, 2015. Preprint [bibtex] [url]
[12]Daniel Nyga and Michael Beetz, "Cloud-based Probabilistic Knowledge Services for Instruction Interpretation", In International Symposium of Robotics Research (ISRR), Sestri Levante (Genoa), Italy, 2015. [bibtex] [url]
[13]Daniel Nyga, Mareike Picklum and Michael Beetz, "What No Robot Has Seen Before – Probabilistic Interpretation of Natural-language Object Descriptions", In International Conference on Robotics and Automation (ICRA), Singapore, 2017. [bibtex] [url]
[14]Daniel Nyga, Mareike Picklum, Sebastian Koralewski and Michael Beetz, "Instruction Completion through Instance-based Learning and Semantic Analogical Reasoning", In International Conference on Robotics and Automation (ICRA), Singapore, 2017. [bibtex] [url]
[15]Pomarlan, Mihai, Nyga, Daniel, Picklum, Mareike, Koralewski, Sebastian and Beetz, Michael, "Deeper Understanding of Vague Instructions through Simulated Execution (Extended Abstract)", In Proceedings of the 2017 International Conference on Autonomous Agents & Multiagent Systems, International Foundation for Autonomous Agents and Multiagent Systems, 2017. [bibtex] [pdf]
[16]Nyga, Daniel, Roy, Subhro, Paul, Rohan, Park, Daehyung, Pomarlan, Mihai, Beetz, Michael and Roy, Nicholas, "Grounding Robot Plans from Natural Language Instructions with Incomplete World Knowledge", In 2nd Conference on Robot Learning (CoRL 2018), Zurich, Switzerland, 2018. [bibtex] [pdf]
[17]Daniel Nyga, Mareike Picklum, Tom Schierenbeck and Michael Beetz, "Joint Probability Trees", In Arxiv.org, 2023. Preprint [bibtex] [url]
Other Publications
[18]Moritz Tenorth, Daniel Nyga and Michael Beetz, "Understanding and Executing Instructions for Everyday Manipulation Tasks from the World Wide Web", Technical report, IAS group, Technische Universität München, Fakultät für Informatik, 2009. [bibtex]
[19]Daniel Nyga, "Interpretation of Natural-language Robot Instructions: Probabilistic Knowledge Representation, Learning, and Reasoning", PhD thesis, University of Bremen, 2017. [bibtex] [pdf]





Prof. Dr. hc. Michael Beetz PhD
Head of Institute

Contact via
Andrea Cowley
assistant to Prof. Beetz
ai-office@cs.uni-bremen.de

Discover our VRB for innovative and interactive research


Memberships and associations:


Social Media: