<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Reinforcement Learning | Mobile Robotics Research Group — Prof. Dr. Christian Pfitzner</title><link>https://christianpfitzner.github.io/forschungsgruppe-mobile-robotik/en/tag/reinforcement-learning/</link><atom:link href="https://christianpfitzner.github.io/forschungsgruppe-mobile-robotik/en/tag/reinforcement-learning/index.xml" rel="self" type="application/rss+xml"/><description>Reinforcement Learning</description><generator>Hugo Blox Builder (https://hugoblox.com)</generator><language>en-us</language><lastBuildDate>Tue, 09 Jun 2026 00:00:00 +0000</lastBuildDate><image><url>https://christianpfitzner.github.io/forschungsgruppe-mobile-robotik/media/icon_hu11734318148517933569.png</url><title>Reinforcement Learning</title><link>https://christianpfitzner.github.io/forschungsgruppe-mobile-robotik/en/tag/reinforcement-learning/</link></image><item><title>Emergent Systems in Production</title><link>https://christianpfitzner.github.io/forschungsgruppe-mobile-robotik/en/publication/2026-mapr-emergente-systeme-produktion/</link><pubDate>Tue, 09 Jun 2026 00:00:00 +0000</pubDate><guid>https://christianpfitzner.github.io/forschungsgruppe-mobile-robotik/en/publication/2026-mapr-emergente-systeme-produktion/</guid><description>&lt;h2 id="project-description">Project Description&lt;/h2>
&lt;p>This 3-semester M-APR project (starting WiSe 2026/2027) compares centralised and decentralised
coordination strategies for heterogeneous robot fleets in simulated and real production scenarios.
The scientific contribution lies in the empirical characterisation of the transition between
both coordination paradigms under varied adversarial conditions.&lt;/p>
&lt;h2 id="structure-over-three-semesters">Structure over Three Semesters&lt;/h2>
&lt;p>&lt;strong>Semester 1 — Foundations and Simulation&lt;/strong>&lt;/p>
&lt;ul>
&lt;li>Literature review on decentralised coordination and multi-agent reinforcement learning&lt;/li>
&lt;li>Building the ROS 2-based simulation environment (at least two agent types: mobile and stationary)&lt;/li>
&lt;li>Implementation of a centralised baseline and a simple decentralised approach&lt;/li>
&lt;/ul>
&lt;p>&lt;strong>Semester 2 — Comparative Study and Learning-Based Coordination&lt;/strong>&lt;/p>
&lt;ul>
&lt;li>Implementation of learning-based decentralised coordination (MARL)&lt;/li>
&lt;li>Systematic comparison under varied adversarial conditions (communication failure, machine failure, dynamic order changes)&lt;/li>
&lt;li>Statistical evaluation and identification of transition points between coordination regimes&lt;/li>
&lt;/ul>
&lt;p>&lt;strong>Semester 3 — Validation and Publication&lt;/strong>&lt;/p>
&lt;ul>
&lt;li>Transfer of selected scenarios to real hardware at TTZ&lt;/li>
&lt;li>Evaluation of sim-to-real transferability&lt;/li>
&lt;li>Completion of master&amp;rsquo;s thesis and preparation of a conference publication (MAPR conference)&lt;/li>
&lt;/ul>
&lt;h2 id="requirements">Requirements&lt;/h2>
&lt;ul>
&lt;li>Bachelor&amp;rsquo;s degree in electrical engineering, computer science, mechatronics, robotics or equivalent&lt;/li>
&lt;li>Programming in C++ and/or Python&lt;/li>
&lt;li>Basic knowledge of machine learning / reinforcement learning&lt;/li>
&lt;li>Experience with ROS 2 and simulation (Gazebo or similar) is an advantage&lt;/li>
&lt;li>Interest in multi-agent systems and production robotics&lt;/li>
&lt;/ul>
&lt;p>This topic can also be completed as a &lt;strong>project or master&amp;rsquo;s thesis&lt;/strong> subject to agreement.&lt;/p>
&lt;h2 id="supervision">Supervision&lt;/h2>
&lt;table>
&lt;thead>
&lt;tr>
&lt;th style="text-align: left">Role&lt;/th>
&lt;th style="text-align: left">Name&lt;/th>
&lt;th style="text-align: left">E-Mail&lt;/th>
&lt;/tr>
&lt;/thead>
&lt;tbody>
&lt;tr>
&lt;td style="text-align: left">Supervisor&lt;/td>
&lt;td style="text-align: left">Prof. Dr. Christian Pfitzner&lt;/td>
&lt;td style="text-align: left">&lt;a href="mailto:christian.pfitzner@th-nuernberg.de">christian.pfitzner@th-nuernberg.de&lt;/a>&lt;/td>
&lt;/tr>
&lt;tr>
&lt;td style="text-align: left">Co-Supervisor&lt;/td>
&lt;td style="text-align: left">Waldemar Haag&lt;/td>
&lt;td style="text-align: left">&lt;a href="mailto:waldemar.haag@th-nuernberg.de">waldemar.haag@th-nuernberg.de&lt;/a>&lt;/td>
&lt;/tr>
&lt;/tbody>
&lt;/table>
&lt;p>&lt;strong>Location:&lt;/strong> TTZ Nürnberger Land, Lauf an der Pegnitz&lt;/p>
&lt;p>Further information: &lt;a href="https://www.th-nuernberg.de/einrichtungen-gesamt/wissenschaftliche-und-forschungskooperationen/technologietransferzentrum-nuernberger-land/" target="_blank" rel="noopener">TTZ Nürnberger Land&lt;/a> · &lt;a href="https://www.th-nuernberg.de/fakultaeten/efi/forschung/forschungsaktive-labore/mobile-robotik/" target="_blank" rel="noopener">Mobile Robotics Lab&lt;/a>&lt;/p></description></item><item><title>2R Robot Arm Lab Experiment – Gravity Compensation and Reinforcement Learning</title><link>https://christianpfitzner.github.io/forschungsgruppe-mobile-robotik/en/publication/2026-2r-roboterarm-praktikum/</link><pubDate>Mon, 08 Jun 2026 00:00:00 +0000</pubDate><guid>https://christianpfitzner.github.io/forschungsgruppe-mobile-robotik/en/publication/2026-2r-roboterarm-praktikum/</guid><description>&lt;h2 id="motivation">Motivation&lt;/h2>
&lt;p>The &amp;ldquo;Intelligent Robotics&amp;rdquo; practical course in the M-IAS master&amp;rsquo;s programme currently lacks
a hands-on experiment bridging classical model-based control and modern learning-based methods.
A 2R robot arm with torque control offers exactly this: students first experience the physical
effects of gravity on the real system, then learn how an RL agent solves the same task in a
data-driven way.&lt;/p>
&lt;h2 id="work-packages">Work Packages&lt;/h2>
&lt;p>&lt;strong>Hardware&lt;/strong>&lt;/p>
&lt;ul>
&lt;li>Selection and commissioning of BLDC motors and motor drivers (e.g. ODrive / VESC)&lt;/li>
&lt;li>Mechanical design and fabrication of arm segments (CAD, 3D printing or aluminium profile)&lt;/li>
&lt;li>Integration of encoders and wiring&lt;/li>
&lt;/ul>
&lt;p>&lt;strong>Software &amp;amp; Control&lt;/strong>&lt;/p>
&lt;ul>
&lt;li>Implementation of forward and inverse kinematics&lt;/li>
&lt;li>Model-based gravity compensation controller (real-time torque compensation)&lt;/li>
&lt;li>ROS integration: topics, services and ros2_control&lt;/li>
&lt;/ul>
&lt;p>&lt;strong>Reinforcement Learning&lt;/strong>&lt;/p>
&lt;ul>
&lt;li>Building a simulation environment (Gazebo or MuJoCo) for RL training&lt;/li>
&lt;li>Training an agent (e.g. PPO / SAC) on a target-reaching task&lt;/li>
&lt;li>Sim-to-real transfer and evaluation on the real arm&lt;/li>
&lt;/ul>
&lt;p>&lt;strong>Documentation&lt;/strong>&lt;/p>
&lt;ul>
&lt;li>Creating lab instructions for use in the M-IAS practical course&lt;/li>
&lt;/ul>
&lt;h2 id="requirements">Requirements&lt;/h2>
&lt;ul>
&lt;li>Knowledge of control theory and robotics (kinematics, dynamics)&lt;/li>
&lt;li>Programming skills in Python and/or C++&lt;/li>
&lt;li>Ideally experience with ROS&lt;/li>
&lt;li>Interest in machine learning and reinforcement learning&lt;/li>
&lt;li>Enthusiasm for hands-on hardware work and prototyping&lt;/li>
&lt;/ul>
&lt;p>This topic can be completed as a &lt;strong>project or master&amp;rsquo;s thesis&lt;/strong> subject to agreement.&lt;/p>
&lt;h2 id="supervision">Supervision&lt;/h2>
&lt;table>
&lt;thead>
&lt;tr>
&lt;th style="text-align: left">Role&lt;/th>
&lt;th style="text-align: left">Name&lt;/th>
&lt;th style="text-align: left">E-Mail&lt;/th>
&lt;/tr>
&lt;/thead>
&lt;tbody>
&lt;tr>
&lt;td style="text-align: left">Supervisor&lt;/td>
&lt;td style="text-align: left">Prof. Dr. Christian Pfitzner&lt;/td>
&lt;td style="text-align: left">&lt;a href="mailto:christian.pfitzner@th-nuernberg.de">christian.pfitzner@th-nuernberg.de&lt;/a>&lt;/td>
&lt;/tr>
&lt;/tbody>
&lt;/table></description></item></channel></rss>