AutoRef - Autonomous Referee System: Difference between revisions

From Control Systems Technology Group
Jump to navigation Jump to search
No edit summary
No edit summary
(19 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{:Layout_AutoRef}}
{{:AutoRef_Layout}}


<div STYLE="float: left; width:80%"></div>
<div style="width: 35%; float: right;"><center>{{:Content_AutoRef_large}}</center></div>
__NOTOC__


<div align="left">
<div align="left">
Line 14: Line 11:
</div>
</div>


<!-- ''To navigate through this wiki, use the navigation box on the right side of the page.'' -->




Line 19: Line 17:




The aim of this project is to do just that; making a system which can evaluate a soccer match, detect events and make decisions accordingly.
The aim of this project is to do just that:
<br>'''''Creating a system which can evaluate a soccer match, detect events and make decisions accordingly.'''''


=History=
This project started in 2015 with the idea to use drones, equipped with cameras, to help monitor a [https://www.robocup.org/leagues/6 RoboCup] [https://www.robocup.org/leagues/6 Middle Size League (MSL)] soccer match. The use of drones was a first though towards achieving the goal. ''While drone can certainly play a part in the system, we must not limit ourselves to them.'' To better understand how the system should look like, a [https://en.wikipedia.org/wiki/Systems_engineering systems engineering] approach should be taken during the design. From the start, this project was part of the [https://www.tue.nl/studeren/alle-opleidingen/pdeng-opleidingen/ PDEng] [https://www.tue.nl/studeren/graduate-school/pdeng-automotive-systems-design/about-msd/ MSD] curriculum. The PDEng trainees were tasked with the development of the system architecture and implementation. Parallel to this, a team of students from the TU/e Honors programme [https://educationguide.tue.nl/programs/tue-honors-academy/bachelor-students/honors-tracks/high-tech-systems/?L=2 High Tech Systems] are tasked with the control of the drones. One of these teams have continued their efforts in drone-control by creating the [https://fireflyeindhoven.nl/ Firefly-project].


To navigate through this wiki, the internal navigation box on the right side of the page can be used.  
The projects described are often of short duration. Moreover, every year the projects are done with new teams, which have their own ideas and approaches. These teams create their own documentation to show what they have done, such that they can be graded. Sometimes they use previous work as inspiration, but often they start from scratch with their own ideas. While this can give new perspectives on the system, it slows down the progress of creation. Instead of going progressing through the entire [https://en.wikipedia.org/wiki/V-Model V-Model] with each new group, we keep repeating the Project Definition (left side of the V).
 
This wiki-page is created in order to centralize the efforts made by several different students and teams. This page will act as the central backbone of the system. All decisions, requirements, functionalities etc. will be explained here. Since we are building ONE system, we should only need ONE backbone. This approach can lead to difficulties in grading the students/teams, since it might not be clear what part exactly they have contributed to. Therefore a separate page is made for each team. Here they can explain their contributions to the system (see navigation box).


<center>[[File:Drone Ref.png|thumb|center|1000px|Illustration by Peter van Dooren, BSc student at Mechanical Engineering, TU Eindhoven, November 2016.]]</center>
<center>[[File:Drone Ref.png|thumb|center|1000px|Illustration by Peter van Dooren, BSc student at Mechanical Engineering, TU Eindhoven, November 2016.]]</center>


=Motivation=
<p>[http://www.robocup.org/ RoboCup] is an international initiative to promote and advance research in robotics and  artificial intelligence. Founded in 1997, its main goal is to ‘develop a team of fully autonomous humanoid robot soccer players that is able to win against the winner of the most recent World Cup, complying with the official rules of FIFA, by the middle of the 21st century’. In the Middle Size League ([http://wiki.robocup.org MSL]), two teams of five autonomous robots play a soccer match on an artificial field. These robots are able to drive around while using several on-board camera's to position themselves on the field. Moreover, they can determine the position of the ball, opponents and team mates. Through radio signals they can communicate with each other and decide upon a strategy. With a ball-handling system the ball can be captured and controlled and a shooting mechanism is able to shoot a ball over the ground or through the air.</p>
<p>As discussed in this [http://wiki.robocup.org/images/7/72/RequirementsforMSL_2016.pdf tutorial], a standard RoboCup field measures 18 by 12 meters. During a match, there are two teams consisting of five robots on this field, driving around with velocities up to 5 m/s and possibly even higher. These robots are all competing for the same thing: scoring goals. This means that getting possession of the ball is a primary goal. When several robots are competing for the ball, collisions, pushing and scrummages are nearly inevitable. To make sure the match is played in a fair way, a human referee keeps a keen eye on the events on the field from the sideline. This human referee is backed up by an auxiliary referee which is standing on the opposite side, next to the field. Both can decide on stopping the game, due to a committed foul, a scored goal, a ball out of bound or any other event. The [http://wiki.robocup.org/images/0/0f/Robocup-msl-rules-2016.pdf rules] for MSL are based on the official FIFA rules, but adapted to robot football rules were necessary. However, the large set of rules and the interpretation thereof can often lead to situations where a referee might decide to continue the game, while another might decide to interrupt. This can and will often lead to frustrations in the aggrieved team. Moreover, a decision made by a referee can affect the outcome of a game and even an entire championship.</p>
<p>An example of this is the final match of the [http://www.robocup2016.org/en/ RoboCup world championship 2016] in Leipzig, Germany (see [https://www.youtube.com/watch?v=f7Y6QLYVhSs&feature=youtu.be&t=6h17m38s full match]/[https://www.youtube.com/watch?v=2JxNjgKE8HQ highlights]). The final was played between team [http://www.techunited.nl/ TechUnited] from the Netherlands and team [http://blog.sina.com.cn/s/articlelist_2532664717_0_1.html%E2%80%8D WATER] from China. The winner of this would become world champion robot soccer in the MSL. At the end of the match the scoreboard showed 2-2. As in human soccer, this means extra time to decide on the winner. During the match, team WATER had some trouble with the ball handling, preventing the ball to rotate in a ‘natural’ way over the field. When it happens that the ball does not rotate in the direction it is being moved, this is considered clamping and regarded as a foul in favor of the other team. In the last couple of minutes the score was 3-3 when WATER turned towards the TechUnited goal, shot and scored the winning goal. While the Chinese team was already celebrating their victory, the auxiliary referee decided that the scoring robot was clamping the ball before scoring the goal. After a discussion with the main referee, it was decided to declare the goal invalid. Since the extra time also ended in a draw, penalties were needed to decide who would become the new world champion. After all penalties of the Chinese team were stopped by the Dutch keeper, the first shot of the TechUnited robot went into the net. The Dutch team won the penalty series with 1-0 and thus TechUnited became the world champion of 2016.</p>
<p>This example shows how important the decisions of the human referee team can be in shaping the course of a match or even a tournament. Rules are always prone to interpretation and a team which is disadvantaged by this will always complain. The referee has no means to justify his decision other than his own intuition and interpretation on the rules. This lead to the question on whether it would be possible to develop a system which can support the human referee team in making decisions. Such system might even become fully autonomous and could replace the human factor in refereeing entirely.</p>


<center>[[File:tumbnail_test_video.png|center|750px|link=https://www.youtube.com/embed/XyRR3rPQ4R0?autoplay=1]]</center>
<center>[[File:tumbnail_test_video.png|center|750px|link=https://www.youtube.com/embed/XyRR3rPQ4R0?autoplay=1]]</center>

Revision as of 12:46, 26 June 2019


AutoRef


An objective autonomous referee system for robot football


A football referee can hardly ever make "the correct decision", at least not in the eyes of the thousands or sometimes millions of fans watching the game. When a decision will benefit one team, there will always be complaints from the other side. It is oft-times forgotten that the referee is also merely a human. To make the game more fair, the use of technology to support the referee is increasing. Nowadays, several stadiums are already equipped with goal line technology and referees can be assisted by a Video Assistant Referee (VAR). If the use of technology keeps increasing, a human referee might one day become entirely obsolete. The proceedings of a match could be measured and evaluated by some system of sensors. With enough (correct) data, this system would be able to recognize certain events and make decisions based on these event.


The aim of this project is to do just that:
Creating a system which can evaluate a soccer match, detect events and make decisions accordingly.

History

This project started in 2015 with the idea to use drones, equipped with cameras, to help monitor a RoboCup Middle Size League (MSL) soccer match. The use of drones was a first though towards achieving the goal. While drone can certainly play a part in the system, we must not limit ourselves to them. To better understand how the system should look like, a systems engineering approach should be taken during the design. From the start, this project was part of the PDEng MSD curriculum. The PDEng trainees were tasked with the development of the system architecture and implementation. Parallel to this, a team of students from the TU/e Honors programme High Tech Systems are tasked with the control of the drones. One of these teams have continued their efforts in drone-control by creating the Firefly-project.

The projects described are often of short duration. Moreover, every year the projects are done with new teams, which have their own ideas and approaches. These teams create their own documentation to show what they have done, such that they can be graded. Sometimes they use previous work as inspiration, but often they start from scratch with their own ideas. While this can give new perspectives on the system, it slows down the progress of creation. Instead of going progressing through the entire V-Model with each new group, we keep repeating the Project Definition (left side of the V).

This wiki-page is created in order to centralize the efforts made by several different students and teams. This page will act as the central backbone of the system. All decisions, requirements, functionalities etc. will be explained here. Since we are building ONE system, we should only need ONE backbone. This approach can lead to difficulties in grading the students/teams, since it might not be clear what part exactly they have contributed to. Therefore a separate page is made for each team. Here they can explain their contributions to the system (see navigation box).

Illustration by Peter van Dooren, BSc student at Mechanical Engineering, TU Eindhoven, November 2016.

Motivation

RoboCup is an international initiative to promote and advance research in robotics and artificial intelligence. Founded in 1997, its main goal is to ‘develop a team of fully autonomous humanoid robot soccer players that is able to win against the winner of the most recent World Cup, complying with the official rules of FIFA, by the middle of the 21st century’. In the Middle Size League (MSL), two teams of five autonomous robots play a soccer match on an artificial field. These robots are able to drive around while using several on-board camera's to position themselves on the field. Moreover, they can determine the position of the ball, opponents and team mates. Through radio signals they can communicate with each other and decide upon a strategy. With a ball-handling system the ball can be captured and controlled and a shooting mechanism is able to shoot a ball over the ground or through the air.

As discussed in this tutorial, a standard RoboCup field measures 18 by 12 meters. During a match, there are two teams consisting of five robots on this field, driving around with velocities up to 5 m/s and possibly even higher. These robots are all competing for the same thing: scoring goals. This means that getting possession of the ball is a primary goal. When several robots are competing for the ball, collisions, pushing and scrummages are nearly inevitable. To make sure the match is played in a fair way, a human referee keeps a keen eye on the events on the field from the sideline. This human referee is backed up by an auxiliary referee which is standing on the opposite side, next to the field. Both can decide on stopping the game, due to a committed foul, a scored goal, a ball out of bound or any other event. The rules for MSL are based on the official FIFA rules, but adapted to robot football rules were necessary. However, the large set of rules and the interpretation thereof can often lead to situations where a referee might decide to continue the game, while another might decide to interrupt. This can and will often lead to frustrations in the aggrieved team. Moreover, a decision made by a referee can affect the outcome of a game and even an entire championship.

An example of this is the final match of the RoboCup world championship 2016 in Leipzig, Germany (see full match/highlights). The final was played between team TechUnited from the Netherlands and team WATER from China. The winner of this would become world champion robot soccer in the MSL. At the end of the match the scoreboard showed 2-2. As in human soccer, this means extra time to decide on the winner. During the match, team WATER had some trouble with the ball handling, preventing the ball to rotate in a ‘natural’ way over the field. When it happens that the ball does not rotate in the direction it is being moved, this is considered clamping and regarded as a foul in favor of the other team. In the last couple of minutes the score was 3-3 when WATER turned towards the TechUnited goal, shot and scored the winning goal. While the Chinese team was already celebrating their victory, the auxiliary referee decided that the scoring robot was clamping the ball before scoring the goal. After a discussion with the main referee, it was decided to declare the goal invalid. Since the extra time also ended in a draw, penalties were needed to decide who would become the new world champion. After all penalties of the Chinese team were stopped by the Dutch keeper, the first shot of the TechUnited robot went into the net. The Dutch team won the penalty series with 1-0 and thus TechUnited became the world champion of 2016.

This example shows how important the decisions of the human referee team can be in shaping the course of a match or even a tournament. Rules are always prone to interpretation and a team which is disadvantaged by this will always complain. The referee has no means to justify his decision other than his own intuition and interpretation on the rules. This lead to the question on whether it would be possible to develop a system which can support the human referee team in making decisions. Such system might even become fully autonomous and could replace the human factor in refereeing entirely.

Tumbnail test video.png