Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove social survery #922

Merged
merged 2 commits into from
Nov 25, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ All notable changes to this project will be documented in this file.

## Rulebook [Current Draft]

* [#922](https://github.com/RoboCupAtHome/RuleBook/pull/922): Remove Bonus for perceived social intelligence as the survey was too hard to conduct in Robocup settings.
* [#887](https://github.com/RoboCupAtHome/RuleBook/pull/887): Remove Social Standard Platform League.
* The League does have a low number of participants.
* Former SSPL Teams can participate in the OPL and thus modify the Robot.
Expand Down
39 changes: 0 additions & 39 deletions pages/general_rules/PenaltiesBonuses.tex
Original file line number Diff line number Diff line change
Expand Up @@ -41,45 +41,6 @@ \subsection{Bonus for outstanding performance}\label{rule:outstanding_performanc
\item It is the decision of the \iaterm{Technical Committee}{TC} if (and to which degree) the bonus score is granted.
\end{enumerate}

\subsection{Bonus for perceived social intelligence}\label{rule:perceived_intelligence}
\begin{enumerate}
\item For the test \iterm{Receptionist} in \iterm{Stage~I} and, \iterm{Restaurant} in \iterm{Stage~II} tests. Teams are evaluated on the robot's perceived social intelligence
performance

\item This bonus, ranging from 0 to 50, depends on the robot's social performance which will be assessed by Referees using a specially designed scale in a survey.

\item The survey evaluates how the robot recognizes, adapts to, and predicts emotions, behaviors, and cognitions. Each component is assessed through several questions, scored on a scale from 1 to 5, where 1 represents "strongly disagree" and 5 represents "strongly agree." The questions used for evaluation include:
\begin{itemize}
\item This robot notices human presence
\item This robot enjoys meeting people
\item This robot recognizes individual people
\item This robot notices when people do things
\item This robot adapts effectively to different things people do
\item This robot anticipates people's behavior
\item This robot tries to be helpful
\item This robot is trustworthy
\item This robot cares about others
\item This robot tries to hurt people
\item This robot knows if someone is part of a social group
\item This robot thinks it is better than everyone else
\item This robot adapts its behavior based upon what people around it know
\item This robot is impolite
\item This robot is socially competent
\end{itemize}
Detailed information can be found in this \href{https://ipip.ori.org/PSIManualSeptember2018.pdf}{manual}.

\item In each evaluation, the score for every question is summed up and then normalized as follows:
\[ x' = N \cdot \frac{{x - x_{\text{min}}}}{{x_{\text{max}} - x_{\text{min}}}} \]

Here, \( N \) is the normalizing factor (50), \( x \) is the sum of scores for each question in the current evaluation, \( x_{\text{min}} \) is set to 15 (since there are 15 questions), and \( x_{\text{max}} \) is set to 75 (as the maximum score for each question is 5).

\item The final score is calculated as the average of individual evaluator scores.

\item The referee has the authority to skip the social assessment test if they believe the robot's performance is not suitable for measurement.

\item After the test is completed, the evaluators will fill out the form, and the scores will be automatically recorded in this \href{https://urjc-my.sharepoint.com/:x:/g/personal/juan_pena_urjc_es/Eb4WyP1H4-FCqeW-qVZ3mF0BRzBR1Cn-J5ltluy90fhTJQ?rtime=guRqYF483Eg}{spreadsheet}.
\end{enumerate}

% Local Variables:
% TeX-master: "../Rulebook"
% End:
1 change: 0 additions & 1 deletion scoresheets/Receptionist.tex
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,6 @@
\scoreitem[2]{100}{Offer a free seat to the new guest}
\scoreitem[2]{25}{Look at the person talking}
\scoreitem[2]{50}{Look at the person the robot is introducing the guest to}
\scoreitem{50}{Qualitative robot social performance \ifShortScoresheet{(see sec.~\ref{rule:perceived_intelligence})}}

\scoreheading{Bonus Rewards}
\scoreitem[2]{100}{Open the entrance door for a guest}
Expand Down
1 change: 0 additions & 1 deletion scoresheets/Restaurant.tex
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,6 @@

\scoreitem[2]{300}{Take an order.}
\scoreitem[2]{300}{Serve an order.}
\scoreitem{50}{Qualitative robot social performance \ifShortScoresheet{(see sec.~\ref{rule:perceived_intelligence})}}

\scoreheading{Bonus Rewards}
\scoreitem[2]{200}{Use an unattached tray to transport}
Expand Down