MILESTONE 3: Data Analysis & Results
For each of the three dependent variables (Frequency of Task Delegation Ratio, Confidence Level in the Robot, Reliance on the Robot), the impact of the manipulations of the independent variables (i.e. autonomous performance and difficulty level of the environment) were analyzed using two-way ANOVA test.
Frequency of Task Delegation Ratio (No. of AI triggers / No. of total moves)
The evidence suggests that the difficulty of the final mission (Hard environment vs. Easy environment) had a singularly significant effect on the participants’ frequency of delegating task control to the robot (p ≈ 0.0067). To our surprise, the robot’s autonomous performance level in the practice mission had no significant impact on this metric.
Also, we could not reject our null hypothesis that there was no interaction between the two
independent variables. In other words, participants tended to perform the task themselves in easy environments while deferring more to robot automation in difficult environments, regardless of whether the robot performance was good or poor.
Confidence Level in the Robot
there is strong evidence to infer that the robot’s performance level was the main effect on the subjects’ responses, with low ratings correlated to bad performance and vice versa (p ≈ 0.00027). Likewise, the evidence indicates that the environment types had no significant effect on the responses, and that there was no interaction between the two independent variables.
Reliance on the Robot
Two main effects were found. First, we can infer that superior autonomous performance was correlated with an increased reliance on the robot (p ≈ 0.033). Second, the more difficult the environment, the more inclined subjects were to rely on the robot (p ≈ 0.0085). No significant interaction was found between the two independent variables.