Browsing by Author "Harris, Don"
Now showing 1 - 7 of 7
- Results Per Page
- Sort Options
- Accuracy and Similarity of Team Situation Awareness in Simulated Air Combat
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä(2023-06) Mansikka, Heikki; Harris, Don; Virtanen, KaiBACKGROUND: Fighter pilots’ Team Situation Awareness (TSA ) has been studied from the perspective of TSA accuracy, which represents how closely the pilots’ collective knowledge is aligned with the real world. When TSA accuracy is low, the pilots can have similarly or dissimilarly inaccurate SA. The concept of TSA similarity represents the similarity of team members’ collective knowledge. This paper investigates how TSA accuracy and similarity of F/A-18 pilots are associated with performance. METHOD: Data were extracted from simulated air combat missions. Performance and TSA were investigated in 58 engagements. The accuracy and similarity of pilots’ SA were elicited and performance was evaluated. TSA accuracy and similarity were analyzed with respect to the flights’ performance, and the independent variables were events in which the flights initiated engagements with enemy aircraft versus events in which the flights were engaged by enemy aircraft. RESULTS: With the mentioned events as the main effect, there were statistically significant differences at all levels of TSA accuracy and similarity. With performance as the main effect, there were also significant differences at all levels of TSA accuracy and similarity. TSA accuracy and similarity were superior in offensive engagements and when engagements were successful. DISCUSSION: T he main contribution of this paper is the extension of the concept of TSA similarity to air combat: both TSA similarity and accuracy were higher when the flight was engaging the enemy aircraft, compared to situations when the flight itself was being engaged. The results also suggest that low TSA accuracy and similarity have a statistically significantly negative impact on the flights’ performance. - Team Performance : Mental Performance N+1
A3 Kirjan tai muun kokoomateoksen osa(2024-08-08) Beech, Deanna; Mansikka, Heikki; Harris, Don; Virtanen, Kai; Pattyn, NathalieThis chapter focuses on the contributions of team dynamics to performance, team performance theory, and team skills, along with how to assess and intervene to improve team performance. A team is not just a group of associated people. A team is “a distinguishable set of two or more people who interact, dynamically, interdependently, and adaptively toward a common and valued goal/objective/mission.” From this generally accepted definition it is clear that even individuals who are performing what appears to be a very individual effort, such as a writer or a pole vaulter, are impacted by the team around them that support their effort toward the shared objective. The impact on the individual is intensified as the interdependence of the individuals increases, as is the case with a football team or a specialized military unit. As such, it is important to prioritize team performance to maintain and improve individual mental performance. Focusing only on the outcome of a team’s task, i.e., the product of taskwork, may give a biased estimate for the performance of a team and provide little explanation for the observed level of performance. A much richer picture of team performance can be obtained by also considering taskwork processes and teamwork, including the coordination mechanisms of team members. Such a holistic performance evaluation is discussed throughout this chapter. - Team Performance in Air Combat : A Teamwork Perspective
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä(2023) Mansikka, Heikki; Virtanen, Kai; Harris, Don; Järvinen, JuhaObjective: The objective of this paper is to describe a model combining taskwork and teamwork of a single-seat fighter aircraft team, or flight, during its performance episode. Background: In air combat, evaluations of team performance have focused on task performance. However, both teamwork and taskwork are required for high performance output. Attempts to address taskwork and teamwork in single-seat fighter aircraft flights have mainly settled for adopting existing models of teamwork to flights. As such, they have overlooked the unique nature of teamwork in air combat. Method: Existing models of teamwork and taskwork are reviewed and a flight’s tactical decision-making is described as an input-process-output model. A model combining flight’s teamwork, taskwork, situation awareness and transactive memory is conceptualized and operation of the model is illustrated with a case study. In the case study, the model is used to provide an alternative explanation for an air combat accident. Results: The model bridges the gap between the well-established concepts of teamwork and the unique nature of air combat. It rationalizes how the mission essential competencies, situation awareness and transactive memory interact with each other, and how they impact the flight’s performance output. Conclusions: The model helps scholars and practitioners in identifying the connection between the flight’s performance output and the underlying processes even when cause and effect are not adjacent in either time or space. - Team situation awareness accuracy measurement technique for simulated air combat - Curvilinear relationship between awareness and performance
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä(2021-10) Mansikka, Heikki; Virtanen, Kai; Uggeldahl, Ville; Harris, DonA new technique for the assessment of Team Situation Awareness (TSA) accuracy based upon post task Critical Decision Method structured interviews was developed and tested using 39 combat-ready F/A-18 pilots. Pilots undertook a number of simulated air combat scenarios, flying in flights of four aircraft against a formation of enemy aircraft. Results showed a strong curvilinear relationship where high TSA accuracy resulted in higher performance in some areas of air combat, measured with friendly losses and kills. There were diminishing returns in performance as TSA accuracy increased. This may explain why previous studies on air combat have found relatively weak relationships between situation awareness and performance where the relationship has been assumed to be linear. - Weight watchers: NASA-TLX weights revisited
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä(2022-11-02) Virtanen, Kai; Mansikka, Heikki; Kontio, Helmiina; Harris, DonNational Aeronautics and Space Administration Task Load Index (NASA-TLX) is a popular method to evaluate mental workload. NASA-TLX assesses mental workload across six load dimensions. When the dimensions are not assumed to be approximately equally important, they are weighted by conducting a pairwise comparison for every dimension pair, followed by the normalisation of weights reflecting the importance of the dimensions. This original NASA-TLX weighting method creates some challenges that are difficult to identify when the weights are being assigned. First, the original NASA-TLX weighting does not allow directly expressing two or more dimensions as equally important. Second, if pairwise comparisons are conducted consistently, there exists only one possible importance order for the dimensions. Third, with consistently conducted pairwise comparisons, a weight of 0.33 is artificially forced on the most important dimension. Swing and Analytic Hierarchy Process weighting methods for eliciting the weights of the dimensions are proposed as a solution to these challenges. The advantages of applying these methods in NASA-TLX are introduced theoretically and demonstrated empirically using data from virtual air combat simulations. The objective of this paper is to help scholars and practitioners to use NASA-TLX in mental workload assessments such that the discussed weighting issues are avoided. - What we got Here, is a Failure to Coordinate : Implicit and Explicit Coordination in Air Combat
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä(2023-09) Mansikka, Heikki; Virtanen, Kai; Harris, DonAir combat is the ultimate test for teamwork, as teams of fighter pilot (or flights), must coordinate their actions in a highly complex, hostile, dynamic and time critical environment. Flights can coordinate their actions using communication, that is, explicitly, or by relying on team situation awareness (SA), that is, implicitly. This paper examines how these two forms of coordination are associated with performance when prosecuting or evading an attack in simulated air combat. This was done by investigating the flights’ team SA, number of SA-related communication acts and performance in these two types of critical events during air combat. The results exhibit a quadratic dependence between team SA and communication. The rate of change of SA-related communication frequency with respect to change of team SA was negative: communication was needed to build team SA, but once an appropriate level of team SA was established, fewer communications were required. If, however, team SA deteriorated the number of SA communication acts increased. However, during time critical events, the flights did not always have enough time to coordinate their actions verbally. If the flights’ team SA in such situations was low, the flights’ explicit coordination attempts were not sufficient to avoid poor performance. - When Worlds Collide: AI-Created, Human-Mediated Video Description Services and the User Experience
A4 Artikkeli konferenssijulkaisussa(2021-07) Braun, Sabine; Starr, Kim; Delfani, Jaleh; Tiittula, Liisa; Laaksonen, Jorma; Braeckman, Karel; Van Rijsselbergen, Dieter; Lagrillière, Sasha; Saarikoski, LauriThis paper reports on a user-experience study undertaken as part of the H2020 project MeMAD (‘Methods for Managing Audiovisual Data: Combining Automatic Efficiency with Human Accuracy’), in which multimedia content describers from the television and archive industries tested Flow, an online platform, designed to assist the post-editing of automatically generated data, in order to enhance the production of archival descriptions of film content. Our study captured the participant experience using screen recordings, the User Experience Questionnaire (UEQ), a benchmarked interactive media questionnaire and focus group discussions, reporting a broadly positive post-editing environment. Users designated the platform’s role in the collation of machine-generated content descriptions, transcripts, named-entities (location, persons, organisations) and translated text as helpful and likely to enhance creative outputs in the longer term. Suggestions for improving the platform included the addition of specialist vocabulary functionality, shot-type detection, film-topic labelling, and automatic music recognition. The limitations of the study are, most notably, the current level of accuracy achieved in computer vision outputs (i.e. automated video descriptions of film material) which has been hindered by the lack of reliable and accurate training data, and the need for a more narratively oriented interface which allows describers to develop their storytelling techniques and build descriptions which fit within a platform-hosted storyboarding functionality. While this work has value in its own right, it can also be regarded as paving the way for the future (semi)automation of audio descriptions to assist audiences experiencing sight impairment, cognitive accessibility difficulties or for whom ‘visionless’ multimedia consumption is their preferred option.