A quantifiable evaluation of workplace mental workload was created by authors Pretorius and Cilliers through a participatory process involving train control center workers. Called the mental workload index (MWLI), the tool measures overall workplace mental workload as opposed to subjective impression of mental workload felt by an individual worker. This style of assessment can assist management in evaluating work volume/nature in order to properly allocate resources to optimize safety.
Although developed for application in railroad industry, a mental workload formula could be developed for nearly any workplace setting by following the authors’ methodology.
Formula Development
A train control center stakeholder group composed of technical experts, experienced radio train order system workers, and labor representatives was formed. Through an analysis of train control officer (TCO) activity and following a consensus process, the stakeholder group identified three key task elements (descriptive of the work content):
- Data transactions – information gathered by a TCO beyond that needed for an authorization (i.e., estimated time of train arrival/departure or equipment breakdown).
- Authorizations – approval of train movement to a specific location.
- Number of telephone and radio communications – relaying a variety of information to facilitate operations (i.e., maintenance requests, breakdown info).
The stakeholder group also identified a set of modifiers that impact mental workload including:
- Shift – time period relative to day and time duration of shift.
- Experience – number of years performing the job.
- Interface complexity – interface with other train control systems.
- Running times – limited or great variation in duration of train running over a specific area.
- Crossing places – uniform or varying gradients; types of points.
- Platform location – whether or not there is a platform; platform design
- Number of authorizations vs. number of crossing places – complexity of planning.
- Type and mix of trains – train characteristic/priority.
- Locomotive depots – presence and number of depots.
- Presence of shunting yards/activities – presence of shunting yards.
- Topography – terrain/landscape of the train run.
It was recognized that a task element or moderating factor may vary in its contribution to mental workload. This concern was resolved by using a weighting value to the variables. The key task elements and moderating factors along with their weighted values are provided in Tables 1 and 2.
|
Task Element
|
Weighted Value
|
|
Data transactions
|
1
|
|
Authorizations
|
3
|
|
Number of telephone and radio communications
|
5
|
Table 1: Task elements and their weighted value. If 11 Authorizations are given over the course of a shift, the value of the Authorizations Task Element is 33 (11 x 3).
|
Modifier
|
Scale range
|
Maximum Weight (%)
|
|
Shift
|
1-5
|
12
|
|
Experience
|
1-4
|
18
|
|
Interface complexity
|
1-4
|
5
|
|
Running times
|
1-4
|
8
|
|
Crossing places
|
1-2
|
6
|
|
Platform location
|
1-4
|
3
|
|
Number of authorizations vs. number of crossing places
|
1-4
|
11
|
|
Type and mix of trains
|
1-4
|
9
|
|
Locomotive depots
|
1-4
|
10
|
|
Presence of shunting yards/activities
|
1-4
|
14
|
|
Topography
|
1-4
|
4
|
Table 2: For each modifier, the scale range and the maximum weight that can be contributed. If the Shift of a TOC was from 18:00 to 06:00 hours, the Shift Modifier was given a scale value of 5.0 and an overall weighted value of 1.120.
The equation that reflects the relationships of Task Elements and Modifiers to mental workload is:
MWLI =(sum of weighted task elements) x (product of weighted modifier factors)
Formula Testing
Thirty-six train control centers were ranked from high to low mental workload demand by users of the system. These same 36 centers were assessed for the task elements and modifiers as per MWLI definitions. MWLI scores ranged from 89 to 5789. There was a close correlation between the subjective ranking of a center’s mental workload and the relative MWLI score. The MWLI value indicated the degree of difference between centers due to its quantitative output.
Formula validity and reliability were furthered by meeting accepted criteria such as:
- Sensitivity – changes in workload such as task difficulty or resource demand were perceived
- Diagnosticity – source of the workload was identifiable
- Selectivity – variables that reflect only mental workload were measured
- Intrusiveness – the workplace was not disturbed while applying the tool
- Operator acceptance – significant work factors were captured to obtain confidence from the operator; the formula was developed with user participation
Study Limitations
Reservations effecting of this research include:
- The sample size of 36 train control centers was considered small.
- Further validity testing is needed.
Article Title: Development of a mental workload index: A systems approach
Publication: Ergonomics 50:9, 1503-1515, 2007
Authors: A Pretorius and P J Cilliers
This article originally appeared in The Ergonomics Report™ on 2007-09-26.