[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2013040642A1 - Activity training apparatus and method - Google Patents

Activity training apparatus and method Download PDF

Info

Publication number
WO2013040642A1
WO2013040642A1 PCT/AU2012/001133 AU2012001133W WO2013040642A1 WO 2013040642 A1 WO2013040642 A1 WO 2013040642A1 AU 2012001133 W AU2012001133 W AU 2012001133W WO 2013040642 A1 WO2013040642 A1 WO 2013040642A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
activity
indicator
routine
processing system
Prior art date
Application number
PCT/AU2012/001133
Other languages
French (fr)
Inventor
Graham Stanley BOULTON
Henry Miller BOULTON
Original Assignee
Tarwarri No. 15 Pty. Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2011903867A external-priority patent/AU2011903867A0/en
Application filed by Tarwarri No. 15 Pty. Ltd. filed Critical Tarwarri No. 15 Pty. Ltd.
Publication of WO2013040642A1 publication Critical patent/WO2013040642A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/744Displaying an avatar, e.g. an animated cartoon character
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165Evaluating the state of mind, e.g. depression, anxiety
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/372Analysis of electroencephalograms
    • A61B5/374Detecting the frequency distribution of signals, e.g. detecting delta, theta, alpha, beta or gamma waves
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • A61B5/375Electroencephalography [EEG] using biofeedback
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00Evaluating a particular growth phase or type of persons or animals
    • A61B2503/10Athletes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0004Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by the type of physiological signal transmitted
    • A61B5/0006ECG or EEG signals
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/1036Measuring load distribution, e.g. podologic studies
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802Sensor mounted on worn items
    • A61B5/6803Head-worn items, e.g. helmets, masks, headphones or goggles
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient ; user input means
    • A61B5/742Details of notification to user or communication with user or patient ; user input means using visual displays
    • A61B5/743Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots

Definitions

  • the present invention relates to a method and apparatus for training a user or determining a mental state of a user for performing a sporting activity, for example to allow a user to improve their mental state for performing activities such as playing a shot in golf.
  • the questions may be about the teaching and training program, the task, the user's perceptions, etc. Observations about the users' behaviour and answers to the questions are characterized and quantified. The quantified results are analyzed to determine the effectiveness of the teaching and training program.
  • EEG signals contain data and patterns of data associated with brain states, which can be used to infer the existence of thought processes.
  • EEGs provide a passive, non-invasive way to study brain activity. Compared to other brain activity analysis tools, EEGs provide a relatively coarse representation of brain activity. However, EEGs require only a small amount of operator training and are safe when used repeatedly or used for extended periods of time.
  • An EEG measures and records the differences in voltage levels between sensors. Electrical changes within the brain of a user cause changes in the voltage level between the sensors. The voltage levels from the sensor are passed to the EEG where the voltage levels are recorded for further processing and analysis. Analysis techniques can focus on general data features of the EEG signal, with data being extracted and analysed using appropriate algorithms. In order for such signal analysis processes to operate correctly, two sensors plus a common electrode are placed on the user's scalp (ear) in a specific, standard, predetermined pattern and artifacts are filtered out of the signals from the sensors.
  • Certain patterns in electrical signals generated by the brain may be associated with brain activities and brain states that may then be used to infer the existence of thought processes, e.g., the surprise signal pattern to infer surprise.
  • the electrical signal patterns recorded by the EEG can be classified as representing cognitive or non-cognitive activities. Examples of cognitive activities are arithmetic calculations, imagining scenes or images, recalling songs, and so on.
  • a cognitive activity generates one or more cognitive signals and artifacts, i.e., cognitive artifacts. Examples of non-cognitive activities are moving a computer mouse and typing on a keyboard. More subtle examples of non-cognitive activities are eye blinking, eye movement, and twitching.
  • a non-cognitive activity generates one or more non- cognitive signal and artifacts, i.e., non-cognitive artifacts.
  • a filter may be constructed to allow the signal to pass through the EEG while artifacts are blocked. Conversely, if an artifact is well-known, a filter may be constructed to block the well-known artefact.
  • neurofeedback training a mechanism, such as a display connected to an EEG, provides the user with information, i.e., feedback, that helps the user determine how well he or she is performing a particular task. As the user uses the feedback to improve performance of the task, the signal patterns associated with the task are strengthened.
  • a user may, through the use of neurofeedback, learn how to "think about moving the cursor" in order to move a cursor in a particular direction, e.g., left.
  • the user makes an attempt to "think about” moving the cursor to the left.
  • the user generates certain signal patterns that are sensed by a sensor array and passed to an EEG.
  • the EEG processes the signals, recognizes the signal patterns, and moves the cursor in accord with the signal patterns providing the user with immediate feedback. If the cursor has moved left, the user knows that the brain state achieved is the appropriate brain state for moving the cursor to the left.
  • the cursor does not move or moves in the wrong direction, e.g. to the right, the user must make an attempt to achieve a different brain state.
  • the signal pattern associated with the brain state for moving the cursor is strengthened so that artifacts do not overwhelm the signal pattern.
  • the present invention seeks to provide a method for determining a mental state of a user for performing a sporting activity, the method including, in an electronic processing system:
  • a pre-activity routine including one or more steps for preparing to perform the sporting activity
  • the at least one indicator is indicative of at least one of:
  • method includes, in the processing system, generating an indication including at least one of:
  • the indicator includes a numerical value and wherein the visual indication includes at least one of:
  • the indicator includes a numerical value
  • the method includes: a) comparing the numerical value to a threshold; and,
  • the indicator includes audible scaled tones having properties dependent on a numerical value of the indicator.
  • the method includes, in the processing system, filtering the measure of electrical activity to thereby determine the at least one indicator.
  • the method includes filtering the signal at between 1 and 100Hz.
  • the method includes filtering the signal at a plurality of different frequency ranges to thereby determine a number of indicators.
  • the method includes filtering the signal at:
  • the method includes using a plurality of filters to generate a plurality of filtered signals, the plurality of filtered signals being selectively combined to determine the at least one indicator.
  • the method includes, in the processing system, smoothing at least one signal to determine the at least one indicator.
  • the method includes training an user to prepare mentally for a sporting activity by:
  • the method includes:
  • the method includes: a) displaying a step to be performed by a user, the step being associated with a pre- activity routine or part of a sporting
  • the desired brain state includes at least one of desired values or a desired range of values for the indicators.
  • the indicator includes a graphical representation of an avatar including indications of a user brain state.
  • the method includes:
  • a) determines from at least one position sensor, signals indicative of a position of at least one of part of the user and equipment used by the user;
  • the method includes:
  • the method includes:
  • the method includes recording a video or image sequence of the user performing at least one of the pre-activity routine and the activity, and storing the sequence together with corresponding values of the at least one indicator.
  • the method includes recording weight distribution data during at least one of the pre-activity routine and the activity, and storing the weight distribution data together with corresponding values of the at least one indicator.
  • the method includes displaying a representation including at least one of: a) the indication of the at least one indicator;
  • the present invention seeks to provide apparatus for determining a mental state of a user for performing a sporting activity, the apparatus including an electronic processing system that:
  • a) determines from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of:
  • a pre-activity routine including one or more steps for preparing to perform the sporting activity
  • the measuring device includes a processing unit for: a) receiving electrical signals from sensors coupled to the user; and, b) transmitting data indicative of the electrical signals to the processing system.
  • the apparatus includes a wearable headgear for measuring electrical activity in the user's brain.
  • the headgear includes:
  • the headgear includes a pad for aligning with a temple of the user.
  • the sensors are at least one of removably and adjustably mounted to the band.
  • the headgear includes a housing mounted to the headband, the housing containing at least a processing unit of measuring device.
  • the measuring device includes at least two straps, each strap extending to an opposing side of the headband to thereby stabilize the position of the band relative to the user's head.
  • the headgear includes an image capture device for capturing at least one of a video or image sequence.
  • the apparatus includes a sensing unit for measuring a distribution of a user weight during at least part of at least one of the pre-activity routine and the activity.
  • the apparatus includes at least one position sensor for measuring a position of at least one of the user and equipment used by the user.
  • the apparatus includes at least one position sensing device, each position sensing device including: a) a position sensor;
  • the present invention seeks to provide apparatus for determining a mental state of a user for performing a sporting activity, the apparatus including:
  • a measuring device including a processing unit for:
  • a wearable headgear including:
  • the headgear includes a pad for aligning with a temple of the user.
  • the sensors are at least one of removably and adjustably mounted to the band.
  • the headgear includes a housing mounted to the headband, the housing containing at least a processing unit of measuring device. 1
  • the measuring device includes at least two straps, each strap extending to an opposing side of the headband to thereby stabilize the position of the band relative to the user's head.
  • the present invention seeks to provide a method for use in training a user for performing a sporting activity, the method including, in an electronic processing system:
  • the present invention seeks to provide apparatus for training a user for performing a sporting activity, the apparatus including an electronic processing system that:
  • a) determines from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of:
  • a pre-activity routine including one or more steps for preparing to perform the sporting activity
  • the present invention seeks to provide apparatus for training a user for performing a sporting activity, the apparatus including:
  • a measuring device including a processing unit for:
  • a wearable headgear including:
  • the present invention seeks to provide a method for use in training a user for performing a sporting activity, the method including, in an electronic processing system:
  • a) determines from at least one position sensor, signals indicative of a position of at least one of part of the user and equipment used by the user;
  • the present invention seeks to provide apparatus for use in training a user for performing a sporting activity, the apparatus including an electronic processing system that:
  • a) determines from at least one position sensor, signals indicative of a position of at least one of part of the user and equipment used by the user;
  • the apparatus includes at least one position sensing device, each position sensing device including:
  • Figure 1 is a schematic diagram of an example of an apparatus for determining a mental state of a user for performing a sporting activity
  • Figure 2A is a flowchart of an example process for determining a mental state of a user for performing a sporting activity
  • Figure 2B is a flowchart of an example process for training a user to perform a sporting activity
  • Figures 3A and 3B are schematic, perspective and plan views of an example headset
  • Figures 4A and 4B are a flowchart of an example process for training a user to perform a sporting activity
  • Figures 5A to 5C are example screen shots showing indicators recorded for an individual performing a sporting activity
  • Figure 6 is a schematic diagram of an example of a comparison to idealised mental state for performing a sporting activity
  • Figures 7A and 7B are further example screen shots showing indicators recorded for an individual performing a sporting activity
  • Figures 8A and 8B are schematic front and side views of a second example headset
  • Figures 9A and 9B are schematic side and plan views of a weight distribution sensing unit
  • Figure 10 is an example screenshot of a user interface showing indicators recorded for an individual performing a sporting activity
  • Figure 11 is a flowchart of a further example of a method of training a user for the purpose of performing a sporting activity
  • Figures 12A to 12G are schematic diagrams of examples of a graphical representation of an avatar for use in determining the mental state of a user
  • Figures 13A to 13R are schematic diagrams of avatar representations of idealised mental states for playing a golf shot
  • Figure 14A is a schematic diagram of a further example of apparatus for us in training an individual for performing a sporting activity
  • Figure 14B is a schematic diagram showing the use of the position sensor of Figure 14 A; and, [0080] Figures 15A to 15F are example screen shots of a user interface for use with the apparatus of Figures 14A and 14B.
  • the apparatus includes a processing system 100, wirelessly connected to a measuring device 110, which forms part of a wearable headgear 120, worn on a user's head 130.
  • the measuring device 110 is capable of measuring electrical activity in the user's brain, with an indication of measured activity being transferred to the processing system 100 for analysis.
  • the measuring device 110 can be of any suitable form that is able to determine information regarding relevant brain activity, and which typically includes a processing unit for receiving electrical signals from sensors coupled to the user and transmitting data indicative of the electrical signals to the processing system 100.
  • the measuring device 110 includes a non-invasive, dry, bio-sensor that measures neurological activity, and generates corresponding electrical signals. The signals may be provided directly to the processing system 100, or at least partially processed in the processing unit, before being transferred to the processing system 100.
  • the processing unit includes an electronic processing device 121 coupled to the sensors (not shown), a power source 122 and a wireless interface 123, for communicating with the processing system 100 are also provided.
  • the processing device 121 receives signals from the sensors, and optionally performs pre-processing, such as digitizing, coarse filtering or other processing steps, before the signals are transferred to the processing system 100.
  • the processing device 121 can be any form of electronic processing device such as a microprocessor, microchip processor, logic gate configuration, firmware optionally associated with implementing logic such as an FPGA (Field Programmable Gate Array), or any other electronic device, system or arrangement capable of processing received signals.
  • FPGA Field Programmable Gate Array
  • the processing system 100 is adapted to further analyse the signals received from the measuring device 1 10, allowing one or more indicators indicative of a measure of a user's electrical brain activity to be determined, with the indicators being presented to the user.
  • the processing system may be of any suitable form.
  • the processing system 100 includes a processor 101, a memory 102, an input/output device 103, such as a keyboard and display, and an external interface 104, coupled together via a bus 105.
  • the external interface 104 can be used to connect the processing system 100 to the measuring device 1 10, as well as allowing optional connectivity to other peripheral systems, such as communications networks, databases or other storage devices, external cameras, or the like, as well as to the measuring device 1 10.
  • a single external interface 104 is shown, this is for the purpose of example only, and in practice multiple interfaces using various method ⁇ (eg. Ethernet, serial, USB, wireless or the like) may be provided.
  • the processor 101 executes instructions in the form of application software stored in the memory 102, to allow signals received from the measuring device 1 10 to be analysed so that different indicators can be determined and displayed.
  • the processing system 100 may be formed from any suitable processing system, such as a suitably programmed PC, Internet terminal, lap-top, hand-held PC, smart phone, PDA, web server, or the like.
  • the processing system 100 is a standard processing system such as a 32-bit or 64-bit Intel Architecture based processing system, which executes software applications stored on non-volatile (e.g., hard disk) storage, although this is not essential.
  • the process can be performed using any electronic processing device such as a microprocessor, microchip processor, logic gate configuration, firmware optionally associated with implementing logic such as an FPGA (Field Programmable Gate Array), or any other electronic device, system or arrangement capable of processing EEG signals.
  • a microprocessor such as an iPhoneTM, AndroidTM based phone, or the like
  • firmware optionally associated with implementing logic such as an FPGA (Field Programmable Gate Array)
  • FPGA Field Programmable Gate Array
  • the processing system could be implemented using a wide variety of different architectures on a variety of operating systems. The included examples are therefore for the purpose of example only and are not intended to be limiting.
  • the measuring device 110 is used to record a measure of electrical activity in a user's brain. This is performed whilst the user is undergoing either a pre-activity routine, or is actually performing the sporting activity itself.
  • a pre-activity routine will be understood to include a series of steps which a user performs prior to performing a sporting activity, and which is typically used to allow the user to prepare mentally for the activity.
  • the technique is therefore particularly applicable to training for activities that include discrete events, such as taking a shot in golf, snooker, target shooting, or other target based activities, taking a free kick in football, bowling in cricket or baseball, or the like.
  • the technique can be applied to any sporting activity in which the participant has an opportunity to go through a pre-activity routine to prepare them.
  • the pre-activity routine and the routine will therefore vary depending on the nature of the sporting activity. For example, in golf, such a routine typically involves having the user approach the ball, stand behind the ball to assess the position of the ball relative to the hole, so that they can determine the nature of the shot to be played. Following this, the user will typically approach and then address the ball, aligning their body with the hole in order to play the shot, before executing the shot. A specific example will be described in more detail below.
  • an indicator indicative of the measure of a user brain state is determined. This may be achieved in any one of a number of ways but typically involves having the processing system 100 analyse the recorded measure of electrical activity in order to extract relevant information. The nature of the analysis will vary depending on the preferred implementation, but typically this involves filtering recorded signals, to provide filtered signals, with the filtered signals being used to derive values for one or more of the indicators. It will be appreciated that such filtering can be provided using appropriate algorithms, although alternatively, this could be achieved using physical filtering circuits.
  • Filtering may be performed for only a single indicator, although more typically multiple indicators are analysed by filtering the measure of electrical activity using a plurality of different frequency ranges. In one particular example, five indicators are determined corresponding to the user's quiet eye, focus, face tension, anxiety, and an overall mental state referred to as "mushin”.
  • the quiet eye indicator is indicative of a rate of blinking
  • the focus indicator is indicative of whether the user has a wide or narrow focus
  • the face tension indicator is indicative of face muscle tension and in particular, jaw tension
  • the anxiety indicator is indicative of user anxiety
  • Mushin is a mental state also referred to as the state of "no-mindness", in which a mind is not fixed or occupied by thought or emotion. When in a state of mushin there is an absence of sexual thought and judgment, so the person is totally free to act and respond. Consequently a person relies not on what they think should be the next move, but what is their trained natural reaction or what is felt intuitively. This is an ideal mental state for participating in sporting activities as it allows the brain's natural intuitive processing to perform the activity, tending to lead to instinctive and more consistent results.
  • a further overall handicap indicator may be derived based on a combination of the other indicators, allowing an overall score to be provided, and it will be appreciated that other indicators may be derived as required.
  • an indication of the indicators is presented to the user. This may be achieved in any one of a number of manners depending on the preferred implementation, and as will be described in more detail below. In one example, this includes providing at least one of a visual indication on a display 103 and/or an audible indicator, for example using speakers or the like.
  • the visual indication can be of any suitable form, but in one example includes one or more of a numerical value, a graphical indication of a numerical value over time and a bar indicator of a current numerical value.
  • the audible indication is in the form of audible tones representing a magnitude of an indicator value.
  • a pre-activity routine is commenced.
  • the process of Figure 2A is used to record and display indicators, and in particular, changes in indicator values over time, during the pre-activity routine.
  • the indicators are arranged so that a low value of the indicator is indicative of a good value, in other words a low value corresponds to narrow focus, good Mushin, low face tension, anxiety and reduced blinking. This allows users to easily discern whether they are in the correct mental state.
  • this is not essential and alternatively other indicators can be used so that, for example, high values may be indicative of a good outcome.
  • the above-described process allows a user to review their mental state during the completion of both the pre-activity routine and the activity itself, in turn allowing the user to modify their pre-activity routine at step 270, for example by including additional, fewer or alternative steps, or the like.
  • the feedback allows the user to modify their pre-activity routine, thereby ensuring the user is in an optimum mental state when performing the activity itself.
  • the headset 300 includes a headband 301 which is designed to extend around the user's head in use.
  • the headband 301 acts to support at least two sensors in the form of first and second electrodes 311, 312, and a third sensor in the form of a clip electrode 315 having an electrode mounted thereon.
  • the electrodes 311, 312, are positioned on the headband 301 so that, in use, the first electrode 311 aligns with a user's temple and a second electrode 312 aligns with the user's forehead.
  • the electrodes 311, 312 may be adjustably and/or removably mounted to the headband, allowing the exact position of the electrodes 311, 312 to be adjusted.
  • this is achieved by mounting the sensor electrodes 311, 312 to the band 300 using hook and loop, or other similar fasteners.
  • the clip electrode 315 is designed to be attached to the user's ear, effectively providing a common electrode allowing measurements from the other electrodes to be made relative to the potential of the common electrode, as will be understood in the art. It will be appreciated that in use, conductive gel and/or antiseptic may be applied to the electrodes as required.
  • the headband 301 may be made of any suitable material, and in one example is plastic, such as PVC, or the like, allowing the headband to provide robust support for the sensors, whilst being flexible and comfortable to wear, as well as being hygienic and easy to clean.
  • plastic such as PVC, or the like
  • the headband 301 is also typically adjustable so as to ensure a tight fit arrangement, and thereby bias the electrodes 311, 312 against the user's skin, helping to ensure good electrical contact and thereby reduce signal artefacts.
  • this is achieved by utilising additional straps 302 incorporating an adjustment mechanism, such as a rachet buckle 303, which cooperates with the straps 302 allowing the relative length of the straps 302 to be adjusted.
  • the straps then fit against the rear of the head, so that the headband 301 can be tightened in situ, thereby providing a secure fit.
  • other arrangements may be used, such as the use of compliant or resilient headbands.
  • a support pad 313 of a similar size and shape to the electrodes 311, 312 may be positioned on the headband 301 so as to align with the user's other temple, thereby ensuring that the headband 301 is symmetrically positioned and balanced on the user's head.
  • Headset 300 also typically includes a housing 320, coupled to the headband via connecting straps 321.
  • the housing 320 contains the measuring device electronics, including the processing device 121, the power source 122, and the wireless interface 123. It will be appreciated that the processing device 121 can be coupled to the electrodes 311, 312 via leads (not shown) extending along or through the headband 301.
  • the headset 300 can also optionally include straps 331, 332 extending to opposing sides of the headband 301.
  • the straps allow the headband to be supported by the top of the user's head, thereby further stabilizing the position of the headband 301 relative to the user's head.
  • the above described headset 300 provides a stable, comfortable and wearable arrangement, which supports the measuring device 1 10, whilst maintaining good electrical contact between the electrodes 311, 312 and the user. This minimizes unwanted signal artifacts, whilst minimizing interference for the user, allowing the user to perform the pre-activity routine and/or activity, substantially unimpeded.
  • the headgear 120 is mounted on the user.
  • the measuring device 110 and processing system 100 are turned on and wirelessly connected.
  • an optional calibration process is performed, which typically involves measuring electrical brain activity in the user when they are in a rest position. This can be utilised to ensure that the apparatus is working correctly and optionally to scale either thresholds or measured electrical signal values so that meaningful indicators can be generated. For example, if an individual has a particularly low or high value of an indicator, it may be necessary to scale a reference threshold used in assessing whether a measured indicator value is acceptable. This also settles the user down when using the equipment for the first time.
  • recording is initialised, typically in accordance with a user input command supplied using the input device 103.
  • the command causes the processing system 100 to activate the measurement device 110 so that the measurement device generates data indicative of measured electrical signals, with the data being received by the processing system 100, at step 415.
  • the measured signals are filtered to generate indicator values.
  • the nature of the filtering performed will depend on the preferred implementation.
  • the processing system 100 is adapted to filter the signals at between 1 and 100Hz, and more typically at between 2 and 60Hz, with filtering typically being performed at a plurality of different frequency ranges to thereby determine the different indicators.
  • the indicators can be based on one or more signals bandpass filtered within the following frequency ranges: focus at between 3 and 6Hz; mushin at between 2 and 60Hz; face tension at between 12 and 15Hz; anxiety at between 15 and 60Hz; and, quiet eye at between 8 and 12Hz.
  • filtered signals can be combined and/or otherwise manipulated to obviate undue fluctuations.
  • the indicators can be determined based on a rolling average of previous determined values, to thereby smooth out fluctuations. It will be appreciated that other suitable smoothing techniques could also be used.
  • alternatively fluctuations can be accounted for by deriving an indicator by combining one or more filtered signals within the relevant frequency range.
  • filtering for at least one of the indicators is achieved by selecting a base frequency range of interest, splitting this filtered signal into three further offset filters, and then re-combining these three signals in an OR gate to generate an indicator. This process can performed for five selected frequencies, with data from the five separate EEG signals are fed into an exclusive AND gate, to provide an overall indicator, such as an overall handicap indicator.
  • the processing system 100 compares the derived indicator values to predetermined threshold values, which are typically stored in memory 102, and which optionally be determined or modified during the calibration process mentioned above.
  • the thresholds are typically set indicator values representing an acceptable or good indicator value, and can therefore be set based on particular training requirements, for example depending on the nature of the activity being performed, a level of expertise of the user, and/or the rest brain state of the user.
  • audible and/or visual indications can be generated by the processing system 100 and presented to the user.
  • audible indications these are typically generated so that sounds are produced, with parameters of the sound, such as the pitch, tone, volume or the like, depending on the determined indicator values.
  • parameters of the sound such as the pitch, tone, volume or the like.
  • different notes are used for different indicators, with a sound only being produced if the relevant indicator value is below a corresponding threshold value, thereby indicating that the indicator is acceptable.
  • the tone can vary depending on the magnitude of the difference between the measured indicator value and the threshold value.
  • the visual indicators are typically presented to the user as a representation forming part of a user interface displayed on the display 103.
  • An example of a suitable user interface for displaying indicators, either during or after a pre-activity routine is performed, will now be described with reference to Figures 5A to 5C.
  • the user interface 500 includes a video window 510, for displaying video footage, numerical indicator values 520, and an indicator graph 530, showing changes in indicator values as the pre-activity routine is performed.
  • the numerical indicator values 520 include a mushin value 521, a focus value 522, an anxiety value 523, a facial tension value 524 and a quiet eye value 525.
  • the graph shows changes in each of the indicator values over time, with the visual indications including a mushin line indicator 531, a focus line indicator 532, an anxiety line indicator 533, and a line indicator quiet eye 535, with a facial tension filled area 534 also being provided.
  • a video sequence or image sequence of the user performing the pre-activity routine and/or activity may also be captured at step 435 and displayed in the video window 510. Capture is performed using an imaging device, such as a video, camera, coupled to the processing system 100, for example via the external interface 104. However, this is not essential, and alternatively the camera may form part of the processing system, such as a webcam, or the like.
  • an imaging device such as a video, camera
  • the video camera can be any form of video camera, and can be provided in any suitable location.
  • the video camera can be provided on a tripod arranged to image the user as they are performing their pre- activity routine.
  • a camera could be mounted on the headset 300 to capture a first person view of the pre-activity routine and/or activity, as it is being performed.
  • the arrangement could also receive data from any other form of sensor that may provide useful feedback to a user.
  • This can include for example, the use of a pressure sensitive system that can analyse the user's weight distribution as an activity is being performed.
  • This can also include other positional sensors, such as motion sensing systems, for analysing the user's body position during the pre-activity routine.
  • a pre-activity routine is an effective method of improving one's focus on the task at hand. An example of a pre- activity routine for a golf shot will now be described in more detail.
  • a pre-shot routine is a consistent and systematic procedure (a sequence of thoughts, checkpoints, movements or details) that is executed by a golfer prior to hitting a golf shot.
  • Pre-shot routines are likely as varied in their steps and details, from person to person, as fingerprints (i.e., each golfer's pre-shot routine is probably unique).
  • a pre-shot routine is good for eliminating extraneous thoughts prior to hitting a golf shot and "grounding" a player, getting them to focus more exclusively on the shot at hand.
  • a pre-shot routine requires the focus of conscious attention on relevant tasks, thereby eliminating or at least reducing any extra time to attend to irrelevant or unwanted things.
  • the key is to prepare for the shot is by thinking prior to the shot, allowing the user's brain to assimilate the required information, and then entering a state known as Mushin, allowing the shot to be executed by the brain automatically.
  • the user assesses for feedback during the pre-shot routine at step 445.
  • feedback can be provided to the user whilst they are undergoing the pre-shot routine, either by making the display 103 visible to the user, or by having another individual such as a trainer, provide verbal feedback.
  • audible tones can also be generated. This allows the user to assess whether their mental state is correct in real time, helping the user understand when they are mentally prepared to perform the activity.
  • the user can review the video footage and indicator values recorded at step 455, for example using the user interface 500, as shown in Figures 5A to 5C.
  • this allows the user to view how their mental state changes as the pre-activity routine and activity progress.
  • a user interface 600 includes a list of pre-activity routine steps or tasks.
  • Indicator values are provided in the form of bar meters for each of the indicators, mushin 621, focus 622, anxiety 623, facial tension 624 and quiet eye 625.
  • a meter is shown representing a measured value and an idealised value. This allows the user to compare each of the indicators, and assesses where in the pre-activity routine improvements could be made.
  • a second example apparatus will now be described with reference to Figures 8 to 10.
  • the apparatus is substantially as described above and operates in a similar manner.
  • the headset is modified to include an image capture device for capturing an image or video sequence, whilst a separate sensing unit is provided for measuring the user's weight distribution during performance of the pre- activity routine or the activity itself.
  • the headband 301 incorporates an image capture device 801 , such as a video camera or the like.
  • the camera 801 is positioned on the headband so that in use, it will align substantially centrally on the user's forehead angled slightly downwards, as shown in Figure 8B.
  • This arrangement is intended for use in sporting activities in which a ball or other object is provided on the ground to be struck, such as golf, football, or the like.
  • the camera 801 faces slightly towards the ground, as typically the user's head would be oriented substantially level with their eyes cast downward to view the ball during the shot.
  • this is not essential and other arrangements could be used, for example, for use in training for other activities.
  • the video camera 801 will capture first-person video footage showing the user performing the pre-activity routine and/or the activity.
  • the video footage can then be transferred to the electronic processing device 121 and/or the interface 123, allowing it to be transmitted to the processing system 100, for subsequent review, as will be described in more detail below.
  • the sensing unit 900 includes a housing including first and second bodies 901, 902.
  • the first body 901 typically contains a processing device 911, which is typically coupled to first and second sensors 921, 922.
  • the sensors 921, 922 are coupled to the second body 902, which is typically resilient or movably mounted to the first body 901, so that as a user stands on the second body 902, the user's weight is detected by the sensors 921, 922.
  • any suitable form of sensor arrangement can be used, such as the use of strain gauges, or the like.
  • markings 931, 932 can be provided on the second body 902, aligned with the sensors 921, 922 to show the user's preferred standing position.
  • the weight sensors 921, 922 can therefore detect the weight of the user and in particular, the weight distribution between the left and right feet, and/or between the toe and heel on each foot.
  • the processing device 911 receives signals from the sensors 921, 922, and optionally performs pre-processing, such as digitizing, coarse filtering or other processing steps, before transferring signals indicative of the weight distribution of the user, to the processing system 100. This in turn allows the processing system 100 to display information regarding the user's centre of gravity, pressure, balance or mass, as will be described in more detail below.
  • pre-processing such as digitizing, coarse filtering or other processing steps
  • the processing device 911 can be any form of electronic processing device such as a microprocessor, microchip processor, logic gate configuration, firmware optionally associated with implementing logic such as an FPGA (Field Programmable Gate Array), or any other electronic device, system or arrangement capable of processing received signals.
  • a microprocessor microchip processor
  • logic gate configuration firmware optionally associated with implementing logic
  • firmware optionally associated with implementing logic
  • FPGA Field Programmable Gate Array
  • the first body 901 may also house additional components such as a power source and interface (not shown) for connecting to the processing system 100, as will be appreciated by persons skilled in the art.
  • the arrangement of the current example works substantially as described above with reference to Figures 4A and 4B, albeit with additional weight distribution information being captured.
  • an indication of mental state, as well as , video footage and weight distribution information can be displayed to the user by a user interface, an example of which is shown in Figure 10.
  • the user interface 1000 is substantially similar to the user interface 500 described above with respect to Figures 5A to 5C. Similar features are therefore identified with similar reference numerals and will not be described in any further detail.
  • the interface 1000 includes an additional weight distribution window 1040 which shows the user's centre of gravity, mass, pressure or balance indicated by a centre of mass, gravity indicator 1041, and a change in centre of mass, gravity over time indicated by the path 1042. Additional numerical indications of the relative weight distribution between the user's left and right feet may also be shown, as indicated at 1043.
  • the interface 1000 may also include an overall activity indicator 1050 which is formed from either direct measures of electrical brain activity, or a combination of other indicators, as previously discussed.
  • An options window 1060 may also be provided allowing the user to select different options, such as which video camera is used to capture a video sequence.
  • the video footage shown in the video window 510 is first-person video footage, recorded from the user's perspective when performing the pre-activity routine and/or the activity. Accordingly, when the user subsequently reviews the video footage, it is more meaningful to them than footage captured from a third person perspective. Consequently, the user can more accurately understand the point at which they are in the pre-activity routine when watching the footage, as well as more easily observe other relevant issues, such as the position of their hands on the club, the position of their feet, or the like.
  • weight distribution also helps the user understand if they are dynamically balanced both when preparing to perform, and more importantly when performing the activity. Thus, for example in golf, this ensures the user is dynamically balanced when addressing the ball, and taking the shot and hence whether they are balanced during the backswing and taking other parts of the shot. Furthermore, by providing this feedback in conjunction with the feedback regarding the mental state, this allows the user to ensure that they maintain the optimum mental state during this process.
  • the feedback allows the user to ensure they remain in the mushin state, whilst being dynamically balanced during the backswing and playing of the shot. Maintaining this combination is important in ensuring that the user is in a physically and mentally optimum state when playing the ball, which can result in a vast improvement in performance.
  • first-person video footage and weight distribution information can further enhance the effectiveness of the above described training technique.
  • the processing system 100 is adapted to determine and display a next step to be performed.
  • the step typically forms part of either a pre-activity routine, or part of an actual sporting activity.
  • the step may be part of a pre-shot routine for a golf shot, or alternatively may comprise part of the golf shot itself, such as the backswing, strike, follow-through, or the like.
  • next step to be performed is determined will vary depending upon the preferred implementation. Typically however a pre-shot routine or sequence of shot steps are predefined and stored in the memory 102, allowing the processor 101 to retrieve details of the next step from the memory 102 and display an appropriate indication of the step to the user via the input/output device 103. This can include displaying an indication of the next step, instructions for performing the step, and optionally information regarding a desired mental state, to assist the user in understanding what is required.
  • the processing system 100 determines indicators indicative of electrical brain activity of the user. As previously described, this process typically involves filtering signals received from the wearable headgear 120, and using these to generate the indicators, which may be indicative of quiet eye, focus, face tension, anxiety and mushin, and may also optionally include additional states such as the amount of blinking and peripheral vision use of the user.
  • the indicators may optionally be displayed to the user at step 1120. It will be appreciated that this process is performed utilising the techniques outlined above and this will not therefore be described in any further j detail.
  • the processing system 100 operates to determine a desired brain state for the step the user is currently performing.
  • the desired brain state will typically be predefined and stored in the memory 102, so that this can be accessed by the processor 101 as required. It will be appreciated that the desired brain state can be defined in any suitable manner, such as by defining desired values, or a desired range of values, for the indicators.
  • the processing system 100 compares the desired brain state to the measured indicators to determine whether the user is an acceptable brain state for the step being performed. This typically involves comparing the measured indicator values to the desired values or ranges.
  • step 1150 if it is determined that the brain state is not acceptable, for example of the measured indicator values do not match the desired values, or fall outside a desired range, the processing system 100 continues to monitor the user's brain state by returning to step 1110 and repeating steps 1110 through to 1150. This will continue until the user is in an acceptable brain state at which point the process proceeds to step 1160 allowing the processing system 100 to generate an indicator indicative of the brain state requirement being met. This may be achieved in any one of a number of ways, but will typically involve having the processing system 100 generate an audible tone which can be heard by the user, thereby alerting the user to the fact that their brain state is acceptable for that particular step, although additionally or alternatively visual indications may be provided.
  • processing system 100 can return to step 1110 and determine a next step to be performed as part of the pre-activity routine or the activity itself, with this then being displayed to the user.
  • the above described process allows the processing system 100 to be programmed with a defined sequence of steps representing either a pre-activity routine or a sporting activity.
  • the processing system 100 can then monitor the user's brain state whilst the user performs each given step within the defined routine or activity, alerting the user when the desired brain state is reached. This helps provide feedback to the user, allowing a user to train their brain over a sequence of steps, making them more able to achieve the required brain state when performing the sporting activity in future.
  • measured indicators can be displayed, together with indications of the desired brain state, allowing the user to compare their current brain state to the desired state, thereby further assisting the user in modifying their brain state as required.
  • the indicators can be in the form of visual representations similar to those described above.
  • the visual representation can be in the form of a graphical representation of an avatar which includes indications of different aspects of the user's brain state as will now be described with reference to Figures 12A to 12G.
  • the graphical representation is in the form of a representation of a human head 1200.1 and an object 1200.2, including a sporting article such as a golf ball, the image being animated in some manner to indicate the different brain states.
  • the avatar is animated by having the avatars eyes blink to indicate a degree of blinking of the user. It will be appreciated that blinking is mandatory as it is required at regular intervals to moisten the individuals eyeballs whilst performing the step However, excessive blinking will cause our user to lose focus and prevent them to being able to maintain a desired state of quiet eye. Accordingly, by providing visual feedback as to the rate of blinking of the user, this can assist the user in controlling their blinking for short periods before execution of the step.
  • FIG. 12C the left hemisphere 1202 of the avatar brain is highlighted, with an intensity, colour or the like representing a particular degree of anxiety.
  • Anxiety can result from performance anxiety or chronic anxiety and this can be controlled by having the user adjust their breathing to reduce the anxiety.
  • a graphical representation can be provided of the user's visual focus in the form of coloured lines or regions 1203 extending from the avatar to one or more objects, thereby indicating what the user's eyes and mind are focussed on. This is important in ensuring the user is focussing correctly for the particular step being performed.
  • the right hand hemisphere 1204 of the avatar's brain is coloured, with the intensity, colour, or the like indicating a degree of mushin, which as previously described is the Japanese word for a state of no mindedness. This is important in ensuring that the user is not over thinking the step to be performed.
  • Figure 12F includes a visual indication of quiet eye in the form of a coloured region 1205 extending from the object 1205 to the avatar, but in a different colour, representing an index of focus concentration in which the eyes go into the fovea vision with a narrow focus point and without deviation of greater than 3 degrees.
  • a coloured region 1206 in front of the avatar is used to represent a degree of peripheral vision when mushin and quiet eye are in sync, with the angle of extent of the region indicating the degree of peripheral vision.
  • the avatar provides feedback to the user regarding their current brain state. Unlike the graphical or numerical representations previously described, the avatar is more intuitive for a user to understand making it easier for the user to understand the feedback being provided and modify their brain state accordingly.
  • FIG. 13A to 13R show idealised avatar states.
  • the avatar 1300 is shown together with first and second objects 1301, 1302 in the form of a ball, and target, such as golf pin, respectively.
  • the first stage in the process is for the process is for the individual to analyse the shot.
  • the individual In analysing the shot, as shown by the idealised avatar in Figure 13C, the individual should have a wide focus of attention 1311 on the target 1302 and utilise their left brain in analysing the stroke to be performed, as shown by the region 1313.
  • This brain state allows the user to observe everything within their view and then analyse relevant parameters for the shot with their left brain including the distance to the target, the wind and other factors and then assess how best to play the shot, for example by avoiding hazards, such as bunkers, water, or the like.
  • the user will stand behind the ball and during this process must transition from the mental state of Figure 13D to that shown in Figure 13E, switching from a narrow visual and left brain focus on the target 1302, to a narrow visual focus 1311 and mushin right brain state, mentally focused on the ball 1301, as shown at 1312. This enables the user to more clearly consider the shot without over analysing it.
  • the user will switch to a covert focus as shown in Figure 13F so that their eye focus 131 1 is on the ball, while their mind focus is on the target 1302, as well as the shot and swing to be executed.
  • a fourth step the user will commence practice swings. At this stage the user must switch from a covert focus to a narrow focus 1311 and state of mushin, as shown in Figure 13G. This allows the user to observe the club head during the practice swing and start creating pictures of the shot as swing to be performed. [0199] The user then stands behind the ball and prepares for the shot. Initially the user will start with a narrow focus 1311 and mushin state, with mental focus 1312 on the ball 1301, as shown in Figure 13H. The user will then switch to focussing on the target 1302 with overt focus so that they are both looking at the target and focussing mentally on the target as shown in Figure 131.
  • the user will switch to a covert focus in which they are looking at the target 1302, whilst focussing mentally on the ball 1301, as shown in Figure 13 J.
  • the user can then saccade between the target 1302 and the ball 1301 until they are confident that they are ready to play the shot.
  • a sixth step the user can approach the ball maintaining an overt focus, as shown in Figure 13J before focussing their attention on the ball 1301 with a narrow visual focus 1311 and mind focus 1312 on the ball 1301 as shown in Figure 13K.
  • the seventh step the user will focus their visual attention on the ball 1301 using smooth head movement to assist in maintaining mushin, with an overt focus.
  • an eighth step the user lines their club behind the ball before switching their mental focus 1312 to the target 1302 while continuing to look at the ball 1301, as shown at 1311, in Figure 13L.
  • the user will set their feet correctly, position themselves relative to the ball, select their side bend and narrow the focus on lining the club head behind the ball.
  • step nine the user shifts their visual focus 1311 to look directly at the target 1302 whilst maintaining their mind focus 1312 on the target 1302 as shown in Figure 13M. Then, the user will look at the target 1302 whilst adjusting their feet and body and then keeping their club on the ground behind the ball lifting their left foot and then right foot whilst looking at the target to dynamically balance the body. Throughout this the user will maintain visual focus on the target 1302 while switching their mind between the target 1302 and the ball 1301, as shown in Figure 13N, as required.
  • step twelve the user focuses back on the ball as shown in Figure 130.
  • step twelve during shot preparation the user will initially focus themselves visually and mentally on the ball 1301, as shown in Figure 130, before visually focussing on the ball 1301, and entering a more general mushin state which controls the intended movement, the muscles of the body and the like allowing these to automatically execute the required movements.
  • the user prepares for the shot during which time they require a narrow focus, mushin and quiet eye as shown in Figure 13Q. This is typically achieved by having the user narrow their visual focus 1311 on a dimple or spot on the ball 1301, which will initiate the onset of quiet eye 1314. This gives the brain time to process and time to communicate with the body allowing the body to respond appropriately to the shot the user has determined will be played.
  • step fourteen the user prepares for the shot by applying a narrow visual focus 1311, mushin, quiet eye 1314 and peripheral vision 1315, which is evoked when the user has complete awareness of their surroundings and is in a position to play the shot.
  • the user may then execute the shot with the body responding and executing the necessary movements so that the shot is executed effortlessly.
  • the apparatus can also be adapted to monitor a position of the user and/or sporting equipment. In one example, this involves using a position sensor attached to either the user or the sporting equipment, with signals from the sensor being used by the processing system to determine at least one position indicator indicative of the position, which can then be displayed to the user.
  • the processing system 100 is coupled to a positional sensing device 1400 which includes an electronic processor 1421, a power source 1422, a wireless interface 1423 and a position sensor 1424, such as a triaxial accelerometer.
  • the processor 1421 optionally performs preliminary processing on signals from the position sensor, before forwarding these to the processing system 100.
  • positional sensing devices 1400.1, 1400.2, 1400.3, 1400.4 are provided mounted either on the player and/or on player equipment, such as a golf club as shown in Figure 14B.
  • positional sensing devices 1400 are provided on the shoulders, hips, and/or head of the user, as well as on the golf club, as the relative position of these are important in ensuring a golf swing is successful.
  • sensors may be provided in an alternative locations, such as on the user's forearms, or the like.
  • any number of positional sensing devices may be used, depending on the body parts or equipment to be monitored. For example, a single positional sensing device could be used if the user wants to focus on the position of one body part only.
  • Positions of the position sensing devices on the player will also vary depending on the nature of this sporting activity being performed. Thus, as mentioned above, in golf it is typical to provide positional sensing device on any one or more of the shoulders, hips, forearm, and/or head of the user. In contrast, for baseball pitching it is typical to attach sensing devices to the lowerbody, upperbody, forearm and upperarm.
  • the positional sensing devices 1400 can be attached in any suitable manner. For example, in the case of the head, attachment of the positional sensing device 1400.4 can be achieved by attaching the positional sensing device 1400.4 to the headgear 120. For positional sensing devices attached to other body parts, this can be achieved using other techniques, such as using straps or bands, hook and loop or adhesive fasteners, as well as special clothing including pockets for holding the positional sensing devices.
  • the positional sensing device could also be integrated into the processing system 100, for example if this is provided in the form of a wearable or portable device.
  • the processing system 100 is a smart phone, or other similar device, this will often incorporate position sensors, and therefore the processing system 100 could be attached to the user and operate as one of the positional sensing devices 1400 to sense the position of part of the user.
  • the processing system 100 will operate to receive positional information from the position sensor 1424 of each of the position sensing devices 1400.1, 1400.2, 1400.3, 1400.4 and use this to ascertain the relative position of the user's hips, shoulders, head or club.
  • the processing system 100 typically performs an initial calibration step, with the position sensing devices 1400 provided in known reference positions. For example, this might involve attaching these to the user with the user standing vertically, and/or holding the equipment vertically.
  • the processing system 100 can then signals acquired from the sensors 1424 as reference signals, with changes in position from the reference position being determined based on changes in the signals acquired from the sensors.
  • the positional information can then be used to display information to the user, regarding the position of the body, such as the hips, shoulders, head or the club, as will be described in more detail below.
  • the determined position of the user and/or equipment can be used in a manner similar to that described above with respect to Figure 11 for the brain activity information. This allows sensed positions of the user and/or sporting equipment to be compared to desired positions for given steps of the activity or pre-activity routine.
  • the processing system can determine a step being associated with a pre-activity routine or part of a sporting activity, use signals from one or more of the sensors 1424 to determine a sensed position of the user and/or equipment, which is then compared to reference position information for the current step being performed. This can then be used to generate an indication indicative of whether the sensed position corresponds to the desired position, or indicate whether the user can move on to the next step in the activity or pre- activity routine.
  • the user may only progress to the next stage of the pre-activity routine and/or shot once the correct position is reached, and also optionally, held for a required period of time.
  • the brain state and position can be monitored simultaneously, although this is not essential, and alternatively the position and/or brain state can be monitored independently.
  • feedback of the user and/or equipment position can be displayed to the user via a graphical user interface, an example of which is shown in Figures 15 A to 15D.
  • sensing devices 1400.1, 1400.2 are used coupled to the user's shoulder and hips respectively, whereas in the example of Figures 15C and 15D, sensing devices 1400.2, 1400.3 are coupled to the user's hips and the golf club.
  • sensing devices 1400.1, 1400.4 are coupled to the user's shoulder and head, whilst in the example of Figure 15F, sensing devices 1400.2, 1400.4 are coupled to the user's hips and head, respectively.
  • a user interface 1500 is shown including an avatar window 1510, a video window 1520, a position window 1530, a step window 1540, a status window 1550 and a control window 1560.
  • the avatar window 1510 displays an avatar similar to the avatars described above with respect to Figures 12 and 13.
  • the video window 1520 displays video footage of the user as they are performing the relevant step, which can be stored for later review as previously described.
  • the position window 1530 displays position representations indicative of the positions of either user body parts 1531.1, 1531.2, 1531.4, as shown in Figures 15 A, 15B, 15E and 15F, or sporting equipment 1531.3 as shown in Figures 15C and 15D, or the headgear, and hence head 1531.4, .
  • the position window can also display reference planes 1532.1, 1532.2 indicative of the desired orientations, as well as numerical values 1533.1, 1533.2, 1533.3 indicative of the relative orientation of each of the sensing devices 1400.1, 1400.2, 1400.3.
  • the position indicator 1531.1 is a first colour, such as red, indicating that the user's torso is at the wrong angle, whilst the position indicator 1531.2 is in a second colour, such as green, indicating that the user's hips are at the wrong angle. Further colours may be used, such as amber or orange, for example to indicate that the body part is approaching the correct orientation.
  • the step window 1540 includes details of the current step being performed.
  • the step window 1540 includes a list of different exercises 1541 corresponding to different golfing shots, along with a positions list 1542 which correspond to the different steps being performed by the user when performing the respective shot.
  • the status window 1550 includes status information which can include information such as the number of reps (repetitions) of the particular exercise that must be performed and also a hold time for a respective position and/or mental state, as previously described.
  • a control window 1560 can include controls 1561, 1562, 1563 to stop/commence the activity, calibrate the sensors or finish the process.
  • sensor status window 1571, 1572 indicate that the position sensors are working correctly.
  • a user can select a sporting activity from the exercise list 1541, and optionally select a particular step from the positions list 1542.
  • the processing system can then monitor signals from either the headgear 120 and/or position sensing devices 1400.1, 1400.2, 1400.3, 1400.4 and use these to display feedback to the user via the avatar, or the position representations 1531.
  • the processing system 100 can also monitor the signals and compare these to reference values and then indicate once the mental state and/or position of the user and/or equipment is correct. Additionally, the processing system 100 can monitor the hold time for which the correct position and/or mental state is held, until a desired hold time is reached. The number of reps performed can then be increased until a desired value is reached, at which time the processing system 100 can move on to a next step for the exercise.
  • the above-described user interface can provide feedback to the user regarding the optimum mental state and position to be achieved during each step of a golfing shot and pre-golf shot routine. This allows the user to repeatedly practice different types of shot ensuring that their mental state and body position are correct for playing the shot and thereby optimising the likelihood of shot success.
  • the above described process provides a technique for improving a user's mental state by using measures of electrical brain activity, such as electroencephalograph (EEG) signals, measured whilst a predetermined sequence of steps representing a pre-activity routine and/or activity, is performed. Measurements are typically made at all stages of the pre-activity routine, although this is not essential, and recordings may be made for only some stages of the pre-activity routine, or the activity itself.
  • EEG electroencephalograph
  • the method may be used to evaluate the performance of a user in preparing for a sporting activity.
  • a user's performance can be evaluated by comparing how hard a user works on each task in a pre-activity routine, or an activity, compared to a predetermined threshold, thereby allowing the user to improve their performance.
  • the signals are collected from sensors attached to the scalp of a neurologically healthy user as the user performs their pre-activity routine.
  • sensors typically only two sensors, forming one sensor pair, are used, which is less than used in traditional EEG techniques.
  • Collected data is analysed allowing indicators indicative of brain states to be determined, with auditory and/or visual feedback being provided to the user on the basis of the indicators.
  • the indicators can be captured together with video footage of the user's movements to assist further in analysis.
  • the brain states are associated with at least one condition chosen from the group of predetermined conditions comprising: quiet eye, face tension, anxiety, wide focus, narrow focus, peripheral focus, and mushin, although other indicators could be used.
  • captured signals are analysed at least in part by filtering for specific frequencies to allow the indicators to be determined.
  • Filtering can be used to reject unwanted signal interference from external sources, such as wireless devices, mains electricity, or the like, as well as to identify specific components of the signals, which can in turn be used as indicators.
  • the process can be understood as a combination of operant conditioning and pattern recognition.
  • Tasks can be used as operant conditioning, but users are not trained to optimally perform the tasks.
  • Pattern recognition uses filters and indicator values to indicate the brain state the user is in while performing the task.
  • the combination of operant conditioning and pattern recognition provides a way to detect brain states, the persistence of brain states, and transitions between brain states that may then be used to more directly measure the conditions of users such as, but not limited to, interruptability, cognitive workload, task engagement, communication mediation, interpreting and predicting system response, surprise, satisfaction, and frustration.
  • the system provides a straightforward mechanism for studying the brain states of a user preparing to perform an activity.
  • the arrangement does not require users to understand the system or control all or part of the system.
  • a pre- activity routine such as a pre-execution sequence, a pre-shot routine, or the like. Examples include baseball, ice hockey, 10 pin bowling, bowling, darts, pistol shooting, AFL, rugby, Rugby League, pool, snooker, golf, or the like.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Physics & Mathematics (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Child & Adolescent Psychology (AREA)
  • Social Psychology (AREA)
  • Hospice & Palliative Care (AREA)
  • Educational Technology (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

A method for determining a mental state of a user for performing a sporting activity, the method including, in an electronic processing system, determining from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of a pre-activity routine, the routine including one or more steps for preparing to perform the sporting activity; and, the sporting activity; determining an indicator indicative of a measure of a user brain state using the measure of electrical activity; and, providing an indication of the at least one indicator to the user.

Description

ACTIVITY TRAINING APPARATUS AND METHOD Background of the Invention
[0001] The present invention relates to a method and apparatus for training a user or determining a mental state of a user for performing a sporting activity, for example to allow a user to improve their mental state for performing activities such as playing a shot in golf.
Description of the Prior Art
[0002] The reference in this specification to any prior publication (or information derived from it), or to any matter which is known, is not, and should not be taken as an acknowledgment or admission or any form of suggestion that the prior publication (or information derived from it) or known matter forms part of the common general knowledge in the field of endeavour to which this specification relates.
[0003] An important part of the process of developing a teaching and training program for users for performing sporting activities is evaluating the effectiveness of the program from the user's point of view. Traditionally, the effectiveness of a teaching and training program is determined by observing users as they perform prescribed tasks.
[0004] For example, when practising golf it is desirable to be able to determine the effectiveness of the practice for the actual golf swing. The traditional method of determining the effectiveness of the practice is just to watch the flight of the ball while the athlete is hitting a golf ball on the practice range. The observed ball flight is then analysed and changes made to the swing.
[0005] Little or no attention is paid to the mental state of the player while practising. Consequently when the golfer arrives at the golf course to actually play golf they typically have a more heightened arousal state, which will alter their cognitive state, resulting in a different swing, meaning practice is ineffective.
[0006] On Way to address this is for users to answer questions before, during, and/or after the tasks are performed. The questions may be about the teaching and training program, the task, the user's perceptions, etc. Observations about the users' behaviour and answers to the questions are characterized and quantified. The quantified results are analyzed to determine the effectiveness of the teaching and training program.
[0007] However, there are problems with evaluating a teaching and training program in the manner described above. Asking a user questions after a task is performed may result in losing information because the user is likely to forget details about the task and his or her reactions to the teaching and training program. An alternative approach, asking a user questions while the user is performing a task, is likely to distract the user from the task and the teaching and training program. In either case, those skilled in the art appreciate that human beings are often poor reporters of their own actions, so such verbal information a user provides may also not be accurate, further impacting on the reliability of such techniques.
[0008] Relying solely on observing a user's external actions is also not likely to provide enough information about what a user is thinking or feeling while in teaching and training program. It is possible that user actions may be misinterpreted or missed by an observer.
[0009] Cognitive techniques analyze electrical signals caused by electrical changes within the brain, i.e., using electroencephalograph (EEG) signals. EEG signals contain data and patterns of data associated with brain states, which can be used to infer the existence of thought processes. EEGs provide a passive, non-invasive way to study brain activity. Compared to other brain activity analysis tools, EEGs provide a relatively coarse representation of brain activity. However, EEGs require only a small amount of operator training and are safe when used repeatedly or used for extended periods of time.
[0010] An EEG measures and records the differences in voltage levels between sensors. Electrical changes within the brain of a user cause changes in the voltage level between the sensors. The voltage levels from the sensor are passed to the EEG where the voltage levels are recorded for further processing and analysis. Analysis techniques can focus on general data features of the EEG signal, with data being extracted and analysed using appropriate algorithms. In order for such signal analysis processes to operate correctly, two sensors plus a common electrode are placed on the user's scalp (ear) in a specific, standard, predetermined pattern and artifacts are filtered out of the signals from the sensors.
[0011] Certain patterns in electrical signals generated by the brain may be associated with brain activities and brain states that may then be used to infer the existence of thought processes, e.g., the surprise signal pattern to infer surprise. The electrical signal patterns recorded by the EEG can be classified as representing cognitive or non-cognitive activities. Examples of cognitive activities are arithmetic calculations, imagining scenes or images, recalling songs, and so on. A cognitive activity generates one or more cognitive signals and artifacts, i.e., cognitive artifacts. Examples of non-cognitive activities are moving a computer mouse and typing on a keyboard. More subtle examples of non-cognitive activities are eye blinking, eye movement, and twitching. A non-cognitive activity generates one or more non- cognitive signal and artifacts, i.e., non-cognitive artifacts.
[0012] Often the strength and/or number of the artifacts is great enough to overwhelm the cognitive and non-cognitive data in the signals making it difficult or impossible to recognize signal patterns. The problem of artifacts overwhelming signal patterns may be overcome to some extent by filtering. If a signal can be sufficiently characterized, a filter may be constructed to allow the signal to pass through the EEG while artifacts are blocked. Conversely, if an artifact is well-known, a filter may be constructed to block the well-known artefact.
[0013] Another solution to the problem of artifacts overwhelming signal patterns is to increase the strength and clarity of signal patterns. To ensure that clear, strong signal patterns are generated, users may be given neurofeedback training. In neurofeedback training a mechanism, such as a display connected to an EEG, provides the user with information, i.e., feedback, that helps the user determine how well he or she is performing a particular task. As the user uses the feedback to improve performance of the task, the signal patterns associated with the task are strengthened.
[0014] For example, instead of moving a cursor using a mouse, a touchpad, or the like, a user may, through the use of neurofeedback, learn how to "think about moving the cursor" in order to move a cursor in a particular direction, e.g., left. The user makes an attempt to "think about" moving the cursor to the left. The user generates certain signal patterns that are sensed by a sensor array and passed to an EEG. The EEG processes the signals, recognizes the signal patterns, and moves the cursor in accord with the signal patterns providing the user with immediate feedback. If the cursor has moved left, the user knows that the brain state achieved is the appropriate brain state for moving the cursor to the left. If the cursor does not move or moves in the wrong direction, e.g. to the right, the user must make an attempt to achieve a different brain state. As the user learns to move the cursor, the signal pattern associated with the brain state for moving the cursor is strengthened so that artifacts do not overwhelm the signal pattern.
[0015] While filtering artifacts, using neurofeedback to strengthen signals, using a plurality of specifically placed sensors, and restricting users' movements may help solve the problem of artifacts overwhelming signal patterns, such strategies restrict the application of such cognitive neuroscience techniques. For example, neurofeedback requires time and effort to train users to perform specific tasks in specific ways. Having to apply many sensors in predetermined positions requires researchers that are trained in such application and consumes time and money. Using many sensors and restricting users movements makes it less likely that suitable subjects, i.e., users, may be willing to participate in studies, and makes the system less useful for evaluating real interfaces in real world scenarios.
Summary of the Present Invention
[0016] In a first broad form the present invention seeks to provide a method for determining a mental state of a user for performing a sporting activity, the method including, in an electronic processing system:
a) determining from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of:
i) a pre-activity routine, the routine including one or more steps for preparing to perform the sporting activity; and,
ii) the sporting activity; b) determining an indicator indicative of a measure of a user brain state using the measure of electrical activity; and,
c) providing an. indication of the at least one indicator to the user.
[0017] Typically the at least one indicator is indicative of at least one of:
a) quiet eye;
b) focus; ί
c) face tension;
d) anxiety; and,
e) mushin.
[0018] Typically method includes, in the processing system, generating an indication including at least one of:
a) a visual indication; and,
b) an audible indication.
[0019] Typically the indicator includes a numerical value and wherein the visual indication includes at least one of:
a) the numerical value; 1
b) a graphical indication of the numerical value over time; and,
c) a bar indicator of a current numerical value.
[0020] Typically the indicator includes a numerical value, and wherein the method includes: a) comparing the numerical value to a threshold; and,
b) generating the indication in accordance with the results of the comparison.
[0021] Typically the indicator includes audible scaled tones having properties dependent on a numerical value of the indicator.
[0022] Typically the method includes, in the processing system, filtering the measure of electrical activity to thereby determine the at least one indicator.
[0023] Typically the method includes filtering the signal at between 1 and 100Hz. [0024] Typically the method includes filtering the signal at a plurality of different frequency ranges to thereby determine a number of indicators.
[0025] Typically the method includes filtering the signal at:
a) between 3 and 6Hz to determine a focus indicator;
b) between 2 and 60Hz to determine a mushin indicator;
c) between 12 and 15Hz to determine a face tension indicator;
d) between 15 and 60Hz to determine an anxiety indicator; and,
e) between 8 and 12Hz to determine a quiet eye indicator.
[0026] Typically the method includes using a plurality of filters to generate a plurality of filtered signals, the plurality of filtered signals being selectively combined to determine the at least one indicator.
[0027] Typically the method includes, in the processing system, smoothing at least one signal to determine the at least one indicator.
[0028] Typically the method includes training an user to prepare mentally for a sporting activity by:
a) determining changes in the at least one indicator over time during a pre-activity routine performed by the user;
b) haying the user modify the pre-activity routine at least partially in accordance with the changes; and,
c) repeating steps a) and b) to determine an improved pre-activity routine.
[0029] Typically the method includes:
a) determining a current step being performed by the user, the step being associated with a pre-activity routine or part of a sporting activity;
b) determining a desired brain state of the user in accordance with the step being performed; and,
c) generating an indication indicative of whether the user has the desired brain state. [0030] Typically the method includes: a) displaying a step to be performed by a user, the step being associated with a pre- activity routine or part of a sporting
Figure imgf000008_0001
b) determining a desired brain state of the user in accordance with the step being performed; and,
c) if the user has the desired brain state, displaying a next step to be performed.
[0031] Typically the desired brain state includes at least one of desired values or a desired range of values for the indicators.
[0032] Typically the indicator includes a graphical representation of an avatar including indications of a user brain state.
[0033] Typically the method includes:
a) determines from at least one position sensor, signals indicative of a position of at least one of part of the user and equipment used by the user;
b) determines at least one position indicator indicative of the position of at least one of part of the user and equipment used by the user; and,
c) provides an indication of the at least one position indicator to the user.
[0034] Typically the method includes:
a) deterrnining a current step being performed by the user, the step being associated with a pre-activity routine or part of a sporting activity;
b) determines from at least one position sensor, signals indicative of a sensed position of at least one of part of the user and equipment used by the user ; c) determining a desired position in accordance with the step being performed; and,
, d) generating an indication indicative of whether the sensed position corresponds to the desired position.
[0035] Typically the method includes:
a) determining a current step being performed by the user, the step being associated with a pre-activity routine or part of a sporting activity; b) determines from at least one position sensor, signals indicative of a sensed position of at least part of one of the user and equipment used by the user;
c) determining a desired position in accordance with the step being performed; and, d) if the sensed position corresponds to the desired positioned, displaying a next step to be performed.
[0036] Typically the method includes recording a video or image sequence of the user performing at least one of the pre-activity routine and the activity, and storing the sequence together with corresponding values of the at least one indicator.
[0037] Typically the method includes recording weight distribution data during at least one of the pre-activity routine and the activity, and storing the weight distribution data together with corresponding values of the at least one indicator.
[0038] Typically the method includes displaying a representation including at least one of: a) the indication of the at least one indicator;
b) an indication of weight distribution data; and,
c) a video or image sequence.
[0039] In a second broad form the present invention seeks to provide apparatus for determining a mental state of a user for performing a sporting activity, the apparatus including an electronic processing system that:
a) determines from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of:
i) a pre-activity routine, the routine including one or more steps for preparing to perform the sporting activity; and,
ii) the sporting activity;
b) determines an indicator indicative of a measure of a user brain state using the measure of electrical activity; and,
c) provides an indication of the at least one indicator to the user.
[0040] Typically the measuring device includes a processing unit for: a) receiving electrical signals from sensors coupled to the user; and, b) transmitting data indicative of the electrical signals to the processing system.
[0041] Typically the apparatus includes a wearable headgear for measuring electrical activity in the user's brain.
[0042] Typically the headgear includes:
a) a band for extending around a user's head in use;
b) two sensors mounted to the band, a first sensor being aligned with a user's forehead and a second sensor being aligned with a user's temple, in use; and, c) a third sensor which in use is clipped to the user's ear.
[0043] Typically the headgear includes a pad for aligning with a temple of the user.
[0044] Typically the sensors are at least one of removably and adjustably mounted to the band.
[0045] Typically the headgear includes a housing mounted to the headband, the housing containing at least a processing unit of measuring device.
[0046] Typically the measuring device includes at least two straps, each strap extending to an opposing side of the headband to thereby stabilize the position of the band relative to the user's head.
[0047] Typically the headgear includes an image capture device for capturing at least one of a video or image sequence.
[0048] Typically the apparatus includes a sensing unit for measuring a distribution of a user weight during at least part of at least one of the pre-activity routine and the activity.
[0049] Typically the apparatus includes at least one position sensor for measuring a position of at least one of the user and equipment used by the user.
[0050] Typically the apparatus includes at least one position sensing device, each position sensing device including: a) a position sensor;
b) a processor; and,
c) a wireless interface for transmitting signals from the position sensor to the electronic processing device.
[0051] In a third broad form the present invention seeks to provide apparatus for determining a mental state of a user for performing a sporting activity, the apparatus including:
a) a measuring device including a processing unit for:
i) receiving electrical signals from sensors coupled to the user; and, ii) transmitting data indicative of the electrical signals to the processing system. b) a wearable headgear including:
i) a band for extending around a user's head in use;
ii) two sensors mounted on the band, a first sensor being aligned with a user's forehead and a second sensor being aligned with a user's temple, in use; and, iii) a third sensor which in use is clipped to the user's ear.
[0052] Typically the headgear includes a pad for aligning with a temple of the user.
[0053] Typically the sensors are at least one of removably and adjustably mounted to the band.
[0054] Typically the headgear includes a housing mounted to the headband, the housing containing at least a processing unit of measuring device. 1
[0055] Typically the measuring device includes at least two straps, each strap extending to an opposing side of the headband to thereby stabilize the position of the band relative to the user's head.
[0056] In a fourth broad form the present invention seeks to provide a method for use in training a user for performing a sporting activity, the method including, in an electronic processing system:
a) determining from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of: i) a pre-activity routine, the routine including one or more steps for preparing to perform the sporting activity; and,
ii) the sporting activity;
b) determining an indicator indicative of a measure of a user brain state using the measure of electrical activity; and,
c) providing an indication of the at least one indicator to the user.
[0057] In a fifth broad form the present invention seeks to provide apparatus for training a user for performing a sporting activity, the apparatus including an electronic processing system that:
a) determines from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of:
i) a pre-activity routine, the routine including one or more steps for preparing to perform the sporting activity; and,
ii) the sporting activity;
b) determines an indicator indicative of a measure of a user brain state using the measure of electrical activity; and,
c) provides an indication of the at least one indicator to the user.
[0058] In a sixth broad form the present invention seeks to provide apparatus for training a user for performing a sporting activity, the apparatus including:
a) a measuring device including a processing unit for:
i) receiving electrical signals from sensors coupled to the user; and, ii) transmitting data indicative of the electrical signals to the processing system. b) a wearable headgear including:
i) a band for extending around a user's head in use;
ii) two sensors mounted on the band, a first sensor being aligned with a user's forehead and a second sensor being aligned with a user's temple, in use; and, iii) a third sensor which in use is clipped to the user's ear, the sensors being for sensing electrical brain activity of the user. [0059] In a seventh broad form the present invention seeks to provide a method for use in training a user for performing a sporting activity, the method including, in an electronic processing system:
a) determines from at least one position sensor, signals indicative of a position of at least one of part of the user and equipment used by the user;
b) determines at least one position indicator indicative of the position of at least one of part of the user and equipment used by the user; and,
c) provides an indication of the at least one position indicator to the user.
[0060] In an eighth broad form the present invention seeks to provide apparatus for use in training a user for performing a sporting activity, the apparatus including an electronic processing system that:
a) determines from at least one position sensor, signals indicative of a position of at least one of part of the user and equipment used by the user;
b) determines at least one position indicator indicative of the position of at least one of part of the user and equipment used by the user; and,
c) provides an indication of the at least one position indicator to the user.
[0061] Typically the apparatus includes at least one position sensing device, each position sensing device including:
a) a position sensor;
b) a processor; and,
c) a wireless interface for transmitting signals from the position sensor to the electronic processing system.
[0062] It will be appreciated that the broad forms of the invention, and the additional features that can be used with each of the broad forms, can be used interchangeably as required
Brief Description of the Drawings
[0063] An example of the present invention will now be described with reference to the accompanying drawings, in which: - [0064] Figure 1 is a schematic diagram of an example of an apparatus for determining a mental state of a user for performing a sporting activity;
[0065] Figure 2A is a flowchart of an example process for determining a mental state of a user for performing a sporting activity;
[0066] Figure 2B is a flowchart of an example process for training a user to perform a sporting activity;
[0067] Figures 3A and 3B are schematic, perspective and plan views of an example headset;
[0068] Figures 4A and 4B are a flowchart of an example process for training a user to perform a sporting activity;
[0069] Figures 5A to 5C are example screen shots showing indicators recorded for an individual performing a sporting activity;
[0070] Figure 6 is a schematic diagram of an example of a comparison to idealised mental state for performing a sporting activity;
[0071] Figures 7A and 7B are further example screen shots showing indicators recorded for an individual performing a sporting activity;
[0072] Figures 8A and 8B are schematic front and side views of a second example headset;
[0073] Figures 9A and 9B are schematic side and plan views of a weight distribution sensing unit;
[0074] Figure 10 is an example screenshot of a user interface showing indicators recorded for an individual performing a sporting activity;
[0075] Figure 11 is a flowchart of a further example of a method of training a user for the purpose of performing a sporting activity;
[0076] Figures 12A to 12G are schematic diagrams of examples of a graphical representation of an avatar for use in determining the mental state of a user;
[0077] Figures 13A to 13R are schematic diagrams of avatar representations of idealised mental states for playing a golf shot;
[0078] Figure 14A is a schematic diagram of a further example of apparatus for us in training an individual for performing a sporting activity;
[0079] Figure 14B is a schematic diagram showing the use of the position sensor of Figure 14 A; and, [0080] Figures 15A to 15F are example screen shots of a user interface for use with the apparatus of Figures 14A and 14B.
Detailed Description of the Preferred Embodiments
[0081] An example of apparatus for determining a mental state of a user for participating in a sporting activity, will now be described with reference to Figure 1.
[0082] In this example, the apparatus includes a processing system 100, wirelessly connected to a measuring device 110, which forms part of a wearable headgear 120, worn on a user's head 130. The measuring device 110 is capable of measuring electrical activity in the user's brain, with an indication of measured activity being transferred to the processing system 100 for analysis.
[0083] The measuring device 110 can be of any suitable form that is able to determine information regarding relevant brain activity, and which typically includes a processing unit for receiving electrical signals from sensors coupled to the user and transmitting data indicative of the electrical signals to the processing system 100. In one example, the measuring device 110 includes a non-invasive, dry, bio-sensor that measures neurological activity, and generates corresponding electrical signals. The signals may be provided directly to the processing system 100, or at least partially processed in the processing unit, before being transferred to the processing system 100.
[0084] In one example, the processing unit includes an electronic processing device 121 coupled to the sensors (not shown), a power source 122 and a wireless interface 123, for communicating with the processing system 100 are also provided. In use, the processing device 121 receives signals from the sensors, and optionally performs pre-processing, such as digitizing, coarse filtering or other processing steps, before the signals are transferred to the processing system 100. Accordingly, the processing device 121 can be any form of electronic processing device such as a microprocessor, microchip processor, logic gate configuration, firmware optionally associated with implementing logic such as an FPGA (Field Programmable Gate Array), or any other electronic device, system or arrangement capable of processing received signals. [0085] In use, the processing system 100 is adapted to further analyse the signals received from the measuring device 1 10, allowing one or more indicators indicative of a measure of a user's electrical brain activity to be determined, with the indicators being presented to the user. Accordingly, the processing system may be of any suitable form.
[0086] In one example, the processing system 100 includes a processor 101, a memory 102, an input/output device 103, such as a keyboard and display, and an external interface 104, coupled together via a bus 105. In this example the external interface 104 can be used to connect the processing system 100 to the measuring device 1 10, as well as allowing optional connectivity to other peripheral systems, such as communications networks, databases or other storage devices, external cameras, or the like, as well as to the measuring device 1 10. Although a single external interface 104 is shown, this is for the purpose of example only, and in practice multiple interfaces using various method^ (eg. Ethernet, serial, USB, wireless or the like) may be provided.
[0087] In use, the processor 101 executes instructions in the form of application software stored in the memory 102, to allow signals received from the measuring device 1 10 to be analysed so that different indicators can be determined and displayed. Accordingly, it will be appreciated that the processing system 100 may be formed from any suitable processing system, such as a suitably programmed PC, Internet terminal, lap-top, hand-held PC, smart phone, PDA, web server, or the like. Thus, in one example, the processing system 100 is a standard processing system such as a 32-bit or 64-bit Intel Architecture based processing system, which executes software applications stored on non-volatile (e.g., hard disk) storage, although this is not essential. However, it will also be understood that the process can be performed using any electronic processing device such as a microprocessor, microchip processor, logic gate configuration, firmware optionally associated with implementing logic such as an FPGA (Field Programmable Gate Array), or any other electronic device, system or arrangement capable of processing EEG signals. This could include a smart phone, such as an iPhone™, Android™ based phone, or the like, and it will be appreciated from this that the processing system could be implemented using a wide variety of different architectures on a variety of operating systems. The included examples are therefore for the purpose of example only and are not intended to be limiting.
[0088] An example process for determining the mental state of a user for performing a sporting activity, using the apparatus of Figure 1 , will now be described with reference to Figure 2A.
[0089] Tn this example, at step 200 the measuring device 110 is used to record a measure of electrical activity in a user's brain. This is performed whilst the user is undergoing either a pre-activity routine, or is actually performing the sporting activity itself.
[0090] In this regard, a pre-activity routine will be understood to include a series of steps which a user performs prior to performing a sporting activity, and which is typically used to allow the user to prepare mentally for the activity. The technique is therefore particularly applicable to training for activities that include discrete events, such as taking a shot in golf, snooker, target shooting, or other target based activities, taking a free kick in football, bowling in cricket or baseball, or the like. However, the technique can be applied to any sporting activity in which the participant has an opportunity to go through a pre-activity routine to prepare them.
[0091] The pre-activity routine, and the routine will therefore vary depending on the nature of the sporting activity. For example, in golf, such a routine typically involves having the user approach the ball, stand behind the ball to assess the position of the ball relative to the hole, so that they can determine the nature of the shot to be played. Following this, the user will typically approach and then address the ball, aligning their body with the hole in order to play the shot, before executing the shot. A specific example will be described in more detail below.
[0092] At step 210, an indicator indicative of the measure of a user brain state is determined. This may be achieved in any one of a number of ways but typically involves having the processing system 100 analyse the recorded measure of electrical activity in order to extract relevant information. The nature of the analysis will vary depending on the preferred implementation, but typically this involves filtering recorded signals, to provide filtered signals, with the filtered signals being used to derive values for one or more of the indicators. It will be appreciated that such filtering can be provided using appropriate algorithms, although alternatively, this could be achieved using physical filtering circuits.
[0093] Filtering may be performed for only a single indicator, although more typically multiple indicators are analysed by filtering the measure of electrical activity using a plurality of different frequency ranges. In one particular example, five indicators are determined corresponding to the user's quiet eye, focus, face tension, anxiety, and an overall mental state referred to as "mushin".
[0094] In one example, the quiet eye indicator is indicative of a rate of blinking, the focus indicator is indicative of whether the user has a wide or narrow focus, the face tension indicator is indicative of face muscle tension and in particular, jaw tension, whilst the anxiety indicator is indicative of user anxiety.
[0095] Mushin is a mental state also referred to as the state of "no-mindness", in which a mind is not fixed or occupied by thought or emotion. When in a state of mushin there is an absence of discursive thought and judgment, so the person is totally free to act and respond. Consequently a person relies not on what they think should be the next move, but what is their trained natural reaction or what is felt intuitively. This is an ideal mental state for participating in sporting activities as it allows the brain's natural intuitive processing to perform the activity, tending to lead to instinctive and more consistent results.
[0096] Typically it is desirable for the user to have a low amount of blinking, a relaxed face, and low anxiety. The focus and mushin will typically vary, but should correspond to a narrow focus and an empty mind, when the activity is performed. For example, when playing a shot in golf, it is important that the user is relaxed, focused on the ball and has what is commonly referred to as an "empty mind" meaning that they are not distracted by other events. [0097] A further overall handicap indicator may be derived based on a combination of the other indicators, allowing an overall score to be provided, and it will be appreciated that other indicators may be derived as required.
[0098] At step 220, an indication of the indicators is presented to the user. This may be achieved in any one of a number of manners depending on the preferred implementation, and as will be described in more detail below. In one example, this includes providing at least one of a visual indication on a display 103 and/or an audible indicator, for example using speakers or the like. The visual indication can be of any suitable form, but in one example includes one or more of a numerical value, a graphical indication of a numerical value over time and a bar indicator of a current numerical value. In one example, the audible indication is in the form of audible tones representing a magnitude of an indicator value.
[0099] By displaying an indication of the indicators to the user, this allows the user to understand their mental state when performing the sporting activity and in particular, the influence of their pre-activity routine on their mental state. This in turn allows the process to be used in training a user to thereby improve their mental state, for example, through modification of their pre-activity routine, as will now be described with reference to Figure 2B.
[0100] In this example, at step 250 a pre-activity routine is commenced. At step 260 the process of Figure 2A is used to record and display indicators, and in particular, changes in indicator values over time, during the pre-activity routine. In one example, the indicators are arranged so that a low value of the indicator is indicative of a good value, in other words a low value corresponds to narrow focus, good Mushin, low face tension, anxiety and reduced blinking. This allows users to easily discern whether they are in the correct mental state. However, it will be appreciated that this is not essential and alternatively other indicators can be used so that, for example, high values may be indicative of a good outcome.
[0101] Accordingly, by presenting indicator values during performance of the pre-activity routine, feedback can be given to the user, allowing them to alter their mental state. Furthermore, by recording indicators and the users' routine, this allows the user to review the indicators following completion of the pre-activity routine and/or the activity itself. This in turn helps the user further understand and synchronize their particular mental state at crucial steps of the pre-activity routine and/or the activity.
[0102] It will therefore be appreciated that the above-described process allows a user to review their mental state during the completion of both the pre-activity routine and the activity itself, in turn allowing the user to modify their pre-activity routine at step 270, for example by including additional, fewer or alternative steps, or the like. Thus, the feedback allows the user to modify their pre-activity routine, thereby ensuring the user is in an optimum mental state when performing the activity itself.
[0103] Accordingly, by determining values for a number of different indicators, this allows these to be compared to a predetermined physical pre-activity routine. This can assist in determining the brain states of a user during thie stages of their pre-activity routine, allowing the user to modify their pre-activity routine and or other preparation, thereby improving their mental state for performing the activity.
[0104] It will be appreciated from the above that it is necessary to wear the headgear 120 during performance of the pre-activity routine and/or the activity. Measurements of electrical brain activity, such as EEG signals are often subject to artefacts caused by a range of factors, including variations in the electrical contact between sensor electrodes and the facial tension of the user. This in turn makes measurement of EEG signals during performance of a sporting activity difficult.
[0105] An example of headgear in the form of a headset will now be described in more detail with reference to Figures 2 A and 2B.
[0106] In this example, the headset 300 includes a headband 301 which is designed to extend around the user's head in use. The headband 301 acts to support at least two sensors in the form of first and second electrodes 311, 312, and a third sensor in the form of a clip electrode 315 having an electrode mounted thereon. [0107] The electrodes 311, 312, are positioned on the headband 301 so that, in use, the first electrode 311 aligns with a user's temple and a second electrode 312 aligns with the user's forehead. To help achieve this, the electrodes 311, 312 may be adjustably and/or removably mounted to the headband, allowing the exact position of the electrodes 311, 312 to be adjusted. In one example, this is achieved by mounting the sensor electrodes 311, 312 to the band 300 using hook and loop, or other similar fasteners. Meanwhile, the clip electrode 315 is designed to be attached to the user's ear, effectively providing a common electrode allowing measurements from the other electrodes to be made relative to the potential of the common electrode, as will be understood in the art. It will be appreciated that in use, conductive gel and/or antiseptic may be applied to the electrodes as required.
[0108] The headband 301 may be made of any suitable material, and in one example is plastic, such as PVC, or the like, allowing the headband to provide robust support for the sensors, whilst being flexible and comfortable to wear, as well as being hygienic and easy to clean.
[0109] The headband 301 is also typically adjustable so as to ensure a tight fit arrangement, and thereby bias the electrodes 311, 312 against the user's skin, helping to ensure good electrical contact and thereby reduce signal artefacts. In one example, this is achieved by utilising additional straps 302 incorporating an adjustment mechanism, such as a rachet buckle 303, which cooperates with the straps 302 allowing the relative length of the straps 302 to be adjusted. The straps then fit against the rear of the head, so that the headband 301 can be tightened in situ, thereby providing a secure fit. Alternatively however, other arrangements may be used, such as the use of compliant or resilient headbands.
[0110] As the electrodes 311, 312 may project inwardly from the headband 301, a support pad 313 of a similar size and shape to the electrodes 311, 312 may be positioned on the headband 301 so as to align with the user's other temple, thereby ensuring that the headband 301 is symmetrically positioned and balanced on the user's head.
[0111] Headset 300 also typically includes a housing 320, coupled to the headband via connecting straps 321. The housing 320 contains the measuring device electronics, including the processing device 121, the power source 122, and the wireless interface 123. It will be appreciated that the processing device 121 can be coupled to the electrodes 311, 312 via leads (not shown) extending along or through the headband 301.
[0112] Finally, the headset 300 can also optionally include straps 331, 332 extending to opposing sides of the headband 301. The straps allow the headband to be supported by the top of the user's head, thereby further stabilizing the position of the headband 301 relative to the user's head.
[0113] Accordingly, the above described headset 300 provides a stable, comfortable and wearable arrangement, which supports the measuring device 1 10, whilst maintaining good electrical contact between the electrodes 311, 312 and the user. This minimizes unwanted signal artifacts, whilst minimizing interference for the user, allowing the user to perform the pre-activity routine and/or activity, substantially unimpeded.
[0114] An example process for measuring the user's brain state will now be described in more detail with reference to Figures 4 A and 4B. In the following specific example, it will be assumed that actions performed by the processing system 100 are performed by the processor 101 in accordance with instructions stored as applications software in the memory 102 and/or input commands received from a user via the I/O device 103. It will also be assumed that the processor 101 implements applications software for remotely controlling the measuring device 110, for example to control collection of data. However, this is not essential and alternative methods can be used.
[0115] In this example, at step 400 the headgear 120 is mounted on the user. As part of this process, the measuring device 110 and processing system 100 are turned on and wirelessly connected.
[0116] At step 405, an optional calibration process is performed, which typically involves measuring electrical brain activity in the user when they are in a rest position. This can be utilised to ensure that the apparatus is working correctly and optionally to scale either thresholds or measured electrical signal values so that meaningful indicators can be generated. For example, if an individual has a particularly low or high value of an indicator, it may be necessary to scale a reference threshold used in assessing whether a measured indicator value is acceptable. This also settles the user down when using the equipment for the first time.
[0117] At step 410, recording is initialised, typically in accordance with a user input command supplied using the input device 103. The command causes the processing system 100 to activate the measurement device 110 so that the measurement device generates data indicative of measured electrical signals, with the data being received by the processing system 100, at step 415.
[0118] At step 420 the measured signals are filtered to generate indicator values. The nature of the filtering performed will depend on the preferred implementation. In one example, the processing system 100 is adapted to filter the signals at between 1 and 100Hz, and more typically at between 2 and 60Hz, with filtering typically being performed at a plurality of different frequency ranges to thereby determine the different indicators.
[0119] For example, the indicators can be based on one or more signals bandpass filtered within the following frequency ranges: focus at between 3 and 6Hz; mushin at between 2 and 60Hz; face tension at between 12 and 15Hz; anxiety at between 15 and 60Hz; and, quiet eye at between 8 and 12Hz.
[0120] Typically electrical signals of brain activity are subject to large fluctuations in short spaces of time, making them difficult to use in determining meaningful indicator values. To overcome this, filtered signals can be combined and/or otherwise manipulated to obviate undue fluctuations. In one example, the indicators can be determined based on a rolling average of previous determined values, to thereby smooth out fluctuations. It will be appreciated that other suitable smoothing techniques could also be used.
[0121] For example, alternatively fluctuations can be accounted for by deriving an indicator by combining one or more filtered signals within the relevant frequency range. In one specific example, filtering for at least one of the indicators is achieved by selecting a base frequency range of interest, splitting this filtered signal into three further offset filters, and then re-combining these three signals in an OR gate to generate an indicator. This process can performed for five selected frequencies, with data from the five separate EEG signals are fed into an exclusive AND gate, to provide an overall indicator, such as an overall handicap indicator.
[0122] At step 425, the processing system 100 compares the derived indicator values to predetermined threshold values, which are typically stored in memory 102, and which optionally be determined or modified during the calibration process mentioned above. The thresholds are typically set indicator values representing an acceptable or good indicator value, and can therefore be set based on particular training requirements, for example depending on the nature of the activity being performed, a level of expertise of the user, and/or the rest brain state of the user.
[0123] At step 430 audible and/or visual indications can be generated by the processing system 100 and presented to the user.
[0124] In the case of audible indications, these are typically generated so that sounds are produced, with parameters of the sound, such as the pitch, tone, volume or the like, depending on the determined indicator values. In one particular example, different notes are used for different indicators, with a sound only being produced if the relevant indicator value is below a corresponding threshold value, thereby indicating that the indicator is acceptable. In this example, the tone can vary depending on the magnitude of the difference between the measured indicator value and the threshold value.
[0125] The visual indicators are typically presented to the user as a representation forming part of a user interface displayed on the display 103. An example of a suitable user interface for displaying indicators, either during or after a pre-activity routine is performed, will now be described with reference to Figures 5A to 5C.
[0126] In this example, the user interface 500 includes a video window 510, for displaying video footage, numerical indicator values 520, and an indicator graph 530, showing changes in indicator values as the pre-activity routine is performed. As shown the numerical indicator values 520 include a mushin value 521, a focus value 522, an anxiety value 523, a facial tension value 524 and a quiet eye value 525. Similarly, the graph shows changes in each of the indicator values over time, with the visual indications including a mushin line indicator 531, a focus line indicator 532, an anxiety line indicator 533, and a line indicator quiet eye 535, with a facial tension filled area 534 also being provided.
[0127] Simultaneously with this process, a video sequence or image sequence of the user performing the pre-activity routine and/or activity, may also be captured at step 435 and displayed in the video window 510. Capture is performed using an imaging device, such as a video, camera, coupled to the processing system 100, for example via the external interface 104. However, this is not essential, and alternatively the camera may form part of the processing system, such as a webcam, or the like.
[0128] In the event that a separate camera is used, the video camera can be any form of video camera, and can be provided in any suitable location. Thus, for example, the video camera can be provided on a tripod arranged to image the user as they are performing their pre- activity routine. In a further' option, as will be described in more detail below, a camera could be mounted on the headset 300 to capture a first person view of the pre-activity routine and/or activity, as it is being performed.
[0129] As will also be described in more detail below, the arrangement could also receive data from any other form of sensor that may provide useful feedback to a user. This can include for example, the use of a pressure sensitive system that can analyse the user's weight distribution as an activity is being performed. This can also include other positional sensors, such as motion sensing systems, for analysing the user's body position during the pre-activity routine.
[0130] The captured video or image sequence, as well as any other data captured from other sensors, is then typically stored together with the indicator values, in the memory 103, or a separate external store, such as a database or the like, allowing for subsequent review. Once recording has commenced, the user commences their pre-activity routine at step 440. [0131] A pre-activity routine is an effective method of improving one's focus on the task at hand. An example of a pre- activity routine for a golf shot will now be described in more detail.
[0132] In this regard, a pre-shot routine is a consistent and systematic procedure (a sequence of thoughts, checkpoints, movements or details) that is executed by a golfer prior to hitting a golf shot. Pre-shot routines are likely as varied in their steps and details, from person to person, as fingerprints (i.e., each golfer's pre-shot routine is probably unique).
[0133] A pre-shot routine is good for eliminating extraneous thoughts prior to hitting a golf shot and "grounding" a player, getting them to focus more exclusively on the shot at hand. A pre-shot routine requires the focus of conscious attention on relevant tasks, thereby eliminating or at least reducing any extra time to attend to irrelevant or unwanted things.
[0134] The key is to prepare for the shot is by thinking prior to the shot, allowing the user's brain to assimilate the required information, and then entering a state known as Mushin, allowing the shot to be executed by the brain automatically.
[0135] An example of an idealised pre-shot routine and subsequent shot for playing golf, and the associated ideal mental states, is as follows:
[0136] 1. Approach to the ball or tee (Wide Focus and good Anxiety)
• observe, observe & observe.
• Breathing tempo & rhythm
• ground conditions and lay of the ground or putting green
• wind directions and gusts
[0137] 2. Behind The ball (Focus & Mushin & Uncluttered)
• Pick Club & shot
• Visualize - Imaging -Feel
• Saccade
• Breathing
• Focus • Mushin
[0138] 3. Walk in to the Ball (Wide Focus & Good Anxiety)
• Walking pace
• Focus
[0139] 4. At the Ball (Focus wide to narrow, Mushin, Low Quiet Eye)
• Burn the target
• Alignment
• Aimpoint
• Mind's eye
• Quiet eye (onset)
• Breath out
[0140] 5. Execute (Low Quiet Eye & Mushin)
• Quiet Eye (Dwell Time)
[0141] 6. Acceptance (Good Anxiety)
• praise good shots~& learn from ordinary shots
• breath tempo & rhythm
• pace assessment then move on
[0142] During this process, the user assesses for feedback during the pre-shot routine at step 445. It will be appreciated that in use, feedback can be provided to the user whilst they are undergoing the pre-shot routine, either by making the display 103 visible to the user, or by having another individual such as a trainer, provide verbal feedback. In addition, audible tones can also be generated. This allows the user to assess whether their mental state is correct in real time, helping the user understand when they are mentally prepared to perform the activity.
[0143] Following completion of the shot a step 450, the user can review the video footage and indicator values recorded at step 455, for example using the user interface 500, as shown in Figures 5A to 5C. In this instance, by reviewing a replay of the video footage in the video window 510, together with the corresponding indicator values, this allows the user to view how their mental state changes as the pre-activity routine and activity progress.
[0144] In the current example, two stages during a pre-shot routine are shown in Figures 5A and 5B, with execution being shown in Figure 5C.
[0145] It will be appreciated that this allows the user to visualise the changes in the indicator values and how these correspond to different stages of the pre-shot and shot routines. This, in turn allows users to assess about what aspects of their routine had a positive and negative effect, and hence whether changes to the routine are required at step 460. If so, the routine can modified at step 465. Otherwise, or once modification has been performed, the process can be repeated as required at step 470, so that users can further refine the pre-activity routine.
[0146] It will be appreciated that the indicators can generated and displayed in any suitable manner and an alternative example for allowing a post routine review is shown in Figure 6.
[0147] In this example, a user interface 600 includes a list of pre-activity routine steps or tasks. Indicator values are provided in the form of bar meters for each of the indicators, mushin 621, focus 622, anxiety 623, facial tension 624 and quiet eye 625. For each indicator, a meter is shown representing a measured value and an idealised value. This allows the user to compare each of the indicators, and assesses where in the pre-activity routine improvements could be made.
[0148] In order to prepare such a representation, it is typically to examine a recording of the pre-activity routine, for example using the user interface 500, and then have a user provide input commands to the processing system 100 defining when particular steps of the pre- activity routine commence and end. Following this, the processing system 100 can determine an average value of each of the indicators over the relevant step, allowing this to be displayed. [0149] It will be appreciated from the above that a wide range of different manners of presentation can be used, and that the particular examples described are for the purpose of illustration and are not intended to be limiting.
[0150] An example of a comparison between indicator values determined over successive pre-shot routines will now be described with reference to Figures 7A and 7B, which show a user interface 500 similar to that of Figures 5A to 5C. In these examples, the time at the ball is indicated by the circle 703, with the approach to the ball and execution of the shot being shown by the arrows 701, 702, respectively.
[0151] In the example of Figure 7A, it can be seen that all indicator values are initially high, with the indicators generally dropping throughout the pre-shot routine. However, as the user approaches the ball, all the indicator values increase. Whilst the anxiety, face tension and quiet eye indicators 533, 534, 535 fall just before execution of the shot, the mushin and focus indicators 531, 532 remain high, meaning the user has a wide focus and poor mushin. It is apparent that during addressing of the ball, the participant became anxious and tense, and that the user did not wait a sufficient amount of time at the ball to allow their mental state to calm. Consequently, the user had poor focus and mushin, meaning their mental state was unsuitable for playing the shot.
[0152] In contrast, after consideration of this, the user approaches the ball in a more measured manner, and waits at the ball before playing the shot. The resulting indicator values are shown in Figure 7B. Again, indicator values generally drop from initial levels during the pre-shot routine. However, by approaching the ball in a more measured manner, the indicators 531, 532, 533, 534, 535, and in particular the mushin and focus indicators 531, 532, do not rise as dramatically when the user approaches the ball. Furthermore, the user waits longer at the ball before executing the shot, allowing the mushin and focus indicators 531, 532 to return to a low level before the ball is struck. This indicates that the user is in an ideal mental state for taking the shot. [0153] It can therefore be seen that providing feedback to the user, and then using the feedback to modify a user's pre-activity routine, can significantly improve the user's mental state, making the user more likely to perform the activity successfully.
[0154] In particular, being able to provide feedback to the user, either during or after completion of a pre-activity routine and/or activity is important as mental states are difficult for individuals to assess, necessarily because thinking about the mental state will inevitable change the individuals mental state. Accordingly, the feedback is provided in such a manner that a user can understand their mental state, without having to think about this, so that they can attain the ideal mental state for performing the activity. By repeating this process, this ensures that entering the correct mental state becomes second nature so that in future the user can achieve this without feedback being required, thereby allowing the user to ensure they are in the correct mental state during subsequent competition or the like.
[0155] A second example apparatus will now be described with reference to Figures 8 to 10. For the purpose of this example, the apparatus is substantially as described above and operates in a similar manner. In this example, however, the headset is modified to include an image capture device for capturing an image or video sequence, whilst a separate sensing unit is provided for measuring the user's weight distribution during performance of the pre- activity routine or the activity itself.
[0156] An example of the headset will now be described in more detail with reference to Figures 8A and 8B. For the purpose of this example, it is assumed that the headset 800 is generally similar to the headset 300 described with reference to Figures 3 A and 3B and accordingly, similar features are identified by similar reference numerals. These features will not therefore be described in any further detail.
[0157] In this example, it can be seen that the headband 301 incorporates an image capture device 801 , such as a video camera or the like. In this example, the camera 801 is positioned on the headband so that in use, it will align substantially centrally on the user's forehead angled slightly downwards, as shown in Figure 8B. This arrangement is intended for use in sporting activities in which a ball or other object is provided on the ground to be struck, such as golf, football, or the like. In this arrangement, the camera 801 faces slightly towards the ground, as typically the user's head would be oriented substantially level with their eyes cast downward to view the ball during the shot. However, this is not essential and other arrangements could be used, for example, for use in training for other activities.
[0158] In any event, the video camera 801 will capture first-person video footage showing the user performing the pre-activity routine and/or the activity. The video footage can then be transferred to the electronic processing device 121 and/or the interface 123, allowing it to be transmitted to the processing system 100, for subsequent review, as will be described in more detail below.
[0159] An example of a weight distribution sensing unit will now be described with reference to Figures 9A and 9B.
[0160] In this example, the sensing unit 900 includes a housing including first and second bodies 901, 902. The first body 901 typically contains a processing device 911, which is typically coupled to first and second sensors 921, 922. The sensors 921, 922 are coupled to the second body 902, which is typically resilient or movably mounted to the first body 901, so that as a user stands on the second body 902, the user's weight is detected by the sensors 921, 922. It will be appreciated that any suitable form of sensor arrangement can be used, such as the use of strain gauges, or the like.
[0161] As shown in Figure 9B, markings 931, 932 can be provided on the second body 902, aligned with the sensors 921, 922 to show the user's preferred standing position. The weight sensors 921, 922 can therefore detect the weight of the user and in particular, the weight distribution between the left and right feet, and/or between the toe and heel on each foot.
[0162] In use, the processing device 911 receives signals from the sensors 921, 922, and optionally performs pre-processing, such as digitizing, coarse filtering or other processing steps, before transferring signals indicative of the weight distribution of the user, to the processing system 100. This in turn allows the processing system 100 to display information regarding the user's centre of gravity, pressure, balance or mass, as will be described in more detail below.
[0163] In any event, it will be appreciated from the above that the processing device 911 can be any form of electronic processing device such as a microprocessor, microchip processor, logic gate configuration, firmware optionally associated with implementing logic such as an FPGA (Field Programmable Gate Array), or any other electronic device, system or arrangement capable of processing received signals.
[0164] Although only two sensors are shown, this is for the purpose of example only and additional sensors may be used in practice. The first body 901 may also house additional components such as a power source and interface (not shown) for connecting to the processing system 100, as will be appreciated by persons skilled in the art.
[0165] In use, the arrangement of the current example works substantially as described above with reference to Figures 4A and 4B, albeit with additional weight distribution information being captured. As in previous examples, an indication of mental state, as well as , video footage and weight distribution information can be displayed to the user by a user interface, an example of which is shown in Figure 10. It will be appreciated that the user interface 1000 is substantially similar to the user interface 500 described above with respect to Figures 5A to 5C. Similar features are therefore identified with similar reference numerals and will not be described in any further detail.
[0166] In this example, the interface 1000 includes an additional weight distribution window 1040 which shows the user's centre of gravity, mass, pressure or balance indicated by a centre of mass, gravity indicator 1041, and a change in centre of mass, gravity over time indicated by the path 1042. Additional numerical indications of the relative weight distribution between the user's left and right feet may also be shown, as indicated at 1043.
[0167] The interface 1000 may also include an overall activity indicator 1050 which is formed from either direct measures of electrical brain activity, or a combination of other indicators, as previously discussed. [0168] An options window 1060 may also be provided allowing the user to select different options, such as which video camera is used to capture a video sequence.
[0169] It will be appreciated that in the above example, the video footage shown in the video window 510 is first-person video footage, recorded from the user's perspective when performing the pre-activity routine and/or the activity. Accordingly, when the user subsequently reviews the video footage, it is more meaningful to them than footage captured from a third person perspective. Consequently, the user can more accurately understand the point at which they are in the pre-activity routine when watching the footage, as well as more easily observe other relevant issues, such as the position of their hands on the club, the position of their feet, or the like.
[0170] Additional information regarding weight distribution also helps the user understand if they are dynamically balanced both when preparing to perform, and more importantly when performing the activity. Thus, for example in golf, this ensures the user is dynamically balanced when addressing the ball, and taking the shot and hence whether they are balanced during the backswing and taking other parts of the shot. Furthermore, by providing this feedback in conjunction with the feedback regarding the mental state, this allows the user to ensure that they maintain the optimum mental state during this process.
[0171] Thus, in golf, the feedback allows the user to ensure they remain in the mushin state, whilst being dynamically balanced during the backswing and playing of the shot. Maintaining this combination is important in ensuring that the user is in a physically and mentally optimum state when playing the ball, which can result in a vast improvement in performance.
[0172] As previously described, by providing this feedback during and/or after completion of the pre-activity routine, this can allow the user to repeatedly perform the pre-activity routine, modifying their routine as required, until entering the mushin state, and maintaining dynamic balance and correct posture becomes second nature, thereby improving the user's natural activity completion performance. [0173] Accordingly, the use of first-person video footage and weight distribution information can further enhance the effectiveness of the above described training technique.
[0174] A further example process for use in training a user for performing a sporting activity will now be described with reference to Figure 11.
[0175] In this example, at step 1100 the processing system 100 is adapted to determine and display a next step to be performed. The step typically forms part of either a pre-activity routine, or part of an actual sporting activity. Thus, for example, the step may be part of a pre-shot routine for a golf shot, or alternatively may comprise part of the golf shot itself, such as the backswing, strike, follow-through, or the like.
[0176] The manner in which the next step to be performed is determined will vary depending upon the preferred implementation. Typically however a pre-shot routine or sequence of shot steps are predefined and stored in the memory 102, allowing the processor 101 to retrieve details of the next step from the memory 102 and display an appropriate indication of the step to the user via the input/output device 103. This can include displaying an indication of the next step, instructions for performing the step, and optionally information regarding a desired mental state, to assist the user in understanding what is required.
[0177] At step 1110, as the user performs the step, the processing system 100 determines indicators indicative of electrical brain activity of the user. As previously described, this process typically involves filtering signals received from the wearable headgear 120, and using these to generate the indicators, which may be indicative of quiet eye, focus, face tension, anxiety and mushin, and may also optionally include additional states such as the amount of blinking and peripheral vision use of the user. The indicators may optionally be displayed to the user at step 1120. It will be appreciated that this process is performed utilising the techniques outlined above and this will not therefore be described in any further j detail.
[0178] At step 1130, the processing system 100 operates to determine a desired brain state for the step the user is currently performing. The desired brain state will typically be predefined and stored in the memory 102, so that this can be accessed by the processor 101 as required. It will be appreciated that the desired brain state can be defined in any suitable manner, such as by defining desired values, or a desired range of values, for the indicators.
[0179] At step 1140, the processing system 100 compares the desired brain state to the measured indicators to determine whether the user is an acceptable brain state for the step being performed. This typically involves comparing the measured indicator values to the desired values or ranges.
[0180] At step 1150 if it is determined that the brain state is not acceptable, for example of the measured indicator values do not match the desired values, or fall outside a desired range, the processing system 100 continues to monitor the user's brain state by returning to step 1110 and repeating steps 1110 through to 1150. This will continue until the user is in an acceptable brain state at which point the process proceeds to step 1160 allowing the processing system 100 to generate an indicator indicative of the brain state requirement being met. This may be achieved in any one of a number of ways, but will typically involve having the processing system 100 generate an audible tone which can be heard by the user, thereby alerting the user to the fact that their brain state is acceptable for that particular step, although additionally or alternatively visual indications may be provided.
[0181] Once this has been performed the processing system 100 can return to step 1110 and determine a next step to be performed as part of the pre-activity routine or the activity itself, with this then being displayed to the user.
[0182] Accordingly, it will be appreciated that the above described process allows the processing system 100 to be programmed with a defined sequence of steps representing either a pre-activity routine or a sporting activity. The processing system 100 can then monitor the user's brain state whilst the user performs each given step within the defined routine or activity, alerting the user when the desired brain state is reached. This helps provide feedback to the user, allowing a user to train their brain over a sequence of steps, making them more able to achieve the required brain state when performing the sporting activity in future. [0183] Throughout this process, measured indicators can be displayed, together with indications of the desired brain state, allowing the user to compare their current brain state to the desired state, thereby further assisting the user in modifying their brain state as required. The indicators can be in the form of visual representations similar to those described above. Alternatively however, the visual representation can be in the form of a graphical representation of an avatar which includes indications of different aspects of the user's brain state as will now be described with reference to Figures 12A to 12G.
[0184] In this example, _the graphical representation is in the form of a representation of a human head 1200.1 and an object 1200.2, including a sporting article such as a golf ball, the image being animated in some manner to indicate the different brain states.
[0185] In the example of Figure 12A, the avatar is animated by having the avatars eyes blink to indicate a degree of blinking of the user. It will be appreciated that blinking is mandatory as it is required at regular intervals to moisten the individuals eyeballs whilst performing the step However, excessive blinking will cause our user to lose focus and prevent them to being able to maintain a desired state of quiet eye. Accordingly, by providing visual feedback as to the rate of blinking of the user, this can assist the user in controlling their blinking for short periods before execution of the step.
[0186] In the example of Figure 12B, muscles 1201 around the cheeks and eyebrow regions of the avatar are highlighted with the intensity, colour, or the like, indicating the degree of muscle tension, and hence face tension of the user. Face tension leads to tension throughout the user's body which can hinder the user's ability to perform the step in the way intended. Accordingly, this representation can direct the user to relax their face muscles and enter a more appropriate facial tension state for performing the step.
[0187] In the example of Figure 12C the left hemisphere 1202 of the avatar brain is highlighted, with an intensity, colour or the like representing a particular degree of anxiety. Anxiety can result from performance anxiety or chronic anxiety and this can be controlled by having the user adjust their breathing to reduce the anxiety. [0188] As shown in Figure 12D a graphical representation can be provided of the user's visual focus in the form of coloured lines or regions 1203 extending from the avatar to one or more objects, thereby indicating what the user's eyes and mind are focussed on. This is important in ensuring the user is focussing correctly for the particular step being performed.
[0189] In the example of Figure 12E the right hand hemisphere 1204 of the avatar's brain is coloured, with the intensity, colour, or the like indicating a degree of mushin, which as previously described is the Japanese word for a state of no mindedness. This is important in ensuring that the user is not over thinking the step to be performed.
[0190] Figure 12F includes a visual indication of quiet eye in the form of a coloured region 1205 extending from the object 1205 to the avatar, but in a different colour, representing an index of focus concentration in which the eyes go into the fovea vision with a narrow focus point and without deviation of greater than 3 degrees.
[0191] Finally, in Figure 12G a coloured region 1206 in front of the avatar is used to represent a degree of peripheral vision when mushin and quiet eye are in sync, with the angle of extent of the region indicating the degree of peripheral vision.
[0192] Accordingly, it will be appreciated that the avatar provides feedback to the user regarding their current brain state. Unlike the graphical or numerical representations previously described, the avatar is more intuitive for a user to understand making it easier for the user to understand the feedback being provided and modify their brain state accordingly.
[0193] An example sequence of brain state during a golfing shot will now be described with reference to Figures 13A to 13R, which show idealised avatar states. In this example, the avatar 1300 is shown together with first and second objects 1301, 1302 in the form of a ball, and target, such as golf pin, respectively.
[0194] In the examples of Figure 13A and 13B these highlight overt and covert attention respectively. In the example of Figure 13A overt attention occurs when the eye and mind focus, represented by the regions 1311, 1312 are looking at the target 1302. In contrast, in the 7
- 37 -
example of Figure 13B eye focus 1311 is looking at the target 1302, while mind focus 1312 is on the ball 1301.
[0195] In this example, when an individual is to perform a pre-golf shot routine and then play the golf shot, the first stage in the process is for the process is for the individual to analyse the shot. In analysing the shot, as shown by the idealised avatar in Figure 13C, the individual should have a wide focus of attention 1311 on the target 1302 and utilise their left brain in analysing the stroke to be performed, as shown by the region 1313. This brain state allows the user to observe everything within their view and then analyse relevant parameters for the shot with their left brain including the distance to the target, the wind and other factors and then assess how best to play the shot, for example by avoiding hazards, such as bunkers, water, or the like.
[0196] Following this, the user must choose the shot to play and the club required. As shown in Figure 13D, this requires a narrow focus 1311 on the target 1302 and continual analysis by the left hand side of the brain as shown at 1313. In particular, this corresponds to the user narrowing their focus on visualising the shape of the shot, including fade draw, straight as well as the trajectory of the shot including low, normal or high. The user will also focus on what club they need and commit to the shot to be played before continuing.
[0197] In the third step, the user will stand behind the ball and during this process must transition from the mental state of Figure 13D to that shown in Figure 13E, switching from a narrow visual and left brain focus on the target 1302, to a narrow visual focus 1311 and mushin right brain state, mentally focused on the ball 1301, as shown at 1312. This enables the user to more clearly consider the shot without over analysing it. Next the user will switch to a covert focus as shown in Figure 13F so that their eye focus 131 1 is on the ball, while their mind focus is on the target 1302, as well as the shot and swing to be executed.
[0198] In a fourth step, the user will commence practice swings. At this stage the user must switch from a covert focus to a narrow focus 1311 and state of mushin, as shown in Figure 13G. This allows the user to observe the club head during the practice swing and start creating pictures of the shot as swing to be performed. [0199] The user then stands behind the ball and prepares for the shot. Initially the user will start with a narrow focus 1311 and mushin state, with mental focus 1312 on the ball 1301, as shown in Figure 13H. The user will then switch to focussing on the target 1302 with overt focus so that they are both looking at the target and focussing mentally on the target as shown in Figure 131. The user will switch to a covert focus in which they are looking at the target 1302, whilst focussing mentally on the ball 1301, as shown in Figure 13 J. The user can then saccade between the target 1302 and the ball 1301 until they are confident that they are ready to play the shot.
[0200] In a sixth step, the user can approach the ball maintaining an overt focus, as shown in Figure 13J before focussing their attention on the ball 1301 with a narrow visual focus 1311 and mind focus 1312 on the ball 1301 as shown in Figure 13K. In the seventh step, the user will focus their visual attention on the ball 1301 using smooth head movement to assist in maintaining mushin, with an overt focus.
[0201] In an eighth step, the user lines their club behind the ball before switching their mental focus 1312 to the target 1302 while continuing to look at the ball 1301, as shown at 1311, in Figure 13L. During this process the user will set their feet correctly, position themselves relative to the ball, select their side bend and narrow the focus on lining the club head behind the ball.
[0202] At step nine, the user shifts their visual focus 1311 to look directly at the target 1302 whilst maintaining their mind focus 1312 on the target 1302 as shown in Figure 13M. Then, the user will look at the target 1302 whilst adjusting their feet and body and then keeping their club on the ground behind the ball lifting their left foot and then right foot whilst looking at the target to dynamically balance the body. Throughout this the user will maintain visual focus on the target 1302 while switching their mind between the target 1302 and the ball 1301, as shown in Figure 13N, as required.
[0203] In an eleventh step, the user focuses back on the ball as shown in Figure 130. In step twelve, during shot preparation the user will initially focus themselves visually and mentally on the ball 1301, as shown in Figure 130, before visually focussing on the ball 1301, and entering a more general mushin state which controls the intended movement, the muscles of the body and the like allowing these to automatically execute the required movements.
[0204] At step thirteen, the user prepares for the shot during which time they require a narrow focus, mushin and quiet eye as shown in Figure 13Q. This is typically achieved by having the user narrow their visual focus 1311 on a dimple or spot on the ball 1301, which will initiate the onset of quiet eye 1314. This gives the brain time to process and time to communicate with the body allowing the body to respond appropriately to the shot the user has determined will be played.
[0205] At step fourteen, as shown in Figure 13R, the user prepares for the shot by applying a narrow visual focus 1311, mushin, quiet eye 1314 and peripheral vision 1315, which is evoked when the user has complete awareness of their surroundings and is in a position to play the shot. The user may then execute the shot with the body responding and executing the necessary movements so that the shot is executed effortlessly.
[0206] Following impact with the ball, the user maintains the narrow focus mission quiet eye and peripheral vision state shown in Figure 13R. Maintaining quiet eye during the dwell time is crucial for accuracy as the brain needs time to complete its instructions set before the user looks up. The user finishes maintaining a state of narrow focus mushin, quiet eye and peripheral vision allowing them to observe the ball in flight and see the results.
[0207] In any event, it will be appreciated that by displaying these idealised brain states to the user as they are going through the steps of their pre-activity routine and playing the shot, can assist the user in achieving the correct mental state. Furthermore by using the process of Figure 11, the user can be prevented from progressing further until the mental state is correct so that the user will only be able to commence the next stage of the shot once they are correctly mentally prepared. By repeating this activity during training, this sequence of steps becomes a second nature to the user meaning that they will attend to have improved ability to maintain the correct mental state during high pressure scenarios such as playing tournament golf. It will be appreciated that similar techniques can be used in training for other sporting activities. [0208] In addition to monitoring the mental state of the user, the apparatus can also be adapted to monitor a position of the user and/or sporting equipment. In one example, this involves using a position sensor attached to either the user or the sporting equipment, with signals from the sensor being used by the processing system to determine at least one position indicator indicative of the position, which can then be displayed to the user.
[0209] An example apparatus to achieve this will now be described with reference to Figures 14A and 14B.
[0210] In this example, the processing system 100 is coupled to a positional sensing device 1400 which includes an electronic processor 1421, a power source 1422, a wireless interface 1423 and a position sensor 1424, such as a triaxial accelerometer. In use, the processor 1421 optionally performs preliminary processing on signals from the position sensor, before forwarding these to the processing system 100.
[0211] Typically multiple positional sensing devices 1400.1, 1400.2, 1400.3, 1400.4 are provided mounted either on the player and/or on player equipment, such as a golf club as shown in Figure 14B. In the current example of a golf shot, positional sensing devices 1400 are provided on the shoulders, hips, and/or head of the user, as well as on the golf club, as the relative position of these are important in ensuring a golf swing is successful. However, this is not intended to be limiting and sensors may be provided in an alternative locations, such as on the user's forearms, or the like. Furthermore, it will be appreciated that whilst four positional sensing devices are shown, any number of positional sensing devices may be used, depending on the body parts or equipment to be monitored. For example, a single positional sensing device could be used if the user wants to focus on the position of one body part only.
[0212] Locations of the position sensing devices on the player will also vary depending on the nature of this sporting activity being performed. Thus, as mentioned above, in golf it is typical to provide positional sensing device on any one or more of the shoulders, hips, forearm, and/or head of the user. In contrast, for baseball pitching it is typical to attach sensing devices to the lowerbody, upperbody, forearm and upperarm. [0213] The positional sensing devices 1400 can be attached in any suitable manner. For example, in the case of the head, attachment of the positional sensing device 1400.4 can be achieved by attaching the positional sensing device 1400.4 to the headgear 120. For positional sensing devices attached to other body parts, this can be achieved using other techniques, such as using straps or bands, hook and loop or adhesive fasteners, as well as special clothing including pockets for holding the positional sensing devices.
[0214] It will also be appreciated that the positional sensing device could also be integrated into the processing system 100, for example if this is provided in the form of a wearable or portable device. For example, if the processing system 100 is a smart phone, or other similar device, this will often incorporate position sensors, and therefore the processing system 100 could be attached to the user and operate as one of the positional sensing devices 1400 to sense the position of part of the user.
[0215] In use, the processing system 100 will operate to receive positional information from the position sensor 1424 of each of the position sensing devices 1400.1, 1400.2, 1400.3, 1400.4 and use this to ascertain the relative position of the user's hips, shoulders, head or club. To achieve this, the processing system 100 typically performs an initial calibration step, with the position sensing devices 1400 provided in known reference positions. For example, this might involve attaching these to the user with the user standing vertically, and/or holding the equipment vertically. The processing system 100 can then signals acquired from the sensors 1424 as reference signals, with changes in position from the reference position being determined based on changes in the signals acquired from the sensors.
[0216] The positional information can then be used to display information to the user, regarding the position of the body, such as the hips, shoulders, head or the club, as will be described in more detail below.
[0217] Additionally, the determined position of the user and/or equipment can be used in a manner similar to that described above with respect to Figure 11 for the brain activity information. This allows sensed positions of the user and/or sporting equipment to be compared to desired positions for given steps of the activity or pre-activity routine.
[0218] Thus, the processing system can determine a step being associated with a pre-activity routine or part of a sporting activity, use signals from one or more of the sensors 1424 to determine a sensed position of the user and/or equipment, which is then compared to reference position information for the current step being performed. This can then be used to generate an indication indicative of whether the sensed position corresponds to the desired position, or indicate whether the user can move on to the next step in the activity or pre- activity routine. Thus, in one example, the user may only progress to the next stage of the pre-activity routine and/or shot once the correct position is reached, and also optionally, held for a required period of time.
[0219] It will be appreciated that the brain state and position can be monitored simultaneously, although this is not essential, and alternatively the position and/or brain state can be monitored independently.
[0220] As mentioned above, feedback of the user and/or equipment position can be displayed to the user via a graphical user interface, an example of which is shown in Figures 15 A to 15D.
[0221] For the purpose of example, in Figures 15A and 15B, sensing devices 1400.1, 1400.2 are used coupled to the user's shoulder and hips respectively, whereas in the example of Figures 15C and 15D, sensing devices 1400.2, 1400.3 are coupled to the user's hips and the golf club. In the example of Figure 15E, sensing devices 1400.1, 1400.4 are coupled to the user's shoulder and head, whilst in the example of Figure 15F, sensing devices 1400.2, 1400.4 are coupled to the user's hips and head, respectively. It will be appreciated from this that in practice any combination of one or more sensing devices, coupled to any suitable part of the user or equipment can be used, and that the examples shown are for the purpose of illustration only. [0222] In the examples of Figures 15A to 15F, a user interface 1500 is shown including an avatar window 1510, a video window 1520, a position window 1530, a step window 1540, a status window 1550 and a control window 1560. As shown in this example, the avatar window 1510 displays an avatar similar to the avatars described above with respect to Figures 12 and 13. The video window 1520 displays video footage of the user as they are performing the relevant step, which can be stored for later review as previously described.
[0223] The position window 1530 displays position representations indicative of the positions of either user body parts 1531.1, 1531.2, 1531.4, as shown in Figures 15 A, 15B, 15E and 15F, or sporting equipment 1531.3 as shown in Figures 15C and 15D, or the headgear, and hence head 1531.4, . In addition to this, the position window can also display reference planes 1532.1, 1532.2 indicative of the desired orientations, as well as numerical values 1533.1, 1533.2, 1533.3 indicative of the relative orientation of each of the sensing devices 1400.1, 1400.2, 1400.3. In the example of Figure 15A, the position indicator 1531.1 is a first colour, such as red, indicating that the user's torso is at the wrong angle, whilst the position indicator 1531.2 is in a second colour, such as green, indicating that the user's hips are at the wrong angle. Further colours may be used, such as amber or orange, for example to indicate that the body part is approaching the correct orientation.
[0224] In contrast, in the example of Figure 15B, both these are in a green colour indicating that the user's torso and hips are in the correct position. Successful and unsuccessful positioning of a golf club during a backswing shown in Figures 15C and 15D, whilst in Figures 15E and 15F show successful and unsuccessful positioning of the head respectively.
[0225] The step window 1540 includes details of the current step being performed. In this particular example, the step window 1540 includes a list of different exercises 1541 corresponding to different golfing shots, along with a positions list 1542 which correspond to the different steps being performed by the user when performing the respective shot.
[0226] The status window 1550 includes status information which can include information such as the number of reps (repetitions) of the particular exercise that must be performed and also a hold time for a respective position and/or mental state, as previously described. A control window 1560 can include controls 1561, 1562, 1563 to stop/commence the activity, calibrate the sensors or finish the process. Finally, sensor status window 1571, 1572 indicate that the position sensors are working correctly.
[0227] Thus, it will be appreciated that in use, a user can select a sporting activity from the exercise list 1541, and optionally select a particular step from the positions list 1542. The processing system can then monitor signals from either the headgear 120 and/or position sensing devices 1400.1, 1400.2, 1400.3, 1400.4 and use these to display feedback to the user via the avatar, or the position representations 1531. The processing system 100 can also monitor the signals and compare these to reference values and then indicate once the mental state and/or position of the user and/or equipment is correct. Additionally, the processing system 100 can monitor the hold time for which the correct position and/or mental state is held, until a desired hold time is reached. The number of reps performed can then be increased until a desired value is reached, at which time the processing system 100 can move on to a next step for the exercise.
[0228] Accordingly, it will be appreciated that the above-described user interface can provide feedback to the user regarding the optimum mental state and position to be achieved during each step of a golfing shot and pre-golf shot routine. This allows the user to repeatedly practice different types of shot ensuring that their mental state and body position are correct for playing the shot and thereby optimising the likelihood of shot success.
[0229] Accordingly the above described process provides a technique for improving a user's mental state by using measures of electrical brain activity, such as electroencephalograph (EEG) signals, measured whilst a predetermined sequence of steps representing a pre-activity routine and/or activity, is performed. Measurements are typically made at all stages of the pre-activity routine, although this is not essential, and recordings may be made for only some stages of the pre-activity routine, or the activity itself.
[0230] The method may be used to evaluate the performance of a user in preparing for a sporting activity. In one example, a user's performance can be evaluated by comparing how hard a user works on each task in a pre-activity routine, or an activity, compared to a predetermined threshold, thereby allowing the user to improve their performance.
[0231] In one example, the signals are collected from sensors attached to the scalp of a neurologically healthy user as the user performs their pre-activity routine. Typically only two sensors, forming one sensor pair, are used, which is less than used in traditional EEG techniques. This allows the sensors to be incorporated into a headset, which may be balanced by a counterweight to reduce physical artefacts and/or attached to the user's head by a ratchet tightening system to minimise movement of the sensors relative to the user. This in turn helps reduce noise related artefacts, whilst providing an arrangement that' is sufficiently comfortable, stabile and unobtrusive to allow a user to perform the pre-activity routine.
[0232] Collected data is analysed allowing indicators indicative of brain states to be determined, with auditory and/or visual feedback being provided to the user on the basis of the indicators. In a further example, the indicators can be captured together with video footage of the user's movements to assist further in analysis.
[0233] Ideally, the brain states are associated with at least one condition chosen from the group of predetermined conditions comprising: quiet eye, face tension, anxiety, wide focus, narrow focus, peripheral focus, and mushin, although other indicators could be used.
[0234] In one example, captured signals are analysed at least in part by filtering for specific frequencies to allow the indicators to be determined. Filtering can be used to reject unwanted signal interference from external sources, such as wireless devices, mains electricity, or the like, as well as to identify specific components of the signals, which can in turn be used as indicators.
[0235] In one example, the process can be understood as a combination of operant conditioning and pattern recognition. Tasks can be used as operant conditioning, but users are not trained to optimally perform the tasks. Pattern recognition uses filters and indicator values to indicate the brain state the user is in while performing the task. The combination of operant conditioning and pattern recognition provides a way to detect brain states, the persistence of brain states, and transitions between brain states that may then be used to more directly measure the conditions of users such as, but not limited to, interruptability, cognitive workload, task engagement, communication mediation, interpreting and predicting system response, surprise, satisfaction, and frustration.
[0236] This allows a teaching and training program to be assed for effectiveness whilst avoiding the problems of traditional cognitive methods by using cognitive and non-cognitive artifacts, instead of filtering out artifacts. The method is focused on using information derived from cognitive and non-cognitive artifacts to determine how well a teaching and training program works. The method is specific in that factors of interest are pre-specified. Using both cognitive and non-cognitive artifacts therefore works well for assessing the teaching and training program effectiveness because the artifacts correlate well with the tasks that are being performed.
[0237] It will be appreciated from the above, that the system provides a straightforward mechanism for studying the brain states of a user preparing to perform an activity. In particular, the arrangement does not require users to understand the system or control all or part of the system.
[0238] It will be appreciated that the above described techniques can be used for a wide range of sporting activities, and particularly sporting activities that can incorporate a pre- activity routine, such as a pre-execution sequence, a pre-shot routine, or the like. Examples include baseball, ice hockey, 10 pin bowling, bowling, darts, pistol shooting, AFL, Rugby, Rugby League, pool, snooker, golf, or the like.
[0239] Persons skilled in the art will appreciate that numerous variations and modifications will become apparent. All such variations and modifications which become apparent to persons skilled in the art, should be considered to fall within the spirit and scope that the invention broadly appearing before described.

Claims

THE CLAIMS DEFINING THE INVENTION ARE AS FOLLOWS:
1) A method for detennining a mental state of a user for performing a sporting activity, the method including, in an electronic processing system:
a) determining from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of:
i) a pre-activity routine, the routine including one or more steps for preparing to perform the sporting activity; and,
ii) the sporting activity;
b) determining an indicator indicative of a measure of a user brain state using the measure of electrical activity; and,
c) providing an indication of the at least one indicator to the user.
2) A method according to claim 1, wherein the at least one indicator is indicative of at least one of:
a) blinking;
b) quiet eye;
c) focus;
d) face tension;
e) anxiety;
f) mushin; and
g) peripheral vision.
3) A method according to claim 1 or claim 2, wherein method includes, in the processing system, generating an indication including at least one of:
a) a visual indication; and,
b) an audible indication.
4) A method according to claim 3, wherein the indicator includes a numerical value and wherein the visual indication includes at least one of:
a) the numerical value;
b) a graphical indication of the numerical value over time; and,
c) a bar indicator of a current numerical value. 5) A method according to claim 3 or claim 4, wherein- the indicator includes a numerical value, and wherein the method includes:
a) comparing the numerical value to a threshold; and,
b) generating the indication in accordance with the results of the comparison.
6) A method according to claim 3 or claim 4, wherein the indicator includes audible scaled tones having properties dependent on a numerical value of the indicator.
7) A method according to any one of the claims 1 to 6, wherein the method includes, in the processing system, filtering the measure of electrical activity to thereby determine the at least one indicator.
8) A method according to claim 7, wherein the method includes filtering the signal at between 1 and 100Hz.
9) A method according to claim 8, wherein the method includes filtering the signal at a plurality of different frequency ranges to thereby determine a number of indicators.
10) A method according to claim 9, wherein the method includes filtering the signal at:
a) between 3 and 6Hz to determine a focus indicator;
b) between 2 and 60Hz to determine a mushin indicator;
c) between 12 and 15Hz to determine a face tension indicator;
d) between 15 and 60Hz to determine an anxiety indicator; and,
e) between 8 and 12Hz to determine a quiet eye indicator.
11) A method according to any one of the claims 7 to 10, wherein the method includes using a plurality of filters to generate a plurality of filtered signals, the plurality of filtered signals being selectively combined to determine the at least one indicator.
12) A method according to any one of the claims 1 to 11, wherein the method includes, in the processing system, smoothing at least one signal to determine the at least one indicator.
13) A method according to any one of the claims 1 to 11, wherein the method includes training an user to prepare mentally for a sporting activity by:
a) determining changes in the at least one indicator over time during a pre-activity routine performed by the user;
b) having the user modify the pre-activity routine at least partially in accordance with the changes; and, c) repeating steps a) and b) to determine an improved pre-activity routine.
14) A method according to any one of the claims 1 to 13, wherein the method includes:
a) determining a current step being performed by the user, the step being associated with a pre-activity routine or part of a sporting activity;
b) determining a desired brain state of the user in accordance with the step being performed; and,
c) generating an indication indicative of whether the user has the desired brain state.
15) A method according to any one of the claims 1 to 14, wherein the method includes:
a) displaying a step to be performed by a user, the step being associated with a pre- activity routine or part of a sporting activity;
b) determining a desired brain state of the user in accordance with the step being performed; and,
c) if the user has the desired brain state, displaying a next step to be performed.
16) A method according to claim 14 or claim 15, wherein the desired brain state includes at least one of desired values or a desired range of values for the indicators.
17) A method according to any one of the claims 1 to 16, wherein the indicator includes a graphical representation of an avatar including indications of a user brain state.
18) A method according to any one of the claims 1 to 17, wherein the method includes:
a) determines from at least one position sensor, signals indicative of a position of at least one of part of the user and equipment used by the user;
b) determines at least one position indicator indicative of the position of at least one of part of the user and equipment used by the user; and,
c) provides an indication of the at least one position indicator to the user.
19) A method according to any one of the claims 1 to 17, wherein the method includes:
a) determining a current step being performed by the user, the step being associated with a pre-activity routine or part of a sporting activity;
b) determines from at least one position sensor, signals indicative of a sensed position of at least one of part of the user and equipment used by the user; c) determining a desired position in accordance with the step being performed; and, d) generating an indication indicative of whether the sensed position corresponds to the desired position.
20) A method according to any one of the claims 1 to 19, wherein the method includes:
a) determining a current step being performed by the user, the step being associated with a pre-activity routine or part of a sporting activity;
b) determines from at least one position sensor, signals indicative of a sensed position of at least one of part of the user and equipment used by the user;
c) determining a desired position in accordance with the step being performed; and, d) if the sensed position corresponds to the desired positioned, displaying a next step to be performed.
21) A method according to any one of the claims 1 to 20, wherein the method includes recording a video or image sequence of the user performing at least one of the pre-activity routine and the activity, and storing the sequence together with corresponding values of the at least one indicator.
22) A method according to any one of the claims 1 to 21, wherein the method includes recording weight distribution data during at least one of the pre-activity routine and the activity, and storing the weight distribution data together with corresponding values of the at least one indicator.
23) A method according to any one of the claims 1 to 22, wherein the method includes displaying a representation including at least one of:
a) the indication of the at least one indicator;
b) an indication of weight distribution data; and,
c) a video or image sequence.
24) Apparatus for determining a mental state of a user for performing a sporting activity, the apparatus including an electronic processing system that:
a) determines from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of:
i) a pre-activity routine, the routine including one or more steps for preparing to perform the sporting activity; and,
ii) the sporting activity; b) determines an indicator indicative of a measure of a user brain state using the measure of electrical activity; and,
c) provides an indication of the at least one indicator to the user.
25) Apparatus according to claim 24, wherein the measuring device includes a processing unit for:
a) receiving electrical signals from sensors coupled to the user; and,
b) transmitting data indicative of the electrical signals to the processing system.
26) Apparatus according to claim 24 or claim 25, wherein the apparatus includes a wearable headgear for measuring electrical activity in the user's brain.
27) Apparatus according to claim 26, wherein the headgear includes:
a) a band for extending around a user' s head in use; , b) two sensors mounted to the band, a first sensor being aligned with a user's forehead and a second sensor being aligned with a user's temple, in use; and, c) a third sensor which in use is clipped to the user's ear.
28) Apparatus according to claim 26 or claim 27, wherein the headgear includes a pad for aligning with a temple of the user.
29) Apparatus according to any one of the claims 26 to 28, wherein the sensors are at least one of removably and adjustably mounted to the band.
30) Apparatus according to any one of the claims 26 to 29, wherein the headgear includes a housing mounted to the headband, the housing containing at least a processing unit of measuring device.
31) Apparatus according to any one of the claims 26 to 30, wherein the measuring device includes at least two straps, each strap extending to an opposing side of the headband to thereby stabilize the position of the band relative to the user's head.
32) Apparatus according to any one of the claims 26 to 31, wherein the headgear includes an image capture device for capturing at least one of a video or image sequence.
33) Apparatus according to any one of the claims 24 to 32, wherein the apparatus includes a sensing device for measuring a distribution of a user weight during at least part of at least one of the pre-activity routine and the activity. 34) Apparatus according to any one of the claims 24 to 33, wherein the apparatus includes at least one position sensor for measuring a position of at least one of part of the user and equipment used by the user.
35) Apparatus according to claim 34, wherein the apparatus includes at least one position sensing device, each position sensing device including:
a) a position sensor;
b) a processor; and, '
c) a wireless interface for transmitting signals from the position sensor to the electronic processing system.
36) Apparatus for determining a mental state of a user for performing a sporting activity, the apparatus including:
a) a measuring device including a processing unit for:
i) receiving electrical signals from sensors coupled to the user; and, ii) transmitting data indicative of the electrical signals to the processing system. b) a wearable headgear including:
i) a band for extending around a user's head in use;
ii) two sensors mounted on the band, a first sensor being aligned with a user's forehead and a second sensor being aligned with a user's temple, in use; and, iii) a third sensor which in use is clipped to the user's ear, the sensors being for sensing electrical brain activity of the user.
37) Apparatus according to claim 36, wherein the headgear includes a pad for aligning with a temple of the user.
38) Apparatus according to claim 36 or claim 37, wherein the sensors are at least one of removably and adjustably mounted to the band.
39) Apparatus according to any one of the claims 36 to 38, wherein the headgear includes a housing mounted to the headband, the housing containing at least a processing unit of measuring device.
40) Apparatus according to any one of the claims 36 to 39, wherein the measuring device includes at least two straps, each strap extending to an opposing side of the headband to thereby stabilize the position of the band relative to the user's head. 41) A method for use in training a user for performing a sporting activity, the method including, in an electronic processing system:
a) determining from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of:
i) a pre^activity routine, the routine including one or more steps for preparing to perform the sporting activity; and,
ii) the sporting activity;
b) determining an indicator indicative of a measure of a user brain state using the measure of electrical activity; and,
c) providing an indication of the at least one indicator to the user.
42) Apparatus for training a user for performing a sporting activity, the apparatus including an electronic processing system that:
a) determines from a measuring device a measure of electrical activity in the user's brain whilst the user performs at least one of:
i) a pre-activity routine, the routine including one or more steps for preparing to perform the sporting activity; and,
ii) the sporting activity;
b) determines an indicator indicative of a measure of a user brain state using the measure of electrical activity; and,
c) provides an indication of the at least one indicator to the user.
43) Apparatus for training a user for performing a sporting activity, the apparatus including: a) a measuring device including a processing unit for:
i) receiving electrical signals from sensors coupled to the user; and, ii) transmitting data indicative of the electrical signals to the processing system. b) a wearable headgear including:
i) a band for extending around a user's head in use;
ii) two sensors mounted on the band, a first sensor being aligned with a user's forehead and a second sensor being aligned with a user's temple, in use; and, iii) a third sensor which in use is clipped to the user's ear, the sensors being for sensing electrical brain activity of the user. 44) A method for use in training a user for performing a sporting activity, the method including, in an electronic processing system:
a) determines from at least one position sensor, signals indicative of a position of at least one of part of the user and equipment used by the user;
b) determines at least one position indicator indicative of the position of at least one of part of the user and equipment used by the user; and,
c) provides an indication of the at least one position indicator to the user.
45) Apparatus for use in training a user for performing a sporting activity, the apparatus including an electronic processing system that:
a) determines from at least one position sensor, signals indicative of a position of at least one of part of the user and equipment used by the user;
b) determines at least one position indicator indicative of the position of at least one of part of the user and equipment used by the user; and,
c) provides an indication of the at least one position indicator to the user.
46) Apparatus according to claim 45, wherein the apparatus includes at least one position sensing device, each position sensing device including:
a) a position sensor;
b) a processor; and,
c) a wireless interface for transmitting signals from the position sensor to the electronic processing system.
PCT/AU2012/001133 2011-09-20 2012-09-20 Activity training apparatus and method WO2013040642A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
AU2011903867A AU2011903867A0 (en) 2011-09-20 Activity training appartus and method
AU2011903867 2011-09-20
US201161540599P 2011-09-29 2011-09-29
US61/540,599 2011-09-29

Publications (1)

Publication Number Publication Date
WO2013040642A1 true WO2013040642A1 (en) 2013-03-28

Family

ID=47913672

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2012/001133 WO2013040642A1 (en) 2011-09-20 2012-09-20 Activity training apparatus and method

Country Status (1)

Country Link
WO (1) WO2013040642A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106725457A (en) * 2016-12-31 2017-05-31 东莞市讯易机电科技有限公司 A kind of inpatient's monitoring system based on brain machine artificial intelligence technology
EP3187110A1 (en) 2015-12-30 2017-07-05 squipe GmbH Apparatus for detecting and providing brain signals by use of electroencephalography
US10052452B2 (en) 2013-02-06 2018-08-21 Daniel Carleton Schoonover Dream enhancement apparatus and method
GB2564865A (en) * 2017-07-24 2019-01-30 Thought Beanie Ltd Biofeedback system and wearable device
CN114007494A (en) * 2019-06-11 2022-02-01 Hi有限责任公司 Non-invasive system and method for detecting and modulating mental state of user through consciousness-initiated effect
WO2022147225A1 (en) * 2020-12-30 2022-07-07 The University Of North Carolina At Chapel Hill Automated eye tracking assessment solution for skill development

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090124920A1 (en) * 2007-11-09 2009-05-14 Kip Errett Patterson Biofeedback devices, systems and method
US20110105859A1 (en) * 2009-04-24 2011-05-05 Advanced Brain Monitoring, Inc. Adaptive Performance Trainer

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090124920A1 (en) * 2007-11-09 2009-05-14 Kip Errett Patterson Biofeedback devices, systems and method
US20110105859A1 (en) * 2009-04-24 2011-05-05 Advanced Brain Monitoring, Inc. Adaptive Performance Trainer

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
"BrainAthlete", 17 December 2010 (2010-12-17), Retrieved from the Internet <URL:http://en.akihabaranews.com/77777/science/video-b-bridge-brain-athlete-learn-how-to-concentrate-and-meditate-to-maximize-your-skills> [retrieved on 20121119] *
"FocusBand and the various links on that page", 23 June 2010 (2010-06-23), Retrieved from the Internet <URL:http://web.archive.org/web/20100623101442/http://www.focusband.com/Product.php> [retrieved on 20121120] *
"FocusBand", 7 February 2011 (2011-02-07), Retrieved from the Internet <URL:http://web.archive.org/web/20110207221247/http://focusband.coni> [retrieved on 20121120] *
"SwingLab", 24 September 2010 (2010-09-24), Retrieved from the Internet <URL:http://web.archive.org/web/20100924144250/http://www.swinglab.com.au> [retrieved on 20121120] *
LEE, H.: "Evaluation of Attention and Relaxation Levels of Archers in Shooting Process using Brain Wave Analysis Algorithms", NEUROSKY INC, vol. 12, no. 3, 2009, pages 341 - 350 *
SOURINA, O. ET AL.: "EEG-Based Personalized Digital Experience", 6TH INTERNATIONAL CONFERENCE, UAHCI 2011, HELD AS PART OF HCI INTERNATIONAL, 9 July 2011 (2011-07-09), pages 591 - 599 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10052452B2 (en) 2013-02-06 2018-08-21 Daniel Carleton Schoonover Dream enhancement apparatus and method
EP3187110A1 (en) 2015-12-30 2017-07-05 squipe GmbH Apparatus for detecting and providing brain signals by use of electroencephalography
CN106725457A (en) * 2016-12-31 2017-05-31 东莞市讯易机电科技有限公司 A kind of inpatient's monitoring system based on brain machine artificial intelligence technology
GB2564865A (en) * 2017-07-24 2019-01-30 Thought Beanie Ltd Biofeedback system and wearable device
CN114007494A (en) * 2019-06-11 2022-02-01 Hi有限责任公司 Non-invasive system and method for detecting and modulating mental state of user through consciousness-initiated effect
EP3982822A2 (en) * 2019-06-11 2022-04-20 Hi LLC Non-invasive systems and methods for the detection and modulation of a user's mental state through awareness of priming effects
CN114007494B (en) * 2019-06-11 2024-07-16 Hi有限责任公司 Non-invasive system and method for detecting and modulating user mental states through conscious initiation effects
WO2022147225A1 (en) * 2020-12-30 2022-07-07 The University Of North Carolina At Chapel Hill Automated eye tracking assessment solution for skill development

Similar Documents

Publication Publication Date Title
US10089763B2 (en) Systems and methods for real-time data quantification, acquisition, analysis and feedback
US11679300B2 (en) Systems and methods for real-time data quantification, acquisition, analysis, and feedback
AU2017386412B2 (en) Systems and methods for real-time data quantification, acquisition, analysis, and feedback
EP2451339B1 (en) Performance testing and/or training
US8696126B2 (en) Eye and body movement tracking for testing and/or training
WO2022193425A1 (en) Exercise data display method and system
US20150279231A1 (en) Method and system for assessing consistency of performance of biomechanical activity
JP2012524636A (en) Adaptive behavior trainer
US20160275805A1 (en) Wearable sensors with heads-up display
US20170229041A1 (en) Coordinated physical and sensory training
WO2013040642A1 (en) Activity training apparatus and method
US20220019284A1 (en) Feedback from neuromuscular activation within various types of virtual and/or augmented reality environments
US20150092980A1 (en) Tracking program and method
KR101651429B1 (en) Fitness monitoring system
US8036849B2 (en) Module for measuring physical attributes linked to exercise, system for analyzing physical attributes linked to exercise and including the module, and method of applying the module
CN105852873B (en) Motion data analysis method, electronic equipment and terminal
US20210060382A1 (en) Systems and methods for wearable devices that determine balance indices
KR20160121460A (en) Fitness monitoring system
US20230178233A1 (en) Biomechanics assessment system and biomechanical sensing device and biomechanical assessment platform thereof
US20200171370A1 (en) Multi-parameter performance assessment and conditioning system
Hiraishi Qualitative analysis of pre-performance routines in throwing using simple brain-wave sensor

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12833759

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12833759

Country of ref document: EP

Kind code of ref document: A1