Which task would be relatively dominant in the left hemisphere?

Abstract

Neurophysiological studies in humans and nonhuman primates have revealed movement representations in both the contralateral and ipsilateral hemispheres. Inspired by clinical observations, we ask if this bilateral representation differs for the left and right hemispheres. Electrocorticography was recorded in human participants during an instructed-delay reaching task, with movements produced with either the contralateral or ipsilateral arm. Using a cross-validated kinematic encoding model, we found stronger bilateral encoding in the left hemisphere, an effect that was present during preparation and was amplified during execution. Consistent with this asymmetry, we also observed better across-arm generalization in the left hemisphere, indicating similar neural representations for right and left arm movements. Notably, these left hemisphere electrodes were centered over premotor and parietal regions. The more extensive bilateral encoding in the left hemisphere adds a new perspective to the pervasive neuropsychological finding that the left hemisphere plays a dominant role in praxis.

Show

Editor's evaluation

Based on a rare set of human intracranial recordings, this paper by Merrick and colleagues asks how the neural processes that generate arm movements are distributed across cortical hemispheres. The authors demonstrate that these contributions are not equal. The key result is that the left hemisphere shows stronger bilateral representations than the right hemisphere. This effect is present during movement preparation but is further accentuated during movement execution. Taken together, the findings provide important new insight into the hemispheric asymmetries that underlie manual actions.

https://doi.org/10.7554/eLife.69977.sa0

  • Decision letter
  • Reviews on Sciety
  • eLife's review process

eLife digest

The brain is split into two hemispheres, each playing the leading role in coordinating movement for the opposite side of the body: lesions on the left hemisphere therefore often result in difficulties moving the right arm or leg, and vice versa. In fact, very few anatomical connections exist between a given hemisphere and the body parts on the same (or ‘ipsilateral’) side. Yet, movements produced with only one limb still engage both sides of the brain, with the hemisphere which does not control the action production, still encoding the direction and speed of the movement. Previous evidence also indicate that the two hemispheres may not have equal roles when coordinating ipsilateral movements.

Merrick et al. aimed to shed light on these processes; to do so, they measured electrical activity from the surface of the brain of six patients as they moved their arms to reach a screen. The results revealed that, while the right hemisphere only encoded information about the opposite arm, the left hemisphere contained information about both arms. Finer analyses showed that, for both hemispheres, moving the opposite arm was strongly associated with activity in the primary motor cortex, a region which helps to execute movements. However, in the left hemisphere, movements from the ipsilateral arm were related to activity in brain areas involved in planning and integrating different types of sensory information.

These findings contribute to a better understanding of how the motor system works, which could ultimately help with the development of brain-machine interfaces for patients who need a neuroprosthetic limb.

Introduction

A primary tenet of neurology is the contralateral organization of movement. The vast majority of the fibers from the corticospinal tract cross to the opposite side of the body (Nyberg-Hansen and Rinvik, 1963) and functionally, hemiparesis resulting from cortical stroke is manifest on the contralateral side of the body (Bourbonnais and Vanden Noven, 1989). Although direct control of arm movements is primarily mediated through contralateral projections, unimanual arm movements elicit bilateral activity in the primary motor cortex (M1, Babiloni et al., 1999; Ghacibeh et al., 2007), indicating that neural activity in the ipsilateral hemisphere contains information relevant to ongoing movement. Correspondingly, kinematic and movement parameters of the ipsilateral limb can be decoded from ipsilateral hemisphere intracortical recordings in monkeys (Ganguly et al., 2009; Ames and Churchland, 2019) and from electrocorticography (ECoG) in humans (Bundy et al., 2018; Ganguly et al., 2009; Wisneski et al., 2008). Ipsilateral signals represent an intriguing source of neural activity, both for understanding how activity across the two hemispheres results in coordinated movement and because this information might be exploited for rehabilitative purposes.

While it is established that information about unimanual movements is contained within the ipsilateral hemisphere, there remains considerable debate about what this signal represents. Previous studies have centered on the question of whether ipsilateral representations overlap or are independent of contralateral representations, leading to mixed results. Consistent with the overlap hypothesis, neural activity for the contralateral and ipsilateral limb movements shows several similarities, including shared target tuning preferences and the ability to cross predict kinematic features from a model trained on the opposite arm (Bundy et al., 2018; Cisek et al., 2003; Steinberg et al., 2002; Willett et al., 2020). Consistent with the independence hypothesis, intracortical recordings in monkeys have revealed that the lower dimensional representations of the two arms lie in orthogonal subspaces (Ames and Churchland, 2019; Heming et al., 2019). These hypotheses are not mutually exclusive. For example, the degree of overlap or independence may depend on the gesture type (e.g., overlapping representations for grasping but not arm movement, Downey et al., 2020), or brain region (e.g., premotor cortex displays stronger preservation of tuning preferences across the two arms than primary motor cortex, Cisek et al., 2003).

One factor that has received little attention in this literature is the recording hemisphere. This is surprising given the marked asymmetries between the two hemispheres in terms of praxis (Corballis et al., 2012; Rothi et al., 1997). Tracing back to the early 20th century, marked hemispheric asymmetries have been defined by the behavioral deficits observed following unilateral brain injury (Schaefer et al., 2007; Liepmann, 1908, cited in De Renzi and Lucchelli, 1988). Apraxia, an impairment in the production of coordinated, meaningful movement in the absence of muscle recruitment deficits, is much more common after left compared to right hemisphere insult (Haaland et al., 2000; De Renzi and Lucchelli, 1988). Moreover, left hemisphere stroke will frequently result in apraxic symptoms for gestures produced with either hand, as well as impairments in action comprehension (De Renzi and Lucchelli, 1988). Hemispheric asymmetries are also evident in neuroimaging activation patterns in healthy participants, with the left hemisphere having stronger activation during ipsilateral movement than the right hemisphere, especially with increasing task difficulty (Chettouf et al., 2020; Verstynen et al., 2005; Verstynen and Ivry, 2011; Schäfer et al., 2012). These patterns raise the possibility that the ipsilateral cortical representation differs between the left and right hemispheres.

In the present study, we use intracranial recordings from the cortical surface (ECoG) to examine the degree of cortical overlap for ipsilateral and contralateral upper limb movement in the left and right hemispheres. The data were collected from six patients, three with left hemisphere implants and three with right hemisphere implants, while they engaged in an instructed-delay reaching task. We focus on predicting the temporal dynamics of high-frequency activity (HFA; 70–200 Hz), a surrogate for infragranular single-unit activity and supragranular dendritic potentials (Leszczyński et al., 2020), which tracks local activation of the cortex (Muthukumaraswamy, 2010). Going beyond previous studies that use decoding models which combine multiple neural features from multiple electrodes to predict kinematics, we employed an encoding model which uses kinematic features to predict neural activity for each electrode, allowing us to retain the high spatial and temporal resolution of the ECoG signal. This approach allows us to create high-resolution topographic maps depicting encoding strength on the surface of the cortex for movements produced with the contralateral and ipsilateral arms. This is preferable to projecting the weights obtained from decoding models since these models have difficulty disambiguating between informative and uninformative electrodes (Kriegeskorte and Douglas, 2019). Moreover, our approach provides a way to map kinematics to neural activity in a time-resolved manner (rather than as single weights), allowing us to identify time ranges of representational overlap and divergence across the two arms for each electrode.

Results

Behavior

We used a delayed response, out-and-back reaching task. On each trial, a cue indicating the target location was presented on a touchscreen followed, after a short delay, by an imperative signal. Participants were instructed to prepare to move to the target during the delay period. The participant was free to move at their own pace, with the instructions emphasizing that the participant should focus on touching the screen near the target and then returning to the start position. Left and right arm reaches were tested in separate blocks, with the position of the nonresponding hand fixed throughout the block.

Table 1 summarizes the total number of successful trials, along with the reaction time and movement time data. A trial was considered unsuccessful if the reach was initiated before the go cue or if contact with the touchscreen was outside the boundary of the target. The percentage of unsuccessful trials was low, ranging between 0% and 12.5% across individuals. The movements had roughly, bell-shaped velocity profiles for the outbound and the inbound segments (Figure 1C, E) and the outbound reaches were, on average, faster than inbound reaches. The marked interindividual differences in reaction time and movement time reflect the fact that the instructions emphasized accuracy and smoothness.

Summary of performance measures for each participant.

Reaction times (RT) are averages over left and right arm reaches since RT differences were negligible for the two arms.

Patient IDAgeHandednessRTOutbound reachInbound reachTotal trials
L1 36 Right 392 (102) 703 (118) 907 (287) 152
L2 26 Right 1574 (871) 598 (173) 1003 (406) 146
L3 55 Ambidextrous 771 (345) 946 (183) 1429 (252) 148
R1 26 Right 518 (194) 940 (211) 1027 (345) 132
R2 32 Right 335 (55) 602 (94) 590 (120) 145
R3 34 Right 534 (157) 721 (145) 1017 (318) 145

Which task would be relatively dominant in the left hemisphere?
Task and model design.

(A) Task overview. Participants performed an instructed-delay reaching task, moving to targets that appeared on a touchscreen monitor with either the left or right arm. (B) Target positions. The position of each target with respect to the start position of the reaching arm can be defined on the basis of three Cartesian coordinates (X, Y, Z) and two spherical angles (theta and phi). (C) Representative kinematics. Average estimated position and velocity traces for a representative series of trials performed with the left arm. (D) Reach accuracy. Accuracy was quantified as the absolute distance from the center of each target (target diameter = 2.5 cm) to the touch location for all four targets with the left (blue) and right (gray) arm. (E) Kinematic encoding model. Time lagged estimated kinematic features were used to the predict high-frequency activity (HFA) for each electrode using ridge regression. Four kinematic features were included in the model: Position in the Z dimension, speed in the Z dimension, and the two spherical angles phi and theta. Kinematic features were trained on a subset of the HFA data and predictions of HFA were evaluated on held-out test sets.

At a more fine-grained level of spatial accuracy, we calculated the distance from the center of each target to the touch location for each trial. On average, the mean distance from the center of the 2.5 cm circle was 0.80 cm (SD = 0.10 cm) for right-handed reaches and 0.90 cm (SD = 0.17 cm) for left-handed reaches (Figure 1D). These values did not differ from one another [t = 1.538, p = 0.22].

Stronger bilateral encoding in the left hemisphere

We examined the extent to which movement kinematics were encoded for contralateral and ipsilateral reaches in individual electrodes. To do this we fit a kinematic encoding model that maps continuous kinematic features to the HFA signal (Figure 1E) for the 665 electrodes meeting our inclusion criteria. This procedure was done separately for contralateral and ipsilateral reaches. We quantified the cross-validated model fit by generating HFA predictions using the kinematic features from held-out trials of the same condition and calculating prediction performance as the square of the linear correlation (R2) between the predicted and actual HFA signal (Figure 2B).

Which task would be relatively dominant in the left hemisphere?
Stronger bilateral encoding in left hemisphere.

Held-out prediction performance (R2) was computed for each electrode during contralateral reaches (C) and ipsilateral reaches (I). R2 was calculated as the squared linear correlation between the actual high-frequency activity (HFA) and the predictions based on the model. (A) Prediction performance maps for individual patients. Performance of each electrode, shown at the idiosyncratic electrode location for each participant (location based on clinical criteria). Electrodes that did not account for at least 0.05% of the variance (R2 < 0.05) in either the contralateral or ipsilateral condition are shown as smaller dots. (B) Model predictions. Representative time series of the actual HFA and model-based predictions for three electrodes during contralateral and ipsilateral reaches. (C) Summary across patients. Scatter plot displaying R2 values separately for patients with electrodes in either the left (upper) or right (lower) hemisphere. Individual patients can be identified in the scatterplot by the color surrounding the patient label (e.g., L1) in A. R2 for contralateral predictions are plotted against R2 for ipsilateral predictions. Electrodes close to the unity line encode both arms equally whereas electrodes off the unity line indicate stronger encoding of one arm. Points above the unity line indicate stronger encoding of the contralateral arm. These differences are summarized in the frequency histograms in the upper right of each panel. The histogram shows less of a shift in the left hemisphere, a signature consistent with stronger bilateral encoding. ***p < 0.001, permutation test.

Figure 2A displays R2 values for each electrode for the contralateral and ipsilateral conditions, presented on the individual patient MRIs. Electrodes with high prediction performance were primarily located in arm areas of sensorimotor cortex. In line with previous research (Downey et al., 2020), a sizeable percentage of the electrodes were able to predict the HFA at or above our criterion of R2 > 0.05 (examples shown in Figure 2B). This degree of prediction was observed not only when the data were restricted to contralateral movement (31% of electrodes), but also when the data were from ipsilateral movement (25%). A number of electrodes (24%) were predictive in both the contralateral and ipsilateral models. Electrodes that did not meet this criterion for either arm are represented as small dots in Figure 2A and were excluded from further analysis, leaving a total of 216 predictive electrodes (32%, 141 = left hemisphere, 75 = right hemisphere).

Before comparing prediction performance across the two hemispheres, we first evaluated the distribution of the electrodes in the right and left hemispheres. Electrode placement for ECoG is determined solely for clinical purposes; as such, hemispheric asymmetries could arise from differences in coverage rather than functional differences. To evaluate coverage, we categorized the position of all electrodes based on a cortical parcellation (Desikan et al., 2006; Figure 2—figure supplement 1). When the categorization data were pooled across the three left hemisphere and the three right hemisphere patients, the proportion of electrodes was similar across the eight parcellations that encompass premotor, sensorimotor motor, and parietal regions [averages: premotorright = 11%, premotorleft = 10%, sensorimotorright = 17%, sensorimotorleft = 16%, parietalright = 5%, parietalleft = 3%; χ2(7) = 0.057, p = 0.99; Figure 2—figure supplement 1].

Given the similar distributions, we next asked whether prediction performance for the two arms differed across the two hemispheres. Figure 2C compares the predictive performance of each electrode for the contralateral and ipsilateral conditions for patients with left or right hemisphere grids. Values close to the unity line yield similar predictions for the two conditions; values off the unity line indicate that encoding is stronger for one arm compared to the other. To compare prediction performance at the group level, we fit a permutation-based mixed-effects model with fixed factors of Arm and Hemisphere and a random factor of Participant. We found a main effect of Arm with contralateral reaches being encoded more strongly than ipsilateral reaches [ χ2(1) = 29.34, p < 0.001]. We found no effect of Hemisphere [ χ2(1) = 0.46, p > 0.50], but we found a significant interaction between Arm and Hemisphere [ χ2(1) = 12.03, p < 0.001].

To further explore this interaction, we calculated the difference between the R2 values for the contralateral and ipsilateral conditions for each electrode, using this as a proxy of an encoding bias between the two arms (Figure 2C, upper right corner of each scatterplot). Values close to zero indicate similar encoding across the two arms, whereas positive values correspond to stronger contralateral encoding and negative values stronger ipsilateral encoding. The distribution for each condition was positively skewed indicating that, overall, there was a bias for better encoding for contralateral reaches [permutation test: pright < 0.001, pleft < 0.001]. However, there was a significant difference in the distributions for the two hemispheres: The bias scores were lower in the left hemisphere compared to the right hemisphere [permutation test: p < 0.001] indicating stronger bilateral encoding in the left hemisphere. We also found that the contralateral bias becomes weaker the further the electrodes are from the primary motor cortex, an effect observed in both hemispheres [rleft = −0.48, pleft < 0.001, rright = −0.45, pright < 0.001; Figure 2—figure supplement 3].

Opposing patterns of kinematic encoding for the left and right hemispheres during planning and execution

As neural activity unfolds from preparation to movement, the underlying computations may change substantially (Elsayed et al., 2016). To examine if hemispheric asymmetries in encoding depend on task state, we repeated the mixed-effects model described in the previous section, but now added a factor Task Phase, separating the data to test the held-out predictions during the instruction and movement phases (Figure 3A). The effect of Arm was again significant, with contralateral reaches more strongly encoded than ipsilateral reaches [χ2(1) = 16.19, p < 0.001]. The main effects of Hemisphere [ χ2(1) = 0.72, p > 0.40] and Task Phase were not significant [χ2(1) = 0.01, p > 0.90]. Importantly, there was a three-way interaction between Arm, Hemisphere, and Task Phase indicating that the level of encoding for the two arms varied across the two hemispheres for the two task phases [χ2(4) = 22.47, p < 0.001].

Which task would be relatively dominant in the left hemisphere?
Opposing encoding patterns for left and right hemispheres across task phase.

For all predictive electrodes the time series was segmented into instruction and movement epochs. R2 was then calculated separately for each epoch. (A) Example model predictions. Time series of a representative electrode with boxes surrounding the instruction (teal) and movement epochs (gray). (B) Prediction performance during movement and instruction. Comparison of R2 values for contralateral and ipsilateral predictions during the instruction epoch (top) and the movement epoch (bottom) for patients with electrodes in the left hemisphere (left) or right hemisphere (right). Bilateral encoding was stronger in the left hemisphere, an effect that was especially pronounced during the movement phase.

To explore this interaction we again examined the distribution of difference scores for each electrode. The right hemisphere electrodes show a positive skew in both the planning and movement phase [permutation test: pright_move < 0.001, pright_planning < 0.001]. However, this pattern is only seen in the left hemisphere during the planning phase [pleft_planning < 0.001]; the mean difference score was not statistically different from zero for the left hemisphere electrodes in the movement phase [pleft_move = 0.482]. Analyzing simple effects within each hemisphere, we found that the difference score was smaller (i.e., more bilateral encoding) in the left hemisphere during the movement phase compared to the planning phase [R2left_move = 0.01, R2left_planning = 0.04, p < 0.001]. In contrast, the opposite pattern was observed in the right hemisphere, with encoding being more bilateral during the instruction phase [R2right_move = 0.13, R2right_planning = 0.10, p < 0.001]. Taken together, these results suggest that the left and right hemispheres may have different roles in bilateral encoding with regard to task phase.

Across-arm generalization: more overlap between arms in the left hemisphere

The preceding analyses focused on an encoding analysis for within-arm prediction. We next evaluate the overlap between the neural representations for contralateral and ipsilateral movements. To this end, we examined across-arm prediction performance by training the kinematic encoding model with the data from movements produced with one arm and testing prediction performance using the data from movements produced with the other arm.

Figure 4A shows the traces for two representative electrodes, one that shows good generalization across the two arms and the other that shows poor generalization. For the electrode that shows good generalization (E1), prediction performance for held-out contralateral reaches is comparable when the model is trained on data from either the contralateral or ipsilateral arm. This suggests that there is overlap between the neural representations for reaches performed with either upper limb for this electrode. In contrast, the electrode showing poor generalization (E2) showed good prediction for contralateral reaches when trained with contralateral data, but poor prediction when trained with ipsilateral data. Here, the neural representations for the arms do not overlap. Note that E2 showed relatively strong within-arm ipsilateral encoding (R2 = 0.25); thus, the inability of this electrode to generalize across arms is not a result of poor encoding of the ipsilateral arm. Rather, E2 encodes movement produced by either arm, but the manner in which they are encoded differs.

Which task would be relatively dominant in the left hemisphere?
Stronger across-arm generalization in the left hemisphere.

Across-arm predictions were created by training the model on ipsilateral reaches and using the trained weights to predict high-frequency activity (HFA) during contralateral reaches. (Within-arm predictions generated the same as in Figures 2 and 3.) Electrodes close to the unity line have overlapping neural representations across the two arms whereas electrodes off the unity line indicate that the two arms are being encoding differentially. (A) Model predictions. Predicted and actual HFA for two electrodes selected from the distribution of left hemisphere electrodes during movement, one that generalizes well across arms (E1) and one that fails to generalize (E2). Bottom row shows within-arm performance for ipsilateral trials, demonstrating that the failure to generalize across arms does not necessarily indicate poor ipsilateral performance. (B) Across-arm generalization across patients. R2 for within-arm predictions plotted against R2 for across-arm predictions, with the analysis performed separately for the instruction and movement phases. Left hemisphere electrodes showed better generalization than right hemisphere electrodes, an effect that was magnified in the movement phase.

Figure 4B summarizes the comparison of within-arm prediction (y-axis) against across-arm prediction (x-axis), with the data separated for the instruction and movement phases. In this depiction, electrodes close to the unity line have overlapping neural representations during contralateral and ipsilateral movements, whereas electrodes off the unity line encode the two arms differentially. We again used a permutation-based mixed-effects model, this time with fixed factors of Generalization, Task Phase, and Hemisphere and a random factor of Participant. As expected, we found a main effect of Generalization with within-arm predictions outperforming across-arm predictions [χ2(1) = 103, p < 0.001]. There was also a main effect of Task Phase [χ2(1) = 30.51, p < 0.001] with better prediction accuracy during the movement phase compared to the instruction phase. The main effect of Hemisphere was not significant [χ2(1) < 0.01, p > 0.90], but there was a significant three-way interaction between the three factors [ χ2(4) = 19.56, p < 0.001].

To evaluate this interaction, we used a difference score, calculated by subtracting the across-arm R2 from the within-arm R2 for each electrode (Figure 4B, upper right corner of each scatterplot). As such, the larger (more positive) the score, the poorer the electrode is in predicting activity when the movement is produced with the other arm. Overall, across-arm generalization was better during the instruction phase compared to the movement phase [R2instruction = 0.05, R2movement = 0.08; p < 0.001]. In terms of laterality differences, the left hemisphere showed stronger across-arm generalization (lower difference values) than the right hemisphere [R2left = 0.04, R2right = 0.11; p < 0.001]. Analyzing simple effects within each task phase, the left hemisphere had better across-arm generalization compared to the right hemisphere for both the instruction and movement phase [simple effect analysis: pinstruct < 0.001, pmove < 0.001]. In addition, better across-arm generalization was found during the instruction phase in both the left and right hemispheres [simple effect analysis: pleft < 0.001, pright < 0.001]. In sum, the three-way interaction reflects the fact that electrodes in the left hemisphere exhibit better generalization across arms than right hemisphere electrodes, an effect observed in both the instruction and movement phases. In addition, the difference in across-arm generalization between phases is more pronounced in the right hemisphere.

Considered together, the within- and across-arm encoding results indicate that left hemisphere electrodes show stronger bilateral encoding and more similar encoding during left and right arm movements. Interestingly, although overall encoding was stronger during movement, across-arm generalization was stronger during the instruction phase.

Temporal and spatial topography of across-arm generalization

To examine how generalization varied across the cortex, we categorized each electrode as showing either good across-arm generalization (decrease of up to 20% relative to within-arm performance) or poor across-arm generalization (decrease of more than 50%; Figure 5A). We focused on the extremes of the generalization distribution based on the assumption that these electrodes were more likely to share similar underlying neural profiles. This also allowed us to have similar numbers of electrodes in each group.

Which task would be relatively dominant in the left hemisphere?
Spatial and temporal relationships of across-arm generalization.

(A) Generalization index. Electrodes were classified as showing good across-arm generalization (white, generalization index >0.80) or poor across-arm generalization (magenta; generalization index <0.50). (B) Ipsilateral encoding strength. Ipsilateral encoding strength for electrodes that generalize well and generalize poorly. (C) Amplitude differences across arms. Average contralateral (solid line) and ipsilateral (dashed line) high-frequency activity (HFA) for electrodes that generalize well across arms (left) or generalize poorly (right). Significant clusters are represented with a gray line. Inset: same data but standardized to highlight shape of the time series independent of absolute amplitude. (D) Spatial distribution of across-arm generalization. Electrodes that generalize well across arms (white) were primarily located in dorsal and ventral premotor regions of the left hemisphere. Electrodes that generalize poorly (magenta) were clustered around the putative arm area of the central sulcus in both the left and right hemispheres. Dashed rectangles indicate extent of electrode coverage across the three patients for each hemisphere. (E) Modulation depth. Depth of tuning was calculated during instruction or movement with either the ipsilateral or contralateral hand. Greater modulation was found during contralateral reaches and during movement. (F) Tuning similarity. Across arms tuning similarity was calculated for electrodes that generalize well (white) or poorly (magenta). Electrodes that generalize well across arms had significantly more tuning similarity than electrodes that did not generalize. *p < 0.05, ***p < 0.001, cluster permutation test, Pearson’s correlation.

Figure 5B plots ipsilateral encoding strength (R2) for electrodes that either generalize well or generalize poorly. Electrodes that generalize poorly have lower ipsilateral encoding strength than electrodes that generalize well [t = 5.921, p < 0.001]. Despite this difference, 61% (23/38) of electrodes that generalize poorly meet our encoding criteria of R2 > 0.05.

To examine the dynamics of representational overlap and divergence, we averaged the time-resolved HFA amplitude across electrodes, restricted to those showing good or poor across-arm generalization. Figure 5C displays the average time series for contralateral (solid line) and ipsilateral (dashed line) predictions for electrodes that generalize well (white) or poorly (magenta). The temporal profile of HFA is similar for electrodes that generalize well, showing a single peak in the movement phase. A cluster-based permutation test identified two periods where the HFA amplitude differed for contralateral and ipsilateral reaches, one during instruction and one well into the movement period. In contrast, the temporal profiles are radically different for those that generalize poorly. The lack of correspondence likely arises, at least in part, because of the weak modulation for these electrodes during ipsilateral reaches.

It is possible that similarity in temporal structure is obscured in the preceding analysis by the differences in HFA amplitude for the electrodes that showed poor generalization. To control for this, we standardized the time series data by dividing each sample by the overall standard deviation (insets: Figure 5C). Using the standardized traces, we calculated the linear correlation coefficient between the contralateral and ipsilateral traces, separately for instruction and movement. As expected, electrodes that generalized well across arms showed strong across-arm correlations for both task phases (inset: Figure 5C, left). In contrast, for electrodes that generalize poorly across arms, the correlation between arms was negative during instruction and then rose to a moderate positive correlation during movement (inset: Figure 5C, right). Thus, the poor generalization of these electrodes is due in part to the temporal divergence of the two arms during instruction, where the ipsilateral trace becomes inhibited compared to the contralateral trace. Interestingly, although the ipsilateral trace remains inhibited during movement, the temporal structure between the two arms reemerges.

We next examined the relationship between generalization, hemisphere and spatial position on the cortical surface. As can be seen in Figure 5D, electrodes that generalize well were predominantly found in the left hemisphere (proportion of electrodes that generalize across patients: L1 = 22%, L2 = 39%, L3 = 29%, R1 = 0%, R2 = 5%, R3 = 4%; χ2(2) = 48813, p < 0.001). In contrast, electrodes showing poor generalization were observed in both hemispheres (proportion of electrodes that generalize poorly: L1 = 21%, L2 = 5%, L3 = 6%, R1 = 14%, R2 = 15%, R3 = 37%; χ2(2) = 0.400, p = 0.818). Moreover, in both hemispheres, electrodes showing poor generalization were clustered near the dorsal portion of the central sulcus, a region corresponding to the arm area of motor cortex. Electrodes showing strong generalization (mostly limited to the left hemisphere) tended to be in dorsal and ventral premotor cortices (PMd and PMv), along with a few in superior parietal cortex. This pattern was also observed when we analyzed all electrodes, rather than restrict the analysis to those showing extreme values. Here we used a continuous measure, correlating the amount of across-arm generalization with the distance (absolute value) from the dorsal aspect of the central sulcus. The correlation was significant in the left hemisphere [rleft = 0.46, pleft < 0.001] but did not reach significance in the right hemisphere, although the trend was in the same direction [rright = 0.22, pright = 0.068; Figure 5—figure supplement 1].

Target modulation and tuning similarity across arms

To examine the extent of target modulation for the contralateral and ipsilateral arms, we calculated the modulation depth (MD) of each electrode during the instruction and movement phases. The modulation index reflects the amount of variability in the signal captured by target tuning (or target specificity): A modulation index of 0.1 means 10% of the variance is captured by the difference between the response to the four target locations. The modulation values overall were relatively low (Figure 5D). However, it should be noted that the reaches were all within the frontoparallel plane which comprise a considerably smaller range of movement compared to studies that use a center-out reaching task. For both electrode types (showing good or poor across-arm generalization), there was a main effect of arm, with ipsilateral modulation lower than contralateral modulation [permutation test: pGeneralize_well < 0.001; pGeneralize_poorly < 0.005]. Both subgroups of electrodes also displayed a main effect of task phase, with the depth of modulation greater during the movement phase compared to the instruction phase [permutation test: pGeneralize_well < 0.001; pGeneralize_poorly < 0.005]. No significant interactions were found for either group.

We also examined the representational overlap between the two arms in terms of their tuning profiles. We computed a tuning similarity index (SI), defined as the sum of squared errors (SSEs) for average HFA predictions to the same target between the contralateral and ipsilateral arms. An SI of 1 would correspond to identical tuning preferences for the arms whereas an SI of 0 would indicate completely disparate tuning preferences. The similarity data were analyzed with a mixed design permutation test, including the factors task phase and electrode type (good vs. poor generalizers). Electrodes that generalize well across the two arms (predominately found in the left hemisphere) showed more overlap of tuning preferences compared to electrodes that generalized poorly [main effect of generalizability: p < 0.001]. While there was no effect of phase [p > 0.70], the interaction was significant [p < 0.005], with electrode types showing more comparable tuning similarity during instruction and tuning similarity diverging during movement. Simple effects analysis revealed that for electrodes that generalize poorly, tuning similarity was higher during the instruction phase compared to the movement phase [permutation test: p < 0.001]. In contrast, for electrodes that generalize well, tuning similarity was higher during movement compared to instruction [permutation test: p < 0.001]. These analyses demonstrate that a number of electrodes in the left hemisphere encode kinematic variables for both arms, including similar tuning preferences across the two arms, which was especially pronounced during the movement phase.

HFA relationship to kinematics

In the final analysis, we examined how the kinematic features of the movements contribute to the encoding model used to predict HFA. Each of the four kinematic features includes 400 time lags and thus 400 weights that contribute to the model. To obtain a metric of the relative contribution of the features, we calculated the total contribution of each feature and normalized these values by dividing by the total contribution of the four features. The calculation was done for each patient separately and then averaged, with error bars representing the standard deviation across patients (Figure 6A). The relative contribution of the four kinematic features was similar for contralateral and ipsilateral reaches. We next examined the temporal profile of the weights (Figure 6B) and found that this was also similar for the two conditions, although the average weights for ipsilateral reaches are substantially lower, consistent with the observation of lower performance metrics for ipsilateral reaches across all predictive electrodes (Figure 2—figure supplement 2).

Which task would be relatively dominant in the left hemisphere?
Relationship of kinematic features to high-frequency activity (HFA).

(A) Relative contribution of kinematic features to the encoding model. Average contribution of the four kinematic features for contralateral (top) and ipsilateral (bottom) reaches. Error bars represent the standard deviation across patients. (B) Temporal pattern of weights across time. Average weights for all predictive electrodes are plotted for each kinematic feature for contralateral (top) and ipsilateral (bottom) reaches. Error bars represent the standard error across electrodes.

As can be seen in Figure 6A, speed and position, kinematic features which are associated with timing and movement initiation make a strong contribution to the encoding model (relative contribution: contra = 68%, ipsi = 63%). This is in contrast with the smaller contribution of theta and phi, features which provide information about movement direction (relative contribution: contra = 32%, ipsi = 37%). This result is similar to that observed in single-unit and population activity recorded in premotor and motor cortex of nonhuman primates. Kaufman et al., 2016 observed that the largest response component was associated with movement timing/initiation rather than features such as movement direction. Similarly, this direction-independent signal occurs twice during sequential movements (Zimnik and Churchland, 2021); in our data, speed has two prominent peaks, one occurring before the reach and the second occurring before the return movement. We were surprised to see the markedly differential weighting for the vertical (theta) and horizontal (phi) directional features. We assume this is likely idiosyncratic to the layout of our targets.

We also examined the correspondence between HFA and the kinematic features as a function of whether electrodes generalize well or poorly (Figure 7). For electrodes that generalize well, position most closely corresponds to HFA for both contralateral and ipsilateral movements. The maximum cross-correlation for contralateral and ipsilateral movements was found at a lag of 200 and 150 ms, respectively, with HFA leading hand position. For electrodes that generalize poorly, the kinematic feature that most closely corresponds to HFA for both contralateral and ipsilateral movements is speed. For these electrodes, the maximum cross-correlation for contralateral and ipsilateral movements were both at a lag of 200 ms, with HFA again leading the kinematic feature. Although the ipsilateral HFA signals are considerably lower in amplitude, the pattern between HFA and speed is quite similar for both ipsilateral and contralateral movements. The fact that the neural activity from electrodes that generalize poorly (primarily located over M1) correlates well with speed provides additional evidence that a strong component of the HFA ECoG signal is related to timing and movement initiation (Kaufman et al., 2016).

Which task would be relatively dominant in the left hemisphere?
Relationship of kinematic features to high-frequency activity (HFA) for electrodes that generalize well or poorly.

(A) HFA overlaid with kinematics. Each plot shows average HFA activity along with average values for position, velocity, or speed, time-locked to movement onset. (B) Cross-correlation between HFA and kinematic features. The cross-correlation between each kinematic feature and the HFA is plotted for electrodes that generalize well or poorly. For each plot, the lag (in ms) yielding the highest correlation between HFA and kinematics is represented by a dashed line with the lag time and correlation coefficient displayed in the inset at the bottom right of each plot.

Discussion

Although the most prominent feature of cortical motor pathways is their contralateral organization, unimanual movements are well represented in the ipsilateral hemisphere. Single-unit activity and local field potentials obtained from motor cortex in nonhuman primates (Ganguly et al., 2009; Ames and Churchland, 2019), as well as ECoG activity in humans (Bundy et al., 2018; Ganguly et al., 2009; Wisneski et al., 2008) can be decoded to predict complex kinematic variables and EMG activity during arm movements of the ipsilateral arm.

Here, we report the results from ECoG data obtained from six patients, three with left hemisphere implants and three with right hemisphere implants, with each patient having at least 17 predictive electrodes. To examine how kinematic features are represented in each hemisphere, we built an electrode-wise encoding model. Such models allow prediction of the full time series for each electrode thus retaining the high spatial and temporal resolution of the intracranial signal. From these metrics we could compare kinematic encoding and across-arm generalization between the two hemispheres as well as the spatial distribution of the information-carrying electrodes within each hemisphere.

Hemispheric asymmetry in movement encoding

We observed a striking asymmetry between the two hemispheres for ipsilateral movement encoding. While contralateral movements were encoded similarly across the two hemispheres, ipsilateral encoding was much stronger in the left hemisphere, an effect that was especially pronounced during movement execution. In addition, there was greater overlap between the representation of contralateral and ipsilateral movement in the left hemisphere compared to the right hemisphere.

The bilateral encoding effect size is quite substantial (Cohen’s d = 1.34), exceeding the conventional criterion for a large effect (d = 0.80). Given the size of the hemispheric asymmetry effect, it is surprising that this asymmetry has not been described in previous reports. This may in part reflect the smaller sample size in ECoG studies. For example, in Bundy et al., 2018, three of the four patients had left hemisphere grids, leaving a hemisphere analysis dependent on the data from a single right hemisphere patient. Studies with nonhuman primates tend to ignore hemispheric differences, perhaps because these animals do not show consistent patterns of hand dominance across individuals. One exception here is a study by Cisek et al., 2003 who reported no hemispheric differences in neural recordings obtained from M1 and PMd during ipsilateral and contralateral arm reaches.

In addition to examining hemispheric differences in the encoding of unimanual movement, we also asked if kinematic features were encoded differently for contralateral and ipsilateral movements by testing across-arm generalization. We categorized electrodes as showing either good across-arm generalization (decrease of up to 20% relative to within-arm performance) or poor across-arm generalization (decrease of more than 50%). This categorization scheme revealed a striking anatomical division, with electrodes showing good across-arm generalization clustering in the left premotor and superior parietal regions and electrodes that generalized poorly clustering in left and right M1. This result does not appear to reflect a sampling bias. There are more left hemisphere electrodes compared to right hemisphere electrodes because two of the left hemisphere patients had high density grid implants. However, the electrodes in our left and right hemisphere samples were similarly distributed over premotor, sensorimotor, and parietal regions (see Figure 2—figure supplement 1).

Examining the temporal profile of electrodes that generalize poorly, we found that the divergence between the two arms occurs during instruction, with the ipsilateral trace becoming inhibited relative to the contralateral trace. TMS studies have shown reduced corticospinal excitability of the nonselected hand during movement preparation (e.g., Leocani et al., 2000; Liepert et al., 2001), an effect that has been hypothesized to reflect inhibition from prefrontal regions to facilitate response selection (Duque and Ivry, 2009).

We further examined the spatial tuning of the electrodes. Target tuning in the HFA band was found for both contralateral and ipsilateral movements, although ipsilateral tuning was significantly shallower. Interestingly, electrodes that generalized well across arms had similar spatial/target tuning for each arm. This suggests that for these electrodes, ipsilateral signals are not just encoding generic movement, but encoding movement direction in a similar manner to contralateral signals. A similar overlap in tuning has been observed in single-unit recordings from PMd (Cisek et al., 2003) and can be inferred from the across-arm generalization decoding results reported by Bundy et al., 2018. In contrast, electrodes that failed to generalize, located primarily in M1 in either left or right hemisphere, exhibited disparate tuning for contralateral and ipsilateral reaches.

Functional implications of hemispheric asymmetries in movement encoding

By using a delayed response task, we were able to segregate activity into an instruction phase during which the participant was presented with the target location for the forthcoming movement and a movement phase, defined at the onset of the reach. With this design, we found that the encoding model could predict neural activity during the instruction phase based on the kinematics of the forthcoming reach, evidence that the participants were indeed planning the upcoming movement.

This task phase analysis also revealed robust asymmetries between the two hemispheres. There was a main effect of hemisphere, with the left hemisphere displaying stronger bilateral encoding overall compared to the right hemisphere. However, there was also an interaction: In the left hemisphere bilateral encoding was stronger during the movement phase whereas in the right hemisphere bilateral encoding was stronger during the instruction phase. Surprisingly, in the left hemisphere the contralateral bias completely disappeared during the movement phase, with both the contralateral and ipsilateral arms being encoded to the same extent. Stronger bilateral encoding during movement (compared to instruction) is surprising given the spatial distribution of electrodes that encode ipsilateral movement was primarily outside of M1, regions typically associated more with planning than execution (e.g., premotor cortices and parietal cortex).

The asymmetry observed here is in accord with the long-standing recognition of hemispheric asymmetries in praxis. Starting with the classic observations of Liepmann at the turn of the 20th century on the association of the left hemisphere and apraxia (Liepmann, 1908, cited in De Renzi and Lucchelli, 1988; see also Schaefer et al., 2007) and continuing with functional imaging studies in neurotypical populations, a large body of evidence points to a dominant role for the left hemisphere in skilled movement (Corballis et al., 2012; Przybylski and Króliczak, 2017). This asymmetry is most pronounced in tasks involving functional object use (Buxbaum et al., 2006), symbolic gestures (Xu et al., 2009), and intransitive pantomimes (Bohlhalter et al., 2009). While the neuropsychological and neuroimaging work have highlighted the involvement of left premotor and parietal cortex in praxis, corresponding asymmetries have also been noted in subcortical structures such as the basal ganglia, cerebellum, and thalamus (Swinnen et al., 2010). We note that for our patient population, we are limited to regions of the brain where we have sufficient electrode coverage.

Apraxia, following left hemisphere damage can be manifest in movements produced with either limb (De Renzi and Lucchelli, 1988), and are usually associated with lesions that encompass premotor and parietal cortices (Haaland et al., 2000). While this asymmetry may be linked to hand dominance (Ochipa et al., 1989), functional imagining studies with relatively large sample sizes have shown that handedness only influences the strength of the left hemisphere bias for skilled movement but does not produce a reversal in left handers (Vingerhoets et al., 2012; Verstynen et al., 2005; Chettouf et al., 2020; Vingerhoets et al., 2013). Of the six patients tested in the current study, five are right handed and the remaining patient reported being ambidextrous with a slight preference for using the left hand. We note that the results from this patient (L3) did not qualitatively differ from the other two left hemisphere patients.

Ipsilateral encoding was most prominent in the premotor and parietal cortex of the left hemisphere, overlapping with the neural regions implicated in praxis. However, two features of our results do not map on readily to an interpretation that focuses on hemispheric asymmetries in praxis. First, our task involved simple reaching movements, whereas praxis generally encompasses more complex learned movements associated with tool use or symbolic gestures. Second, ipsilateral encoding became more pronounced during movement execution.

Assuming that ipsilateral encoding is indicative of bilateral motor representations, one might have expected, a priori, that hemispheric asymmetries in ipsilateral encoding would be more prevalent during movement planning. We recognize that, even with delayed response tasks, it is overly simplistic to assume that the activity cleanly separates into planning and execution phases. This is especially true with sequential movements where planning effects are observed both prior to and during movement execution (Ariani and Diedrichsen, 2019; Zimnik and Churchland, 2021). While the experimental task was to reach to a cued target, the participants made out-and-back movements, returning to the home position in a relatively smooth manner (see Figure 1—figure supplement 1). It is reasonable to assume that some component of the activity during the primary outward movement was related to planning the return movement. As such, we are hesitant to draw strong inferences about the differences between ipsilateral encoding during action planning and movement execution.

To this point, we have focused on how ipsilateral activity may be reflective of control processes associated with movements of the ipsilateral arm. However, it is possible that this activity is related to postural stabilization of the body during reaching. Indeed, extrapyramidal pathways such as the reticulospinal track have a prominent ipsilateral projection associated with postural control (Cleland and Madhavan, 2021), and these pathways receive cortical input. We aimed to reduce postural demands in our task by having the participants seated in an upright hospital bed with the back fully supported; nonetheless, there are surely postural shifts associated with the reaching movement. The clinical setting precluded the use of EMG or video, measurements that would allow a quantitative assessment of the relationship of ipsilateral activity to postural adjustments. We do note a few points that are at odds with a posture-based account of ipsilateral activity. First, we are unaware of evidence suggesting a left hemisphere specialization in postural control. In fact, the evidence suggests that postural instability is more frequently associated with right hemisphere lesions (Bohannon et al., 1986; Spinazzola et al., 2003). Second, postural adjustments typically precede movement onset (Belenkii et al., 1967, cited in Guiard, 1987), whereas ipsilateral encoding in our data increased with movement onset. Third, and perhaps most convincing, the encoding model shows that the ipsilateral signals predict reaching kinematics with relatively high precision.

The asymmetry of ipsilateral encoding may be reflective of a prominent role of the left hemisphere in bimanual coordination (Jäncke et al., 2000; Toyokura et al., 1999; Maki et al., 2008; Serrien et al., 2003; Fujiyama et al., 2016). For example, Schaffer et al., 2020 observed greater impairments in bimanual coordination following left hemisphere stroke compared to right hemisphere stroke. Interestingly, the impairment was manifest prior to peak velocity, a finding interpreted as a disruption in predictive control. It may be that the left hemisphere makes an asymmetric contribution to interlimb coordination by tracking or predicting where both limbs are in space. As such, the encoding of ipsilateral arm movement might be a form of state representation, a means to keep track of the state of the ipsilateral arm given that many actions require the coordinated activity of the two limbs. This hypothesis, derived from the current data, is consistent with the increased ipsilateral encoding during the movement phase. The need to monitor the state of the other limb should hold for unimanual gestures performed with either limb.

An important question for future work is to examine how ipsilateral representations in the left hemisphere are affected during more complex movements, including those that involve both limbs. Using fMRI, Diedrichsen et al., 2013 compared ipsilateral movement representations during unimanual and bimanual movements. Within the primary motor cortex, ipsilateral representations could only be discerned during unimanual movement. However, caudal premotor and anterior parietal regions retained similar ipsilateral representation during uni- and bimanual movement. If the left hemisphere tracks both limbs to facilitate bimanual coordination, we would predict that ipsilateral representations in premotor cortex are retained more strongly in the left hemisphere compared to the right hemisphere when both arms are engaged in the task.

Conclusion

Using a kinematic encoding model, we observed a striking hemispheric asymmetry, with the left hemisphere more strongly encoding the ipsilateral arm than the right hemisphere, a finding that was apparent during preparation and amplified during movement. This asymmetry was primarily driven by electrodes positioned over premotor and parietal cortices, with strong contralateral encoding for electrodes positioned over sensorimotor cortex. We propose that these networks monitor the state of each arm, a prerequisite for most skilled actions.

Materials and methods

Participants

Intracranial recordings were obtained from six patients (two female; five right handed; Table 1) implanted with subdural grids as part of their treatment for intractable epilepsy. Data were recorded at three hospitals: University of California, Irvine (UCI) Medical Center (n = 2), University of California, San Francisco (UCSF) Medical Center (n = 2), and California Pacific Medical Center (CPMC), San Francisco (n = 2). Electrode placement was solely determined based on clinical considerations and all procedures were approved by the institutional review boards at the hospitals, as well as the University of California, Berkeley. All patients provided informed consent prior to participating in the study.

Behavioral task

Request a detailed protocol

Participant performed an instructed-delay reaching task while sitting upright in their hospital bed. The participant rested their arms on a horizontal platform (71 cm × 20 cm) that was placed over a standard hospital overbed table. The platform contained two custom-made buttons, each connected to a microswitch. At the far end of the platform (13 cm from the buttons, approximately 55 cm from the participant’s eyes), a touchscreen monitor was attached, oriented vertically. Visual targets could appear at one of six locations, four for each arm (Figure 1A). The two central locations were used as targets for reaches with either arm; the two eccentric targets varied depending on the arm used. Stimulus presentation was controlled with Matlab 2016a. A photodiode sensor was placed on the monitor to precisely track target presentation times. The analog signals from the photodiode and the two microswitches were fed into the ECoG recording system and were digitized into the same data file as the ECoG data with identical sampling frequency.

Testing of the contralateral and ipsilateral arms (relative to the ECoG electrodes) was conducted in separate experimental blocks that were counterbalanced. To start each trial, the participant placed their left and right index fingers on two custom buttons to depress the microswitches (this indicated they were in the correct position and ready to start the trial). If both microswitches remained depressed for 500 ms, a fixation stimulus was presented in the middle of the screen for 750 ms, followed by the target, a circle (1.25 cm diameter) which appeared in one of the four locations. Another hold period of 900 ms followed in which the participant was instructed to prepare the required movement while the target remained on the screen. If the microswitch was actuated during this hold period, an error message appeared on the screen and the program would advance to the next trial. If the start position was maintained, a compound imperative stimulus was presented at the end of the hold period. This consisted of an auditory tone and an increase in the size of the target (2.5 cm diameter). The participant was instructed that this was the signal to initiate and complete a continuous out-and-back movement, attempting to touch the screen at the target location before returning back to the platform. The target disappeared when the touchscreen was contacted. The imperative was withheld on 5% of the trials (‘catch’ trials) to ensure that the participant only responded after the onset of the imperative.

Once back at the home position, the screen displayed the word ‘HIT’ or ‘MISS’ for 750 ms to indicate if the touch had occurred within the target zone. The target zone included the 2.5 diameter circle as well as a 1 cm buffer around the target. After the feedback interval, the screen was blank for 250 ms before the reappearance of the fixation stimulus, signaling the start of the next trial. The participants were informed to release either of the buttons at any time they wished to take a break.

Each block consisted of 40 trials (10/target), all performed with a single limb. Blocks alternated between contralateral and ipsilateral arms (relative to the ECoG electrodes), with the order counterbalanced across participants. Each block took approximately 5–6 min to complete. All participants completed at least two blocks with each per arm (Table 1).

Movement analysis and trajectory reconstruction

Request a detailed protocol

We used two methods to analyze the movements. For the first method, we recorded key events defined by the release of the microswitch at the start position, time and location of contact with the touchscreen, and return time to the home position, defined by the time at which they depressed the home position microswitch. For the second method, we used the Leap Motion 3D movement analysis system (Weichert et al., 2013) to record continuous hand position and the full movement trajectory (sampling rate = 60 Hz). Although the Leap system is a lightweight video-based tracking device that is highly mobile, the unpredictable environment of the ICU led to erratic recordings from the Leap system. For example, patients frequently had intravenous lines in one or both hands which obstructed the visibility of the hand and interfered with the ability of the Leap system to track the hand using their built-in hand model. This resulted in lost samples and therefore satisfactory kinematic data were obtained from only a subset of conditions collected from patients using the Leap system.

Given the limitations with the Leap data, we opted to use a simple algorithm to reconstruct the time-resolved hand trajectory in each trial, estimating it from the event-based data obtained with the first method. We used a beta distribution to estimate the velocity profile of the forward and return reach based on reach times and the travel distance (sampling rate = 100 Hz). We opted to use a beta distribution because this best matched the velocity profiles of the data obtained with the Leap system.

For conditions that had clean kinematic traces (no lost samples) from the Leap system, we compared the estimated kinematic profiles with those obtained with the Leap system. There was a high correlation between the two datasets (r = 0.98 for position in the Z dimension; r = 0.93 for velocity in the Z dimension; Figure 1—figure supplement 1). We note that our method of estimating the trajectories results in a smoothed version of the movement, one lacking any secondary or corrective movements that are sometimes observed when reaching to a visual target (Suway and Schwartz, 2019). We believe this is still a reasonable estimation given the high correlation with the continuous Leap data, and the fact that participants had ample time to prepare the movements and were instructed and observed to make ballistic movements by the experimenter who was present for all recording sessions (CMM).

Electrode localization

Request a detailed protocol

Grid and strip electrode spacing was 1 cm in four patients and 4 mm in the two other patients. The electrode locations were visualized on a three-dimensional reconstruction of the patient’s cortical surface using a custom script that takes the postoperative computed tomography scan and coregisters it to the preoperative structural magnetic resonance scan (Stolk et al., 2018).

Neural data acquisition and preprocessing

Request a detailed protocol

Intracranial EEG data and peripheral data (photodiode and microswitch traces) were acquired using a Nihon Kohden recording system at UCI (128 channel, 5000 Hz digitization) and CPMC (128 channel, 1000 Hz digitization rate), and two Tucker Davis Technologies recording systems at UCSF (128 channel, 3052 Hz digitization rate).

Offline preprocessing included the following steps. First, if the patient’s data were not sampled at 1000 Hz (UCI and UCSF recording sites), the signal from each electrode was low-pass filtered at 500 Hz using a Butterworth filter as an antialiasing measure before downsampling to 1000 Hz. Electrodes were referenced using a common average reference. Each electrode was notch filtered at 60, 120, and 180 Hz to remove line noise. The signals were then visually inspected and electrodes with sustained excessive noise were excluded from further analyses. The signals were also inspected by a neurologist (RTK) for epileptic activity and other artifacts. Electrodes that had pathological seizure activity were also excluded from the main analyses. Out of 752 electrodes, 82 were removed due to excessive noise and 5 were removed due to epileptic activity, resulting in a final dataset of 665 electrodes. Catch trials and unsuccessful reaches were not included in the analyses.

From the cleaned dataset, we extracted the HFA instantaneous amplitude using a Hilbert transform. To account for the 1/f power drop in the spectrum, we divided the broadband signal into five narrower bands that logarithmically increased from 70 to 200 Hz (i.e., 70–86, 86–107, 107–131, 131–162, and 162–200 Hz), and applied a band-pass filter within each of these ranges. We then took the absolute value of the Hilbert transform within each band-pass, performed a z-score transformation, and averaged the five values. z-Scoring was performed after concatenating all the blocks for each patient, ensuring that we did not obscure possible amplitude differences across the two arms. As a final step, the data were downsampled to 100 Hz to reduce computational load (e.g., number of parameters in the encoding model, see below). HFA amplitude fluctuations (envelope; are evident at lower frequencies Canolty et al., 2006; Pei et al., 2011).

Feature selection

Request a detailed protocol

Four estimated kinematic features were used to predict HFA (Figure 1B, left). The first two features were position and speed in the Z dimension. This dimension captures variability related to movement that is relatively independent of target location (i.e., along the axis between the participant and touchscreen). The second pair of features were spherical angles that define the specific target locations (Figure 1A, right). Features were selected to reduce collinearity and redundancy in the encoding model. Because we include time lags for each kinematic feature, derivatives can emerge from the linear model (e.g., velocity and acceleration can be created from position); thus, velocity and acceleration were not included as additional features. Speed is a nonlinear transformation of position and is added as a separate feature.

Kinematic encoding model

Request a detailed protocol

The estimated kinematic features were used to predict the HFA for each electrode (Figure 1F). We created a 4 × 400 feature matrix by generating a time series for each feature by time lagging the values of the selected feature relative to the neural data, with lags extending from 2 s before movement onset to 2 s after movement onset (sampling rate at 100 Hz). This wide range of lags serves two purposes. First, it provides a way to compensate for the anticipated asynchrony between neural data and movement kinematics. Second, it allowed us to evaluate HFA activity during the instructed-delay (beginning ~1.5 s before movement onset) period as well as during movement. HFA at each time point [HFA(t)] was modeled as a weighted linear combination of the kinematic features at different time lags, resulting in a set of beta weights, b1, …, b400 per kinematic feature. To make the beta weights scale-free, the kinematic features and neural HFA were z-scored before being fit by the model.

Fitting

Request a detailed protocol

Regularized (ridge) regression (Hoerl and Kennard, 1970) was used to estimate the weights that map each kinematic feature (X) to the HFA signal (y) for each electrode, with λ being the regularization hyperparameter:

β^=(XT X+λI)−1XTy

For within-arm model fitting, the total dataset consisted of all clean, successful trials performed with either the ipsilateral or contralateral arm (each arm was fit separately). Nested fivefold cross-validation was used to select the regularization hyperparameter on inner test sets (validation sets) and assess prediction performance on separate, outer test sets. At the outer level, the data were partitioned into five mutually exclusive estimation and test sets. For each test set, the remaining data served as the estimation set. For each outer fold, we further partitioned our estimation set into five mutually exclusive inner folds to train the model (80% of estimation set) and predict neural responses across a range of regularization values on the validation set (20% of estimation set). For each inner fold, the regularization parameter value was selected that produced the best prediction as measured by the linear correlation of the predicted and actual HFA. The average of the selected regularization parameters across the five inner folds was computed and used to calculate the prediction of the HFA on the outer test set. This procedure was done at the outer level five times. Our primary measure is held-out prediction performance (R2), which we quantified as the squared linear correlation between the model prediction and the actual HFA time series, averaged across the five mutually exclusive test sets.

To be considered as predictive, we established a criterion that an electrode must account for at least 5% of the variability in the HFA signal (R2 > 0.05) for either ipsilateral or contralateral reach (Downey et al., 2020). Electrodes not meeting this criterion were not included in subsequent analyses.

For across-arm model fitting, the same procedure was used except the test set was partitioned from the total dataset of the other arm. We partitioned the data in this manner (80% estimation, 20% test) to make the fitting procedure for the across-arm model comparable to that employed in the within-arm model.

Tuning modulation and similarity across arms

Request a detailed protocol

MD of target tuning was calculated as the standard deviation of the mean HFA predictions for each of the four target locations:

MD=∑i=1n(xi−x¯)2 n

where x is the average HFA prediction, xi is the average HFA prediction for each of the four target positions. i iterates through the target locations and n is the total number of target locations. This process was done separately for contralateral and ipsilateral HFA predictions.

To assess similarity in tuning across the two arms, we computed the SSEs for average HFA predictions to the same target between the contralateral and ipsilateral arms. This calculation was computed for each electrode as follows:

SSEe=∑i=1n(contrai−ip sii)2

where contra and ipsi are average HFA predictions for a given target location reached with either the contralateral or ipsilateral arm. Note that for this calculation n is limited to the two positions that served as target locations for both arms.

This metric was only calculated for the two central targets, the targets common to both arms (the two eccentric target locations varied depending on the arm used). These values were scaled from 0 to 1 based on the minimum and maximum values of SSE across all electrodes. SSE represents a metric of dissimilarity; to calculate a similarity index (SI), we subtracted the scaled SSE values from 1:

SI=1-SSEe-min SSEemaxSSEe-minSSEe

Thus, higher SI represents more similar average predictions.

Separating instruction and movement phases

Request a detailed protocol

The encoding model was run to predict the full HFA time course. To compare model prediction performance during different phases of the task, the data were epoched into instruction and movement phases, using event markers recorded in the analog channel (i.e., cue onset and movement onset). Epochs of the same task phase were concatenated together, and prediction performance was operationalized as the square of the Pearson’s correlation between the predicted and actual HFA for each task phase.

Permutation-based linear mixed-effects model

Request a detailed protocol

Linear mixed-effects models were carried out in RStudio using software packages lme4 and permlmer (Bates et al., 2014; Lee and Braun, 2012). Each mixed-effects model used participant as a random effect and experimental variables (e.g., reaching arm, hemisphere) as fixed effects. The models were used to predict performance from the kinematic encoding model for all predictive electrodes. Nested models were created to assess the effect of the fixed factors, with the null model using patient as a random effect to predict encoding values. For the nesting, fixed factors were added to the model to assess if each new factor improved prediction above that obtained with the null model using a permutation-based method (Anderson and Braak, 2003, Lee and Braun, 2012). Interactions were tested by comparing a model in which the fixed effects were restricted to have additive effects to a model that could have both multiplicative and additive effects.

Assessing the contribution of kinematic features in the encoding model

Request a detailed protocol

Average weights for each patient were calculated for all predictive electrodes for each kinematic feature. Because each feature has 400 time lags, there are 400 weights per feature in the full model. To assess the relative contribution of each feature, we calculated the sum of the weights across time lags after taking the absolute value of each weight (since negative weights are as informative as positive weights). The sum of each feature was then plotted as a proportion against the total sum of all weights (after taking the absolute value) to assess the relative contribution. To capture the temporal profile of the weights, the average was taken for all predictive electrodes for all patents.

Assessing explainable variance in the encoding model

Request a detailed protocol

There are several methods to assess prediction performance for encoding models (Lage-Castellanos et al., 2019; Nunez-Elizalde et al., 2019; Schoppe et al., 2016). A drawback with the Pearson’s product-moment correlation coefficient is that it does not distinguish between explainable variability and response variability (Hsu et al., 2004). To better capture this distinction, we calculated CCnorm, a measure which normalizes by signal power (SP) to account for response variability (Schoppe et al., 2016):

CCnor m=Cov(y,y^)Var(y^)1SP

where y is neural activity and y^ are predictions from the model, and SP is:

SP=Var∑n=1NRn -∑n=1NVarRnNN-1

where Rn is the neural time series for the nth trial and N is the total number of trials.

We plot the density estimates of all predictive electrodes for both the Pearson’s correlation coefficient (CCabs) and CCnorm (see Figure 2—figure supplement 2). We find similar values for the two metrics, suggesting that the number of trials in our study and SP is sufficient for the encoding model to capture the majority of explainable variance. (Calculations of Pearson’s correlation coefficient were always taken from held-out trials.)

Calculating distance from dorsal central sulcus

Request a detailed protocol

For each patient, 30 discrete (x, y) coordinates were manually demarcated along the central sulcus on individual MRI scans. The 30 points were then interpolated to create a line traversing the central sulcus for each individual. The dorsal aspect of the central sulcus was defined as all points dorsal to the midpoint of the central sulcus. We then calculated the absolute distance between each electrode and the closest point on the dorsal aspect of the central sulcus (our interpolated line).

Data availability

De-identified ECoG data and task kinematics are available on Zenodo at https://doi.org/10.5281/zenodo.4761390. Code to run these data through the kinematic encoding model can be found at https://github.com/cmerrick15/Asymmetry_ECoG_dataset copy archived at swh:1:rev:25639ec88f6e0279c4925edea6b4927c082815f6.

The following data sets were generated

References

Decision letter

Decision letter after peer review:

Thank you for submitting your article "Left Hemisphere Dominance for Bilateral Kinematic Encoding in the Human Brain" for consideration by eLife. Your article has been reviewed by 3 peer reviewers, and the evaluation has been overseen by Andrew Pruszynski as the Reviewing Editor and Tirin Moore as the Senior Editor. The following individuals involved in review of your submission have agreed to reveal their identity: Stephan Swinnen (Reviewer #1); Atsushi Yokoi (Reviewer #2).

The reviewers have discussed their reviews with one another, and the Reviewing Editor has drafted this to help you prepare a revised submission.

Essential revisions:

1. Provide more details about the electrode positions and more specificity about the brain areas covered: asymmetries in number of electrodes in each hemisphere and their specific location, variability in electrode coverage, electrode coverage for each hemisphere group, subregions of premotor and parietal cortex being covered (if possible).

2. Importantly, clarify and address the impact of the variability in electrode placement on the statistical tests and ultimately on the conclusions being drawn.

3. Elaborate on the topic of bimanual control. Presently this topic is mentioned in the Discussion section but should be worked out in more detail. Some relevant references in this domain are proposed. In general, several relevant references as proposed in the reviews should be added and considered in more detail.

Reviewer #1 (Recommendations for the authors):

1. The authors refer to medical imaging research that has identified evidence for movement representations common to both upper limbs. In this respect, the authors may be interested in complementary fMRI research involving complex coordination skills performed with the left and right body side, pointing to the critical importance of shared activations in the left premotor-parietal complex for movements of the right and left body side. The findings of the latter study are consistent with the findings presented in the ECoG study in spite of the different imaging techniques. Nevertheless, in spite of the convergent findings, this fMRI study also points to additional candidate brain regions for shared movement representations by the left and right hand that cannot be revealed by ECoG (Swinnen et al., 2010).

2. It is a pity that a large amount of movement kinematic data was lost due to problems with the motion registration equipment in interaction with the patients. Nevertheless, the cross-validated kinematic encoding model is very helpful and provides a reasonable representation of these simple reaching movements.

3. Even though unimanual movements are studied, the participants are supposed to keep their finger on the resting switch for the nonmoving hand. Is it possible that this position serves a postural control function to support the movement of the contralateral arm that reaches for the target? If so, could this account for similarities in neural activity for controlling both hands?

4. Is it possible to provide more detailed information about the whole body position of the participants during performance of these reaching tasks. This information is interesting from the perspective of postural control mechanisms (via trunk and contralateral body side), as required for enabling these focal arm reaching movements.

5. In the Table on p. 4, remarkable differences in RT are evident among the 6 participants. Can the authors provide an explanation for the relatively long RTs in some of the patients? Can this still be considered normal behavior?

6. In the figure captions, all the (sub)graphs are explained in meticulous detail allowing the reader to understand the messages that the authors wish to convey. Overall, the manuscript is excellently written and directs the reader to the focal results in relation to the information provided in the figures.

7. On p. 12, it is stated that the poor generalization of some electrodes is generally due to the temporal divergence of the two arms during instruction, where the ipsilateral trace becomes inhibited compared to the contralateral trace. Do the authors refer to an active inhibition mechanism as evidenced from TMS research during movement preparation in which neural excitation is first suppressed and then followed by a phase in which the excitation level of the arm to the moved is increased while that for the nonmoving arm is further depressed prior to movement initiation (Duque and Ivry, 2009).

8. In the Discussion section, the authors reflect on research from bimanual movement control to identify potential accounts for the bilateral encoding architecture. However, the literature to which they refer leaves room for alternative interpretations. Perhaps, the authors may be interested in a neural model of bimanual control based on TMS interhemispheric connectivity research between PMd and M1 in which left PMd (and not right PMd) is hypothesized to be in charge of the division of labor assigned to the left and right hands during the preparation of bimanual movement (Fujiyama et al., 2016a,b). The latter bimanual work is generally consistent with the hemispheric asymmetry evidence provided in the present manuscript but also reflects on the specific function assigned to the left premotor cortex during bimanual control. This suggests potentially alternative reasons for the finding that electrodes that generalized well across arms were primarily located in premotor regions of the left hemisphere.

References:

Duque, J., Ivry, R.B. (2009) Role of corticospinal suppression during motor preparation. Cerebral Cortex, 19, 2013-2024.

Swinnen, S., Vangheluwe, S., Wagemans, J., Coxon, J., Goble, D., Van Impe, A., Sunaert, S., Peeters, R., Wenderoth, N. (2010). Shared neural resources between left and right interlimb coordination skills: The neural substrate of abstract motor representations. NeuroImage, 49 (3), 2570-2580.

Fujiyama, H., Van Soom, J., Rens, G., Gooijers, J., Leunissen, I., Levin, O., Swinnen, S. (2016a). Age-related changes in frontal network structural and functional connectivity in relation to bimanual movement control. Journal of Neuroscience, 36 (6), 1808-1822.

Fujiyama, H., Van Soom, J., Rens, G., Cuypers, K., Heise, K., Levin, O., Swinnen, S. (2016b). Performing two different actions simultaneously: the critical role of interhemispheric interactions during the preparation of bimanual movement. Cortex, 77, 141-154.

Reviewer #2 (Recommendations for the authors):

Personally, I feel the term 'bilateral kinematic encoding' (or 'bilateral encoding'), as it appears in the title or text, is slightly ambiguous, as the 'dominance' for 'bilateral kinematic encoding' can imply that both the contra- and ipsilateral encoding were stronger than the other hemisphere. However, the contralateral kinematic encoding was not explicitly tested in the current paper. It is entirely up to the authors, but I think 'ipsilateral kinematic encoding' would be less confusing than 'bilateral kinematic encoding.' The authors could otherwise compare the contralateral kinematic encoding between the hemispheres.

It was not clear from the text whether the electrodes were pooled over the three patients for each hemisphere group or the patients were still treated as a random effect. Please clarify this point. In either case, it would be informative to show the breakdown of these electrodes in terms of patients (e.g., page 5, line 25 "665" electrodes, page 7, line 11, "141", "75"). A summary table of the electrodes indicating the participants and regions they belong to would be very helpful for readers. As the co-registration process of electrodes on the reconstructed cortical surface indicated by Stolk et al. (2018) uses the freesurfer, it would be relatively easy to find in which of the freesurfer-defined regions, such as Destrieux Atlas (Destrieux et al., Neuroimage, 2010), each of the electrodes covered. Please consider.

Please consider using different colors or marker types for different patients for the scatter plots displayed in Figures 2-5, as this is more informative to readers.

A recent line of studies (Ariani and Diedrichsen, J Neurophysiol, 2019; Ariani et al., J Neurophysiol, 2020) emphasizes the significant contribution of online planning in the production of sequential movement. In this context, the even stronger bilateral shared encoding observed during the movement phase might partially reflect the online planning of return movements. As this return movement is always to the same starting position (target), higher similarity could be explained in part by this component. Please discuss.

Please specify the reason why the authors excluded the peripheral targets for the cross-arm generalization analysis. These targets could provide further insight into under which coordinate frame (i.e., extrinsic or intrinsic) the contra- and ipsilateral encoding overlapped (e.g., Wiestler et al., J Neurosci, 2014; Haar et al., J Neurosci, 2017).

Although up to the authors, it would be recommended to report "noise ceiling" for each electrode (e.g., Schoppe et al., Front Comput Neurosci, 2016). The noise ceiling would also help interpret whether poor prediction accuracy is due to the low SN ratio or the inappropriate model in the across-arm generalization test.

Figure 5B: It would be more informative also to show all other electrodes (or areas covered by each electrode grid, for instance, by colored rectangles) to indicate the coverage for each hemisphere group.

Similarly, displaying the simple ipsilateral encoding strength (shown in Figure 2) in the same format of Figure 5B (categorized by generalization index) would also be informative for comparing the shared and unshared ipsilateral encoding.

Schaffer et al. (2020) was not found in the reference list (Schaffer and Sainburg, 2021 was listed instead). Please list the proper reference.

Please report the age data of the participants in the Methods.

Please provide more details about the statistical analyses in the Methods.

Page 20, line 1: Please specify what the MD, n, i, and x indicate.

Page 20, line 5: Please specify what the SSEe, n, i, contrai, and ipsii, indicate.

Page 20, line 12: "min" is omitted before "(SSEe)" in the denominator.

Reviewer #3 (Recommendations for the authors):

1. I believe that the recording sites between hemispheres must be matched; this is the only way to ensure that the inter-hemispheric differences reported are not simply due to the intra-hemispheric differences reported in Supplementary Figures 1-2.

2. I'm a bit confused as to why the landmark used in Supplementary Figures 1-2 is the dorsal aspect of the central sulcus. I might expect that premotor electrodes would generalize better (and exhibit more bilateral encoding) than M1 electrodes, but your analysis seems to make the argument that face M1 electrodes also generalize better than arm M1 electrodes. Could you provide a bit more interpretation of this empirical result?

3. I don't quite get the relevance of Churchland 2012 results to the trace in Figure 5C. Churchland et al. used only outward reaches in the 2012 study, whereas your subjects are performing out-and-back movements. The trace in Figure 5C is more similar to the trigger signal reported in Kaufman, et al. In fact, in monkeys making movement sequences (comparable to your out-and-back movements), Zimnik and Churchland (2021) found a biphasic trigger signal that looks pretty similar to the trace shown in 5C. To that end, it might be useful to plot the across-subject hand speeds in 5C. If the ECoG signal plotted is related to the trigger signal, then it should have a time-course similar to the subjects' hand speed.

4. Related to 5C, wouldn't it make more sense to plot the actual HFA amplitude, rather than the predicted HFA amplitude? I understand that the two will likely be very similar, but 5C is making a point about the true neural activity.

[Editors' note: further revisions were suggested prior to acceptance, as described below.]

Thank you for resubmitting your work entitled "Left Hemisphere Dominance for Bilateral Kinematic Encoding in the Human Brain" for further consideration by eLife. Your revised article has been evaluated by Tirin Moore as the Senior Editor, a Reviewing Editor, and the original reviewers.

The manuscript has been improved but there are some remaining issues that need to be addressed, as outlined below:

1. All reviewers were very happy with the revisions and think the paper is strong. Please see the remaining comments of Reviewer #2 especially with respect to statistical support for some of the claims.

Reviewer #1 (Recommendations for the authors):

The authors have made a profound and detailed attempt to comply with the questions raised by the reviewers. Accordingly, as far as I am concerned, the paper is acceptable for publication in eLife.

This is important work in which data is obtained from a unique set of patients to reveal the control of ipsilateral and contralateral arm movement in a very detailed manner. It complements previous work collected from nonhuman primates.

Reviewer #2 (Recommendations for the authors):

The authors adequately addressed most of my previous concerns. I have one further recommendation and a comment related to the modification.

The authors need some statistical support for their claims regarding (i) hemispheric equality in regional distribution of electrodes (lines 226-228) and (ii) hemispheric difference in the number of electrodes with good/poor across-arm generalization (lines 412-414, 439-441, and 590-597).

(i) Hemispheric equality in regional distribution of electrodes (lines 226-228):

"When the categorization data were pooled across the three left hemisphere and three right hemisphere patients, the proportion of electrodes was similar in premotor, sensorimotor motor, and parietal regions." (Lines 226-228)

This can be tested by using, for example, multinomial goodness-of-fit tests using expected frequency for each region estimated from the data from either hemisphere. Reporting the number or proportion (%) for these three regions in the main text, in addition to the bar graphs, would also be helpful.

(ii) Hemispheric difference in number of electrodes with good/poor across-arm generalization (lines 412-414, 439-441, and 590-597):

"This categorization scheme revealed a striking anatomical division, with electrodes showing good across-arm generalization clustering in the left premotor and superior parietal regions and electrodes that generalized poorly clustering in left and right M1. This result does not appear to reflect a sampling bias. There are more left hemisphere electrodes compared to right hemisphere electrodes because two of the left hemisphere patients had high density grid implants. However, the electrodes in our left and right hemisphere samples were similarly distributed over premotor, sensorimotor and parietal regions (see Supplementary Figure 2)." (Lines 590-597)

The fact that the electrodes in the left and right hemispheres have similar distribution over these regions does not automatically protect from the risk of finding more electrodes in the left hemisphere due to the hemispheric bias in electrode number, and need formal statistical tests. Similarly to the first point above, this can be tested by using goodness-of-fit tests (e.g., chi-squared test, likelihood-ratio G test, etc.) using the expected number of electrodes that should be found in the same region in the other hemisphere under the null-hypothesis of hemispheric symmetry (e.g., if 20 electrodes are found in the left hemisphere, 74*20/141 electrodes should also be found in the right).

Reviewer #3 (Recommendations for the authors):

Merrick et al. were admirably responsive to all reviewer comments, and the manuscript has been greatly improved as a result. I have no further critiques.

https://doi.org/10.7554/eLife.69977.sa1

Author response

Essential revisions:

1. Provide more details about the electrode positions and more specificity about the brain areas covered: asymmetries in number of electrodes in each hemisphere and their specific location, variability in electrode coverage, electrode coverage for each hemisphere group, subregions of premotor and parietal cortex being covered (if possible).

We categorized the electrode positions for all six patients using the Desikan-Killiany atlas and calculated the proportion of electrodes that were centered over subregions within premotor, sensorimotor and parietal regions. While there are more electrodes in left hemisphere compared to the right hemisphere (left 141; right 75), the proportions of electrodes in these areas is comparable. We have added Supplementary Figure 2. This analysis is also addressed in the Results section (page 8, lines: 200-227).

2. Importantly, clarify and address the impact of the variability in electrode placement on the statistical tests and ultimately on the conclusions being drawn.

Given that there is comparable regional electrode coverage in the left and right hemisphere across patients, it is unlikely that the hemispheric differences are confounded by regional differences; as such, we do not think it essential to include subregion as a factor in our model. We also note that not all of the patients have electrodes over each subregion and thus, adding subregion as a fixed factor would reduce power. For these reasons, we focus on continuous measures such as the distance from the central sulcus rather than categorial measures, allowing us to include all task-relevant electrodes in these analyses. We also think this approach is more precise because the values are based on individual MR scans instead of parcellations that would be derived with respect to a reference MNI brain and then fit to each individual scan.

As suggested by Reviewer 2, we agree that it is important to control for patient variability in our statistical tests. We now use a permutation-based mixed effects model which has fixed effects comprising our experimental factors (hemisphere, reaching arm, task-phase, generalization – depending on the specific statistical test) and a random effect of patient. This allows us to address the nested structure of our dataset (electrodes are nested within patient) and provides a way to consider the effect of patient variability. Including patient as a random effect did not change any of the results. We have revised the Results section to report these tests. We have also updated Figures 2-4, using color to indicate the electrodes for each patient, allowing the reader to readily see the variation across patients. We appreciate the prod from Reviewer # 2, with the changes adding more transparency about variability across patients, both in terms of the statistical tests and figures.

3. Elaborate on the topic of bimanual control. Presently this topic is mentioned in the Discussion section but should be worked out in more detail. Some relevant references in this domain are proposed. In general, several relevant references as proposed in the reviews should be added and considered in more detail.

Based on feedback from all three reviewers we have updated the Discussion section on the issue of bimanual control. We detail these changes in the responses below to the comments of the reviewers.

Reviewer #1 (Recommendations for the authors):

1. The authors refer to medical imaging research that has identified evidence for movement representations common to both upper limbs. In this respect, the authors may be interested in complementary fMRI research involving complex coordination skills performed with the left and right body side, pointing to the critical importance of shared activations in the left premotor-parietal complex for movements of the right and left body side. The findings of the latter study are consistent with the findings presented in the ECoG study in spite of the different imaging techniques. Nevertheless, in spite of the convergent findings, this fMRI study also points to additional candidate brain regions for shared movement representations by the left and right hand that cannot be revealed by ECoG (Swinnen et al., 2010).

This is a great point given that ECoG provides a restricted view of the brain, one that is clinically determined. We believe that our addition to the text addresses this issue (page 19, lines: 647-652).

2. It is a pity that a large amount of movement kinematic data was lost due to problems with the motion registration equipment in interaction with the patients. Nevertheless, the cross-validated kinematic encoding model is very helpful and provides a reasonable representation of these simple reaching movements.

3. Even though unimanual movements are studied, the participants are supposed to keep their finger on the resting switch for the non-moving hand. Is it possible that this position serves a postural control function to support the movement of the contralateral arm that reaches for the target? If so, could this account for similarities in neural activity for controlling both hands?

We have added a paragraph to the Discussion to address the possibility that some aspect of ipsilateral encoding may be related to postural stabilization (page 20-21, lines: 685-703).

4. Is it possible to provide more detailed information about the whole body position of the participants during performance of these reaching tasks. This information is interesting from the perspective of postural control mechanisms (via trunk and contralateral body side), as required for enabling these focal arm reaching movements.

The participants were tested in their hospital bed, with the bed positioned so that the patient was in upright, “seated” position (legs extended). We did not record EMG from potential postural muscles and thus cannot examine the postural question in a quantitative manner. As such, we have opted to note this limitation in the Discussion where we discuss the postural hypothesis (page 20, lines: 693-695). This would be a good issue to tackle directly in future studies.

5. In the Table on p. 4, remarkable differences in RT are evident among the 6 participants. Can the authors provide an explanation for the relatively long RTs in some of the patients? Can this still be considered normal behavior?

The Reviewer is correct in noting the large between-participant variability in RT. This is likely a consequence of the task instructions: We did not emphasize speed, letting the patients work at their own pace and putting the emphasis on accuracy. The only constraint was that the message “Too Slow” appeared if the participant did not initiate the movement within 2.5 s. This was really there in case the patient’s attention lapsed (and rarely happened). Our experience is that RT demands should be minimized with ECoG patients given their clinical state. We also had our plan to fit the kinematics on an individual basis and did not anticipate wanting to average signals across patients. For this reason, we did not see RT variability as a major concern. We have modified the text in the results to note that participants were instructed to move at their own pace and focus on accuracy (page 4, lines: 141-143).

6. In the figure captions, all the (sub)graphs are explained in meticulous detail allowing the reader to understand the messages that the authors wish to convey. Overall, the manuscript is excellently written and directs the reader to the focal results in relation to the information provided in the figures.

7. On p. 12, it is stated that the poor generalization of some electrodes is generally due to the temporal divergence of the two arms during instruction, where the ipsilateral trace becomes inhibited compared to the contralateral trace. Do the authors refer to an active inhibition mechanism as evidenced from TMS research during movement preparation in which neural excitation is first suppressed and then followed by a phase in which the excitation level of the arm to the moved is increased while that for the non-moving arm is further depressed prior to movement initiation (Duque and Ivry, 2009).

This is a very interesting point and something that we had discussed but opted to not include in the original submission. Inspired by the comment, we have now added text to the Discussion to discuss this possible mechanism of inhibition (page 18, lines 598-604).

8. In the Discussion section, the authors reflect on research from bimanual movement control to identify potential accounts for the bilateral encoding architecture. However, the literature to which they refer leaves room for alternative interpretations. Perhaps, the authors may be interested in a neural model of bimanual control based on TMS interhemispheric connectivity research between PMd and M1 in which left PMd (and not right PMd) is hypothesized to be in charge of the division of labor assigned to the left and right hands during the preparation of bimanual movement (Fujiyama et al., 2016a,b). The latter bimanual work is generally consistent with the hemispheric asymmetry evidence provided in the present manuscript but also reflects on the specific function assigned to the left premotor cortex during bimanual control. This suggests potentially alternative reasons for the finding that electrodes that generalized well across arms were primarily located in premotor regions of the left hemisphere.

Thanks for pointing out this relevant reference for our discussion on bimanual control. The text has been updated in the Discussion section (page 21, lines 704-707).

Reviewer #2 (Recommendations for the authors):

Personally, I feel the term 'bilateral kinematic encoding' (or 'bilateral encoding'), as it appears in the title or text, is slightly ambiguous, as the 'dominance' for 'bilateral kinematic encoding' can imply that both the contra- and ipsilateral encoding were stronger than the other hemisphere. However, the contralateral kinematic encoding was not explicitly tested in the current paper. It is entirely up to the authors, but I think 'ipsilateral kinematic encoding' would be less confusing than 'bilateral kinematic encoding.' The authors could otherwise compare the contralateral kinematic encoding between the hemispheres.

We choose the term bilateral instead of ipsilateral because we wanted to emphasize the fact that the left hemisphere appears to be encoding movements produced by both the ipsilateral and contralateral arm.

It was not clear from the text whether the electrodes were pooled over the three patients for each hemisphere group or the patients were still treated as a random effect. Please clarify this point. In either case, it would be informative to show the breakdown of these electrodes in terms of patients (e.g., page 5, line 25 "665" electrodes, page 7, line 11, "141", "75"). A summary table of the electrodes indicating the participants and regions they belong to would be very helpful for readers. As the co-registration process of electrodes on the reconstructed cortical surface indicated by Stolk et al. (2018) uses the freesurfer, it would be relatively easy to find in which of the freesurfer-defined regions, such as Destrieux Atlas (Destrieux et al., Neuroimage, 2010), each of the electrodes covered. Please consider.

Please see our response to Essential Revisions #1 above where we discuss at length the issue of electrode variability and how we had addressed this in the revised manuscript. In brief, we now treat participant as a random effect in the linear mixed effects model. We have also added a new supplementary, S2, which has a summary of electrode locations classified by regions using the Desikan-Killiany Atlas. While the Destrieux Altas has more parcellations, many are within the sulci and thus are not well reflected in activity of the ECoG grids; as such, the Desikan-Killiany Atlas provides similar information and is easier to visualize given it contains fewer parcellations.

Please consider using different colors or marker types for different patients for the scatter plots displayed in Figures 2-5, as this is more informative to readers.

Thanks for the suggestion. Figures 2-5 now use different colors for each participant.

A recent line of studies (Ariani and Diedrichsen, J Neurophysiol, 2019; Ariani et al., J Neurophysiol, 2020) emphasizes the significant contribution of online planning in the production of sequential movement. In this context, the even stronger bilateral shared encoding observed during the movement phase might partially reflect the online planning of return movements. As this return movement is always to the same starting position (target), higher similarity could be explained in part by this component. Please discuss.

This is an interesting idea and we now address this in the Discussion (Page 20, lines 674-684).

Please specify the reason why the authors excluded the peripheral targets for the cross-arm generalization analysis. These targets could provide further insight into under which coordinate frame (i.e., extrinsic or intrinsic) the contra- and ipsilateral encoding overlapped (e.g., Wiestler et al., J Neurosci, 2014; Haar et al., J Neurosci, 2017).

Only the two center targets (2,4) were common to the left and right arm conditions. The two peripheral targets (1,3) were in different locations and thus do not make a good comparison. We opted to prioritize the number of trials per target at a cost of having a larger target space given the limited testing time for each participant.

Although up to the authors, it would be recommended to report "noise ceiling" for each electrode (e.g., Schoppe et al., Front Comput Neurosci, 2016). The noise ceiling would also help interpret whether poor prediction accuracy is due to the low SN ratio or the inappropriate model in the across-arm generalization test.

We have added a new Supplemental Figure, S3, to show the calculations for CCnorm (recommended by Schoppe et al., 2016) alongside our primary encoding metric (CCabs; average held-out correlation between the actual HFB and the predictions based on the model). CCnorm is normalized by signal power whereas our primary metric – Pearson’s product-moment correlation coefficient is not. We find that CCnorm does not drastically differ from CCabs, suggesting that we have sufficient trials and signal power in our dataset such that the encoding model does a good job of capturing the majority of explainable variance. The text has been updated in the Method section (Page 26-27, lines 956-972).

With respect to our interpretation of electrodes that fail to generalize, we have also added a new panel to Figure 5 (Figure 5B) which is discussed in more detail in the next comment.

Figure 5B: It would be more informative also to show all other electrodes (or areas covered by each electrode grid, for instance, by colored rectangles) to indicate the coverage for each hemisphere group.

Similarly, displaying the simple ipsilateral encoding strength (shown in Figure 2) in the same format of Figure 5B (categorized by generalization index) would also be informative for comparing the shared and unshared ipsilateral encoding.

We have added an outline to the figure 5D (which used to be 5B in the previous version) to detail the extent of coverage across participants in each hemisphere. We considered outlining the coverage for each patient individually, but thought it made the figure too busy.

We have added a new panel to Figure 5 (5B in revised figure) to summarize ipsilateral encoding strength for electrodes that generalize well and electrodes that generalize poorly. As can be seen in the figure, ipsilateral encoding strength is lower for electrodes that generalize poorly, a point evident in Figure 5C (ipsilateral signals have lower amplitude).

Beyond the difference in ipsilateral encoding, in Figure 5C we can examine the temporal structure of the two signals. For electrodes that generalize poorly there is a divergence in temporal structure prior to movement onset, captured by the negative correlation between the HFA signal encoding ipsilateral or contralateral movements. Thus, electrodes that generalize poorly have lower ipsilateral signal strength and differ in terms of the temporal pattern for ipsilateral and contralateral movement.

We have revised the text and Figure 5 to clarify our arguments on this issue (pages 12-14, Results section: Temporal and spatial topography of across-arm generalization). This led us to switch the order so that we now first discuss the temporal relationship and then the spatial relationship.

Schaffer et al. (2020) was not found in the reference list (Schaffer and Sainburg, 2021 was listed instead). Please list the proper reference.

Thank you – we have updated the reference list.

Please report the age data of the participants in the Methods.

Patient ages have been added to Table 1.

Please provide more details about the statistical analyses in the Methods.

Page 20, line 1: Please specify what the MD, n, i, and x indicate.

Page 20, line 5: Please specify what the SSEe, n, i, contrai, and ipsii, indicate.

Page 20, line 12: "min" is omitted before "(SSEe)" in the denominator.

We have clarified variable names and indices and provided more details about our statistical analyses in the Methods section.

Reviewer #3 (Recommendations for the authors):

1. As stated above, I believe that the recording sites between hemispheres must be matched; this is the only way to ensure that the inter-hemispheric differences reported are not simply due to the intra-hemispheric differences reported in Supplementary Figures 1-2.

We agree: Please see our response to Essential Revisions #1 above where we discuss at length the issue of electrode variability and how we had addressed this in the revised manuscript. In brief, we have added a new figure (S2), quantifying the number of electrodes in each subregion.

2. I'm a bit confused as to why the landmark used in Supplementary Figures 1-2 is the dorsal aspect of the central sulcus. I might expect that premotor electrodes would generalize better (and exhibit more bilateral encoding) than M1 electrodes, but your analysis seems to make the argument that face M1 electrodes also generalize better than arm M1 electrodes. Could you provide a bit more interpretation of this empirical result?

Part of the motivation here was empirical: We observed that only electrodes located close to the arm area of motor cortex failed to generalize across arms. A post-hoc explanation would be that electrodes over motor cortex are more closely tied to actual arm movement. However, we recognize that other areas (including within M1) might be encoding information about the contralateral arm, even if that information is more abstract (e.g., about the movement goal). Indeed, signals from microelectrode arrays in the human hand knob have been shown to be related to movements performed by the face, head, arm and leg (Willet et al., 2019), suggesting (yet again) the need to reconsider the notion of the motor homunculus. Similarly, we see encoding (strong levels of prediction performance) in other areas of M1 that are likely distant from the arm area of M1. For example, in more ventral aspects (corresponding to face area in the conventional maps), we see more similar encoding across the two arms suggesting that this information is more abstract.

3. I don't quite get the relevance of Churchland 2012 results to the trace in Figure 5C. Churchland et al. used only outward reaches in the 2012 study, whereas your subjects are performing out-and-back movements. The trace in Figure 5C is more similar to the trigger signal reported in Kaufman, et al. In fact, in monkeys making movement sequences (comparable to your out-and-back movements), Zimnik and Churchland (2021) found a biphasic trigger signal that looks pretty similar to the trace shown in 5C. To that end, it might be useful to plot the across-subject hand speeds in 5C. If the ECoG signal plotted is related to the trigger signal, then it should have a time-course similar to the subjects' hand speed.

Upon reflection, we agree that this reference was inappropriate. We have revised the Results section by citing two papers that are more relevant, Kaufman et al. (2016) and Zimnik and Churchland (2021). In addition, we have added a new section and figure (Figure 7) to the Results section to address whether the HFA is related to the condition-invariant trigger signal. Specifically, Figure 7 compares HFA to averaged kinematic activity for electrodes that generalize well or poorly. Two results stand out from this figure, the first is that for electrodes that generalize poorly (primarily located over M1), the HFA signal resembles speed, suggesting that this activity is related to the condition-invariant trigger signal. We find this relationship for both contralateral and ipsilateral reaches, despite the decreased amplitude of the HFA during ipsilateral movements. Second, for electrodes that generalize well we find that the HFA most closely resembles position. We note that the kinematics lag behind HFA by approximately ~200 ms for both speed and position, in line with Kaufman et al., (2016, see their Figure 6). This new section and figure are discussed in the Results section (page 16 lines: 523-537).

4. Related to 5C, wouldn't it make more sense to plot the actual HFA amplitude, rather than the predicted HFA amplitude? I understand that the two will likely be very similar, but 5C is making a point about the true neural activity.

Thanks for pointing this out. We have changed these panel from predictions to actual HFA amplitude. As the reviewer predicted, the two look quite similar but we agree it makes more sense to plot HFA given our aim is to interpret neural signals.

[Editors' note: further revisions were suggested prior to acceptance, as described below.]

The manuscript has been improved but there are some remaining issues that need to be addressed, as outlined below:

1. All reviewers were very happy with the revisions and think the paper is strong. Please see the remaining comments of Reviewer #2 especially with respect to statistical support for some of the claims.

Reviewer #2 (Recommendations for the authors):

The authors adequately addressed most of my previous concerns. I have one further recommendation and a comment related to the modification.

The authors need some statistical support for their claims regarding (i) hemispheric equality in regional distribution of electrodes (lines 226-228) and (ii) hemispheric difference in the number of electrodes with good/poor across-arm generalization (lines 412-414, 439-441, and 590-597).

(i) Hemispheric equality in regional distribution of electrodes (lines 226-228):

"When the categorization data were pooled across the three left hemisphere and three right hemisphere patients, the proportion of electrodes was similar in premotor, sensorimotor motor, and parietal regions." (Lines 226-228)

This can be tested by using, for example, multinomial goodness-of-fit tests using expected frequency for each region estimated from the data from either hemisphere. Reporting the number or proportion (%) for these three regions in the main text, in addition to the bar graphs, would also be helpful.

We now report a chi-squared goodness of fit test, assessing if the proportion of electrodes across the eight parcellations were different for the left and right hemisphere patients. We have added the following text to the paper:

‘When the categorization data were pooled for the three left hemisphere and the three right hemisphere patients, the proportion of electrodes was similar across the eight parcellations that encompass premotor, sensorimotor motor, and parietal regions [averages: premotorright= 11% ,premotorleft=10%,sensorimotorright  = 17%, sensorimotorright=16%,parietalright=5 %,parietalleft=3%;(7) = 0.057, p =.999; Figure 2—figure supplement 1].’

(ii) Hemispheric difference in number of electrodes with good/poor across-arm generalization (lines 412-414, 439-441, and 590-597):

"This categorization scheme revealed a striking anatomical division, with electrodes showing good across-arm generalization clustering in the left premotor and superior parietal regions and electrodes that generalized poorly clustering in left and right M1. This result does not appear to reflect a sampling bias. There are more left hemisphere electrodes compared to right hemisphere electrodes because two of the left hemisphere patients had high density grid implants. However, the electrodes in our left and right hemisphere samples were similarly distributed over premotor, sensorimotor and parietal regions (see Supplementary Figure 2)." (Lines 590-597)

The fact that the electrodes in the left and right hemispheres have similar distribution over these regions does not automatically protect from the risk of finding more electrodes in the left hemisphere due to the hemispheric bias in electrode number, and need formal statistical tests. Similarly to the first point above, this can be tested by using goodness-of-fit tests (e.g., chi-squared test, likelihood-ratio G test, etc.) using the expected number of electrodes that should be found in the same region in the other hemisphere under the null-hypothesis of hemispheric symmetry (e.g., if 20 electrodes are found in the left hemisphere, 74*20/141 electrodes should also be found in the right).

Similar to above, we performed a chi-squared goodness of fit test to assess if the left and right hemispheres have similar number of electrodes that generalize well and generalize poorly. We have added the following to the paper:

‘We next examined the relationship between generalization, hemisphere and spatial position on the cortical surface. […] In contrast, electrodes showing poor generalization were observed in both hemispheres (proportion of electrodes that generalize poorly: L1 = 21%, L2 = 5%, L3 = 6%, R1 = 14%, R2 = 15%, R3 = 37%; χ2(2) = 0.400, p=.818).’

https://doi.org/10.7554/eLife.69977.sa2

Article and author information

Author details

  1. Jack Lin

    Department of Neurology, University of California at Irvine, Irvine, United States
    Contribution
    Resources
    Competing interests
    No competing interests declared

  2. David King-Stephens

    Department of Neurology and Neurosurgery, California Pacific Medical Center, San Francisco, United States
    Contribution
    Resources
    Competing interests
    No competing interests declared

  3. Kenneth D Laxer

    Department of Neurology and Neurosurgery, California Pacific Medical Center, San Francisco, United States
    Contribution
    Resources
    Competing interests
    No competing interests declared

  4. Peter B Weber

    Department of Neurology and Neurosurgery, California Pacific Medical Center, San Francisco, United States
    Contribution
    Resources
    Competing interests
    No competing interests declared

  5. Jose Carmena

    1. UC Berkeley – UCSF Graduate Program in Bioengineering, University of California, Berkeley, Berkeley, United States
    2. Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, Berkeley, United States
    3. Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, United States
    Contribution
    Conceptualization, Funding acquisition, Methodology, Supervision
    Competing interests
    No competing interests declared

  6. Robert Thomas Knight

    1. Department of Psychology, University of California, Berkeley, Berkeley, United States
    2. UC Berkeley – UCSF Graduate Program in Bioengineering, University of California, Berkeley, Berkeley, United States
    3. Department of Neurological Surgery, University of California San Francisco, San Francisco, San Francisco, United States
    4. Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, United States
    Contribution
    Conceptualization, Funding acquisition, Supervision, Writing - review and editing
    Competing interests
    No competing interests declared
    Which task would be relatively dominant in the left hemisphere?
    "This ORCID iD identifies the author of this article:" 0000-0001-8686-1685

  7. Richard B Ivry

    1. Department of Psychology, University of California, Berkeley, Berkeley, United States
    2. UC Berkeley – UCSF Graduate Program in Bioengineering, University of California, Berkeley, Berkeley, United States
    3. Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, United States
    Contribution
    Conceptualization, Funding acquisition, Methodology, Supervision, Writing - review and editing
    Competing interests
    Senior editor, eLife
    Which task would be relatively dominant in the left hemisphere?
    "This ORCID iD identifies the author of this article:" 0000-0003-4728-5130

Funding

National Institutes of Health (NS097480)

  • Robert Thomas Knight
  • Richard B Ivry
  • Jose Carmena

The funders had no role in study design, data collection, and interpretation, or the decision to submit the work for publication.

Acknowledgements

We want to thank Anwar Nunez-Elizalde for his invaluable guidance building the encoding model, Ian Greenhouse for building the first prototype rig to bring into the ICU and William Liberti for his advice with the figures. This research was supported by the National Institutes of Health: NS097480.

Ethics

Intracranial recordings were obtained from six patients implanted with subdural grids as part of their treatment for intractable epilepsy. Data were recorded at three hospitals: University of California, Irvine (UCI) Medical Center, University of California, San Francisco (UCSF) Medical Center, and California Pacific Medical Center (CPMC), San Francisco. Electrode placement was solely determined based on clinical considerations. All procedures were approved by the Institutional Review Board at every site as well as by the Committee for Protection of Human Subjects the University of California, Berkeley (protocol number: 2010-02-783) and conducted in accordance with the Declaration of Helsinki. All patients provided informed consent prior to participating in the study.

Senior Editor

  1. Tirin Moore, Stanford University, United States

Reviewing Editor

  1. J Andrew Pruszynski, Western University, Canada

Reviewers

  1. Stephan Swinnen
  2. Atsushi Yokoi, Western University, Japan

Publication history

  1. Preprint posted: May 2, 2021 (view preprint)
  2. Received: May 3, 2021
  3. Accepted: January 19, 2022
  4. Version of Record published: March 1, 2022 (version 1)

Copyright

© 2022, Merrick et al.

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 657 Page views
  • 103 Downloads
  • 1 Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Christina M Merrick
  2. Tanner C Dixon
  3. Assaf Breska
  4. Jack Lin
  5. Edward F Chang
  6. David King-Stephens
  7. Kenneth D Laxer
  8. Peter B Weber
  9. Jose Carmena
  10. Robert Thomas Knight
  11. Richard B Ivry

(2022)

Left hemisphere dominance for bilateral kinematic encoding in the human brain

eLife 11:e69977.

https://doi.org/10.7554/eLife.69977

What are the tasks of the left hemisphere?

The left brain handles reading, writing, and calculations. Some call it the logical side of the brain. The right brain is more visual and deals in images more than words. It processes information in an intuitive and simultaneous manner.

In what tasks is the left hemisphere superior?

function in human intelligence … and others found that the left hemisphere is superior in analytical tasks, such as are involved in the use of language, while the right hemisphere is superior in many forms of visual and spatial tasks.

Which task is the left hemisphere of the brain associated?

In general, the left hemisphere is specialized for processing language and producing speech, carrying out sequential processing of information, focusing attention, and inhibiting negative emotions.

What does the left hemisphere of the brain control quizlet?

The left hemisphere of the brain controls the right side of the body. The parietal lobe is the portion of the cerebral cortex located below the temporal lobe. At the corpus callosum, - occurs between the two hemispheres.