Biased competition in semantic representations across the human brain during category-based visual search

Abstract

Humans can perceive thousands of distinct object and action categories in the visual scene and successfully divide their attention among multiple target categories. It has been shown that object and action categories are represented in a continuous semantic map across the cortical surface and attending to a specific category causes broad shifts in voxel-wise semantic tuning profiles to enhance the representation of the target category. However, the effects of divided attention to multiple categories on semantic representation remain unclear. In line with predictions of the biased-competition model, recent evidence suggests that brain response to two objects presented simultaneously can be described as a weighted average of the responses to individual objects presented in isolation, and that attention biases these weights in favor of the target object. We question whether this biased-competition hypothesis can also account for attentional modulation of semantic representations. To address this question, we recorded participants’ BOLD responses while they performed category-based search in natural movies that contained 831 distinct objects and actions. Three different tasks were used: search for “humans”, search for “vehicles”, and search for “both humans and vehicles” (i.e. divided attention). Voxel-wise category models were fit separately under each task, and voxel-wise semantic tuning profiles were then obtained using a principal components analysis on the model weights. Semantic tuning profiles were compared across the single-target tasks and the divided-attention task. We find that in higher visual cortex a substantial portion of semantic tuning during divided attention can be expressed as a weighted average of the tuning profiles during attention to single targets. We also find that semantic tuning in categoryselective regions is biased towards the preferred object category. Overall, these results suggest that the biased-competition theory accounts for attentional modulation of semantic representations during natural visual search.