While recent theoretical debates have foregrounded sociomaterial studies and the interpenetration between the social and the material, practice-based studies have neglected, if not omitted, the place of affect and ideology in work practice. The use of the notion of materiality causes a conflation of different ontological claims, and a conceptual clarification is needed to grasp the polysemy of materiality. This paper provides some key notions for those interested in addressing the materiality of the affective register at work. By drawing on authors such as Lacan, Althusser, Butler and the Essex Lacanian School, this paper suggests that much is to be gained by addressing two difficult but crucial notions: the materiality of the signifier and ideological fantasy.