By embedding autistic individuals in live non-verbal interactions, we found that individuals with autism struggled to assign meanings to signals based on the unique communicative context established through past interaction with their partners.