ToDMA: Large Model-Driven Massive Token Communications for Semantic Multiple Access

Token communications (TokenCom) is an emerging generative semantic communication paradigm, where tokens serve as compact representation units across modalities.

Their contextual dependencies can be exploited by pretrained large models for semantic recovery.

In this paper, we propose token-domain multiple access (ToDMA), a large-model-driven semantic multiple access scheme for massive token communications.

ToDMA integrates unsourced random access with context-aware token processing.

It enables massive uncoordinated devices to transmit tokenized source representations over common uplink resources.

Specifically, each token index is associated with a shared modulation codeword, exposing token-level structure to the receiver for context-aware recovery.

At the receiver, compressed sensing is first employed to jointly detect active tokens and estimate their corresponding channel state information (CSI) from the superposed signals.

The source token sequences are then reconstructed by exploiting the consistency of token-associated CSI across multiple token positions.

In the presence of token collisions, some active tokens may remain unassigned, leading to missing entries in the reconstructed token sequences.

To recover these tokens, candidate-restricted masked-token prediction is performed using pretrained contextual models, thereby leveraging token-level context to mitigate collision effects.

Simulation results on both image and text transmission tasks demonstrate that ToDMA reduces access latency while maintaining favorable token recovery and semantic reconstruction quality, showing its scalability for semantic multiple access.