A Vision Toward Energy-Efficient Domain-Specific Artificial Intelligence Models and Agents

The field of artificial intelligence (AI) has taken a tight hold on broad aspects of society, industry, business, and governance in ways that dictate the prosperity and might of the world's economies.

The AI market size is projected to grow from {\$}189 billion in 2023 to {\$}4.8 trillion by 2033.

Currently, AI is dominated by large language models (LLMs) that exhibit linguistic and visual intelligence.

However, training these models requires a massive amount of data scraped from the web as well as large amounts of energy (50-60 GWh to train GPT-4).

Despite these costs, these models often hallucinate, a characteristic that prevents them from being deployed in critical application domains.

In contrast, the human brain consumes only 20W of power.

What is needed is the next level of AI evolution in which lightweight domain-specific multimodal models, especially compact models with 10--20B parameters for bounded domains, with higher levels of intelligence can reason, plan, and make decisions in dynamic environments with real-time data and prior knowledge, while learning continuously and evolving in ways that enhance future decision-making capability.

This will define the next wave of AI, progressing from today's large models, trained with vast amounts of data, to nimble energy-efficient domain-specific agents that can reason and think in a world full of uncertainty.

To support such agents, hardware will need to be reimagined to allow system-level energy efficiencies $\geq {1000X}$ over the state of the art for targeted domain tasks, subject to accuracy, latency, and coverage constraints.

Such a vision of future AI systems is developed in this work.