Retrain small open-source language models for long-horizon agentic workloads and sell efficient inference and on-device deployments

Problem: Existing AI tooling was built primarily for chatbots rather than agentic systems that must reason over long contexts and complete complex tasks. Frontier models can perform these workloads but require more expensive infrastructure and may require company data to leave the business.

For: Businesses that need reliable long-running AI agents, cloud providers and hardware companies seeking efficient model deployments, and eventually consumers who want locally owned AI on computers or phones.

Examples

• Subconscious: retrains open-source models and serves them on efficient infrastructure for long-running tasks; it is offering inference to a number of customers and working with hardware companies on embedded deployments.

Other takes on AI model development

• AI simulation company that models human behavior and lets organizations test decisions against simulated populations 20VC with Harry Stebbings
• An open foundation-model company focused on coding and long-horizon software tasks Latent Space
• Enterprise context and training-data infrastructure for AI applications 20VC with Harry Stebbings
• In-database semantic analytics using large database models IBM Technology
• A domain-specific AI product built around private data, specialized models, and purpose-built workflows Y Combinator
• Continually learning AI model provider for enterprises Dwarkesh Patel

All AI model development ideas →

Related ideas

• Enterprise multimodel AI system combining a proprietary specialist model with external models and task-specific subagents
• Model-independent enterprise AI harness for autonomous software development
• Enterprise AI concierge for customer, sales, and operational workflows
• Managed agent-driven post-training for small custom models
• Production-ready inference hosting for open AI models