Foundation Models

• Large Language Models (LLMs)
• Vision Foundation Models
• Multimodal Foundation Models
• Domain-specific Foundation Models
• Scientific Foundation Models
• Foundation Models for Robotics

Generative AI

• Text Generation
• Image and Video Generation
• Audio and Speech Generation
• 3D Content Generation
• Generative Agents
• Diffusion Models

Model Architectures and Learning Algorithms

• Transformer Architectures
• Mixture-of-Experts (MoE) Models
• State Space Models (SSMs)
• Efficient Neural Architectures
• Representation Learning
• Self-supervised Learning

Training, Fine-tuning and Optimization

• Pre-training Strategies
• Parameter-efficient Fine-tuning (PEFT)
• Direct Preference Optimization (DPO)
• Curriculum Learning
• Distributed and Large-scale Training
• Data-efficient Learning

Multimodal Intelligence

• Vision-Language Models
• Cross-modal Representation Learning
• Audio-Visual Learning
• Multimodal Reasoning
• Multimodal Dialogue Systems
• Unified Multimodal Models

Unified Multimodal Models

• Chain-of-Thought Reasoning
• AI Agents and Autonomous Systems
• Multi-agent Collaboration
• Long-horizon Planning
• Memory-enhanced Models
• Tool Learning and Tool Use