Emerging Challenges in Engineering an Open Source, State-of-the-Art LLM

Abstract

Project Mayflower is engineering a state-of-the-art (SoTA), open source LLM with the following goals: Analyze the current state of Generative AI (artificial intelligence), data, model architecture, fitting techniques, training, fine tuning, generation, RLHF (reinforcement learning from human feedback); Investigate and develop use cases; and Develop and instantiate a mission specific (test) model.

Open PDF

Document Details

Document Type
Technical Report
Publication Date
Jun 09, 2023
Accession Number
AD1204991

Entities

People

  • Shannon Gallagher

Organizations

  • Carnegie Mellon University

Tags

Communities of Interest

  • Autonomy

DTIC Thesaurus Topics

  • Acquisition
  • Artificial Intelligence
  • Cost Analysis
  • Data Sets
  • Demographic Cohorts
  • Department Of Defense
  • Emerging Technology
  • Engineering
  • Engineers
  • Human Rights
  • Infrastructure
  • Instructions
  • Lessons Learned
  • Machine Learning
  • Materials
  • Optimization
  • Reinforcement Learning
  • Scientists
  • Software Assurance
  • Software Development
  • Statistical Inference
  • Test And Evaluation
  • Training
  • Universities

Fields of Study

  • Computer science

Readers

  • Agent-Based Social Robotics and Mobile-Assisted Learning in Virtual Environments.
  • Geospatial Intelligence and Artificial Intelligence Analytics
  • Systems Analysis and Design

Technology Areas

  • AI & ML
  • AI & ML - DoD AI Strategy
  • AI & ML - Neural Networks