Research papers

Work by Cohere For AI and Technical Staff at Cohere

Filter papers

Dec 06, 2023

On the Fairness Impacts of Hardware Selection in Machine Learning

Hardware

Responsible AI

Tooling

Supervised Learning

Nov 29, 2023

Elo Uncovered: Robustness and Best Practices in Language Model Evaluation

Evaluation

Reproducibility

Language

Generative Models

Responsible AI

Safety

AI Policy

Data

Evaluation

Efficiency

Language

Generative Models

Oct 11, 2023

Safety

Generative Models

Language Models

AI Policy

Compute

Open Source

Tooling

Hardware

Sep 11, 2023

Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning

Mixture of Experts

Efficiency

Transfer Learning

Language

Generative Models

Compute

Sep 08, 2023

When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale

Transformers

Generative Models

Data Pruning

Large-Scale Pretraining

Data Efficiency

Jun 14, 2023

Interpretability

Safety

Responsible AI

AI Policy

May 30, 2023

Intriguing Properties of Quantization at Scale

Generative Models

Representation Learning

Transformers

Model Compression

Safety

Reasoning

Interpretability

Reinforcement Learning

Safety

Reproducibility

Responsible AI

Apr 11, 2023

PASHA: Efficient HPO and NAS with Progressive Resource Allocation

Efficiency

Optimization

Neural Architecture Search

Efficiency

Generative Models