Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.

A modular, easy to extend GFlowNet library

Personal Webpage

Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).

Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.

Automating the Search for Artificial Life with Foundation Models!

Python implementation of CMA-ES

Vector (and Scalar) Quantization, in Pytorch

Evolution Through Large Models

CycleQD is a framework for parameter space model merging.

Diffusion model derived evolutionary algorithm

A list of free LLM inference resources accessible via API.

A bibliography and survey of the papers surrounding o1

[NAACL 25 main] Awesome LLM Causal Reasoning is a collection of LLM-based casual reasoning works, including papers, codes and datasets.

MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Research

Stick-breaking attention

[ICLR 2024] Official implementation for "Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrations"

📈 Adaptive: parallel active learning of mathematical functions

Demonstrations of Loss of Plasticity and Implementation of Continual Backpropagation

Collection of common code that's shared among different research projects in FAIR computer vision team.

System 2 Reasoning Link Collection

Pytorch implementation of Hyperspherical Variational Auto-Encoders

EGG: Emergence of lanGuage in Games

code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"

Code for "Bayesian Structure Learning with Generative Flow Networks"

xLSTM as Generic Vision Backbone

Simple (and cheap!) neural network uncertainty estimation