Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Python bindings for MPI

Zero-copy MPI communication of JAX arrays, for turbo-charged HPC applications in Python ⚡

Best practices & guides on how to write distributed pytorch training code

Python extension language using accelerators

DeepHyper: Scalable Asynchronous Neural Architecture and Hyperparameter Search for Deep Neural Networks

Simplify HPC and Batch workloads on Azure

A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

Distributed and decentralized training framework for PyTorch over graph

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

FedTorch is a generic repository for benchmarking different federated and distributed learning algorithms using PyTorch Distributed API.

A common interface to processing pools.

Analysis kit for large-scale structure datasets, the massively parallel way

Geophysical Bayesian Inference in Python. Docs:

DISROPT: A Python framework for distributed optimization

OpenClimateGIS is a set of geoprocessing and calculation tools for CF-compliant climate datasets.

Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.

Perun is a Python package that measures the energy consumption of you applications.

Code for tutorials and examples

Official Code of "[ICCV 2023] MPI-Flow: Learning Realistic Optical Flow with Multiplane Images"