Argonne National Laboratory

Upcoming Events

A Massively Parallel Library for Matrix and Tensor Algorithms

LANS Informal Seminar
Edgar Solomonik, University of Illinois at Urbana-Champaign
October 25, 2017 10:30AM to 11:30AM
Building 240, Room 4301

Abstract: We present a framework of communication-avoiding parallel algorithms and a distributed-memory library of primitive routines for sparse and dense tensors. Computationally, a tensor represents a multidimensional array of data, while numerically tensors represent multilinear maps that operate and compose by means of contraction. We study the communication complexity of parallel algorithms for contractions of tensors with sparsity and symmetry. The proposed algorithms are implemented as part of Cyclops Tensor Framework. Cyclops supports contractions of tensors with user-defined element types and elementwise functions. We show performance results of application-codes achieving near 1 petaflop/s performance using Cyclops as well as case-studies using symmetry, sparsity, and custom element-types.