MPTorch is a low\/mixed-precision training and inference simulation framework built atop the popular PyTorch deep learning library, allowing users to test the effect of low precision arithmetic operators (in floating-point and fixed-point) in their deep learning workflows. It is built as a research prototype tool, favoring exploration and experimentation. For the moment, it reimplements the underlying computations of commonly used layers for CNNs (e.g., matrix multiplication and 2D convolutions) using user-specified floating-point formats for each operation (e.g., addition, multiplication). All the operations are internally done using IEEE-754 32-bit floating-point arithmetic, with the results rounded to the specified format.<\/p>\n\n\n\n
More information and examples can be found on our GitHub repository<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":" Software MPTorch is a low\/mixed-precision training and inference simulation framework built atop the popular PyTorch deep learning library, allowing users to test the effect of\u2026<\/p>\n