v0.18.2

Summary

Changelog for Release v0.18.2 (notable changes since v0.12.3).

Generality

• Implemented support for 5 additional model variants, including 2 new architectures:
  • SSD300 ResNet50
  • YOLOv6 with the following variants:
    • yolov6n
    • yolov6s
    • yolov6m
    • yolov6l

Performance

Grayskull (e75, e150)

• Enhanced performance observed in DeiT (11%)
• Notable performance regressions on e75 include HRNet (-27%), MobileNetV3 (-18%), ResNet (-11%)
• Regression in Whisper (to-be patched in future release)

Wormhole (n150)

• Achieved broad performance improvements averaging 6%
• Significantly enhanced performance observed in MobileNetV2 (46%), YOLOv5​ (20%), VoVNet (19%)
• Notable performance regressions on include Whisper (-78%), Stable Diffusion (-50%) (to-be patched in future release)

Wormhole (n300)

• Introduced performance benchmarks for the n300 (single-chip)
• n300 dual-chip and multi-card data parallel performance to be included in next release

General (Improvements/Features/Etc.)

• Introduced functionality for Wormhole n300, including the LoudBox and QuietBox configurations
  • Limited to single-chip and 4x chip functionality, with dual-chip and 8x chip ethernet support planned for next release
• Across-the-board bug fixes and enhancements to compiler stability
• Enhanced customer-facing documentation for improved clarity and accessibility

Known issues

• Models running on 1x1 grid size might face issues on Intel CPUs
• Regression on Whisper model utilizing enc_dec implementation
• Ethernet issues leading to hangs on n300 dual-chip data parallel mode

Compatibility matrix

OS	Python	PyTorch	Driver	Firmware
Ubuntu 22.04	3.10.12	2.1.0+cpu.cxx11.abi	ttkmd_1.28	fw_v80.10.0.0
Ubuntu 20.04	3.8.10	2.1.0+cpu.cxx11.abi	ttkmd_1.28	fw_v80.10.0.0

What's Changed

• Fix typos. by @jasondavies in #25
• Fix user_guide.rst doc python example issues by @jaebaek in #27
• Mistype fix by @gritukan in #30
• Uplift 2024-06-27 by @vmilosevic in #34

New Contributors

• @jasondavies made their first contribution in #25
• @jaebaek made their first contribution in #27
• @gritukan made their first contribution in #30

Full Changelog: v0.12.3...v0.18.2