Skip to content

Model LLM inference on single-core hardware architectures

License

Notifications You must be signed in to change notification settings

KULeuven-MICAS/zigzag-llm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

linting: pylint

ZigZag-LLM

This repository provides a framework to model Large Language Models on dedicated, single-core accelerators and facilitates early identification of energy bottlenecks within the hardware architecture. It is built upon the ZigZag Design Space Exploration tool and inherits its hardware definition format.

Getting started

$ python3 -m venv env
$ source env/bin/activate
$ pip install -r requirements.txt
$ python main.py

The result should look like this: image

About

Model LLM inference on single-core hardware architectures

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Languages