Skip to content

Commit fd6ec3f

Browse files
committed
add elana
1 parent 1fcb7b2 commit fd6ec3f

File tree

12 files changed

+132
-2
lines changed

12 files changed

+132
-2
lines changed

_includes/misc.html

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,13 @@
11

22
<div class="misc">
33
<h2>Academic service</h2>
4-
Conference Reviewer: NeurIPS (2024, 2025), ICLR 2025, ICML 2025, AAAI 2026
4+
Conference Reviewer: NeurIPS (2024, 2025), ICLR (2025, 2026), ICML 2025, AAAI 2026
55
<br><br>
66
<h2>Open-source contributions</h2>
77
<ul>
88
<li><a href="https://github.com/facebookresearch/HolisticTraceAnalysis">HolisticTraceAnalysis</a> -- A PyTorch profiling tool by Facebook Research</li>
99
<li><a href="https://github.com/Dao-AILab/fast-hadamard-transform">fast-hadamard-transform</a> -- An efficient Hadamard transform implementation from Dao-AILab (Tri Dao)</li>
10+
<li><a href="https://github.com/enyac-group/Elana">Elana</a> -- Elana: A Simple Energy & Latency Analyzer for LLMs</li>
1011
</ul>
1112
<h2>Pro bono office hours</h2>
1213
I've committed to set aside 1 hour every week to provide mentorship and/or guidance for whoever is in need. If you find my research, work, oversea and/or life experience useful, welcoming to fill in this <a href="https://docs.google.com/forms/d/e/1FAIpQLScxlNtC1qnStXdmbGNCYNJGVOVdZgHAKeNEtzw5cPd3CqS6UA/viewform?usp=sf_link">form</a>.

_news/20250321_open_to_work.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
layout: post
33
date: 2025-03-21
44
inline: true
5-
top: true
5+
top: false
66
---
77
:briefcase: **<span style="color:red">I will be on the job market in late 2025 and actively seeking full-time research scientist positions</span>** <br/>
88
Topics: Efficient Machine Learning, including optimization techniques for deep learning models, diffusion models, and large language models.

_news/20251211_elana_released.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
---
2+
layout: post
3+
date: 2025-12-11
4+
inline: true
5+
---
6+
:computer: **<span style="color:red">Tool Released</span>** <br/>
7+
We release an open-sourced profiling tool: *ELANA: A Simple Energy and Latency Analyzer for LLMs*, please checkout on our [github](https://github.com/enyac-group/Elana/) and the [tenchnical report](https://arxiv.org/pdf/2512.09946)

_projects/elana.md

Lines changed: 122 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,122 @@
1+
---
2+
layout: page
3+
title: ELANA
4+
full_title: "ELANA: A Simple Energy and Latency Analyzer for LLMs"
5+
authors: Hung-Yueh Chiang, Bokun Wang, Diana Marculescu
6+
description: "Energy and Latency Analyzern for LLMs"
7+
img: assets/img/publication_preview/elana.png
8+
importance: 2
9+
category: research
10+
---
11+
12+
<style>
13+
li {
14+
font-size: 1.1rem; /* Adjust as needed */
15+
}
16+
</style>
17+
18+
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css">
19+
20+
<div style="text-align: center; padding-bottom: 1rem;">
21+
<!-- <abbr class="badge" style="background-color:#00369f; margin-left:0.1rem; margin-right:0.1rem; font-size:1.1rem;">Arxiv</abbr> -->
22+
<abbr class="badge" style="background-color:#BF5700; margin-left:0.1rem; margin-right:0.1rem; font-size:1.1rem; width:80px; display:inline-block; text-align:center;">Arxiv</abbr>
23+
</div>
24+
25+
<div class="authors">
26+
<a href="https://hychiang.info">Hung-Yueh Chiang</a>,
27+
<a href="https://bokun-wang.github.io">Bokun Wang</a>,
28+
<a href="https://users.ece.utexas.edu/~dianam/">Diana Marculescu</a>
29+
</div>
30+
<div class="authors">
31+
The University of Texas at Austin
32+
</div>
33+
<div style="text-align: center; margin-top:12px;">
34+
<a href="https://arxiv.org/pdf/2512.09946"><i class="fa fa-file-pdf-o" style="font-size:24px;color"></i><b> Report </b></a> &nbsp;
35+
<a href="https://github.com/enyac-group/Elana/"><i class="fa fa-github" style="font-size:24px;color"></i><b> Code </b></a> &nbsp;
36+
</div>
37+
38+
39+
<br>
40+
<div style="text-align: center;">
41+
<p style="font-family: Comic Neue; font-size: 1.4rem;">
42+
&#129303; Support models on Hugging Face, including Transformers, SSMs, and hybrid models <br>
43+
&#128295; Support energy, latency, model size, KV cache size profiling <br>
44+
&#128269; Support detailed kernel latency profiling <br>
45+
</p>
46+
</div>
47+
<div class="row mt-3">
48+
<div class="col-sm-10 mt-3 mt-md-0 offset-1">
49+
{% include figure.html path="assets/img/projects/elana/elana.png" title="elana logo" class="img-fluid rounded z-depth-1" %}
50+
</div>
51+
</div>
52+
<br>
53+
54+
# Compare to Zeus profiling framework
55+
<div class="row">
56+
<div class="col-sm-10 mt-3 mt-md-0 offset-1">
57+
{% include gif.html path="assets/img/projects/elana/compare.png" title="compare" class="img-fluid rounded z-depth-1" %}
58+
</div>
59+
</div>
60+
<br>
61+
62+
# Hugging Face interface
63+
<div class="row mt-3">
64+
<div class="col-sm-10 mt-3 mt-md-0 offset-1">
65+
{% include figure.html path="assets/img/projects/elana/hf_interface.png" title="hf interface" class="img-fluid rounded z-depth-1" %}
66+
</div>
67+
</div>
68+
<br>
69+
70+
# Profile model size
71+
<div class="row mt-3">
72+
<div class="col-sm-10 mt-3 mt-md-0 offset-1">
73+
{% include figure.html path="assets/img/projects/elana/model_size.png" title="model size" class="img-fluid rounded z-depth-1" %}
74+
</div>
75+
</div>
76+
<br>
77+
78+
79+
80+
# Profiling results
81+
### Profile models on A6000
82+
<div class="row mt-4">
83+
<div class="col-sm-10 mt-4 mt-md-0 offset-1">
84+
{% include figure.html path="assets/img/projects/elana/A6000.png" title="A6000 results" class="img-fluid rounded z-depth-1" %}
85+
</div>
86+
</div>
87+
<br>
88+
89+
### Profile models on Jetson series
90+
<div class="row mt-4">
91+
<div class="col-sm-10 mt-4 mt-md-0 offset-1">
92+
{% include figure.html path="assets/img/projects/elana/jetson.png" title="jetson results" class="img-fluid rounded z-depth-1" %}
93+
</div>
94+
</div>
95+
<br>
96+
97+
98+
# Profiling kernels
99+
We use torch profile to generate a json trace file and visualize it with [Perfetto](https://ui.perfetto.dev/).
100+
<div class="row mt-4">
101+
<div class="col-sm-10 mt-4 mt-md-0 offset-1">
102+
{% include figure.html path="assets/img/projects/elana/perfetto_kernel.png" title="kernel results" class="img-fluid rounded z-depth-1" %}
103+
</div>
104+
</div>
105+
<br>
106+
107+
108+
# Citation
109+
{% raw %}
110+
```latex
111+
@article{chiang2025elana,
112+
title = {ELANA: A Simple Energy and Latency Analyzer for LLMs},
113+
author = {Chiang, Hung-Yueh and Wang, Bokun and Marculescu, Diana},
114+
journal = {arXiv preprint arXiv:2512.09946},
115+
year = {2025},
116+
}
117+
```
118+
{% endraw %}
119+
120+
<br>
121+
# Acknowledgements
122+
This work was supported in part by the ONR Minerva program, NSF CCF Grant No. 2107085, iMAGiNE - the Intelligent Machine Engineering Consortium at UT Austin, UT Cockrell School of Engineering Doctoral Fellowships.
205 KB
Loading
264 KB
Loading
634 KB
Loading
202 KB
Loading
307 KB
Loading
88.3 KB
Loading

0 commit comments

Comments
 (0)