Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions notebooks/02_thicket_rajaperf_clustering.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
"tags": []
},
"source": [
"# Clustering RAJA Performance Suite Dataset: Thicket Tutorial\n",
"# HPDC '23: Optimization-Based K-means Clustering on the RAJA Performance Suite: Thicket Tutorial\n",
"\n",
"Thicket is a python-based toolkit for Exploratory Data Analysis (EDA) of parallel performance data that enables performance optimization and understanding of applications’ performance on supercomputers. It bridges the performance tool gap between being able to consider only a single instance of a simulation run (e.g., single platform, single measurement tool, or single scale) and finding actionable insights in multi-dimensional, multi-scale, multi-architecture, and multi-tool performance datasets.\n",
"\n",
Expand Down Expand Up @@ -1513,7 +1513,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.9"
"version": "3.11.7"
},
"papermill": {
"default_parameters": {},
Expand Down
4 changes: 2 additions & 2 deletions notebooks/07_nsight_compute.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -384,7 +384,7 @@
},
{
"cell_type": "code",
"execution_count": 50,
"execution_count": null,
"id": "909bbd4e",
"metadata": {},
"outputs": [],
Expand Down Expand Up @@ -503,7 +503,7 @@
" else:\n",
" ymin_ix_elbow=list()\n",
" ymin_x_elbow=list()\n",
" for ix in range(1, x):\n",
" for ix in range(1, nx):\n",
" if (ymin <= roof[1] * x[ix] and ymin > roof[1] * x[ix - 1]):\n",
" ymin_x_elbow.append(x[ix - 1])\n",
" ymin_ix_elbow.append(ix - 1)\n",
Expand Down
7 changes: 3 additions & 4 deletions notebooks/08A_composing_parallel_sorting_data.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"# Composing & Modeling Parallel Sorting Performance Data\n",
"## Part A: Composing Parallel Sorting Data\n",
"# PPAM '24: Composing & Modeling Parallel Sorting Performance Data (Part A): Thicket Tutorial\n",
"\n",
"The parallel sorting dataset consists of 8,747 MPI sorting algorithm performance profiles (collected with [Caliper](https://software.llnl.gov/Caliper/)) for 5 different algorithms and 51 implementations.\n",
"We start with a dataset that includes over 10,000 performance profiles, and we show how to apply various filters and checks on the performance data to remove profiles that do not match our criteria.\n",
Expand Down Expand Up @@ -628,7 +627,7 @@
],
"metadata": {
"kernelspec": {
"display_name": "thesis-3.11.9",
"display_name": "tk-3.9.12",
"language": "python",
"name": "python3"
},
Expand All @@ -642,7 +641,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.9"
"version": "3.9.18"
}
},
"nbformat": 4,
Expand Down
5 changes: 2 additions & 3 deletions notebooks/08B_modeling_parallel_sorting_data.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"# Composing & Modeling Parallel Sorting Performance Data\n",
"## Part B: Modeling Parallel Sorting Data\n",
"# PPAM '24: Composing & Modeling Parallel Sorting Performance Data (Part B): Thicket Tutorial\n",
"\n",
"In part B, we use machine learning to predict the parallel algorithm class from the performance data we processed and composed in part A. Running notebook `08A_composing_parallel_sorting_data.ipynb` is necessary to generate the data that we will use in this notebook.\n",
"\n",
Expand Down Expand Up @@ -489,7 +488,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.9"
"version": "3.9.18"
}
},
"nbformat": 4,
Expand Down
18 changes: 10 additions & 8 deletions notebooks/09_tma_speedup_clustering.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"# RAJA Performance Suite Clustering Analysis\n",
"# P3HPC '24: Top Down and Hierarchical Clustering on the RAJA Performance Suite: Thicket Tutorial\n",
"\n",
"In this notebook, we compose performance data from experiments using the RAJA Performance Suite on various hardware:\n",
"\n",
Expand Down Expand Up @@ -1423,7 +1423,7 @@
},
{
"cell_type": "code",
"execution_count": 27,
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
Expand Down Expand Up @@ -1490,7 +1490,7 @@
},
{
"cell_type": "code",
"execution_count": 29,
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
Expand Down Expand Up @@ -1568,7 +1568,7 @@
},
{
"cell_type": "code",
"execution_count": 31,
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
Expand Down Expand Up @@ -1760,7 +1760,8 @@
"\n",
"#fig.write_image(\"images/par_coord_AVG_NO_OUTLIERS.png\")\n",
"\n",
"fig.show()"
"#fig.show() # <- For interactive plot\n",
"fig.show(renderer=\"png\") # <- For static plot"
]
},
{
Expand Down Expand Up @@ -1884,13 +1885,14 @@
"\n",
"#fig.write_image(\"images/par_coord_NO_OUTLIERS.png\")\n",
"\n",
"fig.show()"
"#fig.show() # <- For interactive plot\n",
"fig.show(renderer=\"png\") # <- For static plot"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3 (ipykernel)",
"display_name": "tk-3.9.12",
"language": "python",
"name": "python3"
},
Expand All @@ -1904,7 +1906,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.5"
"version": "3.9.18"
}
},
"nbformat": 4,
Expand Down
2 changes: 2 additions & 0 deletions requirements.txt
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
git+https://github.com/LLNL/thicket.git@develop-2024-11-02
ipython==7.15.0
extrap
nbformat>=4.2.0
plotly
scikit-learn
seaborn