fix preprocess data

README.md

@@ -279,7 +279,7 @@ In the `zns.trace/` directory, we provide a framework to trace activity on zns d
 
 ## Evaluation
 
-In the `evaluation/` directory we provide a benchmarking setup for evaluating the performance of the zns-tools, and an end-to-end visualization framework for RocksDB to analyze and visualize the data movement of flush/compaction operations, as well as F2FS Zone management operations. 
+In the `evaluation/` directory we provide a benchmarking setup for evaluating the performance of the zns-tools, and an end-to-end visualization framework for RocksDB to analyze and visualize the data movement of flush/compaction operations, as well as F2FS Zone management operations.
 
 ### Setup
 
@@ -299,4 +299,6 @@ To run the RocksDB workload, a script is provided that executes all necessary to
 sh ./timeline_data_rocksdb_gen.sh
 ```
 
-To then visualize the data, copy it to the `../timeline-gen/` directory and execute the cells in the `plot.ipynb` notebook (`jupyter notebook` to start the notebook).
+Afterwards data should be preprocessed for plotting by running the notebook `preprocess.ipynb`  (`jupyter notebook` to start the notebook). It should create `data.json` in  `../timeline-gen`.
+
+To then visualize the data, move to `../timeline-gen/` directory and execute the cells in the `plot.ipynb` notebook (`jupyter notebook` to start the notebook).

evaluation/timeline-data/preprocess_data.ipynb

@@ -276,16 +276,6 @@
     "    ptr_jobs = ptr_jobs + 1\n"
    ]
   },
-  {
-   "cell_type": "code",
-   "execution_count": null,
-   "id": "4f814114",
-   "metadata": {},
-   "outputs": [],
-   "source": [
-    "compactions"
-   ]
-  },
   {
    "cell_type": "code",
    "execution_count": null,
@@ -496,6 +486,14 @@
     "            } for z in json.loads(zone_data)['zone_list']]      "
    ]
   },
+  {
+   "cell_type": "markdown",
+   "id": "66757695",
+   "metadata": {},
+   "source": [
+    "# Score recreation"
+   ]
+  },
   {
    "cell_type": "code",
    "execution_count": null,
@@ -565,6 +563,14 @@
     "    print(\"diff\", dif)"
    ]
   },
+  {
+   "cell_type": "markdown",
+   "id": "9395fe41",
+   "metadata": {},
+   "source": [
+    "# Printing"
+   ]
+  },
   {
    "cell_type": "code",
    "execution_count": null,
@@ -610,6 +616,25 @@
     "    rr = [x[1] for x in compactions[job]['past_resets']]\n",
     "    print('     R:', rr)\n"
    ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "7aee51cd",
+   "metadata": {},
+   "source": [
+    "# Generate JSON"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "3b927407",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "with open('../timeline-gen/data.json', 'w') as f:\\n\",\n",
+    "    json.dump(compactions, f, indent=4)\""
+   ]
   }
  ],
  "metadata": {