-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Deployed b07100e with MkDocs version: 1.6.0
- Loading branch information
Unknown
committed
May 14, 2024
0 parents
commit feea452
Showing
35 changed files
with
5,803 additions
and
0 deletions.
There are no files selected for viewing
Empty file.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,182 @@ | ||
<!DOCTYPE html> | ||
<html lang="en" data-bs-theme="auto"> | ||
<head> | ||
<meta charset="utf-8"> | ||
<meta http-equiv="X-UA-Compatible" content="IE=edge"> | ||
<meta name="viewport" content="width=device-width, initial-scale=1.0"> | ||
|
||
|
||
|
||
<link rel="shortcut icon" href="/img/favicon.ico"> | ||
<title>Feature Generation Benchmark</title> | ||
<link href="/css/bootstrap.min.css" rel="stylesheet"> | ||
<link href="/css/fontawesome.min.css" rel="stylesheet"> | ||
<link href="/css/brands.min.css" rel="stylesheet"> | ||
<link href="/css/solid.min.css" rel="stylesheet"> | ||
<link href="/css/v4-font-face.min.css" rel="stylesheet"> | ||
<link href="/css/base.css" rel="stylesheet"> | ||
<link id="hljs-light" rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/11.8.0/styles/github.min.css" disabled> | ||
<link id="hljs-dark" rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/11.8.0/styles/github-dark.min.css" disabled> | ||
<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/11.8.0/highlight.min.js"></script> | ||
<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/11.8.0/languages/python.min.js"></script> | ||
<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/11.8.0/languages/rust.min.js"></script> | ||
<script>hljs.highlightAll();</script> | ||
</head> | ||
|
||
<body> | ||
<div class="navbar fixed-top navbar-expand-lg navbar-dark bg-dark"> | ||
<div class="container"> | ||
<a class="navbar-brand" href="/.">Feature Generation Benchmark</a> | ||
<!-- Expander button --> | ||
<button type="button" class="navbar-toggler" data-bs-toggle="collapse" data-bs-target="#navbar-collapse" aria-controls="navbar-collapse" aria-expanded="false" aria-label="Toggle navigation"> | ||
<span class="navbar-toggler-icon"></span> | ||
</button> | ||
|
||
<!-- Expanded navigation --> | ||
<div id="navbar-collapse" class="navbar-collapse collapse"> | ||
<!-- Main navigation --> | ||
<ul class="nav navbar-nav"> | ||
<li class="nav-item"> | ||
<a href="/." class="nav-link">Home</a> | ||
</li> | ||
<li class="nav-item"> | ||
<a href="/benchmark_results/" class="nav-link">Results</a> | ||
</li> | ||
<li class="nav-item"> | ||
<a href="/dev_guide/" class="nav-link">Development Guide</a> | ||
</li> | ||
<li class="nav-item"> | ||
<a href="https://github.com/SemyonSinchenko/feature-generation-benchmark" class="nav-link">GitHub</a> | ||
</li> | ||
</ul> | ||
|
||
<ul class="nav navbar-nav ms-md-auto"> | ||
<li class="nav-item"> | ||
<a href="#" class="nav-link" data-bs-toggle="modal" data-bs-target="#mkdocs_search_modal"> | ||
<i class="fa fa-search"></i> Search | ||
</a> | ||
</li> | ||
<li class="nav-item dropdown"> | ||
<button id="theme-menu" aria-expanded="false" data-bs-toggle="dropdown" data-bs-display="static" aria-label="Toggle theme" class="nav-link dropdown-toggle"> | ||
<i class="fa-solid fa-circle-half-stroke fa-fw"></i> | ||
<span class="d-lg-none ms-2">Toggle theme</span> | ||
</button> | ||
<ul class="dropdown-menu dropdown-menu-end"> | ||
<li> | ||
<button class="dropdown-item d-flex align-items-center" data-bs-theme-value="light" aria-pressed="false"> | ||
<i class="fa-solid fa-sun fa-fw"></i> | ||
<span class="ms-2">Light</span> | ||
<i class="fa-solid fa-check ms-auto d-none"></i> | ||
</button> | ||
</li> | ||
<li> | ||
<button class="dropdown-item d-flex align-items-center" data-bs-theme-value="dark" aria-pressed="false"> | ||
<i class="fa-solid fa-moon fa-fw"></i> | ||
<span class="ms-2">Dark</span> | ||
<i class="fa-solid fa-check ms-auto d-none"></i> | ||
</button> | ||
</li> | ||
<li> | ||
<button class="dropdown-item d-flex align-items-center" data-bs-theme-value="auto" aria-pressed="true"> | ||
<i class="fa-solid fa-circle-half-stroke fa-fw"></i> | ||
<span class="ms-2">Auto</span> | ||
<i class="fa-solid fa-check ms-auto"></i> | ||
</button> | ||
</li> | ||
</ul> | ||
</li> | ||
</ul> | ||
</div> | ||
</div> | ||
</div> | ||
<script src="/js/darkmode.js"></script> | ||
|
||
<div class="container"> | ||
<div class="row"> | ||
|
||
<div class="row-fluid"> | ||
<div id="main-content" class="span12"> | ||
<h1 id="404-page-not-found" style="text-align: center">404</h1> | ||
<p style="text-align: center"><strong>Page not found</strong></p> | ||
</div> | ||
</div> | ||
|
||
|
||
</div> | ||
</div> | ||
|
||
<footer class="col-md-12"> | ||
<hr> | ||
<p>Documentation built with <a href="https://www.mkdocs.org/">MkDocs</a>.</p> | ||
</footer> | ||
<script src="/js/bootstrap.bundle.min.js"></script> | ||
<script> | ||
var base_url = "/", | ||
shortcuts = {"help": 191, "next": 78, "previous": 80, "search": 83}; | ||
</script> | ||
<script src="/js/base.js"></script> | ||
<script src="/search/main.js"></script> | ||
|
||
<div class="modal" id="mkdocs_search_modal" tabindex="-1" role="dialog" aria-labelledby="searchModalLabel" aria-hidden="true"> | ||
<div class="modal-dialog modal-lg"> | ||
<div class="modal-content"> | ||
<div class="modal-header"> | ||
<h4 class="modal-title" id="searchModalLabel">Search</h4> | ||
<button type="button" class="btn-close" data-bs-dismiss="modal" aria-label="Close"></button> | ||
</div> | ||
<div class="modal-body"> | ||
<p>From here you can search these documents. Enter your search terms below.</p> | ||
<form> | ||
<div class="form-group"> | ||
<input type="search" class="form-control" placeholder="Search..." id="mkdocs-search-query" title="Type search term here"> | ||
</div> | ||
</form> | ||
<div id="mkdocs-search-results" data-no-results-text="No results found"></div> | ||
</div> | ||
<div class="modal-footer"> | ||
</div> | ||
</div> | ||
</div> | ||
</div><div class="modal" id="mkdocs_keyboard_modal" tabindex="-1" role="dialog" aria-labelledby="keyboardModalLabel" aria-hidden="true"> | ||
<div class="modal-dialog"> | ||
<div class="modal-content"> | ||
<div class="modal-header"> | ||
<h4 class="modal-title" id="keyboardModalLabel">Keyboard Shortcuts</h4> | ||
<button type="button" class="btn-close" data-bs-dismiss="modal" aria-label="Close"></button> | ||
</div> | ||
<div class="modal-body"> | ||
<table class="table"> | ||
<thead> | ||
<tr> | ||
<th style="width: 20%;">Keys</th> | ||
<th>Action</th> | ||
</tr> | ||
</thead> | ||
<tbody> | ||
<tr> | ||
<td class="help shortcut"><kbd>?</kbd></td> | ||
<td>Open this help</td> | ||
</tr> | ||
<tr> | ||
<td class="next shortcut"><kbd>n</kbd></td> | ||
<td>Next page</td> | ||
</tr> | ||
<tr> | ||
<td class="prev shortcut"><kbd>p</kbd></td> | ||
<td>Previous page</td> | ||
</tr> | ||
<tr> | ||
<td class="search shortcut"><kbd>s</kbd></td> | ||
<td>Search</td> | ||
</tr> | ||
</tbody> | ||
</table> | ||
</div> | ||
<div class="modal-footer"> | ||
</div> | ||
</div> | ||
</div> | ||
</div> | ||
|
||
</body> | ||
</html> |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,65 @@ | ||
# Results of Benchmark | ||
|
||
## Setup | ||
|
||
**EC2 m5.4xlarge** | ||
|
||
| Key | Value | | ||
|-----------------------|--------------------------| | ||
| vCPUs | 16 | | ||
| Memory (GiB) | 64.0 | | ||
| Memory per vCPU (GiB) | 4.0 | | ||
| Physical Processor | Intel Xeon Platinum 8175 | | ||
| Clock Speed (GHz) | 3.1 | | ||
| CPU Architecture | x86_64 | | ||
|
||
[Details about the instance type](https://instances.vantage.sh/aws/ec2/m5.4xlarge) | ||
|
||
## Datasets | ||
|
||
All the information provided for a default seed 42. Size on disk is a total size of compressed parquet files. An amount of rows depends of SEED that was used for generation of the data because an amount of transactions for each id (customer id) per day is sampled from binomial distribution. | ||
|
||
See `src/lib.rs` for details of the implementation. | ||
|
||
## Tiny Dataset | ||
|
||
**Amount of rows:** 17,299,455 | ||
|
||
**Size on disk:** 178 Mb | ||
|
||
**Unique IDs:** 1,000 | ||
|
||
| Tool | Approach | Time of processing in seconds | | ||
| ---- | -------- | ----------------------------- | | ||
{% for key in results_tiny -%} | ||
| {{ key }} | {{ results_tiny[key]["approach"] }} | {{ results_tiny[key]["total_time"] }} | | ||
{% endfor %} | ||
|
||
## Small Dataset | ||
|
||
**Amount of rows:** 172,925,732 | ||
|
||
**Size on disk:** 1.8 Gb | ||
|
||
**Unique IDs:** 10,000 | ||
|
||
| Tool | Approach | Time of processing in seconds | | ||
| ---- | --------- | ----------------------------- | | ||
{% for key in results_small -%} | ||
| {{ key }} | {{ results_small[key]["approach"] }} | {{ results_small[key]["total_time"] }} | | ||
{% endfor %} | ||
|
||
|
||
## Medium Dataset | ||
|
||
**Amount of rows:** 1,717,414,863 | ||
|
||
**Size on disk:** 18 Gb | ||
|
||
**Unique IDs:** 100,000 | ||
|
||
| Tool | Approach | Time of processing in seconds | | ||
| ---- | --------- | ----------------------------- | | ||
{% for key in results_medium -%} | ||
| {{ key }} | {{ results_medium[key]["approach"] }} | {{ results_medium[key]["total_time"] }} | | ||
{% endfor %} |
Oops, something went wrong.