{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":527730517,"defaultBranch":"main","name":"dlio_benchmark","ownerLogin":"argonne-lcf","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-08-22T20:59:35.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/52420195?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1724999879.0","currentOid":""},"activityList":{"items":[{"before":"b9bc737de11681a1b734302945861e72a469e9ea","after":"ad0ea30f35185fed5b5b03aadbaf89080d9f7d0e","ref":"refs/heads/feature/log","pushedAt":"2024-09-04T20:57:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"changed log level field to output section","shortMessageHtmlLink":"changed log level field to output section"}},{"before":"140d86cc1fd1c88e10d5d1d50dbd73d50db61fed","after":"b9bc737de11681a1b734302945861e72a469e9ea","ref":"refs/heads/feature/log","pushedAt":"2024-09-03T21:06:59.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"Update utility.py","shortMessageHtmlLink":"Update utility.py"}},{"before":"2321952cc97d7974c38852be2f8022a062a1d1e3","after":"abeb0aca8c8c7144de0a4867537b6c3f6812cfd0","ref":"refs/heads/bugfix/sample_indexing","pushedAt":"2024-09-03T21:03:09.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"Merge branch 'main' into bugfix/sample_indexing","shortMessageHtmlLink":"Merge branch 'main' into bugfix/sample_indexing"}},{"before":"d6924f3ff48312db1d3ae94a5336cbe99bcb8ee0","after":"bbe9bae59fc6afa40110bc3023ce9604480eb3e3","ref":"refs/heads/main","pushedAt":"2024-09-03T20:36:48.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"Improve CI Performance. (#227)\n\n* IMprove CI Performance.\r\n\r\n1. Improve generation of hdf5 files it was taking too long.\r\n2. Do not finalize in pytest this allows multiple tests to run together.\r\n\r\n* Reduce DEBUG LEVEL\r\n\r\n* revert test\r\n\r\n* reduce threads not enough data\r\n\r\n* increase files to support some I/O","shortMessageHtmlLink":"Improve CI Performance. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2496370071\" data-permission-text=\"Title is private\" data-url=\"https://github.com/argonne-lcf/dlio_benchmark/issues/227\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/argonne-lcf/dlio_benchmark/pull/227/hovercard\" href=\"https://github.com/argonne-lcf/dlio_benchmark/pull/227\">#227</a>)"}},{"before":"c179a56c9a5a12832e12433a03870fd03db744a7","after":"140d86cc1fd1c88e10d5d1d50dbd73d50db61fed","ref":"refs/heads/feature/log","pushedAt":"2024-09-03T19:06:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"added error mode; and changed the metric output to print to STDOUT","shortMessageHtmlLink":"added error mode; and changed the metric output to print to STDOUT"}},{"before":"682a300ddc0fff0839625fce8d0b1945f869f3ef","after":"2321952cc97d7974c38852be2f8022a062a1d1e3","ref":"refs/heads/bugfix/sample_indexing","pushedAt":"2024-08-31T00:53:59.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"ensure the sampler do not goes past the file in the last rank.","shortMessageHtmlLink":"ensure the sampler do not goes past the file in the last rank."}},{"before":"4e6019e776f19faa9a95e50c57c8e7e58c489ab3","after":"8fefd7d95b8b4425d64fd3df65afeada07f54747","ref":"refs/heads/enhance/ci_pytest","pushedAt":"2024-08-30T07:16:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"increase files to support some I/O","shortMessageHtmlLink":"increase files to support some I/O"}},{"before":"ee2ecbd43f2e0bfafbd86c325070064a09eb73a1","after":"4e6019e776f19faa9a95e50c57c8e7e58c489ab3","ref":"refs/heads/enhance/ci_pytest","pushedAt":"2024-08-30T07:15:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"reduce threads not enough data","shortMessageHtmlLink":"reduce threads not enough data"}},{"before":"ae0f6d944f882dcf1920552357924d34dc51cff5","after":"682a300ddc0fff0839625fce8d0b1945f869f3ef","ref":"refs/heads/bugfix/sample_indexing","pushedAt":"2024-08-30T07:13:38.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"reduced reader threads asnot enough data","shortMessageHtmlLink":"reduced reader threads asnot enough data"}},{"before":"b816ca3d2165e9d77646e7db6b3505d652da8752","after":"ee2ecbd43f2e0bfafbd86c325070064a09eb73a1","ref":"refs/heads/enhance/ci_pytest","pushedAt":"2024-08-30T06:56:12.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"revert test","shortMessageHtmlLink":"revert test"}},{"before":"7ccc57d433457ad4da5ffca4b2daeea03b99a1e7","after":"b816ca3d2165e9d77646e7db6b3505d652da8752","ref":"refs/heads/enhance/ci_pytest","pushedAt":"2024-08-30T06:54:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"revert test","shortMessageHtmlLink":"revert test"}},{"before":"c2af0c20ac630c9e0d6ac097523f5e5901f855a0","after":"7ccc57d433457ad4da5ffca4b2daeea03b99a1e7","ref":"refs/heads/enhance/ci_pytest","pushedAt":"2024-08-30T06:41:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"Reduce DEBUG LEVEL","shortMessageHtmlLink":"Reduce DEBUG LEVEL"}},{"before":null,"after":"c2af0c20ac630c9e0d6ac097523f5e5901f855a0","ref":"refs/heads/enhance/ci_pytest","pushedAt":"2024-08-30T06:37:59.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"IMprove CI Performance.\n\n1. Improve generation of hdf5 files it was taking too long.\n2. Do not finalize in pytest this allows multiple tests to run together.","shortMessageHtmlLink":"IMprove CI Performance."}},{"before":"6b2f3daeaf6c27d0c732b8564fce1affb5c72ce1","after":"ae0f6d944f882dcf1920552357924d34dc51cff5","ref":"refs/heads/bugfix/sample_indexing","pushedAt":"2024-08-30T06:20:39.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"Increasing test case to improve testing","shortMessageHtmlLink":"Increasing test case to improve testing"}},{"before":"4ee8f097cac20393b6280e5e208d2c134fc1bf00","after":"6b2f3daeaf6c27d0c732b8564fce1affb5c72ce1","ref":"refs/heads/bugfix/sample_indexing","pushedAt":"2024-08-30T05:43:03.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"Increase GOTCHA and DFTRACER LEVEL to reduce print","shortMessageHtmlLink":"Increase GOTCHA and DFTRACER LEVEL to reduce print"}},{"before":"adf0649327aded027c5a7201e40166925c53173b","after":"4ee8f097cac20393b6280e5e208d2c134fc1bf00","ref":"refs/heads/bugfix/sample_indexing","pushedAt":"2024-08-30T05:42:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"Increase GOTCHA and DFTRACER LEVEL to reduce print","shortMessageHtmlLink":"Increase GOTCHA and DFTRACER LEVEL to reduce print"}},{"before":"a535b0de2f6ed64e88c89f5b512cf592ac62b07f","after":"adf0649327aded027c5a7201e40166925c53173b","ref":"refs/heads/bugfix/sample_indexing","pushedAt":"2024-08-30T05:25:49.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"For sample indexing we fix the uneven sampling\n\n1. Fix uneven sampling done for index based and iterative\n2. Add a validation step to ensure we can validate that global indices are correctly shuffled and no indices are lost.\n3. Make sure we do file and sample shuffling in reconfigure step.\n4. Remove sample shuffling from dataloader Sampler code.\n5. Added test case to support uneven file distributions #225","shortMessageHtmlLink":"For sample indexing we fix the uneven sampling"}},{"before":"916072221fbe58a0ca0333ae647fcfb32b969ace","after":"a535b0de2f6ed64e88c89f5b512cf592ac62b07f","ref":"refs/heads/bugfix/sample_indexing","pushedAt":"2024-08-30T04:49:59.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"For sample indexing we fix the uneven sampling\n\n1. Fix uneven sampling done for index based and iterative\n2. Add a validation step to ensure we can validate that global indices are correctly shuffled and no indices are lost.\n3. Make sure we do file and sample shuffling in reconfigure step.\n4. Remove sample shuffling from dataloader Sampler code.\n5. Added test case to support uneven file distributions #225","shortMessageHtmlLink":"For sample indexing we fix the uneven sampling"}},{"before":null,"after":"916072221fbe58a0ca0333ae647fcfb32b969ace","ref":"refs/heads/bugfix/sample_indexing","pushedAt":"2024-08-30T04:44:06.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"For sample indexing we fix the uneven sampling\n\n1. Fix uneven sampling done for index based and iterative\n2. Add a validation step to ensure we can validate that global indices are correctly shuffled and no indices are lost.\n3. Make sure we do file and sample shuffling in reconfigure step.\n4. Remove sample shuffling from dataloader Sampler code.\n5. Added test case to support uneven file distributions #225","shortMessageHtmlLink":"For sample indexing we fix the uneven sampling"}},{"before":"ec22aec74eb9a547a9007b7a915dde2a80497828","after":"d6924f3ff48312db1d3ae94a5336cbe99bcb8ee0","ref":"refs/heads/main","pushedAt":"2024-08-28T14:40:26.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"fix missing import for chunking. (#223)","shortMessageHtmlLink":"fix missing import for chunking. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2490599891\" data-permission-text=\"Title is private\" data-url=\"https://github.com/argonne-lcf/dlio_benchmark/issues/223\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/argonne-lcf/dlio_benchmark/pull/223/hovercard\" href=\"https://github.com/argonne-lcf/dlio_benchmark/pull/223\">#223</a>)"}},{"before":"8cabad2034592979dc79023d2132bb2814ff1a5b","after":"ec22aec74eb9a547a9007b7a915dde2a80497828","ref":"refs/heads/main","pushedAt":"2024-08-28T14:39:56.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"Fix PyPI Publish Issue and Improve Project Metadata (#224)\n\n* Update CD workflow to use the same versions of actions as CI.\r\n\r\n* Fix description typo.\r\n\r\n* Update project URLs.\r\n\r\n* Remove id-token permission.","shortMessageHtmlLink":"Fix PyPI Publish Issue and Improve Project Metadata (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2490670567\" data-permission-text=\"Title is private\" data-url=\"https://github.com/argonne-lcf/dlio_benchmark/issues/224\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/argonne-lcf/dlio_benchmark/pull/224/hovercard\" href=\"https://github.com/argonne-lcf/dlio_benchmark/pull/224\">#224</a>)"}},{"before":null,"after":"1217488aecec716dc262586660aa05076b21f826","ref":"refs/heads/bugfix/import_math","pushedAt":"2024-08-28T00:27:57.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"fix missing import for chunking.","shortMessageHtmlLink":"fix missing import for chunking."}},{"before":"2cae8161164392ac7b6ea0ed4f2328e7f8a5b51b","after":"c179a56c9a5a12832e12433a03870fd03db744a7","ref":"refs/heads/feature/log","pushedAt":"2024-08-27T22:59:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"added doc changes","shortMessageHtmlLink":"added doc changes"}},{"before":"08d8fa30dbfc4fff68a0934f30dbaeb3618d2ca9","after":"2cae8161164392ac7b6ea0ed4f2328e7f8a5b51b","ref":"refs/heads/feature/log","pushedAt":"2024-08-27T22:53:28.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"fixed mocking","shortMessageHtmlLink":"fixed mocking"}},{"before":"3221d9f063b2ad36467bf232310834186f3ca672","after":"08d8fa30dbfc4fff68a0934f30dbaeb3618d2ca9","ref":"refs/heads/feature/log","pushedAt":"2024-08-27T22:16:45.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"fixed bug","shortMessageHtmlLink":"fixed bug"}},{"before":"f764d93a87d31849ac7a5998dfa03f4d65ef5bd2","after":"8cabad2034592979dc79023d2132bb2814ff1a5b","ref":"refs/heads/main","pushedAt":"2024-08-27T22:14:24.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"Fixed iterator to only store data for that rank. (#216)\n\n* fixed iterator to only store data for that rank.\r\n\r\n- we fix reconfiguration logic to build rank map for train and valid.\r\n- Now we need reconfigure per epoch to shuffle the list.\r\n\r\n* Remove shuffling from tfreader as it is already shuffled before,\r\n\r\n* fixed logging","shortMessageHtmlLink":"Fixed iterator to only store data for that rank. (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2435106496\" data-permission-text=\"Title is private\" data-url=\"https://github.com/argonne-lcf/dlio_benchmark/issues/216\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/argonne-lcf/dlio_benchmark/pull/216/hovercard\" href=\"https://github.com/argonne-lcf/dlio_benchmark/pull/216\">#216</a>)"}},{"before":null,"after":"3221d9f063b2ad36467bf232310834186f3ca672","ref":"refs/heads/feature/log","pushedAt":"2024-08-27T22:13:32.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"added configuration for setting log level, workload.workflow.log_level","shortMessageHtmlLink":"added configuration for setting log level, workload.workflow.log_level"}},{"before":"134a94e722a6c8fd4311ec9e72973971e0afef07","after":"82fa0d5445c6d480860b7351759720bfb10ddaf1","ref":"refs/heads/bugfix/sampling","pushedAt":"2024-08-27T21:25:31.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"hariharan-devarajan","name":"Hariharan Devarajan","path":"/hariharan-devarajan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21210820?s=80&v=4"},"commit":{"message":"Merge branch 'main' into bugfix/sampling","shortMessageHtmlLink":"Merge branch 'main' into bugfix/sampling"}},{"before":"866828cef4c741b33ab351ba81c179ec15b002ef","after":"f764d93a87d31849ac7a5998dfa03f4d65ef5bd2","ref":"refs/heads/main","pushedAt":"2024-08-27T21:05:59.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"Fixed mocking for DFTracer (#220)\n\n* Fixed mocking for DFTracer\r\n\r\nThe current mocking was not following the correct signature as used in DFTracer\r\n\r\n* Fixed typo\r\n\r\n* Update utility.py\r\n\r\nMake it more generic\r\n\r\n---------\r\n\r\nCo-authored-by: Huihuo Zheng <zhenghh04@gmail.com>","shortMessageHtmlLink":"Fixed mocking for DFTracer (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2469461255\" data-permission-text=\"Title is private\" data-url=\"https://github.com/argonne-lcf/dlio_benchmark/issues/220\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/argonne-lcf/dlio_benchmark/pull/220/hovercard\" href=\"https://github.com/argonne-lcf/dlio_benchmark/pull/220\">#220</a>)"}},{"before":"9921e943497b54da255b38368b171c5ecac90852","after":"20d1fc153767d7c9f7dd09d10c56607c880467e2","ref":"refs/heads/bugfix/dftracer_mock","pushedAt":"2024-08-23T15:07:00.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"zhenghh04","name":"Huihuo Zheng","path":"/zhenghh04","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/5777773?s=80&v=4"},"commit":{"message":"Update utility.py\n\nMake it more generic","shortMessageHtmlLink":"Update utility.py"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAErShgBgA","startCursor":null,"endCursor":null}},"title":"Activity · argonne-lcf/dlio_benchmark"}