{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":465044203,"defaultBranch":"main","name":"ea_airflow_util","ownerLogin":"edanalytics","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-03-01T20:21:20.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/8584241?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1726116731.0","currentOid":""},"activityList":{"items":[{"before":"723e808a167a4fc303b4b76e38f55727c9fcb8fc","after":null,"ref":"refs/heads/hotfix/sleep_on_aws_param_store","pushedAt":"2024-09-12T04:52:11.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"}},{"before":null,"after":"723e808a167a4fc303b4b76e38f55727c9fcb8fc","ref":"refs/heads/hotfix/sleep_on_aws_param_store","pushedAt":"2024-09-11T22:49:17.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Make number of seconds to sleep between ParamStore pagination editable in DAG arguments.","shortMessageHtmlLink":"Make number of seconds to sleep between ParamStore pagination editabl…"}},{"before":"98593416db96ca75d6aa085b3055b87869db0334","after":null,"ref":"refs/heads/rc/0.3.2","pushedAt":"2024-09-05T20:43:56.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"}},{"before":"d4efb39919d0a3164f9c558efe3290dc0736c2e1","after":"0102af38c26e6703674d1103a4eb3dfef781283a","ref":"refs/heads/main","pushedAt":"2024-09-05T20:43:53.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Release Candidate v0.3.2 (#53)\n\n* Update project version metadata.\r\n\r\n* Feature/Sharefile custom users DAG & S3 to Snowflake standardization (#50)\r\n\r\n* add sharefile dag and helpers\r\n\r\n* use S3ToSnowflake operator\r\n\r\n* use correct operator\r\n\r\n* fix metadata column name\r\n\r\n* datetime issues\r\n\r\n* rename to num_expected_files and make use optional\r\n\r\n* Feature/simplify sharefile to disk (#49)\r\n\r\n* Add type hints and comments; make ds_nodash and ts_nodash optional; reduce number of loops and simply variable-referencing.\r\n\r\n* Simplify Regex call.\r\n\r\n* Deprecate ds_nodash and ts_nodash from sharefile callable.\r\n\r\n* Raise HTTP errors for all ShareFile hook exceptions, instead of generic Airflow exceptions.\r\n\r\n* Update .gitignore.\r\n\r\n* add logging when deleting from sharefile\r\n\r\n* Add kwargs to sharefile_to_disk() for Airflow context paramter overflow.\r\n\r\n---------\r\n\r\nCo-authored-by: johncmerfeld \r\n\r\n* Feature/dynamic aws param store to airflow dag (#48)\r\n\r\n* Allow wildcards to be passed to SSM prefix strings (untested).\r\n\r\n* BugFix (wrong datatype for ParameterFilters).\r\n\r\n* Bugfix (revert logic when not using wildcards).\r\n\r\n* Minor cleanup.\r\n\r\n* Add 1 second sleep between page gets.\r\n\r\n* Ignore unexpected keys in collected connections.\r\n\r\n* Attempt to fix parameter filters to use both Recursive and Contains options.\r\n\r\n* Clean up error handling in AWS ParamStore DAG.\r\n\r\n* Cleanup to try to use a single filter.\r\n\r\n* Output missing paramstore keys in DAG.\r\n\r\n* Bugfix: set.difference()\r\n\r\n* Update metadata files.\r\n\r\n* Update ssm.py\r\n\r\n* Update CHANGELOG with missing updates.\r\n\r\n* Callable: S3 to Sharefile (#51)\r\n\r\n* init\r\n\r\n* tested code\r\n\r\n* update docs\r\n\r\n* use None instead of empty string\r\n\r\n* update allshared comment\r\n\r\n---------\r\n\r\nCo-authored-by: Jay Kaiser \r\n\r\n* Hotfix/support files in ftp (#52)\r\n\r\n* Overload FTP.download_all() to support files.\r\n\r\n* Fix file passed as remote_dir.\r\n\r\n* Update CHANGELOG.\r\n\r\n---------\r\n\r\nCo-authored-by: Samantha LeBlanc <56237580+sleblanc23@users.noreply.github.com>\r\nCo-authored-by: johncmerfeld ","shortMessageHtmlLink":"Release Candidate v0.3.2 (#53)"}},{"before":"61ea109fe74e02d9da73caccf8596e7ef39b79f7","after":"98593416db96ca75d6aa085b3055b87869db0334","ref":"refs/heads/rc/0.3.2","pushedAt":"2024-09-05T19:26:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Update CHANGELOG.","shortMessageHtmlLink":"Update CHANGELOG."}},{"before":"377b2407dc7849893da2b5e09d121011e9bef5f5","after":null,"ref":"refs/heads/hotfix/support_files_in_ftp","pushedAt":"2024-09-05T19:12:08.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"}},{"before":"3c0d1addc4e30e9460057b0c1458ba8987e2da86","after":"61ea109fe74e02d9da73caccf8596e7ef39b79f7","ref":"refs/heads/rc/0.3.2","pushedAt":"2024-09-05T19:12:06.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Hotfix/support files in ftp (#52)\n\n* Overload FTP.download_all() to support files.\r\n\r\n* Fix file passed as remote_dir.","shortMessageHtmlLink":"Hotfix/support files in ftp (#52)"}},{"before":"e45a0dc9a74f2fedf750b62a15e335c9e462d2c5","after":null,"ref":"refs/heads/feature/simplify_sharefile_to_disk","pushedAt":"2024-09-05T18:58:04.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"}},{"before":"b90d89459ceebc48dc836111624256845707c613","after":null,"ref":"refs/heads/feature/dynamic_aws_param_store_to_airflow_dag","pushedAt":"2024-09-05T18:58:03.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"}},{"before":"49c7900a5c20449b8c549d4dd901dcff5ad766ee","after":null,"ref":"refs/heads/feature/s3-to-sharefile","pushedAt":"2024-09-05T18:58:02.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"}},{"before":"a7622c39d233224d8a6f0ed5465c3b319d4c3122","after":"377b2407dc7849893da2b5e09d121011e9bef5f5","ref":"refs/heads/hotfix/support_files_in_ftp","pushedAt":"2024-09-05T16:16:55.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Fix file passed as remote_dir.","shortMessageHtmlLink":"Fix file passed as remote_dir."}},{"before":null,"after":"a7622c39d233224d8a6f0ed5465c3b319d4c3122","ref":"refs/heads/hotfix/support_files_in_ftp","pushedAt":"2024-09-05T15:45:39.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Overload FTP.download_all() to support files.","shortMessageHtmlLink":"Overload FTP.download_all() to support files."}},{"before":null,"after":"57986aeed1e9eb29ccd6c8a691a064799275adfe","ref":"refs/heads/feature/more_s3_callables","pushedAt":"2024-08-26T20:18:19.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"sleblanc23","name":"Samantha LeBlanc","path":"/sleblanc23","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/56237580?s=80&v=4"},"commit":{"message":"add s3 to local and delete from s3","shortMessageHtmlLink":"add s3 to local and delete from s3"}},{"before":"6284fac2526aa7353b050735fb3d3791f6158a2e","after":"3c0d1addc4e30e9460057b0c1458ba8987e2da86","ref":"refs/heads/rc/0.3.2","pushedAt":"2024-08-23T14:25:08.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Callable: S3 to Sharefile (#51)\n\n* init\r\n\r\n* tested code\r\n\r\n* update docs\r\n\r\n* use None instead of empty string\r\n\r\n* update allshared comment\r\n\r\n---------\r\n\r\nCo-authored-by: Jay Kaiser ","shortMessageHtmlLink":"Callable: S3 to Sharefile (#51)"}},{"before":"2fda633a19a2eafef5ce30487efb778205feb590","after":"49c7900a5c20449b8c549d4dd901dcff5ad766ee","ref":"refs/heads/feature/s3-to-sharefile","pushedAt":"2024-08-22T13:10:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"johncmerfeld","name":"John C. Merfeld","path":"/johncmerfeld","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/11447044?s=80&v=4"},"commit":{"message":"update allshared comment","shortMessageHtmlLink":"update allshared comment"}},{"before":"e3aa6000b2c66142d76dfd70317f35addada5b7b","after":"2fda633a19a2eafef5ce30487efb778205feb590","ref":"refs/heads/feature/s3-to-sharefile","pushedAt":"2024-08-21T19:51:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"johncmerfeld","name":"John C. Merfeld","path":"/johncmerfeld","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/11447044?s=80&v=4"},"commit":{"message":"use None instead of empty string","shortMessageHtmlLink":"use None instead of empty string"}},{"before":"59d6261f56a879279820b33773d938db21affd5e","after":"e3aa6000b2c66142d76dfd70317f35addada5b7b","ref":"refs/heads/feature/s3-to-sharefile","pushedAt":"2024-08-21T14:25:59.000Z","pushType":"push","commitsCount":2,"pusher":{"login":"johncmerfeld","name":"John C. Merfeld","path":"/johncmerfeld","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/11447044?s=80&v=4"},"commit":{"message":"add comment about allshared","shortMessageHtmlLink":"add comment about allshared"}},{"before":"dd02571a65ee18a491f645c6d40196a46addc875","after":"6284fac2526aa7353b050735fb3d3791f6158a2e","ref":"refs/heads/rc/0.3.2","pushedAt":"2024-08-20T22:58:11.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Update CHANGELOG with missing updates.","shortMessageHtmlLink":"Update CHANGELOG with missing updates."}},{"before":"2927b66599a5911bc6850207e46aa08b0ca5f27e","after":"59d6261f56a879279820b33773d938db21affd5e","ref":"refs/heads/feature/s3-to-sharefile","pushedAt":"2024-08-20T22:46:38.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Merge branch 'rc/0.3.2' into feature/s3-to-sharefile","shortMessageHtmlLink":"Merge branch 'rc/0.3.2' into feature/s3-to-sharefile"}},{"before":"47af1785de1efc4ee1b729903d6c4f1e9478b80f","after":"dd02571a65ee18a491f645c6d40196a46addc875","ref":"refs/heads/rc/0.3.2","pushedAt":"2024-08-20T22:45:06.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Feature/dynamic aws param store to airflow dag (#48)\n\n* Allow wildcards to be passed to SSM prefix strings (untested).\r\n\r\n* BugFix (wrong datatype for ParameterFilters).\r\n\r\n* Bugfix (revert logic when not using wildcards).\r\n\r\n* Minor cleanup.\r\n\r\n* Add 1 second sleep between page gets.\r\n\r\n* Ignore unexpected keys in collected connections.\r\n\r\n* Attempt to fix parameter filters to use both Recursive and Contains options.\r\n\r\n* Clean up error handling in AWS ParamStore DAG.\r\n\r\n* Cleanup to try to use a single filter.\r\n\r\n* Output missing paramstore keys in DAG.\r\n\r\n* Bugfix: set.difference()\r\n\r\n* Update metadata files.\r\n\r\n* Update ssm.py","shortMessageHtmlLink":"Feature/dynamic aws param store to airflow dag (#48)"}},{"before":"ac127ed0c663a4cc339010069f9b3a84f0bc42ae","after":"b90d89459ceebc48dc836111624256845707c613","ref":"refs/heads/feature/dynamic_aws_param_store_to_airflow_dag","pushedAt":"2024-08-20T22:44:59.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Merge branch 'rc/0.3.2' into feature/dynamic_aws_param_store_to_airflow_dag","shortMessageHtmlLink":"Merge branch 'rc/0.3.2' into feature/dynamic_aws_param_store_to_airfl…"}},{"before":"8190f1f03aad254913f5abbe21f74684fea0983c","after":"47af1785de1efc4ee1b729903d6c4f1e9478b80f","ref":"refs/heads/rc/0.3.2","pushedAt":"2024-08-20T22:44:02.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Feature/simplify sharefile to disk (#49)\n\n* Add type hints and comments; make ds_nodash and ts_nodash optional; reduce number of loops and simply variable-referencing.\r\n\r\n* Simplify Regex call.\r\n\r\n* Deprecate ds_nodash and ts_nodash from sharefile callable.\r\n\r\n* Raise HTTP errors for all ShareFile hook exceptions, instead of generic Airflow exceptions.\r\n\r\n* Update .gitignore.\r\n\r\n* add logging when deleting from sharefile\r\n\r\n* Add kwargs to sharefile_to_disk() for Airflow context paramter overflow.\r\n\r\n---------\r\n\r\nCo-authored-by: johncmerfeld ","shortMessageHtmlLink":"Feature/simplify sharefile to disk (#49)"}},{"before":"59e853ee36f3483129601a6b90fbcd3eaa56b84f","after":"e45a0dc9a74f2fedf750b62a15e335c9e462d2c5","ref":"refs/heads/feature/simplify_sharefile_to_disk","pushedAt":"2024-08-20T22:43:54.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Merge branch 'rc/0.3.2' into feature/simplify_sharefile_to_disk","shortMessageHtmlLink":"Merge branch 'rc/0.3.2' into feature/simplify_sharefile_to_disk"}},{"before":"3ee448bc0a4264b2964b7df995a2b29a21cd64cb","after":"8190f1f03aad254913f5abbe21f74684fea0983c","ref":"refs/heads/rc/0.3.2","pushedAt":"2024-08-20T22:41:24.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Feature/Sharefile custom users DAG & S3 to Snowflake standardization (#50)\n\n* add sharefile dag and helpers\r\n\r\n* use S3ToSnowflake operator\r\n\r\n* use correct operator\r\n\r\n* fix metadata column name\r\n\r\n* datetime issues\r\n\r\n* rename to num_expected_files and make use optional","shortMessageHtmlLink":"Feature/Sharefile custom users DAG & S3 to Snowflake standardization (#…"}},{"before":null,"after":"3ee448bc0a4264b2964b7df995a2b29a21cd64cb","ref":"refs/heads/rc/0.3.2","pushedAt":"2024-08-20T22:40:47.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Update project version metadata.","shortMessageHtmlLink":"Update project version metadata."}},{"before":"554352208058da9af209261103509a97de4ba5b8","after":"dca19596a084368a7f92e22cb9492147d0ffbdf5","ref":"refs/heads/feature/sharefile_custom_users","pushedAt":"2024-08-14T18:45:00.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"sleblanc23","name":"Samantha LeBlanc","path":"/sleblanc23","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/56237580?s=80&v=4"},"commit":{"message":"rename to num_expected_files and make use optional","shortMessageHtmlLink":"rename to num_expected_files and make use optional"}},{"before":"97a1b7757e583530e955d1b18e72a0b674abf375","after":"2927b66599a5911bc6850207e46aa08b0ca5f27e","ref":"refs/heads/feature/s3-to-sharefile","pushedAt":"2024-08-14T15:49:47.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"johncmerfeld","name":"John C. Merfeld","path":"/johncmerfeld","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/11447044?s=80&v=4"},"commit":{"message":"update docs","shortMessageHtmlLink":"update docs"}},{"before":"1b1b5723924ee0768a816decb4b1ebd21e593b3f","after":"97a1b7757e583530e955d1b18e72a0b674abf375","ref":"refs/heads/feature/s3-to-sharefile","pushedAt":"2024-08-14T15:34:59.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"johncmerfeld","name":"John C. Merfeld","path":"/johncmerfeld","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/11447044?s=80&v=4"},"commit":{"message":"tested code","shortMessageHtmlLink":"tested code"}},{"before":null,"after":"1b1b5723924ee0768a816decb4b1ebd21e593b3f","ref":"refs/heads/feature/s3-to-sharefile","pushedAt":"2024-08-12T21:37:18.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"johncmerfeld","name":"John C. Merfeld","path":"/johncmerfeld","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/11447044?s=80&v=4"},"commit":{"message":"init","shortMessageHtmlLink":"init"}},{"before":"6b761389b8ff11b3d804af93a40d8f1d048a6eb6","after":"59e853ee36f3483129601a6b90fbcd3eaa56b84f","ref":"refs/heads/feature/simplify_sharefile_to_disk","pushedAt":"2024-08-08T22:44:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"jayckaiser","name":"Jay Kaiser","path":"/jayckaiser","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/22627573?s=80&v=4"},"commit":{"message":"Add kwargs to sharefile_to_disk() for Airflow context paramter overflow.","shortMessageHtmlLink":"Add kwargs to sharefile_to_disk() for Airflow context paramter overflow."}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEs-8-SwA","startCursor":null,"endCursor":null}},"title":"Activity · edanalytics/ea_airflow_util"}