Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add a write_to_athena method to the WithAthena class, writing dataframes to AWS athena. #17

Open
5 tasks
miodohelper opened this issue Jul 22, 2022 · 0 comments
Assignees
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@miodohelper
Copy link
Contributor

miodohelper commented Jul 22, 2022

Context

It is required that Dynamicio can directly write to AWS Athena.

  • Further details about getting started with dynamicio can be found here

Note: #9 is a pre-requisite for this task.

Task

  • Add a write_to_athena method to the WithAthena class, writing dataframes to AWS athena.

Suggested Approach

Dynamicio already uses the boto3 library to access AWS. You'll want to continue using the boto3 class for authentication, and reading/writing where possible.

Please contact [email protected] for instructions on how to test your code against a test AWS Athena instance.

Acceptance Criteria

  • The write_to_athena method should write entire dataframes to athena tables.
  • All existing tests pass.
  • New tests written as required.
  • Readme & docs are updated to reflect the new changes.

The Process

Please fork this repo, commit your changes on a branch, then send @miodohelper a PR request when your work is ready for review. Miodo will review the code before sending the PR for a final review by @Christos-Hadjinikolis.

Expected Duration

8hrs

@miodohelper miodohelper self-assigned this Jul 22, 2022
@miodohelper miodohelper changed the title Add a write_to_athena method to the WithAthena class, writing dataframes to AWS athena. feat: Add a write_to_athena method to the WithAthena class, writing dataframes to AWS athena. Jul 22, 2022
@Christos-Hadjinikolis Christos-Hadjinikolis added enhancement New feature or request help wanted Extra attention is needed labels Jul 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants