Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for writing Ion Binary #39

Closed
wants to merge 1 commit into from
Closed

Conversation

raganhan
Copy link
Contributor

@raganhan raganhan commented Oct 5, 2018

Suport for writing Ion binary through the encoding SerDe property.

A lot of changes are due to normalizing the copyright notice after adding a checkstyle check to ensure that all files have it and it's all the same

#22
#4

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Suport for writing Ion binary through the encoding SerDe property.

#22
#4
@raganhan raganhan requested a review from therapon October 5, 2018 22:16
*
* @param path path to create the directory.
* @return true if the directory was created, false otherwise.
*/
fun mkdir(path: String) = File(path).mkdirs()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: I would add the return type on the Kotlin signature as well, in case we alter the body in a way that alters the return type. Documents and possibly catches us from making an API change.

Since I am here. Are we planning to add the program that analyzes API changes for us on each version (todo or issue here would suffice)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#40

This is part of test code so we don't need to care much about breaking changes. Also since the SerDe not a general purpose library but a Hive plugin backward compatibility is not that important, it's more important to be compatible with Hive versions

fun isClosed() = connection.isClosed

/**
* Drops all hive tables in the current database.
*
* **Note**: External tables don't their data destroyed.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

don't have their data destroyed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

external tables are akin to views. The data is actually managed by something else, e.g. HDFS, S3, so a drop table drops only the metadata but no data

@raganhan
Copy link
Contributor Author

Merged manually

@raganhan raganhan closed this Oct 16, 2018
@raganhan raganhan deleted the hadoop-output-format-22 branch October 16, 2018 17:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants