Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Re-enable GitHub Actions for macOS #4

Open
dmikurube opened this issue Nov 9, 2021 · 3 comments
Open

Re-enable GitHub Actions for macOS #4

dmikurube opened this issue Nov 9, 2021 · 3 comments

Comments

@dmikurube
Copy link
Member

dmikurube commented Nov 9, 2021 •
edited
Loading

Between Oct 7 and Nov 5, 2021, its tests on GitHub Actions stopped working on macOS for some unknown reason.

We disabled macOS in embulk/embulk-standards#15, but we intend to re-enable it when macOS goes okay.
@dmikurube dmikurube mentioned this issue Nov 9, 2021
Merged
@dmikurube dmikurube transferred this issue from embulk/embulk-standards Jul 31, 2023
@hiroyuki-sato
Copy link
Member

hiroyuki-sato commented Aug 1, 2023 •
edited
Loading

I tried re-enabled macOS. It timed out.
https://github.com/hiroyuki-sato/embulk-parser-csv/actions/runs/5723714784/job/15508805650

Run ./gradlew --stacktrace :check embulk-guess-csv:check embulk-guess-csv_all_strings:check
  ./gradlew --stacktrace :check embulk-guess-csv:check embulk-guess-csv_all_strings:check
  shell: /bin/bash -e {0}
  env:
    JAVA_HOME: /Users/runner/hostedtoolcache/Java_Temurin-Hotspot_jdk/8.0.372-7/x64/Contents/Home
    JAVA_HOME_8_X64: /Users/runner/hostedtoolcache/Java_Temurin-Hotspot_jdk/8.0.372-7/x64/Contents/Home
Downloading https://services.gradle.org/distributions/gradle-7.6.1-bin.zip
...........10%............20%...........30%............40%............50%...........60%............70%............80%...........90%............100%

Welcome to Gradle 7.6.1!

Here are the highlights of this release:
 - Added support for Java 19.
 - Introduced `--rerun` flag for individual task rerun.
 - Improved dependency block for test suites to be strongly typed.
 - Added a pluggable system for Java toolchains provisioning.

For more details see https://docs.gradle.org/7.6.1/release-notes.html

Starting a Gradle Daemon (subsequent builds will be faster)
/Users/runner/work/embulk-parser-csv/embulk-parser-csv/src/main/java/org/embulk/parser/csv/CsvParserPlugin.java:422: warning: [deprecation] setJson(org.embulk.spi.Column,org.msgpack.value.Value) in org.embulk.spi.PageBuilder has been deprecated

                                            pageBuilder.setJson(column, jsonParser.parse(v));
> Task :compileJava
                                                       ^
1 warning

> Task :processResources NO-SOURCE
> Task :classes
/Users/runner/work/embulk-parser-csv/embulk-parser-csv/src/test/java/org/embulk/standards/preview/TestFilePreview.java:101: warning: [deprecation] <T>assertThat(T,org.hamcrest.Matcher<? super T>) in org.junit.Assert has been deprecated

        assertThat(readFile(outputPath), is(readResource(RESOURCE_NAME_PREFIX + resultCsvResourceName)));
> Task :compileTestJava
        ^
1 warning

> Task :processTestResources
> Task :testClasses
> Task :checkstyleMain

> Task :test

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeNull STANDARD_ERROR
    SLF4J: No SLF4J providers were found.
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeNull STANDARD_OUT
     Random seed: 0x5e1099520d4c8f62L

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeNull STANDARD_ERROR
    Hidden dependencies are uninitialized. Maybe using classes loaded by Embulk's top-level ClassLoader.

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeNull PASSED

org.embulk.parser.csv.TestCsvParserPlugin > checkColumnsRequired STANDARD_OUT
     Random seed: 0x74a5f9e1c6b8c44L

org.embulk.parser.csv.TestCsvParserPlugin > checkColumnsRequired PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteUnspecified STANDARD_OUT
     Random seed: 0xab36338c8428a02fL

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteUnspecified PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteBackslash STANDARD_OUT
     Random seed: 0x5c732de1da85f182L

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteBackslash PASSED

org.embulk.parser.csv.TestCsvParserPlugin > checkLoadConfig STANDARD_OUT
     Random seed: 0x1d026129f9a14163L

org.embulk.parser.csv.TestCsvParserPlugin > checkLoadConfig PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteNull STANDARD_OUT
     Random seed: 0xeea4daaa5923b795L

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteNull PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeBackslash STANDARD_OUT
     Random seed: 0x28e588e6270bafefL

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeBackslash PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeUnspecified STANDARD_OUT
     Random seed: 0x1c69d864d2c6da6dL

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeUnspecified PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteQuotation STANDARD_OUT
     Random seed: 0x528c43be0806800cL

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteQuotation PASSED

org.embulk.parser.csv.TestCsvParserPlugin > checkDefaultValues STANDARD_OUT
     Random seed: 0x72b8b4876b9d937dL

org.embulk.parser.csv.TestCsvParserPlugin > checkDefaultValues PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeSlash STANDARD_OUT
     Random seed: 0xd671be28a92e0dc2L

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeSlash PASSED

org.embulk.standards.preview.TestFilePreview > changePreviewSampleBufferBytes STANDARD_ERROR
    SLF4J: No SLF4J providers were found.
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.
    Hidden dependencies are uninitialized. Maybe using classes loaded by Embulk's top-level ClassLoader.

> Task :checkstyleTest
Error: The operation was canceled.

And on my macOS result.

./gradlew --stacktrace :check embulk-guess-csv:check embulk-guess-csv_all_strings:check

> Task :compileJava
/path/to/embulk-parser-csv/src/main/java/org/embulk/parser/csv/CsvParserPlugin.java:422: warning: [deprecation] setJson(org.embulk.spi.Column,org.msgpack.value.Value) in org.embulk.spi.PageBuilder has been deprecated
                                            pageBuilder.setJson(column, jsonParser.parse(v));
                                                       ^
1 warning

> Task :compileTestJava
/path/to/embulk-parser-csv/src/test/java/org/embulk/standards/preview/TestFilePreview.java:101: warning: [deprecation] <T>assertThat(T,org.hamcrest.Matcher<? super T>) in org.junit.Assert has been deprecated
        assertThat(readFile(outputPath), is(readResource(RESOURCE_NAME_PREFIX + resultCsvResourceName)));
        ^
1 warning

> Task :test

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeNull STANDARD_ERROR
    SLF4J: No SLF4J providers were found.
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeNull STANDARD_OUT
     Random seed: 0x4120c4593d907aa9L

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeNull STANDARD_ERROR
    Hidden dependencies are uninitialized. Maybe using classes loaded by Embulk's top-level ClassLoader.

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeNull PASSED

org.embulk.parser.csv.TestCsvParserPlugin > checkColumnsRequired STANDARD_OUT
     Random seed: 0x174c01d6411e33adL

org.embulk.parser.csv.TestCsvParserPlugin > checkColumnsRequired PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteUnspecified STANDARD_OUT
     Random seed: 0x3aa5b7d3297bdf4aL

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteUnspecified PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteBackslash STANDARD_OUT
     Random seed: 0x4e3852d146c7da37L

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteBackslash PASSED

org.embulk.parser.csv.TestCsvParserPlugin > checkLoadConfig STANDARD_OUT
     Random seed: 0xd722653599c7b209L

org.embulk.parser.csv.TestCsvParserPlugin > checkLoadConfig PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteNull STANDARD_OUT
     Random seed: 0x72f5101a8e99fa1cL

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteNull PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeBackslash STANDARD_OUT
     Random seed: 0xbc961ca0efc407faL

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeBackslash PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeUnspecified STANDARD_OUT
     Random seed: 0x8516eaf8a9162c57L

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeUnspecified PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteQuotation STANDARD_OUT
     Random seed: 0xa5e5f56c664e716cL

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerQuoteQuotation PASSED

org.embulk.parser.csv.TestCsvParserPlugin > checkDefaultValues STANDARD_OUT
     Random seed: 0xa4477e46473b615L

org.embulk.parser.csv.TestCsvParserPlugin > checkDefaultValues PASSED

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeSlash STANDARD_OUT
     Random seed: 0xdb214a05b1f714b3L

org.embulk.parser.csv.TestCsvParserPlugin > testCsvTokenizerEscapeSlash PASSED

org.embulk.standards.preview.TestFilePreview > changePreviewSampleBufferBytes STANDARD_ERROR
    SLF4J: No SLF4J providers were found.
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.
    Hidden dependencies are uninitialized. Maybe using classes loaded by Embulk's top-level ClassLoader.

org.embulk.standards.preview.TestFilePreview > changePreviewSampleBufferBytes PASSED

org.embulk.standards.preview.TestFilePreview > testSimple PASSED

> Task :embulk-guess-csv:compileTestJava
/path/to/embulk-parser-csv/embulk-guess-csv/src/test/java/org/embulk/guess/csv/TestCsvGuessPlugin.java:43: warning: [unchecked] unchecked cast
        final List<Map> columnsActual = (List<Map>) actual.getNested("parser").get(List.class, "columns");
                                                                                  ^
  required: java.util.List<java.util.Map>
  found:    java.util.List
/path/to/embulk-parser-csv/embulk-guess-csv/src/test/java/org/embulk/standards/guess/TestCsvGuessPlugin.java:264: warning: [deprecation] <T>assertThat(T,org.hamcrest.Matcher<? super T>) in org.junit.Assert has been deprecated
        assertThat(guessed, is((DataSource) embulk.loadYamlResource(RESOURCE_NAME_PREFIX + resultResourceName)));
        ^
2 warnings

> Task :embulk-guess-csv:test

org.embulk.guess.csv.TestCsvGuessPlugin > testTrimFlagWhenWillBeLongIfStripArroundSpace STANDARD_ERROR
    SLF4J: No SLF4J providers were found.
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.

org.embulk.guess.csv.TestCsvGuessPlugin > testTrimFlagWhenWillBeLongIfStripArroundSpace PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testQuote PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testSkipHeaderLinesOne PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testComplexLine PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testCommentLineMarker PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testSkipHeaderLinesThree PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testColumnsWithHeader PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testDelimiterDetection PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testNullString PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testEscape PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testLargeLong PASSED

org.embulk.guess.csv.TestCsvGuessPlugin > testColumnsWithoutHeader PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor1RowsAndHeaderWithTrimNeeded STANDARD_ERROR
    SLF4J: No SLF4J providers were found.
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.
    Hidden dependencies are uninitialized. Maybe using classes loaded by Embulk's top-level ClassLoader.

org.embulk.standards.guess.TestCsvGuessPlugin > testFor1RowsAndHeaderWithTrimNeeded PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > skipSuggestIfEmptySampleRecords PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testDoubleSingleColumn PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > suggestTabAsDelimiter PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor2RowsAndHeader PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor1StringSingleColumnRow PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > suggestSemicolonAsDelimiter PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor1RowsAndHeader PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > suggestSingleQuoteAsQuote PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > suggestBackslashAsEscape PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor2StringSingleColumnRows PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor1IntSingleColumnRow PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor1StringSingleColumnAndHeader PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testStringSingleColumn PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testComplex PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor1RowsWithTrimNeeded PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testIntSingleColumnWithHeader PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testMergeTimeFormats PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor1Rows PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor2Rows PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testIntSingleColumn PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testHeader PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor2IntSingleColumnRows PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testSimple PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testStringSingleColumnWithHeader PASSED

org.embulk.standards.guess.TestCsvGuessPlugin > testFor1IntSingleColumnAndHeader PASSED

> Task :embulk-guess-csv_all_strings:compileTestJava
/path/to/embulk-parser-csv/embulk-guess-csv_all_strings/src/test/java/org/embulk/standards/guess/TestCsvAllStringsGuessPlugin.java:83: warning: [deprecation] <T>assertThat(T,org.hamcrest.Matcher<? super T>) in org.junit.Assert has been deprecated
        assertThat(guessed, is((DataSource) embulk.loadYamlResource(RESOURCE_NAME_PREFIX + "test_simple_guessed.yml")));
        ^
1 warning

> Task :embulk-guess-csv_all_strings:test

org.embulk.guess.csv_all_strings.TestCsvAllStringsGuessPlugin > testColumnsWithHeader STANDARD_ERROR
    SLF4J: No SLF4J providers were found.
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.

org.embulk.guess.csv_all_strings.TestCsvAllStringsGuessPlugin > testColumnsWithHeader PASSED

org.embulk.guess.csv_all_strings.TestCsvAllStringsGuessPlugin > testColumnsWithoutHeader PASSED

org.embulk.standards.guess.TestCsvAllStringsGuessPlugin > testSimple STANDARD_ERROR
    SLF4J: No SLF4J providers were found.
    SLF4J: Defaulting to no-operation (NOP) logger implementation
    SLF4J: See https://www.slf4j.org/codes.html#noProviders for further details.
    Hidden dependencies are uninitialized. Maybe using classes loaded by Embulk's top-level ClassLoader.

org.embulk.standards.guess.TestCsvAllStringsGuessPlugin > testSimple PASSED

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.6.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD SUCCESSFUL in 17s
19 actionable tasks: 19 executed

@hiroyuki-sato
Copy link
Member

I'm not sure of the root cause yet.
But, this infinite loop relates to this part. (I disabled embulk-guess-csv and embulk-guess-csv_all_strings tests)
https://github.com/embulk/embulk-parser-csv/blob/main/src/test/java/org/embulk/standards/preview/TestFilePreview.java#L99

It means that embulk preview is running forever.

        // execute preview
        final PreviewResult result = builder.in(load).outputPath(outputPath).preview();

@dmikurube
Copy link
Member Author

Thanks for your deeper investigation! Hmm, I see... When we get some time, let's dive deeper on it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dmikurube @hiroyuki-sato