Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: refactor e2e test to a script from yaml #3982

Merged
merged 49 commits into from
Aug 12, 2024
Merged
Show file tree
Hide file tree
Changes from 6 commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
fe7ab45
wip: extract e2e test script from yaml
vaind Jul 25, 2024
a393435
update e2e test script
vaind Jul 27, 2024
5c13f0d
move more stuff to e2e.js
vaind Jul 27, 2024
a477d6e
script args
vaind Jul 27, 2024
fc61db5
more stuff moved to e2e.js
vaind Jul 27, 2024
857e6a8
run tests from e2e script
vaind Jul 30, 2024
53e825f
remove e2e build from ci
vaind Jul 30, 2024
dd8abf5
fix ruby/setup-ruby
vaind Jul 30, 2024
b0a2ca2
update actions
vaind Jul 30, 2024
273a376
more script fixes
vaind Jul 30, 2024
7b7a0c2
fixup script on CI
vaind Jul 30, 2024
e368e4a
cleanup
vaind Jul 30, 2024
fd4c50a
fix CI
vaind Jul 30, 2024
b6601a3
fix CI
vaind Jul 30, 2024
655300d
linter issues
vaind Jul 31, 2024
2dc8ebc
Merge branch 'main' into test/e2e-refactor
vaind Jul 31, 2024
3f65502
post-merge script update
vaind Jul 31, 2024
6e94861
Update scripts/e2e.mjs
vaind Jul 31, 2024
612813d
Update scripts/e2e.mjs
vaind Jul 31, 2024
85e6afb
Update scripts/e2e.mjs
vaind Jul 31, 2024
efd1f9a
Update scripts/e2e.mjs
vaind Jul 31, 2024
883f9fb
cleanup
vaind Jul 31, 2024
5701c7c
move webdriveragent build to test
vaind Jul 31, 2024
030049d
cache webdriveragent build
vaind Jul 31, 2024
1739957
Merge branch 'main' into test/e2e-refactor
vaind Jul 31, 2024
d0b1f42
use bundler
vaind Jul 31, 2024
8becfea
Update e2e.yml
vaind Jul 31, 2024
b26695b
fix e2e test run
vaind Jul 31, 2024
009864d
try to fix ci
vaind Jul 31, 2024
d2cd560
Update e2e.yml
vaind Jul 31, 2024
0442bfa
fixes
vaind Jul 31, 2024
35b1c9e
try to remove node module removal
vaind Jul 31, 2024
883b36a
fix caching
vaind Jul 31, 2024
80b5fa4
Revert "try to remove node module removal"
vaind Jul 31, 2024
991927e
fix e2e.yml cache config
vaind Jul 31, 2024
a31ca9a
fix appium invocation
vaind Jul 31, 2024
459e842
handle child processes gracefully
vaind Aug 1, 2024
6c1bb2c
try to fix android test hangs
vaind Aug 1, 2024
11c1692
try to fix ci
vaind Aug 1, 2024
d742a85
tmp: debug session
vaind Aug 1, 2024
f1140fa
tmp killall
vaind Aug 1, 2024
082406e
fix android ci
vaind Aug 1, 2024
5ddfeb9
roll back unintended changes
vaind Aug 1, 2024
92fa628
fix hanging CI
vaind Aug 1, 2024
f554613
ensure node_modules from root are not resolved during e2e test app build
vaind Aug 1, 2024
6074dae
Merge branch 'main' into test/e2e-refactor
vaind Aug 1, 2024
03a948c
Merge branch 'main' into test/e2e-refactor
vaind Aug 5, 2024
6e1ddc3
Merge branch 'main' into test/e2e-refactor
vaind Aug 8, 2024
bdbee2a
Merge branch 'main' into test/e2e-refactor
vaind Aug 9, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
166 changes: 16 additions & 150 deletions .github/workflows/e2e.yml
Original file line number Diff line number Diff line change
Expand Up @@ -162,9 +162,13 @@ jobs:
needs: [diff_check]
if: ${{ needs.diff_check.outputs.skip_ci != 'true' }}
env:
SENTRY_DISABLE_AUTO_UPLOAD: 'true' # TODO: Remove this when testing against a mocked Sentry server
RN_SENTRY_POD_NAME: RNSentry
RN_DIFF_REPOSITORY: https://github.com/react-native-community/rn-diff-purge.git
RN_VERSION: ${{ matrix.rn-version }}
RN_ENGINE: ${{ matrix.engine }}
USE_FRAMEWORKS: ${{ matrix.ios-use-frameworks }}
PRODUCTION: ${{ matrix.build-type == 'production' && '1' || '0' }}
RCT_NEW_ARCH_ENABLED: ${{ matrix.rn-architecture == 'new' && '1' || '0' }}
IOS_RUNTIME: ${{ matrix.runtime }}
IOS_DEVICE: ${{ matrix.device }}
strategy:
fail-fast: false # keeps matrix running if one fails
matrix:
Expand Down Expand Up @@ -281,150 +285,40 @@ jobs:
working-directory: test/e2e
run: yarn install

- name: Build SDK
run: yarn build

- name: Build E2E Tests Library
working-directory: test/e2e
run: yarn build

- name: Package SDK
run: yalc publish

- uses: actions/setup-node@v4
if: ${{ matrix.rn-version == '0.65.3' }}
with:
node-version: 16

- name: Download Plain RN ${{ matrix.rn-version }} App
working-directory: test/react-native/versions
run: git clone $RN_DIFF_REPOSITORY --branch release/${{ matrix.rn-version }} --single-branch ${{ matrix.rn-version }}

- name: Add SDK to App
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp
run: yalc add @sentry/react-native

- name: Install App JS Dependencies
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp
run: yarn install

- name: Add E2E Tests Library to App
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp
run: yarn add ../../../../e2e

- uses: ruby/setup-ruby@v1
if: ${{ matrix.platform == 'ios' }}
with:
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp
vaind marked this conversation as resolved.
Show resolved Hide resolved
ruby-version: '3.3.0' # based on what is used in the sample
bundler-cache: true # runs 'bundle install' and caches installed gems automatically
cache-version: 1 # cache the installed gems
- run: gem install cocoapods -v 1.15.2 # fixes Hermes pod install https://github.com/CocoaPods/CocoaPods/issues/12226#issuecomment-1930604302
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp
if: ${{ matrix.platform == 'ios' }}

- name: Install App Pods
if: ${{ matrix.platform == 'ios' }}
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp/ios
run: |
../../../../rn.patch.podfile.js --pod-file Podfile --engine ${{ matrix.engine }}
[[ "${{ matrix.ios-use-frameworks }}" == "static" ]] && export USE_FRAMEWORKS=static && export NO_FLIPPER=1
[[ "${{ matrix.ios-use-frameworks }}" == "dynamic" ]] && export USE_FRAMEWORKS=dynamic && export NO_FLIPPER=1
[[ "${{ matrix.build-type }}" == "production" ]] && ENABLE_PROD=1 || ENABLE_PROD=0
[[ "${{ matrix.rn-architecture }}" == "new" ]] && ENABLE_NEW_ARCH=1 || ENABLE_NEW_ARCH=0
[[ "${{ matrix.rn-version }}" == "0.65.3" ]] && POD_INSTALL_COMMNAND="pod install" || POD_INSTALL_COMMNAND="bundle exec pod install"
echo "ENABLE_PROD=$ENABLE_PROD"
echo "ENABLE_NEW_ARCH=$ENABLE_NEW_ARCH"
echo "USE_FRAMEWORKS=$USE_FRAMEWORKS"
PRODUCTION=$ENABLE_PROD RCT_NEW_ARCH_ENABLED=$ENABLE_NEW_ARCH $POD_INSTALL_COMMNAND
cat Podfile.lock | grep $RN_SENTRY_POD_NAME

- name: Patch App RN
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp
run: |
patch --verbose --strip=0 --force --ignore-whitespace --fuzz 4 < ../../../rn.patch
../../../rn.patch.app.js --app .
../../../rn.patch.metro.config.js --path metro.config.js

- name: Patch Android App RN
if: ${{ matrix.platform == 'android' }}
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp
run: |
../../../rn.patch.gradle.properties.js --gradle-properties android/gradle.properties --engine ${{ matrix.engine }}
../../../rn.patch.app.build.gradle.js --app-build-gradle android/app/build.gradle

- name: Patch iOS App RN
if: ${{ matrix.platform == 'ios' }}
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp
run: |
../../../rn.patch.xcode.js \
--project ios/RnDiffApp.xcodeproj/project.pbxproj \
--rn-version '${{ matrix.rn-version }}'
- name: Setup Plain RN ${{ matrix.rn-version }} App
run: ./scripts/e2e.mjs ${{ matrix.platform }} --create

# This prevents modules resolution from outside of the RN Test App projects
# during the native app build
- name: Clean SDK node_modules
run: rm -rf node_modules

- name: Build Android App
if: ${{ matrix.platform == 'android' }}
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp/android
run: |
if [[ ${{ matrix.rn-architecture }} == 'new' ]]; then
perl -i -pe's/newArchEnabled=false/newArchEnabled=true/g' gradle.properties
echo 'New Architecture enabled'
fi
[[ "${{ matrix.build-type }}" == "production" ]] && CONFIG='Release' || CONFIG='Debug'
echo "Building $CONFIG"
./gradlew ":app:assemble$CONFIG" -PreactNativeArchitectures=x86

- name: Build iOS App
if: ${{ matrix.platform == 'ios' }}
working-directory: test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp/ios
run: |
[[ "${{ matrix.build-type }}" == "production" ]] && CONFIG='Release' || CONFIG='Debug'
echo "Building $CONFIG"
mkdir -p "DerivedData"
derivedData="$(cd "DerivedData" ; pwd -P)"
set -o pipefail && xcodebuild \
-workspace RnDiffApp.xcworkspace \
-configuration "$CONFIG" \
-scheme RnDiffApp \
-destination 'platform=iOS Simulator,OS=${{ matrix.runtime }},name=${{ matrix.device }}' \
ONLY_ACTIVE_ARCH=yes \
-derivedDataPath "$derivedData" \
build \
| tee xcodebuild.log \
| xcbeautify --quieter --is-ci --disable-colored-output

- name: Archive Android APK
if: matrix.platform == 'android' && matrix.build-type == 'production'
run: |
BUILD_PATH=test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp/android/app/build/outputs/apk/release
BUILD_NAME=app-release.apk
tar -cvf apk.tar -C $BUILD_PATH $BUILD_NAME

- name: Archive iOS APP
if: matrix.platform == 'ios' && matrix.build-type == 'production'
run: |
BUILD_PATH=test/react-native/versions/${{ matrix.rn-version }}/RnDiffApp/ios/DerivedData/Build/Products/Release-iphonesimulator
BUILD_NAME=RnDiffApp.app
tar -cvf app.tar -C $BUILD_PATH $BUILD_NAME

- name: Upload App APK
if: matrix.platform == 'android' && matrix.build-type == 'production'
uses: actions/upload-artifact@v4
with:
name: ${{ matrix.rn-version }}-${{ matrix.rn-architecture }}-${{ matrix.engine }}-${{ matrix.platform }}-${{ matrix.build-type }}-${{ matrix.ios-use-frameworks }}-app-package
path: apk.tar
retention-days: 1
- name: Build Plain RN ${{ matrix.rn-version }} App
run: ./scripts/e2e.mjs ${{ matrix.platform }} --build

- name: Upload App APP
if: matrix.platform == 'ios' && matrix.build-type == 'production'
- name: Upload App
if: matrix.build-type == 'production'
uses: actions/upload-artifact@v4
with:
name: ${{ matrix.rn-version }}-${{ matrix.rn-architecture }}-${{ matrix.engine }}-${{ matrix.platform }}-${{ matrix.build-type }}-${{ matrix.ios-use-frameworks }}-app-package
path: app.tar
path: test/e2e/test-app.ap*
retention-days: 1

- name: Upload logs
Expand Down Expand Up @@ -494,10 +388,6 @@ jobs:
name: ${{ matrix.rn-version }}-${{ matrix.rn-architecture }}-${{ matrix.engine }}-${{ matrix.platform }}-${{ matrix.build-type }}-${{ matrix.ios-use-frameworks }}-app-package
path: test/e2e

- name: Extract App Package
working-directory: test/e2e
run: tar -xvf *.tar

- uses: actions/setup-node@v4
with:
node-version: 20
Expand Down Expand Up @@ -552,25 +442,10 @@ jobs:
| tee xcodebuild.log \
| xcbeautify --quieter --is-ci --disable-colored-output

- name: Start Appium Server
working-directory: test/e2e
run: yarn run appium --log-timestamp --log-no-colors --log appium.${{ matrix.platform }}.log &

# Wait until the Appium server starts.
- name: Check Appium Server
uses: nick-fields/retry@7152eba30c6575329ac0576536151aca5a72780e # [email protected]
with:
timeout_seconds: 60
max_attempts: 10
command: curl --output /dev/null --silent --head --fail http://127.0.0.1:4723/sessions

- name: Run tests on Android
if: ${{ matrix.platform == 'android' }}
env:
APPIUM_APP: ./app-release.apk
uses: reactivecircus/android-emulator-runner@77986be26589807b8ebab3fde7bbf5c60dabec32 # [email protected]
with:
working-directory: test/e2e
api-level: 30
force-avd-creation: false
disable-animations: true
Expand All @@ -586,20 +461,11 @@ jobs:
-camera-back none
-camera-front none
-timezone US/Pacific
script: |
# Collect logs
adb logcat '*:D' 2>&1 >adb.log &
adb devices -l

yarn test --verbose
script: ./scripts/e2e.mjs ${{ matrix.platform }} --test

- name: Run tests on iOS
if: ${{ matrix.platform == 'ios' }}
working-directory: test/e2e
env:
APPIUM_APP: ./RnDiffApp.app
APPIUM_DERIVED_DATA: DerivedData
run: yarn test --verbose
run: ./scripts/e2e.mjs ${{ matrix.platform }} --test

- name: Upload logs
if: ${{ always() }}
Expand Down
Loading
Loading