Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade conan2 (#1242) #1244

Open
wants to merge 133 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
133 commits
Select commit Hold shift + click to select a range
6029aa5
Upgrade conan2 (#1242)
curioyang Sep 12, 2024
6a472f5
Apply code-format changes
curioyang Sep 12, 2024
1d1a307
fix python build
Sep 12, 2024
aa8a8e1
Merge branch 'upgrade_conan2' of https://github.com/kendryte/nncase i…
Sep 12, 2024
8105e1b
fix python build
Sep 12, 2024
c96daa2
fix python build
Sep 12, 2024
8688d03
fix python build
Sep 12, 2024
4afa951
fix python build
Sep 12, 2024
4b849fa
fix python build
Sep 12, 2024
bea680e
only test linux python build
Sep 12, 2024
dae0f4e
only test linux python build
Sep 12, 2024
ef7229e
only test linux python build
Sep 12, 2024
4d4f5e4
only test linux python build
Sep 12, 2024
c37b6d1
only test linux python build
Sep 12, 2024
b92dfd3
only test linux python build
Sep 12, 2024
400a7a1
only test linux python build
Sep 12, 2024
4d5afbd
only test linux python build
Sep 12, 2024
71cb12d
only test linux python build
Sep 12, 2024
48dae15
only test linux python build
Sep 12, 2024
08c77bc
only test linux python build
Sep 12, 2024
1f9569b
only test linux python build
Sep 12, 2024
e699b43
only test linux python build
Sep 12, 2024
2234e7d
debug dotnet
Sep 13, 2024
4cf1993
debug dotnet
Sep 13, 2024
e0e134b
debug dotnet
Sep 13, 2024
d5e14b2
debug dotnet
Sep 13, 2024
cde1ed9
debug dotnet
Sep 13, 2024
2af03ad
debug dotnet
Sep 13, 2024
963fcce
debug dotnet
Sep 13, 2024
b493048
debug dotnet
Sep 13, 2024
c024f0b
debug dotnet
Sep 13, 2024
5af989d
debug dotnet
Sep 13, 2024
b1f54c8
debug dotnet
Sep 13, 2024
26e9a26
debug dotnet
Sep 13, 2024
9e1efcd
debug dotnet
Sep 13, 2024
f4e1335
debug dotnet
Sep 13, 2024
a9880eb
debug dotnet
Sep 13, 2024
acd1bd2
debug dotnet
Sep 13, 2024
d470402
debug dotnet
Sep 13, 2024
18adb4e
debug dotnet
Sep 13, 2024
289d00e
debug dotnet
Sep 13, 2024
0fcd3f4
debug dotnet
Sep 13, 2024
d65d2c9
Apply code-format changes
curioyang Sep 13, 2024
6fb3b34
debug dotnet
Sep 13, 2024
69d9c6c
Merge branch 'upgrade_conan2' of https://github.com/kendryte/nncase i…
Sep 13, 2024
f880f40
debug dotnet
Sep 13, 2024
bd4478f
debug dotnet
Sep 13, 2024
06fa910
debug dotnet
Sep 13, 2024
c777c32
debug dotnet
Sep 13, 2024
efe3f09
debug dotnet
Sep 13, 2024
d3cea11
debug dotnet
Sep 13, 2024
8d41c24
debug dotnet
Sep 13, 2024
359c5c7
debug dotnet
Sep 13, 2024
fcfcfbb
debug dotnet
Sep 14, 2024
e5f1cb6
debug dotnet
Sep 14, 2024
51b1f18
debug dotnet
Sep 14, 2024
6f467d0
debug dotnet
Sep 14, 2024
f9621ee
debug dotnet
Sep 14, 2024
a3abfa1
debug dotnet
Sep 14, 2024
66fffd7
debug dotnet
Sep 14, 2024
2235666
debug dotnet
Sep 14, 2024
3c0725a
debug dotnet
Sep 14, 2024
bafa8fd
debug dotnet
Sep 14, 2024
4ca1582
debug dotnet
Sep 14, 2024
f0f3309
downgrade python lib
Sep 14, 2024
2e4945a
debug dotnet
Sep 14, 2024
752efec
all test
Sep 14, 2024
85db6e3
all test
Sep 14, 2024
f16514f
all test
Sep 14, 2024
f17b11d
all test
Sep 14, 2024
5a87410
fix python build whl
Sep 19, 2024
8af8199
fix remove file
Sep 19, 2024
e8f6103
fix error
Sep 19, 2024
1731b6c
fix error
Sep 19, 2024
bf6ed1b
fix error
Sep 19, 2024
6561389
fix error
Sep 19, 2024
406476d
close mac python whl
Sep 19, 2024
7bbcc41
fix error
Sep 19, 2024
a77db88
fix intrinsic args
Sep 20, 2024
297bdf9
disable ctest
Sep 20, 2024
7653ce1
enable mac build python whl
Sep 20, 2024
b934f15
try fix python build
Sep 20, 2024
3965684
Revert "try fix python build"
Sep 20, 2024
233bad4
try fix python build
Sep 20, 2024
f804b06
Revert "try fix python build"
Sep 20, 2024
7957434
try fix macos python build
Sep 20, 2024
312baee
check build dir with wrong macos
Sep 20, 2024
57c6e9b
fix cmd
Sep 20, 2024
6ea06e2
debug
Sep 20, 2024
17b7628
ssh debug
Sep 20, 2024
3fb2de6
fix mac build error
Sep 20, 2024
3373f5c
remove debug code
Sep 20, 2024
3ae802a
start to debug windows ci
Sep 23, 2024
521568c
upgrade windows version
Sep 23, 2024
14323b5
debug ssh
Sep 23, 2024
2d79f85
fix win build
Sep 23, 2024
fb51b5a
debug
Sep 23, 2024
4b1d4ca
fix error in windows python build wheel
Sep 23, 2024
e30c297
fix ninja dependence
Sep 23, 2024
7438011
fix ninja dependence
Sep 23, 2024
10815c1
fix ninja dependence
Sep 23, 2024
f6c0451
fix ninja dependence
Sep 23, 2024
c3e278d
fix lib miss
Sep 23, 2024
cfeef82
fix path error
Sep 23, 2024
fdd90dc
fix ninja
Sep 23, 2024
e4176b8
fix ninja
Sep 23, 2024
2f2ea98
fix ninja
Sep 23, 2024
4d7b730
disable linux mac
Sep 23, 2024
880eabf
recover conanfile path replace
Sep 23, 2024
593b6d5
debug
Sep 23, 2024
da70b19
debug
Sep 23, 2024
485d463
debug
Sep 23, 2024
01d681f
debug
Sep 23, 2024
642ff61
debug
Sep 23, 2024
85ba486
debug
Sep 23, 2024
e5913e5
debug
Sep 23, 2024
5a952eb
debug
Sep 23, 2024
74fc432
debug
Sep 23, 2024
9ebaf18
debug
Sep 23, 2024
28cb0f9
debug
Sep 23, 2024
ba17d1e
debug
Sep 24, 2024
d328151
debug
Sep 24, 2024
98f5b46
python build ok
Sep 24, 2024
bfd15cd
debug test compiler
Sep 24, 2024
120c0ff
debug
Sep 24, 2024
8a18c59
debug
Sep 24, 2024
a5fa6af
debug
Sep 24, 2024
7a6747c
recover
Sep 24, 2024
2d18d3d
debug
Sep 24, 2024
b666dae
debug
Sep 24, 2024
b3b7db8
Revert "debug"
Sep 24, 2024
4b9e903
change windows version
Sep 24, 2024
247baf2
disable windows test-compiler
Sep 25, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/disable-workflows/compiler-python-build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ jobs:
runs-on: ${{ matrix.os }}
strategy:
matrix:
os: [ubuntu-18.04,windows-2019,macos-10.15]
os: [ubuntu-18.04,windows-latest,macos-10.15]

steps:
- uses: actions/checkout@v2
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/code-format.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ jobs:
- name: Setup .NET
uses: actions/setup-dotnet@v1
with:
dotnet-version: "7.0"
dotnet-version: "7.0.x"

- name: Install Formatters
run: |
Expand Down
81 changes: 31 additions & 50 deletions .github/workflows/compiler-build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,9 +17,9 @@ jobs:
strategy:
matrix:
config:
- {name: x86_64-macos, os: macos-12, cmakeArgs: -DENABLE_X86SIMD=OFF, buildType: Release}
- {name: x86_64-linux, os: ubuntu-latest, cmakeArgs: '', buildType: Release}
- {name: x86_64-windows, os: windows-2019, arch: x64, cmakeArgs: -DCMAKE_C_COMPILER=clang-cl -DCMAKE_CXX_COMPILER=clang-cl, buildType: Release}
- {name: x86_64-macos, os: macos-12, buildType: Release}
- {name: x86_64-linux, os: ubuntu-22.04, buildType: Release}
- {name: x86_64-windows, os: windows-2022, arch: x64, buildType: Release}

steps:
- uses: actions/checkout@v3
Expand All @@ -39,30 +39,32 @@ jobs:
- name: Setup Python
uses: actions/setup-python@v4
with:
python-version: 3.7

- name: Install Conan
shell: bash
run: |
pip install conan==1.58
python-version: '3.8'

- name: Configure Conan (Linux)
run: |
conan profile new default --detect
conan profile update settings.compiler.libcxx=libstdc++11 default
echo "CC=gcc-10" >> $GITHUB_ENV
echo "CXX=g++-10" >> $GITHUB_ENV
if: runner.os == 'Linux'

- name: Configure CMake
- name: Install Conan
shell: bash
run: |
cmake -B build -G Ninja -DCMAKE_BUILD_TYPE=${{matrix.config.buildType}} ${{matrix.config.cmakeArgs}} -DPython3_ROOT_DIR=${pythonLocation}
pip install conan==2.6.0
conan remote add sunnycase https://conan.sunnycase.moe --index 0



- name: Configure
shell: bash
run: |
conan install . --build=missing -s build_type=${{matrix.config.buildType}} -pr:a=toolchains/${{matrix.config.name}}.profile.jinja -o "&:runtime=False" -o "&:python=True" -o "&:tests=False"
cmake --preset conan-release

- name: Build & Install
run: |
cmake --build build --config ${{matrix.config.buildType}}
cmake --install build --prefix install
cmake --build build/${{matrix.config.buildType}} --config ${{matrix.config.buildType}}
cmake --install build/${{matrix.config.buildType}} --prefix install

- name: Upload nncase Native Build Artifact
uses: actions/upload-artifact@v3
Expand All @@ -80,15 +82,15 @@ jobs:
dotnet-version: ['7.0']
config:
- {name: x86_64-macos, os: macos-12, shell: bash, rid: osx-x64, buildType: Release}
- {name: x86_64-linux, os: ubuntu-latest, shell: bash, rid: linux-x64, buildType: Release}
- {name: x86_64-windows, os: windows-2019, shell: bash, rid: win-x64, buildType: Release}
- {name: x86_64-linux, os: ubuntu-22.04, shell: bash, rid: linux-x64, buildType: Release}
- {name: x86_64-windows, os: windows-2022, shell: bash, rid: win-x64, buildType: Release}

steps:
- uses: actions/checkout@v2
- name: Setup .NET
uses: actions/setup-dotnet@v1
with:
dotnet-version: ${{matrix.dotnet-version}}
dotnet-version: '7.0.x'

- name: Cache NuGet packages
uses: actions/cache@v3
Expand All @@ -99,7 +101,7 @@ jobs:
${{ runner.os }}-nuget-

- name: Install nncase native Artifact
uses: actions/download-artifact@v2.0.9
uses: actions/download-artifact@v3
with:
name: nncase-native-${{matrix.config.name}}
path: ${{github.workspace}}/install
Expand Down Expand Up @@ -169,18 +171,15 @@ jobs:
dotnet-version: ['7.0']
config:
- {name: x86_64-macos, os: macos-12, shell: bash}
- {name: x86_64-linux, os: ubuntu-latest, shell: bash}
- {name: x86_64-windows, os: windows-2019, shell: bash}

env:
VULKANSDK_VER: 1.3.268.0
- {name: x86_64-linux, os: ubuntu-22.04, shell: bash}
# - {name: x86_64-windows, os: windows-2022, arch: x64, shell: bash}

steps:
- uses: actions/checkout@v3
- name: Setup .NET
uses: actions/setup-dotnet@v1
with:
dotnet-version: ${{matrix.dotnet-version}}
dotnet-version: '7.0.x'

- name: Install nncase native Artifact
uses: actions/download-artifact@v3
Expand All @@ -197,60 +196,42 @@ jobs:
- name: Set up test environment (macOS)
run: |
brew install sunnycase/core/[email protected]
aria2c --parameterized-uri=true https://{sdk.lunarg.com/sdk/download/${VULKANSDK_VER}/mac,distfiles.macports.org/MoltenVK}/vulkansdk-macos-${VULKANSDK_VER}.dmg
hdiutil attach ./vulkansdk-macos-*.dmg
sudo /Volumes/vulkansdk-macos-*/InstallVulkan.app/Contents/MacOS/InstallVulkan --root $HOME/VulkanSDK --accept-licenses --default-answer --confirm-command install
hdiutil detach /Volumes/vulkansdk-macos-*
echo "VULKAN_SDK=$HOME/VulkanSDK/macOS" >> $GITHUB_ENV
wget https://github.com/sunnycase/swiftshader/releases/download/v1.0/swiftshader-macos-10.15-x86_64.zip -O swiftshader.zip
unzip swiftshader.zip
sudo cmake -E make_directory /usr/local/share/vulkan/icd.d
sudo cp lib/* /usr/local/share/vulkan/icd.d
cp install/lib/*.dylib install/
echo "PYTHONPATH=$GITHUB_WORKSPACE/install/lib:$GITHUB_WORKSPACE/install/python:$GITHUB_WORKSPACE/tests" >> $GITHUB_ENV
if: runner.os == 'macOS'

- name: Set up test environment (Linux)
run: |
wget https://sdk.lunarg.com/sdk/download/${VULKANSDK_VER}/linux/vulkansdk-linux-x86_64-${VULKANSDK_VER}.tar.xz -O vulkansdk.tar.xz
tar xf vulkansdk.tar.xz
sudo cp -P ${VULKANSDK_VER}/x86_64/lib/libvulkan.so* /usr/local/lib/
wget https://github.com/sunnycase/swiftshader/releases/download/v1.0/swiftshader-ubuntu-18.04-x86_64.zip -O swiftshader.zip
unzip swiftshader.zip
sudo cmake -E make_directory /usr/local/share/vulkan/icd.d
sudo cp lib/* /usr/local/share/vulkan/icd.d
cp install/lib/*.so install/
echo "PYTHONPATH=$GITHUB_WORKSPACE/install/lib:$GITHUB_WORKSPACE/install/python:$GITHUB_WORKSPACE/tests" >> $GITHUB_ENV
if: runner.os == 'Linux'

- name: Set up test environment (Windows)
shell: pwsh
run: |
# Invoke-WebRequest -Uri https://sdk.lunarg.com/sdk/download/${env:VULKANSDK_VER}/windows/VulkanSDK-${env:VULKANSDK_VER}-Installer.exe -O VulkanSDK-Installer.exe
# .\VulkanSDK-Installer.exe /S
Invoke-WebRequest -Uri https://github.com/sunnycase/swiftshader/releases/download/v1.0/swiftshader-windows-2019-x86_64.zip -OutFile swiftshader.zip
Expand-Archive swiftshader.zip
Copy-Item swiftshader\lib\vk_swiftshader_icd.json swiftshader\bin\
Copy-Item install/bin/*.dll install/
echo "VK_ICD_FILENAMES=${env:GITHUB_WORKSPACE}/swiftshader/bin/vk_swiftshader_icd.json" >> $env:GITHUB_ENV
echo "PYTHONPATH=${env:GITHUB_WORKSPACE}/install/lib;${env:GITHUB_WORKSPACE}/install/python;${env:GITHUB_WORKSPACE}/tests" >> $env:GITHUB_ENV
echo "PATH=${env:PATH};${env:GITHUB_WORKSPACE}/install/bin" >> $env:GITHUB_ENV
if: runner.os == 'Windows'

- name: Setup Python
uses: actions/setup-python@v4
with:
python-version: 3.7
python-version: '3.8'
cache: 'pip'
cache-dependency-path: '**/requirements.test.txt'

- name: Install Python Packages
run:
# python -m pip install --upgrade "pip<24.0" #pip24 not available on 3.7
# python -m pip install --upgrade "pip<24.0" #pip24 not available on 3.8
pip install -r requirements.test.txt

- name: Create Test Environment
run: mkdir test_results

# - name: Start tmate session for debugging
# uses: mxschmitt/action-tmate@v3
# continue-on-error: true

- name: Test
working-directory: ${{github.workspace}}
Expand Down Expand Up @@ -289,7 +270,7 @@ jobs:
- name: Setup .NET
uses: actions/setup-dotnet@v1
with:
dotnet-version: "7.0"
dotnet-version: '7.0.x'

- name: Download Unit Test Coverage
uses: actions/download-artifact@v3
Expand Down
21 changes: 10 additions & 11 deletions .github/workflows/compiler-python-release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,15 +15,15 @@ jobs:
dotnet-version: ['7.0']
config:
- {name: x86_64-macos, os: macos-12, shell: bash, rid: osx-x64, buildType: Release}
- {name: x86_64-linux, os: ubuntu-latest, shell: bash, rid: linux-x64, buildType: Release}
- {name: x86_64-windows, os: windows-2019, shell: bash, rid: win-x64, buildType: Release}
- {name: x86_64-linux, os: ubuntu-22.04, shell: bash, rid: linux-x64, buildType: Release}
- {name: x86_64-windows, os: windows-2022, shell: bash, rid: win-x64, buildType: Release}

steps:
- uses: actions/checkout@v2
- name: Setup .NET
uses: actions/setup-dotnet@v1
with:
dotnet-version: ${{matrix.dotnet-version}}
dotnet-version: '7.0.x'

- name: Cache NuGet packages
uses: actions/cache@v3
Expand Down Expand Up @@ -54,19 +54,18 @@ jobs:
dotnet-version: ['7.0']
config:
- {name: x86_64-macos, os: macos-12}
- {name: x86_64-linux, os: ubuntu-latest}
- {name: x86_64-windows, os: windows-2019, arch: x64}

env:
VULKANSDK_VER: 1.3.268.0
- {name: x86_64-linux, os: ubuntu-22.04}
- {name: x86_64-windows, os: windows-2022, arch: x64}

steps:
- uses: actions/checkout@v3

- uses: seanmiddleditch/gha-setup-ninja@master

- name: Setup .NET
uses: actions/setup-dotnet@v1
with:
dotnet-version: ${{matrix.dotnet-version}}
dotnet-version: '7.0.x'

- name: Install nncase
uses: actions/download-artifact@v3
Expand All @@ -88,11 +87,11 @@ jobs:
- name: Setup Python
uses: actions/setup-python@v4
with:
python-version: 3.7
python-version: 3.8

- name: Install cibuildwheel
run: pip install cibuildwheel

- name: Build wheel
run: python -m cibuildwheel --output-dir wheelhouse

Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/jupyter-test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,17 +10,17 @@ jobs:
strategy:
matrix:
config:
- {name: x86_64-macos, os: macos-12}
- {name: x86_64-macos, os: macos-12,}
- {name: x86_64-linux, os: ubuntu-latest}
- {name: x86_64-windows, os: windows-2019}
- {name: x86_64-windows, os: windows-2022}

steps:
- uses: actions/checkout@v2

- name: Setup Python
uses: actions/setup-python@v2
with:
python-version: 3.7
python-version: '3.8'

- name: Install dependencies
run: pip install --upgrade pip && pip install jupyterlab pytest nbmake
Expand Down
Loading
Loading