✅ configure extra manually fail without afterEvaluate
✅ configure sdk manually test
✅ configure extra manually fail on unconfigured extra dependency
✅ configure sdk manually fail without afterEvaluate
✅ configure plugins manually fail on some unconfigured plugins
✅ configure plugins manually test
✅ configure plugins manually fail on unconfigured plugin
✅ configure plugins manually fail without afterEvaluate
✅ configure extra dependencies manually test

✅ add external zip plugin source artifacts from src directory when downloadSources = true
✅ add ant dependencies to classpath
✅ expect build fails when using unsupported Gradle version
✅ add external zip plugin source artifacts from src directory when downloadSources = false
✅ add external zip plugin source artifacts from src directory when localPath used
✅ add bundled plugin source artifacts from IDE_ROOT-lib-src directory when downloadSources = false
✅ add require plugin id parameter in test tasks
✅ add bundled zip plugin source artifacts from src directory when downloadSources = true
✅ add local plugin to compile only classpath
✅ resolve bundled plugin by its id
✅ does not add zip plugin source artifacts from IDE_ROOT-lib-src directory when sources not provided
✅ ide dependencies are added to test fixtures compile only classpath
⚪ expect successful build using minimal supported Gradle version
✅ add bundled plugin source artifacts from IDE_ROOT-lib-src directory when downloadSources = true
✅ patch test tasks
✅ add builtin plugin dependencies to classpath
✅ use test compile classpath for non-builtin plugins if Gradle lte 2_12
✅ use compile only classpath for non-builtin plugins if Gradle lte 2_12
✅ add external zip-plugins to compile only classpath
✅ intellij-specific tasks
✅ do not update existing jvm arguments in test tasks
✅ add bundled zip plugin source artifacts from IDE_ROOT-lib-src directory when localPath used
✅ custom sandbox directory
✅ resolve plugins in Gradle lte 4_3
✅ add bundled zip plugin source artifacts from src directory when localPath used
✅ add bundled zip plugin source artifacts from src directory when downloadSources = false

✅ resolve 11_0_11b1536_2
✅ resolve jbr_fd-11_0_13b1751_16
✅ resolve jbr_nomod-11_0_13b1751_16
✅ resolve jbr_dcevm-11_0_13b1751_16
✅ resolve 11_0_13b1751_16 in fd variant
✅ resolve jbrsdk-11_0_13b1751_16

✅ total time absent test
✅ simple parser test

✅ simple parser test
✅ assertTimeout is null

✅ provide MANIFEST_MF with build details
✅ build plugin distribution
✅ can compile classes that depends on external plugins
✅ include only relevant searchableOptions_jar
✅ build plugin distribution with Kotlin
✅ use gradle project name for distribution if plugin name is not defined
✅ can compile classes that depend on external plugin with classes directory
✅ use custom sandbox for distribution
✅ build plugin without sources

⚪ build searchable options produces XML
✅ skip building searchable options using IDEA prior 2019_1

✅ download plugin through maven block
✅ download jar plugin
✅ download zip plugin
✅ download plugin from custom repository
✅ download plugin from custom repository without xml
✅ download plugin from custom repository without xml with query
✅ download zip plugin from non-default channel
✅ download plugin from custom repository 2
✅ download plugin from custom repository with query

⚪ download ultimate idea dependencies and community sources without dist when downloadSources = true
⚪ download ultimate idea dependencies without sources when downloadSources = false
⚪ download idea dependencies without sources when downloadSources = false
⚪ download idea with sources when downloadSources = true

✅ download new robot server plugin task
✅ download old robot server plugin task
✅ download latest robot server plugin task

✅ instrument code with nullability annotations
✅ do not instrument code on empty source sets
✅ instrumentation does not invalidate compile tasks
✅ instrument kotlin forms
✅ do not instrument code if option is set to false
✅ instrument tests with nullability annotations

✅ skip jarring searchable options using IDEA prior 2019_1
✅ jar searchable options produces archive

✅ get IDEs list for the multiple platformTypes
✅ get IDEs list for the custom platformType and platformVersion defined in intellij
✅ get IDEs list using sinceBuild and untilBuild
✅ get IDEs list using sinceBuild despite it is lower than intellij_version
✅ get IDEs list for the current platformType
✅ get Android Studio releases for Release channel
✅ get IDEs list for the current platformType, sinceBuild and untilBuild
✅ get IDEs list without EAP releases
✅ get IDEs list for the current platformType and limited versions scope
✅ get Android Studio releases
✅ productsReleasesUpdateFiles uses values from updatePaths

✅ add version tags in the beginning of file
✅ do not update version tag if project_version is undefined
✅ patch change notes
✅ override version and since until builds
✅ same since and until builds
✅ patch version and since until builds
✅ patch patching preserves UTF-8 characters
✅ patch description
✅ patch id
✅ do not update id if pluginId is undefined
✅ take extension setting into account while patching
✅ patch version and since until builds on intellij version changing
✅ skip patch task if intellij version did not changed

✅ prepare sandbox for two plugins
✅ disable ide update with updates_xml empty
✅ prepare sandbox with external zip-type plugin
✅ use gradle project name if plugin name is not defined
✅ prepare sandbox with external jar-type plugin
✅ prepare sandbox for two plugins with evaluated project
✅ replace jar on version changing
✅ disable ide update without value attribute
✅ disable ide update without check_needed option
✅ rename jars with same names
✅ prepare ui tests sandbox task
✅ prepare custom sandbox task
✅ disable ide update with complex updates_xml
✅ disable ide update without updates_xml
✅ prepare sandbox task without plugin_xml
✅ disable ide update without updates component
✅ prepare sandbox with plugin dependency with classes directory
✅ prepareTestingSandbox runs before test
✅ prepare sandbox task
✅ disable ide update

✅ do not break incremental processing
✅ use patched plugin xml files
✅ update resources on updated patched xml files

✅ skip publishing if token is missing

✅ pass on any failureLevel
✅ run plugin verifier in specified version
✅ run plugin verifier fails on old version lower than 1_255
✅ set verification reports directory
✅ test plugin against two IDEs
✅ run plugin verifier in the latest version
✅ set verification reports with default settings
✅ run plugin verifier in offline mode
✅ fail on incorrect ideVersion
✅ set ignored problems file
✅ pass on CLI arguments the internal API usage mode as a free arg
✅ pass on Deprecated API usages
✅ set verification reports output formats
✅ fail on any failureLevel
✅ fail on Deprecated API usages
⚪ pass on CLI arguments passed as free args
✅ fail on verifyPlugin task
✅ set verification reports with empty set of output formats
✅ do not use ListProductsReleasesTask output on empty array passed to ideVersions property
✅ test plugin against Android Studio
✅ use ListProductsReleasesTask output on missing ideVersions property

✅ idea dependency is available

✅ fail on signing with incorrect password provided
✅ verify plugin signature with certificateChain
✅ verify plugin signed with password provided
✅ skip plugin signature verification task if plugin signing is not configured
✅ sign plugin with password provided
✅ run Marketplace ZIP Signer in specified version using certificateChain and privateKey
✅ run Marketplace ZIP Signer in the latest version
✅ skip Marketplace ZIP Signer task if no key and certificateChain were provided
✅ fail on signing without password provided
✅ run Marketplace ZIP Signer and fail on invalid version
✅ verify plugin signature with certificateChainFile
✅ verify unsigned plugin archive
✅ run Marketplace ZIP Signer in specified version using certificateChainFile and privateKeyFile
✅ output file contains version when specified in build file

✅ report too high Kotlin jvmTarget
✅ report Kotlin stdlib bundling
✅ report too low Kotlin languageVersion
✅ report too high Java targetCompatibility
✅ do not show errors when configuration is valid
✅ do not report too high patch number in Kotlin apiVersion
✅ report too low Java sourceCompatibility
✅ report too low since-build
✅ report too high Kotlin apiVersion
✅ do not report too low patch number in Kotlin languageVersion
✅ report kotlinx-coroutines dependency

✅ do not fail on errors if option is enabled
✅ fail on errors by default
✅ fail on errors if ignore unacceptable warnings option is enabled
✅ do not fail if there are no errors and warnings
✅ do not fail on unacceptable warnings if ignoreFailures option is enabled
✅ do not fail on unacceptable warnings if option is enabled
✅ do not fail on warning by default
✅ fail on warning if option is disabled
✅ fail on unacceptable warnings by default

✅ dependency parsing

✅ version parsing
✅ version comparison