Installation under Windows #14

aoles · 2018-09-28T09:00:17Z

Hi, Andrzej!

I am stuck while trying to install Rbioformats in Windows 10. Rtools and devtools are installed, packages can be compile from source. rJava compiled fine and loads properly. However, when running I get

biocLite("aoles/RBioFormats")

I get the following output:

BioC_mirror: https://bioconductor.org
Using Bioconductor 3.7 (BiocInstaller 1.30.0), R 3.5.1 (2018-07-02).
Installing github package(s) ‘aoles/RBioFormats’
Downloading GitHub repo aoles/RBioFormats@master
Installing package into ‘C:/Users/Geo/Documents/R/win-library/3.5’
(as ‘lib’ is unspecified)

installing source package 'RBioFormats' ...
** R
** inst
** byte-compile and prepare package for lazy loading
** help
*** installing help indices
converting help for package 'RBioFormats'
finding HTML links ... done
AnnotatedImage-class html
finding level-2 HTML links ... done

AnnotatedImageList-class html
BioFormats.version html
FormatTools html
ImageMetadata-class html
RBioFormats html
checkJavaMemory html
dimorder html
metadata html
metadataAccessors html
mockFile html
read.image html
read.metadata html
read.omexml html
seriesCount html
write.image html
** building package indices
** installing vignettes
** testing if installed package can be loaded
trying URL 'https://downloads.openmicroscopy.org/bio-formats/5.9.1/artifacts/bioformats_package.jar'
Content type 'application/x-java-archive' length 31779356 bytes (30.3 MB)
==================================================
downloaded 30.3 MB

Error: package or namespace load failed for 'RBioFormats':
.onLoad failed in loadNamespace() for 'RBioFormats', details:
call: .jfield("loci/formats/FormatTools", "S", "VERSION")
error: cannot find class loci/formats/FormatTools
Error: loading failed
Execution halted
ERROR: loading failed

removing 'C:/Users/Geo/Documents/R/win-library/3.5/RBioFormats'
In R CMD INSTALL
Warning message:
In i.p(...) :
installation of package ‘C:/Users/Geo/AppData/Local/Temp/RtmpU7bsbM/remotes13fc5a4431eb/aoles-RBioFormats-9d104f6’ had non-zero exit status

Do you have an idea what might go wrong?

Many thanks in advance,

Geo

From: "Andrzej K. Oleś" [email protected]
Reply-To: aoles/RBioFormats [email protected]
Date: Sunday, May 13, 2018 at 1:03 PM
To: aoles/RBioFormats [email protected]
Cc: Geo Vogler [email protected], State change [email protected]
Subject: Re: [aoles/RBioFormats] meta data is different between ImageJ and RBioformats (#11)

Hi Geo,

thank you for reaching out and for reporting the disappointing performance of read.metadata. I will look int this, I've opened a dedicated issue#12 in order to better keep track of it.

Best,
Andrzej

—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub#11 (comment), or mute the threadhttps://github.com/notifications/unsubscribe-auth/AaGUenMsW-xwAM96YwOFxAUFg_aRCrKjks5tyJF3gaJpZM4Sppuu.

Originally posted by @GrauKatze in #11 (comment)

gvogler · 2018-10-31T16:42:13Z

Hi, Andrzej!

Any news on this issue? Or pointers of what I could try to help troubleshooting?

-Geo

Wang-Hsiang-Sheng · 2018-12-30T01:46:34Z

I also face the same problem in windows 10 on my own computer and work place.
Is this issue specific to windows 10 or other OS also face the same problem?

Wang-Hsiang-Sheng · 2019-01-07T05:09:27Z

I think the problem is due to java class path isn't set properly when .jfield("loci/formats/FormatTools", "S", "VERSION") is called. I downloaded "bioformats_package.jar" first and put it in one folder, then entered the utils.R file and change some code from:
"BioFormats.version = function() .jfield("loci/formats/FormatTools", "S", "VERSION")"
to:
"BioFormats.version = function() {
library(rJava)
.jinit()
.jaddClassPath(location of "bioformats_package.jar" just downloaded)
.jfield("loci/formats/FormatTools", "S", "VERSION")
}"
then install this package again show no problem on my Windows
and RBioFormats can also be loaded properly after installation

gvogler · 2019-01-07T20:19:05Z

Doesn't seem to work in my installation - it still downloads the file and fails with call: .jfield.
Setting CLASSPATH in the Windows Environment should do the trick as well and doesn't.

manerotoni · 2019-04-02T14:46:10Z

Same issue here (R 3.5.3, Windows10). I don't understand where do I find the "utils.R" file so to try @Wang-Hsiang-Sheng suggestion.

manerotoni · 2019-04-02T16:13:20Z

What worked for me.
download bioformats
Clone this repo
Change the file RBioformats/R/utils.R as described by @Wang-Hsiang-Sheng
Start R from the main path of the cloned directory
run devtools::build()
in my case it first failed twice because I had to install 2 additional packages
BiocStyle (biocLite('BiocStyle')) and
XML install.packages('XML')
after installing the 2 packages devtools:build() was successful and the package seems to work.
In fact at library('RBioFormats') it automatically download again a bioformat_package.jar.

oodegard · 2019-05-02T11:31:12Z

The @manerotoni method worked for me, but I would like to add that you ofcause have to install the library afterwards from the filepath that was created with devtools::build().
What I did was:

Download bioformats to my .libPaths() path
Clone repo to my "C:/R/" folder from git bash

git clone https://github.com/aoles/RBioFormats.git

Change the file RBioformats/R/utils.R as described by @Wang-Hsiang-Sheng

BioFormats.version = function() .jfield("loci/formats/FormatTools", "S", "VERSION")"
to:
"BioFormats.version = function() {
library(rJava)
.jinit()
.jaddClassPath(location of "bioformats_package.jar" just downloaded) ## in my case ".jaddClassPath("C:/R/Library/bioformats/bioformats_package.jar")"
.jfield("loci/formats/FormatTools", "S", "VERSION")
}

Set the working directory to the cloned RBioFormats directory
Build RBioFormats

run devtools::build() # you may need to install additional packages
# [1] "C:/R/RBioFormats_0.0.54.tar.gz"

Install RBioFormats from the newly built

install.packages("C:/R/RBioFormats_0.0.54.tar.gz", repos = NULL, type = "source")

gvogler · 2019-05-03T02:00:06Z

This works perfect. Those last steps were not clear to me (location of library/bioformats vs. repo clone) before.

gvogler · 2019-05-28T20:39:46Z

I just noticed that now it downloads the bioformats package everytime the library is loaded. Do you see this as well?

aoles · 2019-05-28T21:41:23Z

Hi guys,

joining the party late - let me apologize for this! First off all, many thanks to all of you involved in debugging this, I really appreciate your commitment.

Normally JVM initialization should be performed through .jpackage(), see the details in ?.jinit. I'm not entirely sure what the problem here could be as this is already called before BioFormats.version(), I will need to look into it.

For now could you maybe verify whether disabling the package startup message resolves the issue? Please try running the modified version through

devtools::install_github("aoles/RBioFormats@debug").

Looking forward to your feedback!

Cheers,
Andrzej

gvogler · 2019-05-28T22:07:13Z

Nice - this installed like a charm on a vanilla Windows 7, RStudio, R3.5.3 64bit.

However, it still downloads the bioformats package from openmicroscopy.org whenever the RBioFormats library is loaded.

aoles · 2019-05-28T22:34:05Z

Thanks @GrauKatze for getting back to me so quickly!

I've just modified the test branch to print some debug messages, would you mind reinstalling the package once again and paste here the output you get when you load the package?

Cheers,
Andrzej

gvogler · 2019-05-28T22:40:14Z

library(RBioFormats)
Loading required package: rJava
MD5 local: 3055c5e3c8378a619b73ebe2e83c8929
MD5 remote: 6e8fa3e3919cb8408a23ca73b38d33d5
trying URL 'https://downloads.openmicroscopy.org/bio-formats/6.0.0/artifacts/bioformats_package.jar'
Content type 'application/x-java-archive' length 35214253 bytes (33.6 MB)
downloaded 33.6 MB

aoles · 2019-05-28T22:55:21Z

Awesome, thanks! So the problem comes from the fact that the checksum of your local library copy does not match the remote one, weird.

Do you consistently get the same value 3055c5e3c8378a619b73ebe2e83c8929 when you reload the package?

gvogler · 2019-05-28T23:09:22Z

Yes, it is the identical message each time.

aoles · 2019-05-28T23:21:21Z

Thanks for verifying! Might be related to the following comment in ?tools::md5sum.

On Windows all files are read in binary mode (as the md5sum utilities there do): on other OSes the files are read in the default mode (almost always text mode where there is more than one).

Could you maybe check what value you get when you manually download the file https://downloads.openmicroscopy.org/bio-formats/6.0.0/artifacts/bioformats_package.jar and run tools::md5sum() on it?

gvogler · 2019-05-28T23:44:29Z

tools::md5sum("bioformats.jar") on the downloaded file returns the remote value (MD5 remote: 6e8fa3e3919cb8408a23ca73b38d33d5)

aoles · 2019-05-29T08:40:37Z

Great, thanks a lot!

So I guess we can rule out tools::md5sum() then. However, there might be a problem with utils::download.file(), in particular the default file write mode. In order to verify this, would you mind pasting the output of running the following code snippet on your system?

Cheers,
Andrzej

url <- "https://downloads.openmicroscopy.org/bio-formats/6.0.0/artifacts/bioformats_package.jar"

for (m in c("w", "wb")) {
	f <- tempfile("", , ".jar")
	utils::download.file(url, f, mode = m, quiet = TRUE)
	message(tools::md5sum(f))
}

gvogler · 2019-05-29T18:23:50Z

I ran this 2x, with different results:

> url <- "https://downloads.openmicroscopy.org/bio-formats/6.0.0/artifacts/bioformats_package.jar"
> 
> for (mode in c("w", "wb")) {
+     f <- tempfile("", , ".jar")
+     utils::download.file(url, f, quiet=TRUE)
+     message(tools::md5sum(f))
+ }
3055c5e3c8378a619b73ebe2e83c8929
3055c5e3c8378a619b73ebe2e83c8929
> url <- "https://downloads.openmicroscopy.org/bio-formats/6.0.0/artifacts/bioformats_package.jar"
> 
> for (m in c("w", "wb")) {
+     f <- tempfile("", , ".jar")
+     utils::download.file(url, f, mode = m, quiet = TRUE)
+     message(tools::md5sum(f))
+ }
3055c5e3c8378a619b73ebe2e83c8929
6e8fa3e3919cb8408a23ca73b38d33d5

aoles · 2019-05-29T20:06:16Z

Great, thanks a lot!

So the problem with reoccurring downloads was caused by the default mode = "w", I've modified the debug branch to use mode = "wb".

Additionally, I've updated the way how the library version is being resolved during startup.

Looking forward to your feedback!

Cheers,
Andrzej

gvogler · 2019-05-29T20:10:49Z

This looks good (on Windows 10 and macOS)!

> library(RBioFormats)
Loading required package: rJava
MD5 local:  6e8fa3e3919cb8408a23ca73b38d33d5
MD5 remote: 6e8fa3e3919cb8408a23ca73b38d33d5
BioFormats library version 6.0.0

aoles · 2019-05-29T20:15:23Z

Awesome, glad to hear that!

aoles mentioned this issue Sep 28, 2018

meta data is different between ImageJ and RBioformats #11

Closed

aoles mentioned this issue Jun 5, 2019

Address issues on Windows #19

Merged

aoles closed this as completed in #19 Jun 5, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Installation under Windows #14

Installation under Windows #14

aoles commented Sep 28, 2018

gvogler commented Oct 31, 2018

Wang-Hsiang-Sheng commented Dec 30, 2018

Wang-Hsiang-Sheng commented Jan 7, 2019

gvogler commented Jan 7, 2019

manerotoni commented Apr 2, 2019

manerotoni commented Apr 2, 2019 •

edited

Loading

oodegard commented May 2, 2019

gvogler commented May 3, 2019

gvogler commented May 28, 2019

aoles commented May 28, 2019

gvogler commented May 28, 2019

aoles commented May 28, 2019

gvogler commented May 28, 2019 •

edited

Loading

aoles commented May 28, 2019

gvogler commented May 28, 2019

aoles commented May 28, 2019

gvogler commented May 28, 2019

aoles commented May 29, 2019 •

edited

Loading

gvogler commented May 29, 2019 •

edited

Loading

aoles commented May 29, 2019

gvogler commented May 29, 2019

aoles commented May 29, 2019

Installation under Windows #14

Installation under Windows #14

Comments

aoles commented Sep 28, 2018

gvogler commented Oct 31, 2018

Wang-Hsiang-Sheng commented Dec 30, 2018

Wang-Hsiang-Sheng commented Jan 7, 2019

gvogler commented Jan 7, 2019

manerotoni commented Apr 2, 2019

manerotoni commented Apr 2, 2019 • edited Loading

oodegard commented May 2, 2019

gvogler commented May 3, 2019

gvogler commented May 28, 2019

aoles commented May 28, 2019

gvogler commented May 28, 2019

aoles commented May 28, 2019

gvogler commented May 28, 2019 • edited Loading

aoles commented May 28, 2019

gvogler commented May 28, 2019

aoles commented May 28, 2019

gvogler commented May 28, 2019

aoles commented May 29, 2019 • edited Loading

gvogler commented May 29, 2019 • edited Loading

aoles commented May 29, 2019

gvogler commented May 29, 2019

aoles commented May 29, 2019

manerotoni commented Apr 2, 2019 •

edited

Loading

gvogler commented May 28, 2019 •

edited

Loading

aoles commented May 29, 2019 •

edited

Loading

gvogler commented May 29, 2019 •

edited

Loading