Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Swedish moth names #542

Open
larspett opened this issue Mar 20, 2023 · 94 comments
Open

Swedish moth names #542

larspett opened this issue Mar 20, 2023 · 94 comments
Assignees
Labels
app issues related to mobile applications moth Priority 2 website: general Issues related to drupal website, non-Indicia

Comments

@larspett
Copy link
Collaborator

Last spring we provided a list of Swedish day active moths (#417) that I believe was deployed but none of those seem available.

Also, I wonder if we did provide a full list of the Swedish macro moths? If not, we can easily do that, currently we only see moth names in German in the moth part of the app. In the butterfly parts of the app, only butterflies are available despite the day active moth option being enabled.

If you want us to provide a moth dictionary, what format and which taxonomic groups should I provide?

@larspett
Copy link
Collaborator Author

@chrisvanswaay maybe you have the format and taxonomic group info that I would need to supply Swedish common names for the full set of macromoths?

@chrisvanswaay
Copy link
Collaborator

No I haven't, but I think @JimBacon might help you with a start. He also arranged all the Dutch butterfly names (actually better than I did).

@larspett
Copy link
Collaborator Author

larspett commented Mar 21, 2023

@DavidRoy @kazlauskis Here are the Swedish common micro and macro moth names in a tab separated textfile with scientific names first on each row.
There are a few new aggregates (5) plus some mismatches between our taxonomic backbone and the ones used in the taxonomic aggregate dataset I got for NL (5). All those are listed in a separate text file. Is this the way you want the data @JimBacon ? Would be great if it could be added to the homepage (where the common names are a mixture of German and English for some reason and the app (where common names seem to be German only)
Scientific_and_Swedish_common_names.txt
Scientific_and_Swedish_common_names_additions_and_mismatches.txt

@JimBacon
Copy link
Member

Hi,
I'm sure the file format will be fine but I do not expect to look at this for several weeks as I have a list of other jobs I am working on.
Jim.

@larspett
Copy link
Collaborator Author

The Swedish taxonomic backbone seems like it hadn't been updated against gbif etc so only one of the taxonomic mismatches were actully a mismatch. Have updated the aggregates and mismatch list here
Scientific_and_Swedish_common_names_additions_and_mismatches_v2.txt

@DavidRoy
Copy link
Collaborator

@kazlauskis can you review how the day-flying moths are being included in the app?
@andrewvanbreda could you add in the swedish common names when working on #464

@andrewvanbreda
Copy link
Collaborator

@DavidRoy Will do.
Am just checking some things with John about the other issue first.

@kazlauskis kazlauskis added this to the Priority for Spring 2023 milestone Mar 24, 2023
@kazlauskis kazlauskis added website: general Issues related to drupal website, non-Indicia app issues related to mobile applications labels Mar 24, 2023
@larspett
Copy link
Collaborator Author

larspett commented Apr 4, 2023

@kazlauskis is this one closing in? Am planning for some moth monitoring publicity but need to have Swedish common names in the app and website before I can do that

@kazlauskis
Copy link
Member

Not yet, but we are actively working on the app, and we'll look into this next week.

@larspett
Copy link
Collaborator Author

larspett commented Apr 5, 2023

Much appreciated

@andrewvanbreda
Copy link
Collaborator

Hi @BirenRathod
Would you be able to get me these results please whenever you get chance.
Thanks

SQL 1.txt
SQL 2.csv

@BirenRathod
Copy link

@andrewvanbreda
I attached the results.
ABLE.zip

@larspett
Copy link
Collaborator Author

Any feedback needed from my end here @andrewvanbreda? Will the names end up in the butterfly count at the same time they are deployed at the site? I'd love to promote the app more widely but all names are in German at the moment

@andrewvanbreda
Copy link
Collaborator

Hi @larspett

I have prepared some of the import files, but have not done the actual import yet.

The reason for the delay is the original file actually contains synonyms which are not held in the species list, so I don't think the importer will recognise them.

I am in the process of changing the import files, but I just wanted to double check with my brother (John van Breda) about this approach before I did the actual import.

So for example, one example would be "Yponomeuta irrorellus" in the import file is "Yponomeuta irrorella" in the EBMS Moths database list but many are like this.

I have not developed on or used the butterfly count app myself, however if it uses the same species list I guess the names would appear in the app.
@kazlauskis might be able to confirm that one.

Andy

@larspett
Copy link
Collaborator Author

larspett commented Apr 14, 2023

Ok I saw those and thought I had removed them but that was probably just in the aggregates list (where this particular example is found too). Sorry about the non-standard taxonomy used by the Swedish taxonomic backbone

@andrewvanbreda
Copy link
Collaborator

@larspett
No problem. Will let you know when done.

@kazlauskis
Copy link
Member

@andrewvanbreda is the species list update complete now? I will then fetch the new taxa to the app.

@andrewvanbreda
Copy link
Collaborator

@kazlauskis
No it isn't, as have had to do a lot of preparation.
However I should be in a position to import most of it in the next day or so.
There will be about 350 items that won't be imported initially for various reasons.

@andrewvanbreda
Copy link
Collaborator

Hi @BirenRathod
Would you be able to get me this result whenever you get a sec please. I hope it will return nothing. Cheers.

Test if not exists SQL.txt

@BirenRathod
Copy link

BirenRathod commented Apr 17, 2023

@andrewvanbreda have you got my other email about using PgAdmin from your machine, so you can run this query?

@andrewvanbreda
Copy link
Collaborator

@BirenRathod
Thanks Biren, I hadn't seen the email but I have now.
I will look into fixing NPMS first, then checkout Pgadmin after that. Cheers

@larspett
Copy link
Collaborator Author

so in demo but not in production version of app yet?

@Vilius-Stankaitis
Copy link
Collaborator

Production as well v1.20.0

@larspett
Copy link
Collaborator Author

larspett commented May 12, 2023 via email

@Vilius-Stankaitis
Copy link
Collaborator

Mhm, I will investigate this. Cheers

@larspett
Copy link
Collaborator Author

larspett commented May 17, 2023

@Vilius-Stankaitis I try to switch between common names in Swedish and scientific names but only get Swedish ones all the time (unless I enter the scientific name manually, then it sticks). I try changing the common/scientific option in settings but nothing happens. Shouldn't it?

@Vilius-Stankaitis
Copy link
Collaborator

I sent you an email last week with more details (could you check the span folder). I will create a new ticket.

@larspett
Copy link
Collaborator Author

@Vilius-Stankaitis hi haven't received such an email from you directly (not in the spam folder either). Can you please resend with cc to [email protected]. Could have been stopped before the mailbox

@Vilius-Stankaitis
Copy link
Collaborator

Hi all,

a few mistakes:

"Gammafly" is not assigned to the Swedish common name.

"Gammaeule" currently is assigned to the Swedish common names list (should be assigned to German).

Could someone fix this?

Thank you

@JimBacon
Copy link
Member

@Vilius-Stankaitis I've fixed the names for Autographa gamma mentioned in your comment above, thanks.

I'm going to import another 221 Swedish moth names this afternoon that have been matched to scientific names already in our list. There are a further 88 Swedish names still to come once they have a matching scientific name in the moth list.

@JimBacon
Copy link
Member

I've uploaded the following 232 Swedish moth names; a few more than expected as I found some synonyms among the names I thought were unmatched. I haven't added the synonyms at the moment.

swedish-moth-names.csv

Furthermore, I

  • added Agrochola circellaris with its English and Swedish names. It was missing which was surprising given it is widespread in Europe,
  • removed Colias croceus from the Swedish list of missing species as it is a butterfly.
  • removed kortstreckad videguldmal, previously given as a common name for Phyllonorycter brevilineatella which is now listed as a synonym of Phyllonorycter salicicolella which already has the name vinkelbandad videguldmal (Possibly the wrong decision - maybe both common names should be kept for this taxon.)

This leaves 74 unmatched names still to import.

@larspett
Copy link
Collaborator Author

  • Phyllonorycter brevilineatellus and Phyllonorycter brevilineatella are synonyms and are called Kortstreckad videguldmal as common name
  • Phyllonorycter salicicolellus and Phyllonorycter salicicolella are synoyms and are called Vinkelbandad videguldmal as common name
  • These two species are distinct and not synonyms

@JimBacon
Copy link
Member

Hi @larspett. In your spreadsheet, moth_list_swe_Errors_LP.xlsx, (in #542 (comment)) you wrote that P.brevilineatellus is a synonym of P. salicicolella
I was about to conclude there was a copy and paste error in the spreadsheet but then the Catalogue of Life also states they are synonyms.
I don't know what to do!

@larspett
Copy link
Collaborator Author

ah taxonomy the joy of it :) Georg, who compiled the list, found the synonym listing whereas I found a different (older) listing where they were not considered synonyms. All these four are apparently considered synonyms and the common name should be Vinkelbandad videguldmal . Sorry about that

@larspett
Copy link
Collaborator Author

@JimBacon I noticed that there are no translations for species like Korscheltellus lupulinus (lupulina), are we missing common names for Hepialidae? The image recognition fails too. ObsIdentify solves the image recognition 100%

@JimBacon
Copy link
Member

The translation for Korscheltellus lupulina was one I added on Monday so I would not expect it to be present in the app yet.

Can you attach the image which is not giving the result you expect, so that I can investigate. My guess is that the photo is identified as Korscheltellus lupulinus which would not be matched against our list as we have Korscheltellus lupulina without the synonym, at present.

@larspett
Copy link
Collaborator Author

Sounds likely, here it is (not cropped here) image

@JimBacon
Copy link
Member

It's more depressing than I thought. The image classifier returns another synonym altogether, Pharmacis lupulina.

We need to do something to align the eBMS and the NIA taxonomy. David's comment suggests this is planned.

@larspett
Copy link
Collaborator Author

What is the NIA taxonomy? Couldn't easily find my way through all NIA acronyms

@JimBacon
Copy link
Member

Nature Identification API

@DavidRoy
Copy link
Collaborator

We are switching the updated NIA soon. We’ll also review taxonomy then

@DavidRoy
Copy link
Collaborator

NIA = ObsIdentify

@kazlauskis
Copy link
Member

The app part is done for this and includes the Swedish moth names. Can we close it now?

@DavidRoy
Copy link
Collaborator

DavidRoy commented Dec 8, 2023

@larspett

@JimBacon
Copy link
Member

JimBacon commented Dec 8, 2023

I can see a comment of mine from 22 May: 'This leaves 74 unmatched names still to import'
Don't close until I have been able to check what happened to those.

There is a separate issue, Indicia-Team/drupal-8-modules-indicia-ai#2, regarding updating the NIA classifier. This is also still to do.

@larspett
Copy link
Collaborator Author

larspett commented Dec 8, 2023

Last time I had a look there were still numerous names in German. I can have a look now. Which ones are the unmatched names @JimBacon ?

@larspett
Copy link
Collaborator Author

larspett commented Dec 8, 2023

This, for instance, is an attempt to view butterfly data but what appears as top entries are bumblebees and hoverfles
image

@larspett
Copy link
Collaborator Author

larspett commented Dec 8, 2023

Some more examples:
image

@larspett
Copy link
Collaborator Author

larspett commented Dec 8, 2023

Looks like synonyms that are missing

  • Fruktträdssommarvecklare Archips podanus
  • Mattgul lavspinnare Eilema depressum
  • Unknown could be Okänd

@DavidRoy DavidRoy added the moth label May 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
app issues related to mobile applications moth Priority 2 website: general Issues related to drupal website, non-Indicia
Projects
None yet
Development

No branches or pull requests

9 participants