Adds detection for various apps (matomo-org#7613)

* Adds detection for Microsoft Copilot * Rename Petal Search App to Petal Search * Improves version detection for Instabridge * Improves detection for Instabridge * Adds detection for Whatplay * Improves detection for MetaMask * Adds detection for Lark * Adds detection for SearchCraft * Adds detection for Crypto.com DeFi Wallet * Adds detection for Clipbox+ * Improves version detection for LinkedIn * Adds detection for Google Assistant * Improves detection for HideX * Improves detection for Petal Search * Adds detection for Huawei Mobile Services * Adds detection for PLAYit * Adds detection for Autoplius.lt * Adds detection for Hotels.com * Adds detection for Coinbase * Fix Google Assistant regex * Improves Huawei Mobile Services regex * Fix Huawei Mobile Services regex * Move AFNetworking generic at the bottom * Adds detection for generic apps * Improves detection for Yahoo! Japan * Adds detection for Browser-Anonymizer * Rename BingWebApp, Bing iPad, Microsoft Bing Search to Microsoft Bing * Improves Surfshark regex * Improves Blackboard regex * Adds detection for De Telegraaf * Adds detection for waipu.tv * Adds detection for Zen (Дзен) * Adds detection for Redditor * Adds detection for BuzzVideo * Improves detection for Microsoft Copilot
liviuconcioiu · Mar 11, 2024 · 447958d · 447958d
1 parent 29b5c5d
commit 447958d
Show file tree

Hide file tree

Showing 10 changed files with 407 additions and 60 deletions.
diff --git a/Tests/Parser/Client/fixtures/mobile_app.yml b/Tests/Parser/Client/fixtures/mobile_app.yml
@@ -165,7 +165,7 @@
   user_agent: Mozilla/5.0 (Linux; Android 7.0; VIE-L09 Build/HUAWEIVIE-L09; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/59.0.3071.125 Mobile Safari/537.36 BingWeb/6.9.25207603
   client:
     type: mobile app
-    name: BingWebApp
+    name: Microsoft Bing
     version: "6.9.25207603"
 -
   user_agent: Mozilla/5.0 (Linux; U; Android 4.1.2; fr-ca; LT30a Build/9.1.A.0.489) AppleWebKit/534.30 (KHTML, like Gecko) Version/4.0 Mobile Safari/534.30 GSA/3.3.11.1069658.arm
@@ -1047,7 +1047,7 @@
   user_agent: Mozilla/5.0 (Linux; Android 10; NEN-L22 Build/HUAWEINEN-L22; ) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/83.0.4103.106 Mobile Safari/537.36 BingSapphire/21.6.390910305
   client:
     type: mobile app
-    name: Microsoft Bing Search
+    name: Microsoft Bing
     version: 21.6.390910305
 -
   user_agent: Mozilla/5.0 (Linux; Android 10; JNY-LX1 Build/HUAWEIJNY-L21; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/88.0.4324.93 Mobile Safari/537.36HiSearch/21.1.11.300
@@ -1389,7 +1389,7 @@
   user_agent: Mozilla/5.0 (iPad; CPU OS 12_5_5 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 Safari/601.1 bingipadclient BingWeb
   client:
     type: mobile app
-    name: Bing iPad
+    name: Microsoft Bing
     version:
 -
   user_agent: Mozilla/5.0 (Windows NT 10.0; rv:80.0) Gecko/20100101 Firefox/80.0 anonymized by Abelssoft 1003141044
@@ -1611,7 +1611,7 @@
   user_agent: Mozilla/5.0 (Linux; Android 11; JLN-LX3 Build/HUAWEIJLN-LX3; ) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/88.0.4324.93 Mobile Safari/537.36 Sapphire/23.3.401205602
   client:
     type: mobile app
-    name: Microsoft Bing Search
+    name: Microsoft Bing
     version: 23.3.401205602
 -
   user_agent: Bitwarden_Mobile/2023.1.0 (Android 13; SDK 33; Model SM-F926B)
@@ -1751,6 +1751,156 @@
     type: mobile app
     name: Google Lens
     version: 289.0.577695730
+-
+  user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 17_3_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.3.1 Mobile/15E148 Safari/605.1.15 CopilotSapphire/1.0.180000000
+  client:
+    type: mobile app
+    name: Microsoft Copilot
+    version: 1.0.180000000
+-
+  user_agent: Mozilla/5.0 (Linux; Android 11; BV4900Pro) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/85.0.4183.127 Mobile Safari/537.36 Instabridge/21.9.0
+  client:
+    type: mobile app
+    name: Instabridge
+    version: 21.9.0
+-
+  user_agent: Mozilla/5.0 (Linux; Android 11; MI 9 Build/RKQ1.200826.002; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/106.0.5249.126 Mobile Safari/537.36 Whatplay
+  client:
+    type: mobile app
+    name: Whatplay
+    version: ""
+-
+  user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 16_0_2 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 WebView MetaMaskMobile
+  client:
+    type: mobile app
+    name: MetaMask
+    version: ""
+-
+  user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 16_3_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/16.3.1 Mobile/15E148 Safari/604.1 Lark/5.29.6 LarkLocale/en_US ChannelName/Lark LKBrowserIdentifier/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
+  client:
+    type: mobile app
+    name: Lark
+    version: 5.29.6
+-
+  user_agent: 'Mozilla/5.0  App/2000002 Plu/2012 channel/0main  (Linux; Android 12; LIO-AN00) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.2526.83 Mobile Safari/537.36 SearchCraft/2.6.1 (Baidu; P2 11.3.1)'
+  client:
+    type: mobile app
+    name: SearchCraft
+    version: 2.6.1
+-
+  user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 15_6_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 DeFiWallet/1.43.0
+  client:
+    type: mobile app
+    name: Crypto.com DeFi Wallet
+    version: 1.43.0
+-
+  user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 15_6_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/14.0.1 Mobile/15E148 Safari/605.1.15/Clipbox+/2.2.8
+  client:
+    type: mobile app
+    name: Clipbox+
+    version: 2.2.8
+-
+  user_agent: 'Mozilla/5.0 (iPhone; CPU iPhone OS 16_1_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 [LinkedInApp]/9.24.1488'
+  client:
+    type: mobile app
+    name: LinkedIn
+    version: 9.24.1488
+-
+  user_agent: Mozilla/5.0 (iPhone; CPU OS 16.3.1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) GoogleWv/1.0 (WKWebView) OPA/1.9.78001 CoreAssistant/com.google.OPA
+  client:
+    type: mobile app
+    name: Google Assistant
+    version: 1.9.78001
+-
+  user_agent: Mozilla/5.0 (Linux; Android 10; Redmi Y3 Build/QKQ1.191008.001) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/121.0.6167.178 Mobile Safari/537.36 appname/HideX appverc/30517004
+  client:
+    type: mobile app
+    name: HideX
+    version:
+-
+  user_agent: Mozilla/5.0 (Linux; Android 10; MAR-LX1M Build/HUAWEIMAR-L01MEA; wv) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.6167.143 Mobile Safari/537.36 HMSCore/6.13.0.302
+  client:
+    type: mobile app
+    name: Huawei Mobile Services
+    version: 6.13.0.302
+-
+  user_agent: Mozilla/5.0 (Linux; Android 12; moto g(30) Build/S0RCS32.41-10-19-14) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/121.0.6167.178 Mobile Safari/537.36 appname/PLAYit appverc/20714015
+  client:
+    type: mobile app
+    name: PLAYit
+    version:
+-
+  user_agent: 'Mozilla/5.0 Autopliuslt/7.8.0 EmbeddedBrowser (iPhone; CPU iPhone OS 16_6_1 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile DeviceUID:  VendorUID:  AppPkgID: lt.plius.auto'
+  client:
+    type: mobile app
+    name: Autoplius.lt
+    version: 7.8.0
+-
+  user_agent: HCom/2024.5.0 Dalvik/2.1.0 (Linux; U; Android 9; FIG-LX1 Build/HUAWEIFIG-L11)
+  client:
+    type: mobile app
+    name: Hotels.com
+    version: 2024.5.0
+-
+  user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 15_2 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 CoinbaseRetail/11.10.8 (build:11100008; iOS 15.2)
+  client:
+    type: mobile app
+    name: Coinbase
+    version: 11.10.8
+-
+  user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 17_3_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 YJApp-IOS jp.co.yahoo.ipn.appli/4.107.0
+  client:
+    type: mobile app
+    name: Yahoo! Japan
+    version: 4.107.0
+-
+  user_agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; WOW64; rv:41.0) Gecko/20100101 Firefox/105.0.3 (x64 de) Anonymisiert durch AlMiSoft Browser-Anonymisierer 2477101
+  client:
+    type: mobile app
+    name: Browser-Anonymizer
+    version:
+-
+  user_agent: Mozilla/5.0 (iPad; CPU OS 9_3_5 like Mac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Mobile/13G36 Safari/601.1 bingipadclient
+  client:
+    type: mobile app
+    name: Microsoft Bing
+    version:
+-
+  user_agent: De Telegraaf/6.8.11 (Android 11; en_US)
+  client:
+    type: mobile app
+    name: De Telegraaf
+    version: 6.8.11
+-
+  user_agent: waipu/2023.25.0-40b5976d4b (Phone; CUBOT; NOTE 7; waipu; Android 10)
+  client:
+    type: mobile app
+    name: waipu.tv
+    version: 2023.25.0
+-
+  user_agent: Mozilla/5.0 (Linux; Android 8.1.0; C12 Pro Build/O11019; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/73.0.3683.90 Mobile Safari/537.36 ZenKit/1.40.1.0-internalNewdesign-Zen
+  client:
+    type: mobile app
+    name: Zen
+    version: 1.40.1.0
+-
+  user_agent: Mozilla/5.0 (Linux; arm_64; Android 11; IN2010) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.216 BroPP/1.0 SA/3 YaSearchBrowser/21.53.1 YaApp_Android/21.53.1 ru.yandex.searchplugin/21.53.210503023 (OnePlus IN2010; Android 11) ZenKit/21.5.3
+  client:
+    type: mobile app
+    name: Zen
+    version: 21.5.3
+-
+  user_agent: Redditor/152 CFNetwork/1331.0.7 Darwin/21.4.0
+  client:
+    type: mobile app
+    name: Redditor
+    version:
+-
+  user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 15_1 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 TopBuzz com.topbuzz.videoen/8.8.8 (iPhone; iOS 15.1; en; WIFI)
+  client:
+    type: mobile app
+    name: BuzzVideo
+    version: 8.8.8
 -
   user_agent: Mozilla/5.0 (iPhone; CPU iPhone OS 13_5 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/KPN_Veilig 18.5.274904 18.5.274904 16.0 Safari/605.1.15
   client:

diff --git a/Tests/fixtures/clienthints-app.yml b/Tests/fixtures/clienthints-app.yml
@@ -873,7 +873,7 @@
     platform: ""
   client:
     type: mobile app
-    name: Microsoft Bing Search
+    name: Microsoft Bing
     version: 22.2.400225301
   device:
     type: smartphone
@@ -891,7 +891,7 @@
     platform: ""
   client:
     type: mobile app
-    name: Microsoft Bing Search
+    name: Microsoft Bing
     version: 21.9.400310302
   device:
     type: smartphone
@@ -2461,6 +2461,96 @@
     model: Nova 9 SE
   os_family: Android
   browser_family: Unknown
+-
+  user_agent: Mozilla/5.0 (Linux; Android 11; ZTE 8010) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/85.0.4183.127 Mobile Safari/537.36 Instabridge/21.9.0
+  headers:
+    http-x-requested-with: com.instabridge.android
+  os:
+    name: Android
+    version: "11"
+    platform: ""
+  client:
+    type: mobile app
+    name: Instabridge
+    version: 21.9.0
+  device:
+    type: phablet
+    brand: ZTE
+    model: Blade V2020 Smart
+  os_family: Android
+  browser_family: Unknown
+-
+  user_agent: Mozilla/5.0 (Linux; Android 11; MI 9 Build/RKQ1.200826.002; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/106.0.5249.126 Mobile Safari/537.36 Whatplay
+  headers:
+    http-x-requested-with: com.repotools.whatplay
+  os:
+    name: Android
+    version: "11"
+    platform: ""
+  client:
+    type: mobile app
+    name: Whatplay
+    version: ""
+  device:
+    type: smartphone
+    brand: Xiaomi
+    model: Mi 9
+  os_family: Android
+  browser_family: Unknown
+-
+  user_agent: 'Mozilla/5.0  App/2000002 Plu/3013 channel/0main  (Linux; Android 12; CET-AL00) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.2526.83 Mobile Safari/537.36 SearchCraft/2.6.1 (Baidu; P2 11.3.1)'
+  headers:
+    http-x-requested-with: com.saf.seca
+  os:
+    name: Android
+    version: "12"
+    platform: ""
+  client:
+    type: mobile app
+    name: SearchCraft
+    version: 2.6.1
+  device:
+    type: smartphone
+    brand: Huawei
+    model: Mate 50
+  os_family: Android
+  browser_family: Unknown
+-
+  user_agent: Mozilla/5.0 (Linux; Android 10; HMA-L29 Build/HUAWEIHMA-L29; wv) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/102.0.5005.125 Mobile Safari/537.36 HMSCore/6.5.1.302
+  headers:
+    http-x-requested-with: com.huawei.hwsearch
+  os:
+    name: Android
+    version: "10"
+    platform: ""
+  client:
+    type: mobile app
+    name: Petal Search
+    version: ""
+  device:
+    type: smartphone
+    brand: Huawei
+    model: Mate 20
+  os_family: Android
+  browser_family: Unknown
+-
+  user_agent: Mozilla/5.0 (Linux; Android 10; Redmi 8A Dual Build/QKQ1.191014.001) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/96.0.4664.45 Mobile Safari/537.36 appname/PLAYit appverc/20602004 appname/PLAYit appverc/20602004 appname/PLAYit appverc/20602004 appname/PLAYit appverc/20602004
+  headers:
+    http-x-requested-with: com.playit.videoplayer
+  os:
+    name: Android
+    version: "10"
+    platform: ""
+  client:
+    type: mobile app
+    name: PLAYit
+    version: ""
+  device:
+    type: smartphone
+    brand: Xiaomi
+    model: Redmi 8A Dual
+  os_family: Android
+  browser_family: Unknown
 -
   user_agent: Mozilla/5.0 (Linux; Android 11.0; Orange TV Box Build/QTG1.200615.001; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/102.0.5005.22 Mobile Safari/537.36
   headers:
@@ -2497,3 +2587,21 @@
     model: Galaxy A03 Core
   os_family: Android
   browser_family: Unknown
+-
+  user_agent: Mozilla/5.0 (Linux; Android 14; Pixel 6 Build/UQ1A.240105.002; ) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Mobile Safari/537.36 EdgA/119.0.0.0
+  headers:
+    http-x-requested-with: com.microsoft.copilot
+  os:
+    name: Android
+    version: "14"
+    platform: ""
+  client:
+    type: mobile app
+    name: Microsoft Copilot
+    version: ""
+  device:
+    type: smartphone
+    brand: Google
+    model: Pixel 6
+  os_family: Android
+  browser_family: Unknown
diff --git a/Tests/fixtures/mobile_apps.yml b/Tests/fixtures/mobile_apps.yml
@@ -1640,7 +1640,7 @@
     platform: ""
   client:
     type: mobile app
-    name: Petal Search App
+    name: Petal Search
     version: 11.0.1.324
   device:
     type: smartphone

diff --git a/Tests/fixtures/portable_media_player.yml b/Tests/fixtures/portable_media_player.yml
@@ -549,7 +549,7 @@
     platform: ""
   client:
     type: mobile app
-    name: BingWebApp
+    name: Microsoft Bing
     version: 3.02.1641.20120106
   device:
     type: portable media player

diff --git a/Tests/fixtures/smartphone-10.yml b/Tests/fixtures/smartphone-10.yml
@@ -1153,20 +1153,18 @@
   user_agent: Mozilla/5.0 (Linux; Android 7.1.1; Neffos N1 Build/N4F26M; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/74.0.3729.157 Mobile Safari/537.36 ZenKit/1.39.8.2-internalNewdesign-Zen
   os:
     name: Android
-    version: "7.1.1"
+    version: 7.1.1
     platform: ""
   client:
-    type: browser
-    name: Chrome Webview
-    version: "74.0.3729.157"
-    engine: Blink
-    engine_version: "74.0.3729.157"
+    type: mobile app
+    name: Zen
+    version: 1.39.8.2
   device:
     type: smartphone
     brand: Neffos
     model: N1
   os_family: Android
-  browser_family: Chrome
+  browser_family: Unknown
 -
   user_agent: Mozilla/5.0 (Linux; Android 7.0; Neffos X1 Build/NRD90M) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/59.0.3071.125 Mobile Safari/537.36
   os:

diff --git a/Tests/fixtures/smartphone-26.yml b/Tests/fixtures/smartphone-26.yml
@@ -7204,17 +7204,15 @@
   os_family: Android
   browser_family: Internet Explorer
 -
-  user_agent: Mozilla/5.0 (Linux; arm_64; Android 11; SM-M625F) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 BroPP/1.0 SA/3 YaSearchBrowser/21.81.1 YaApp_Android/21.81.1 ru.yandex.searchplugin/21.81.210801043 (samsung SM-M625F; Android 11) ZenKit/21.8.1.
+  user_agent: Mozilla/5.0 (Linux; arm_64; Android 11; SM-M625F) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 BroPP/1.0 SA/3 YaSearchBrowser/21.81.1 YaApp_Android/21.81.1 ru.yandex.searchplugin/21.81.210801043 (samsung SM-M625F; Android 11) ZenKit/21.8.1
   os:
     name: Android
     version: "11"
     platform: ARM
   client:
-    type: browser
-    name: Yandex Browser
-    version: 21.81.1
-    engine: Blink
-    engine_version: "92.0.4515.159"
+    type: mobile app
+    name: Zen
+    version: 21.8.1
   device:
     type: smartphone
     brand: Samsung