Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Utiq #64

Merged
merged 3 commits into from
Sep 23, 2024
Merged

Utiq #64

merged 3 commits into from
Sep 23, 2024

Conversation

max-ostapenko
Copy link

@max-ostapenko max-ostapenko marked this pull request as ready for review September 23, 2024 09:59
src/technologies/u.json Outdated Show resolved Hide resolved
@max-ostapenko
Copy link
Author

It's really helpful to test rules one by one.

Copy link

WPT test run for https://almanac.httparchive.org/en/2022/

WPT test run results: http://webpagetest.httparchive.org/results.php?test=240923_4X_5
Detected technologies:

{
    "detected": {
        "IaaS": "Google Cloud",
        "JavaScript libraries": "web-vitals",
        "RUM": "web-vitals",
        "Performance": "Priority Hints,Google Cloud Trace",
        "Security": "HSTS",
        "Webmail": "Google Workspace",
        "Email": "Google Workspace",
        "Analytics": "Google Analytics",
        "CDN": "Cloudflare",
        "Miscellaneous": "RSS,Open Graph"
    },
    "detected_apps": {
        "Google Cloud": "",
        "web-vitals": "",
        "Priority Hints": "",
        "HSTS": "",
        "Google Workspace": "",
        "Google Cloud Trace": "",
        "Google Analytics": "",
        "Cloudflare": "",
        "RSS": "",
        "Open Graph": ""
    },
    "detected_technologies": {
        "Google Cloud": {
            "name": "Google Cloud",
            "description": "Google Cloud is a suite of cloud computing services.",
            "slug": "google-cloud",
            "categories": [
                {
                    "id": 63,
                    "slug": "iaas",
                    "groups": [
                        7
                    ],
                    "name": "IaaS",
                    "priority": 8
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google Cloud.svg",
            "website": "https://cloud.google.com",
            "pricing": [],
            "cpe": "cpe:2.3:a:google:cloud_platform:*:*:*:*:*:*:*:*"
        },
        "web-vitals": {
            "name": "web-vitals",
            "description": "The web-vitals JavaScript is a tiny, modular library for measuring all the web vitals metrics on real users.",
            "slug": "web-vitals",
            "categories": [
                {
                    "id": 59,
                    "slug": "javascript-libraries",
                    "groups": [
                        9
                    ],
                    "name": "JavaScript libraries",
                    "priority": 9
                },
                {
                    "id": 78,
                    "slug": "rum",
                    "groups": [
                        2
                    ],
                    "name": "RUM",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "web-vitals.svg",
            "website": "https://github.com/GoogleChrome/web-vitals",
            "pricing": [],
            "cpe": null
        },
        "Priority Hints": {
            "name": "Priority Hints",
            "description": "Priority Hints exposes a mechanism for developers to signal a relative priority for browsers to consider when fetching resources.",
            "slug": "priority-hints",
            "categories": [
                {
                    "id": 92,
                    "slug": "performance",
                    "groups": [
                        7
                    ],
                    "name": "Performance",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Priority Hints.svg",
            "website": "https://wicg.github.io/priority-hints/",
            "pricing": [],
            "cpe": null
        },
        "HSTS": {
            "name": "HSTS",
            "description": "HTTP Strict Transport Security (HSTS) informs browsers that the site should only be accessed using HTTPS.",
            "slug": "hsts",
            "categories": [
                {
                    "id": 16,
                    "slug": "security",
                    "groups": [
                        11
                    ],
                    "name": "Security",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "default.svg",
            "website": "https://www.rfc-editor.org/rfc/rfc6797#section-6.1",
            "pricing": [],
            "cpe": null
        },
        "Google Workspace": {
            "name": "Google Workspace",
            "description": "Google Workspace, formerly G Suite, is a collection of cloud computing, productivity and collaboration tools.",
            "slug": "google-workspace",
            "categories": [
                {
                    "id": 30,
                    "slug": "webmail",
                    "groups": [
                        4
                    ],
                    "name": "Webmail",
                    "priority": 2
                },
                {
                    "id": 75,
                    "slug": "email",
                    "groups": [
                        4,
                        2
                    ],
                    "name": "Email",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google.svg",
            "website": "https://workspace.google.com/",
            "pricing": [],
            "cpe": null
        },
        "Google Cloud Trace": {
            "name": "Google Cloud Trace",
            "description": "Google Cloud Trace is a distributed tracing system that collects latency data from applications and displays it in the Google Cloud Console.",
            "slug": "google-cloud-trace",
            "categories": [
                {
                    "id": 92,
                    "slug": "performance",
                    "groups": [
                        7
                    ],
                    "name": "Performance",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "google-cloud-trace.svg",
            "website": "https://cloud.google.com/trace",
            "pricing": [],
            "cpe": null
        },
        "Google Analytics": {
            "name": "Google Analytics",
            "description": "Google Analytics is a free web analytics service that tracks and reports website traffic.",
            "slug": "google-analytics",
            "categories": [
                {
                    "id": 10,
                    "slug": "analytics",
                    "groups": [
                        8
                    ],
                    "name": "Analytics",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google Analytics.svg",
            "website": "https://google.com/analytics",
            "pricing": [],
            "cpe": null
        },
        "Cloudflare": {
            "name": "Cloudflare",
            "description": "Cloudflare is a web-infrastructure and website-security company, providing content-delivery-network services, DDoS mitigation, Internet security, and distributed domain-name-server services.",
            "slug": "cloudflare",
            "categories": [
                {
                    "id": 31,
                    "slug": "cdn",
                    "groups": [
                        7
                    ],
                    "name": "CDN",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "CloudFlare.svg",
            "website": "https://www.cloudflare.com",
            "pricing": [],
            "cpe": null
        },
        "RSS": {
            "name": "RSS",
            "description": "RSS is a family of web feed formats used to publish frequently updated works—such as blog entries, news headlines, audio, and video—in a standardized format.",
            "slug": "rss",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "RSS.svg",
            "website": "https://www.rssboard.org/rss-specification",
            "pricing": [],
            "cpe": null
        },
        "Open Graph": {
            "name": "Open Graph",
            "description": "Open Graph is a protocol that is used to integrate any web page into the social graph.",
            "slug": "open-graph",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Open Graph.png",
            "website": "https://ogp.me",
            "pricing": [],
            "cpe": null
        }
    }
}
WPT test run for https://www.aufeminin.com/

WPT test run results: http://webpagetest.httparchive.org/results.php?test=240923_FC_6
Detected technologies:

{
    "detected": {
        "Webmail": "Apple iCloud Mail,Google Workspace",
        "Payment processors": "Stripe",
        "PaaS": "Amazon Web Services",
        "JavaScript libraries": "web-vitals,PubSubJS,LazySizes,core-js 3.35.1,Swiper",
        "RUM": "web-vitals,SpeedCurve",
        "Analytics": "TikTok Pixel,Marfeel,Hotjar,Google Analytics,Facebook Pixel 2.9.167",
        "Performance": "LazySizes",
        "Advertising": "Google AdSense,Utiq,Taboola,Outbrain,Marfeel",
        "Widgets": "Outbrain",
        "Security": "HSTS",
        "Email": "Google Workspace",
        "Tag managers": "Google Tag Manager",
        "Cookie compliance": "Funding Choices,Didomi",
        "Segmentation": "Adobe Audience Manager",
        "A/B Testing": "AB Tasty",
        "Miscellaneous": "Permutive,RSS,Open Graph,LottieFiles,HTTP/3"
    },
    "detected_apps": {
        "Apple iCloud Mail": "",
        "Stripe": "",
        "Amazon Web Services": "",
        "web-vitals": "",
        "TikTok Pixel": "",
        "PubSubJS": "",
        "LazySizes": "",
        "Google AdSense": "",
        "core-js": "3.35.1",
        "Swiper": "",
        "Utiq": "",
        "Taboola": "",
        "SpeedCurve": "",
        "Outbrain": "",
        "Marfeel": "",
        "Hotjar": "",
        "HSTS": "",
        "Google Workspace": "",
        "Google Tag Manager": "",
        "Google Analytics": "",
        "Funding Choices": "",
        "Facebook Pixel": "2.9.167",
        "Didomi": "",
        "Adobe Audience Manager": "",
        "AB Tasty": "",
        "Permutive": "",
        "RSS": "",
        "Open Graph": "",
        "LottieFiles": "",
        "HTTP/3": ""
    },
    "detected_technologies": {
        "Apple iCloud Mail": {
            "name": "Apple iCloud Mail",
            "description": "Apple iCloud Mail is a webmail service provided by Apple, Inc.",
            "slug": "apple-icloud-mail",
            "categories": [
                {
                    "id": 30,
                    "slug": "webmail",
                    "groups": [
                        4
                    ],
                    "name": "Webmail",
                    "priority": 2
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Apple.svg",
            "website": "https://www.apple.com/icloud/",
            "pricing": [],
            "cpe": null
        },
        "Stripe": {
            "name": "Stripe",
            "description": "Stripe offers online payment processing for internet businesses as well as fraud prevention, invoicing and subscription management.",
            "slug": "stripe",
            "categories": [
                {
                    "id": 41,
                    "slug": "payment-processors",
                    "groups": [
                        1
                    ],
                    "name": "Payment processors",
                    "priority": 8
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Stripe.svg",
            "website": "https://stripe.com",
            "pricing": [
                "payg"
            ],
            "cpe": null
        },
        "Amazon Web Services": {
            "name": "Amazon Web Services",
            "description": "Amazon Web Services (AWS) is a comprehensive cloud services platform offering compute power, database storage, content delivery and other functionality.",
            "slug": "amazon-web-services",
            "categories": [
                {
                    "id": 62,
                    "slug": "paas",
                    "groups": [
                        7
                    ],
                    "name": "PaaS",
                    "priority": 8
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Amazon Web Services.svg",
            "website": "https://aws.amazon.com/",
            "pricing": [],
            "cpe": null
        },
        "web-vitals": {
            "name": "web-vitals",
            "description": "The web-vitals JavaScript is a tiny, modular library for measuring all the web vitals metrics on real users.",
            "slug": "web-vitals",
            "categories": [
                {
                    "id": 59,
                    "slug": "javascript-libraries",
                    "groups": [
                        9
                    ],
                    "name": "JavaScript libraries",
                    "priority": 9
                },
                {
                    "id": 78,
                    "slug": "rum",
                    "groups": [
                        2
                    ],
                    "name": "RUM",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "web-vitals.svg",
            "website": "https://github.com/GoogleChrome/web-vitals",
            "pricing": [],
            "cpe": null
        },
        "TikTok Pixel": {
            "name": "TikTok Pixel",
            "description": null,
            "slug": "tiktok-pixel",
            "categories": [
                {
                    "id": 10,
                    "slug": "analytics",
                    "groups": [
                        8
                    ],
                    "name": "Analytics",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "TikTok.svg",
            "website": "https://ads.tiktok.com",
            "pricing": [],
            "cpe": null
        },
        "PubSubJS": {
            "name": "PubSubJS",
            "description": "PubSubJS is a topic-based publish/subscribe library written in JavaScript.",
            "slug": "pubsubjs",
            "categories": [
                {
                    "id": 59,
                    "slug": "javascript-libraries",
                    "groups": [
                        9
                    ],
                    "name": "JavaScript libraries",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "pubsub-js.png",
            "website": "https://github.com/mroderick/PubSubJS",
            "pricing": [],
            "cpe": null
        },
        "LazySizes": {
            "name": "LazySizes",
            "description": "LazySizes is a JavaScript library used to delay the loading of images (iframes, scripts, etc) until they come into view.",
            "slug": "lazysizes",
            "categories": [
                {
                    "id": 59,
                    "slug": "javascript-libraries",
                    "groups": [
                        9
                    ],
                    "name": "JavaScript libraries",
                    "priority": 9
                },
                {
                    "id": 92,
                    "slug": "performance",
                    "groups": [
                        7
                    ],
                    "name": "Performance",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "default.svg",
            "website": "https://github.com/aFarkas/lazysizes",
            "pricing": [],
            "cpe": null
        },
        "Google AdSense": {
            "name": "Google AdSense",
            "description": "Google AdSense is a program run by Google through which website publishers serve advertisements that are targeted to the site content and audience.",
            "slug": "google-adsense",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google AdSense.svg",
            "website": "https://www.google.com/adsense/start/",
            "pricing": [],
            "cpe": null
        },
        "core-js": {
            "name": "core-js",
            "description": "core-js is a modular standard library for JavaScript, with polyfills for cutting-edge ECMAScript features.",
            "slug": "core-js",
            "categories": [
                {
                    "id": 59,
                    "slug": "javascript-libraries",
                    "groups": [
                        9
                    ],
                    "name": "JavaScript libraries",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "3.35.1",
            "icon": "core-js.png",
            "website": "https://github.com/zloirock/core-js",
            "pricing": [],
            "cpe": null
        },
        "Swiper": {
            "name": "Swiper",
            "description": "Swiper is a JavaScript library that creates modern touch sliders with hardware-accelerated transitions.",
            "slug": "swiper",
            "categories": [
                {
                    "id": 59,
                    "slug": "javascript-libraries",
                    "groups": [
                        9
                    ],
                    "name": "JavaScript libraries",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Swiper.svg",
            "website": "https://swiperjs.com",
            "pricing": [],
            "cpe": null
        },
        "Utiq": {
            "name": "Utiq",
            "description": "Utiq empowers brands and publishers to address audiences through Telco-powered first-party identifier.",
            "slug": "utiq",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Utiq.svg",
            "website": "https://utiq.com/",
            "pricing": [],
            "cpe": null
        },
        "Taboola": {
            "name": "Taboola",
            "description": "Taboola is a content discovery & native advertising platform for publishers and advertisers.",
            "slug": "taboola",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Taboola.svg",
            "website": "https://www.taboola.com",
            "pricing": [
                "payg"
            ],
            "cpe": null
        },
        "SpeedCurve": {
            "name": "SpeedCurve",
            "description": "SpeedCurve is a front-end performance monitoring service.",
            "slug": "speedcurve",
            "categories": [
                {
                    "id": 78,
                    "slug": "rum",
                    "groups": [
                        2
                    ],
                    "name": "RUM",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "SpeedCurve.svg",
            "website": "https://www.speedcurve.com",
            "pricing": [
                "mid",
                "recurring"
            ],
            "cpe": null
        },
        "Outbrain": {
            "name": "Outbrain",
            "description": "Outbrain is a web advertising platform that displays boxes of links, known as chumboxes, to pages within websites.",
            "slug": "outbrain",
            "categories": [
                {
                    "id": 5,
                    "slug": "widgets",
                    "groups": [
                        6
                    ],
                    "name": "Widgets",
                    "priority": 9
                },
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Outbrain.svg",
            "website": "https://www.outbrain.com",
            "pricing": [
                "payg"
            ],
            "cpe": null
        },
        "Marfeel": {
            "name": "Marfeel",
            "description": "Marfeel is a publisher platform that allows publishers to create, optimise and monetise their mobile websites.",
            "slug": "marfeel",
            "categories": [
                {
                    "id": 10,
                    "slug": "analytics",
                    "groups": [
                        8
                    ],
                    "name": "Analytics",
                    "priority": 9
                },
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Marfeel.svg",
            "website": "https://www.marfeel.com",
            "pricing": [
                "freemium",
                "poa"
            ],
            "cpe": null
        },
        "Hotjar": {
            "name": "Hotjar",
            "description": "Hotjar is a suite of analytic tools to assist in the gathering of qualitative data, providing feedback through tools such as heatmaps, session recordings, and surveys.",
            "slug": "hotjar",
            "categories": [
                {
                    "id": 10,
                    "slug": "analytics",
                    "groups": [
                        8
                    ],
                    "name": "Analytics",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Hotjar.svg",
            "website": "https://www.hotjar.com",
            "pricing": [
                "freemium",
                "low",
                "recurring"
            ],
            "cpe": null
        },
        "HSTS": {
            "name": "HSTS",
            "description": "HTTP Strict Transport Security (HSTS) informs browsers that the site should only be accessed using HTTPS.",
            "slug": "hsts",
            "categories": [
                {
                    "id": 16,
                    "slug": "security",
                    "groups": [
                        11
                    ],
                    "name": "Security",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "default.svg",
            "website": "https://www.rfc-editor.org/rfc/rfc6797#section-6.1",
            "pricing": [],
            "cpe": null
        },
        "Google Workspace": {
            "name": "Google Workspace",
            "description": "Google Workspace, formerly G Suite, is a collection of cloud computing, productivity and collaboration tools.",
            "slug": "google-workspace",
            "categories": [
                {
                    "id": 30,
                    "slug": "webmail",
                    "groups": [
                        4
                    ],
                    "name": "Webmail",
                    "priority": 2
                },
                {
                    "id": 75,
                    "slug": "email",
                    "groups": [
                        4,
                        2
                    ],
                    "name": "Email",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google.svg",
            "website": "https://workspace.google.com/",
            "pricing": [],
            "cpe": null
        },
        "Google Tag Manager": {
            "name": "Google Tag Manager",
            "description": "Google Tag Manager is a tag management system (TMS) that allows you to quickly and easily update measurement codes and related code fragments collectively known as tags on your website or mobile app.",
            "slug": "google-tag-manager",
            "categories": [
                {
                    "id": 42,
                    "slug": "tag-managers",
                    "groups": [
                        8
                    ],
                    "name": "Tag managers",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google Tag Manager.svg",
            "website": "https://www.google.com/tagmanager",
            "pricing": [],
            "cpe": null
        },
        "Google Analytics": {
            "name": "Google Analytics",
            "description": "Google Analytics is a free web analytics service that tracks and reports website traffic.",
            "slug": "google-analytics",
            "categories": [
                {
                    "id": 10,
                    "slug": "analytics",
                    "groups": [
                        8
                    ],
                    "name": "Analytics",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google Analytics.svg",
            "website": "https://google.com/analytics",
            "pricing": [],
            "cpe": null
        },
        "Funding Choices": {
            "name": "Funding Choices",
            "description": "Funding Choices is a messaging tool that can help you comply with the EU General Data Protection Regulation (GDPR), and recover lost revenue from ad blocking users.",
            "slug": "funding-choices",
            "categories": [
                {
                    "id": 67,
                    "slug": "cookie-compliance",
                    "groups": [
                        13
                    ],
                    "name": "Cookie compliance",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google.svg",
            "website": "https://developers.google.com/funding-choices",
            "pricing": [],
            "cpe": null
        },
        "Facebook Pixel": {
            "name": "Facebook Pixel",
            "description": "Facebook pixel is an analytics tool that allows you to measure the effectiveness of your advertising.",
            "slug": "facebook-pixel",
            "categories": [
                {
                    "id": 10,
                    "slug": "analytics",
                    "groups": [
                        8
                    ],
                    "name": "Analytics",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "2.9.167",
            "icon": "Facebook.svg",
            "website": "https://facebook.com",
            "pricing": [],
            "cpe": null
        },
        "Didomi": {
            "name": "Didomi",
            "description": "Didomi is a consent management platform helping brands and businesses collect, store and leverage their customer consents.",
            "slug": "didomi",
            "categories": [
                {
                    "id": 67,
                    "slug": "cookie-compliance",
                    "groups": [
                        13
                    ],
                    "name": "Cookie compliance",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "didomi.png",
            "website": "https://www.didomi.io/en/consent-preference-management",
            "pricing": [],
            "cpe": null
        },
        "Adobe Audience Manager": {
            "name": "Adobe Audience Manager",
            "description": "Adobe Audience Manager is a versatile audience data management platform.",
            "slug": "adobe-audience-manager",
            "categories": [
                {
                    "id": 86,
                    "slug": "segmentation",
                    "groups": [
                        2
                    ],
                    "name": "Segmentation",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Adobe.svg",
            "website": "https://business.adobe.com/products/audience-manager/adobe-audience-manager.html",
            "pricing": [
                "high",
                "recurring"
            ],
            "cpe": null
        },
        "AB Tasty": {
            "name": "AB Tasty",
            "description": "AB Tasty is a customer experience optimisation company. AB Tasty offers AI-driven experimentation, personalisation, and product optimisation platforms for user testing.",
            "slug": "ab-tasty",
            "categories": [
                {
                    "id": 74,
                    "slug": "a-b-testing",
                    "groups": [
                        8
                    ],
                    "name": "A/B Testing",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "AB Tasty.svg",
            "website": "https://www.abtasty.com",
            "pricing": [
                "poa"
            ],
            "cpe": null
        },
        "Permutive": {
            "name": "Permutive",
            "description": "Permutive is a publisher-focused data management platform.",
            "slug": "permutive",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Permutive.png",
            "website": "https://permutive.com",
            "pricing": [
                "poa"
            ],
            "cpe": null
        },
        "RSS": {
            "name": "RSS",
            "description": "RSS is a family of web feed formats used to publish frequently updated works—such as blog entries, news headlines, audio, and video—in a standardized format.",
            "slug": "rss",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "RSS.svg",
            "website": "https://www.rssboard.org/rss-specification",
            "pricing": [],
            "cpe": null
        },
        "Open Graph": {
            "name": "Open Graph",
            "description": "Open Graph is a protocol that is used to integrate any web page into the social graph.",
            "slug": "open-graph",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Open Graph.png",
            "website": "https://ogp.me",
            "pricing": [],
            "cpe": null
        },
        "LottieFiles": {
            "name": "LottieFiles",
            "description": "LottieFiles is an open-source animation file format that's tiny, high quality, interactive, and can be manipulated at runtime.",
            "slug": "lottiefiles",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "LottieFiles.svg",
            "website": "https://lottiefiles.com",
            "pricing": [],
            "cpe": null
        },
        "HTTP/3": {
            "name": "HTTP/3",
            "description": "HTTP/3 is the third major version of the Hypertext Transfer Protocol used to exchange information on the World Wide Web.",
            "slug": "http-3",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "HTTP3.svg",
            "website": "https://httpwg.org/",
            "pricing": [],
            "cpe": null
        }
    }
}
WPT test run for https://www.tz.de/

WPT test run results: http://webpagetest.httparchive.org/results.php?test=240923_SC_7
Detected technologies:

{
    "detected": {
        "Programming languages": "Java",
        "Caching": "Varnish",
        "UI frameworks": "Bootstrap",
        "JavaScript frameworks": "RequireJS 2.1.18",
        "Web servers": "Nginx",
        "Reverse proxies": "Nginx",
        "CDN": "Cloudflare",
        "Advertising": "Prebid 8.52.0,Criteo,Rubicon Project,PubMatic,OpenX,AppNexus,Utiq,Teads,Outbrain,Google Publisher Tag,Google AdSense,DoubleClick Campaign Manager (DCM),Amazon Advertising",
        "JavaScript libraries": "core-js 3.25.3",
        "Retargeting": "Criteo",
        "Security": "reCAPTCHA,Cloudflare Bot Management",
        "Analytics": "Snowplow Analytics,MoEngage,Google Analytics",
        "IaaS": "Snowplow Analytics",
        "Widgets": "Outbrain",
        "Marketing automation": "MoEngage",
        "Webmail": "Microsoft 365",
        "Email": "Microsoft 365",
        "Tag managers": "Google Tag Manager",
        "Miscellaneous": "Webpack,RSS,PWA,Open Graph"
    },
    "detected_apps": {
        "Java": "",
        "Varnish": "",
        "Bootstrap": "",
        "RequireJS": "2.1.18",
        "Nginx": "",
        "Cloudflare": "",
        "Prebid": "8.52.0",
        "core-js": "3.25.3",
        "Criteo": "",
        "reCAPTCHA": "",
        "Rubicon Project": "",
        "PubMatic": "",
        "OpenX": "",
        "AppNexus": "",
        "Utiq": "",
        "Teads": "",
        "Snowplow Analytics": "",
        "Outbrain": "",
        "MoEngage": "",
        "Microsoft 365": "",
        "Google Tag Manager": "",
        "Google Publisher Tag": "",
        "Google Analytics": "",
        "Google AdSense": "",
        "DoubleClick Campaign Manager (DCM)": "",
        "Cloudflare Bot Management": "",
        "Amazon Advertising": "",
        "Webpack": "",
        "RSS": "",
        "PWA": "",
        "Open Graph": ""
    },
    "detected_technologies": {
        "Java": {
            "name": "Java",
            "description": "Java is a class-based, object-oriented programming language that is designed to have as few implementation dependencies as possible.",
            "slug": "java",
            "categories": [
                {
                    "id": 27,
                    "slug": "programming-languages",
                    "groups": [
                        9
                    ],
                    "name": "Programming languages",
                    "priority": 5
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Java.svg",
            "website": "https://java.com",
            "pricing": [],
            "cpe": "cpe:2.3:a:oracle:jre:*:*:*:*:*:*:*:*"
        },
        "Varnish": {
            "name": "Varnish",
            "description": "Varnish is a reverse caching proxy.",
            "slug": "varnish",
            "categories": [
                {
                    "id": 23,
                    "slug": "caching",
                    "groups": [
                        7
                    ],
                    "name": "Caching",
                    "priority": 7
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Varnish.svg",
            "website": "https://www.varnish-cache.org",
            "pricing": [],
            "cpe": "cpe:2.3:a:varnish-software:varnish_cache:*:*:*:*:*:*:*:*"
        },
        "Bootstrap": {
            "name": "Bootstrap",
            "description": "Bootstrap is a free and open-source CSS framework directed at responsive, mobile-first front-end web development. It contains CSS and JavaScript-based design templates for typography, forms, buttons, navigation, and other interface components.",
            "slug": "bootstrap",
            "categories": [
                {
                    "id": 66,
                    "slug": "ui-frameworks",
                    "groups": [
                        9
                    ],
                    "name": "UI frameworks",
                    "priority": 7
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Bootstrap.svg",
            "website": "https://getbootstrap.com",
            "pricing": [],
            "cpe": "cpe:2.3:a:getbootstrap:bootstrap:*:*:*:*:*:*:*:*"
        },
        "RequireJS": {
            "name": "RequireJS",
            "description": "RequireJS is a JavaScript library and file loader which manages the dependencies between JavaScript files and in modular programming.",
            "slug": "requirejs",
            "categories": [
                {
                    "id": 12,
                    "slug": "javascript-frameworks",
                    "groups": [
                        9
                    ],
                    "name": "JavaScript frameworks",
                    "priority": 8
                }
            ],
            "confidence": 100,
            "version": "2.1.18",
            "icon": "RequireJS.svg",
            "website": "https://requirejs.org",
            "pricing": [],
            "cpe": null
        },
        "Nginx": {
            "name": "Nginx",
            "description": "Nginx is a web server that can also be used as a reverse proxy, load balancer, mail proxy and HTTP cache.",
            "slug": "nginx",
            "categories": [
                {
                    "id": 22,
                    "slug": "web-servers",
                    "groups": [
                        7
                    ],
                    "name": "Web servers",
                    "priority": 8
                },
                {
                    "id": 64,
                    "slug": "reverse-proxies",
                    "groups": [
                        7
                    ],
                    "name": "Reverse proxies",
                    "priority": 7
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Nginx.svg",
            "website": "https://nginx.org/en",
            "pricing": [],
            "cpe": "cpe:2.3:a:f5:nginx:*:*:*:*:*:*:*:*"
        },
        "Cloudflare": {
            "name": "Cloudflare",
            "description": "Cloudflare is a web-infrastructure and website-security company, providing content-delivery-network services, DDoS mitigation, Internet security, and distributed domain-name-server services.",
            "slug": "cloudflare",
            "categories": [
                {
                    "id": 31,
                    "slug": "cdn",
                    "groups": [
                        7
                    ],
                    "name": "CDN",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "CloudFlare.svg",
            "website": "https://www.cloudflare.com",
            "pricing": [],
            "cpe": null
        },
        "Prebid": {
            "name": "Prebid",
            "description": "Prebid is an open-source header bidding wrapper. It forms the core of our Nucleus ad platform, helping maximize revenue and performance for publishers.",
            "slug": "prebid",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "8.52.0",
            "icon": "Prebid.png",
            "website": "https://prebid.org",
            "pricing": [],
            "cpe": null
        },
        "core-js": {
            "name": "core-js",
            "description": "core-js is a modular standard library for JavaScript, with polyfills for cutting-edge ECMAScript features.",
            "slug": "core-js",
            "categories": [
                {
                    "id": 59,
                    "slug": "javascript-libraries",
                    "groups": [
                        9
                    ],
                    "name": "JavaScript libraries",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "3.25.3",
            "icon": "core-js.png",
            "website": "https://github.com/zloirock/core-js",
            "pricing": [],
            "cpe": null
        },
        "Criteo": {
            "name": "Criteo",
            "description": "Criteo provides personalised retargeting that works with Internet retailers to serve personalised online display advertisements to consumers who have previously visited the advertiser's website.",
            "slug": "criteo",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                },
                {
                    "id": 77,
                    "slug": "retargeting",
                    "groups": [
                        2
                    ],
                    "name": "Retargeting",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Criteo.svg",
            "website": "https://criteo.com",
            "pricing": [
                "poa"
            ],
            "cpe": null
        },
        "reCAPTCHA": {
            "name": "reCAPTCHA",
            "description": "reCAPTCHA is a free service from Google that helps protect websites from spam and abuse.",
            "slug": "recaptcha",
            "categories": [
                {
                    "id": 16,
                    "slug": "security",
                    "groups": [
                        11
                    ],
                    "name": "Security",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "reCAPTCHA.svg",
            "website": "https://www.google.com/recaptcha/",
            "pricing": [
                "freemium",
                "payg",
                "poa"
            ],
            "cpe": null
        },
        "Rubicon Project": {
            "name": "Rubicon Project",
            "description": "Rubicon Project is an advertising automation platform enabling publishers to transact advertising brands.",
            "slug": "rubicon-project",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Rubicon Project.svg",
            "website": "https://rubiconproject.com/",
            "pricing": [],
            "cpe": null
        },
        "PubMatic": {
            "name": "PubMatic",
            "description": "PubMatic is a company that develops and implements online advertising software and strategies for the digital publishing and advertising industry.",
            "slug": "pubmatic",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "PubMatic.svg",
            "website": "https://www.pubmatic.com/",
            "pricing": [
                "payg"
            ],
            "cpe": null
        },
        "OpenX": {
            "name": "OpenX",
            "description": "OpenX is a programmatic advertising technology company.",
            "slug": "openx",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "OpenX.png",
            "website": "https://openx.com",
            "pricing": [],
            "cpe": "cpe:2.3:a:openx:openx:*:*:*:*:*:*:*:*"
        },
        "AppNexus": {
            "name": "AppNexus",
            "description": "AppNexus is a cloud-based software platform that enables and optimizes programmatic online advertising.",
            "slug": "appnexus",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "AppNexus.svg",
            "website": "https://appnexus.com",
            "pricing": [
                "poa"
            ],
            "cpe": null
        },
        "Utiq": {
            "name": "Utiq",
            "description": "Utiq empowers brands and publishers to address audiences through Telco-powered first-party identifier.",
            "slug": "utiq",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Utiq.svg",
            "website": "https://utiq.com/",
            "pricing": [],
            "cpe": null
        },
        "Teads": {
            "name": "Teads",
            "description": "Teads is a technology provider that sells ads on publisher websites.",
            "slug": "teads",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Teads.svg",
            "website": "https://www.teads.com",
            "pricing": [],
            "cpe": null
        },
        "Snowplow Analytics": {
            "name": "Snowplow Analytics",
            "description": "Snowplow is an open-source behavioral data management platform for businesses.",
            "slug": "snowplow-analytics",
            "categories": [
                {
                    "id": 10,
                    "slug": "analytics",
                    "groups": [
                        8
                    ],
                    "name": "Analytics",
                    "priority": 9
                },
                {
                    "id": 63,
                    "slug": "iaas",
                    "groups": [
                        7
                    ],
                    "name": "IaaS",
                    "priority": 8
                }
            ],
            "confidence": 50,
            "version": "",
            "icon": "Snowplow.svg",
            "website": "https://snowplowanalytics.com",
            "pricing": [
                "poa"
            ],
            "cpe": null
        },
        "Outbrain": {
            "name": "Outbrain",
            "description": "Outbrain is a web advertising platform that displays boxes of links, known as chumboxes, to pages within websites.",
            "slug": "outbrain",
            "categories": [
                {
                    "id": 5,
                    "slug": "widgets",
                    "groups": [
                        6
                    ],
                    "name": "Widgets",
                    "priority": 9
                },
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Outbrain.svg",
            "website": "https://www.outbrain.com",
            "pricing": [
                "payg"
            ],
            "cpe": null
        },
        "MoEngage": {
            "name": "MoEngage",
            "description": "MoEngage is an intelligent customer engagement platform for the customer-obsessed marketer.",
            "slug": "moengage",
            "categories": [
                {
                    "id": 32,
                    "slug": "marketing-automation",
                    "groups": [
                        2
                    ],
                    "name": "Marketing automation",
                    "priority": 9
                },
                {
                    "id": 10,
                    "slug": "analytics",
                    "groups": [
                        8
                    ],
                    "name": "Analytics",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "MoEngage.png",
            "website": "https://www.moengage.com",
            "pricing": [
                "poa"
            ],
            "cpe": null
        },
        "Microsoft 365": {
            "name": "Microsoft 365",
            "description": "Microsoft 365 is a line of subscription services offered by Microsoft as part of the Microsoft Office product line.",
            "slug": "microsoft-365",
            "categories": [
                {
                    "id": 30,
                    "slug": "webmail",
                    "groups": [
                        4
                    ],
                    "name": "Webmail",
                    "priority": 2
                },
                {
                    "id": 75,
                    "slug": "email",
                    "groups": [
                        4,
                        2
                    ],
                    "name": "Email",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Microsoft 365.svg",
            "website": "https://www.microsoft.com/microsoft-365",
            "pricing": [],
            "cpe": null
        },
        "Google Tag Manager": {
            "name": "Google Tag Manager",
            "description": "Google Tag Manager is a tag management system (TMS) that allows you to quickly and easily update measurement codes and related code fragments collectively known as tags on your website or mobile app.",
            "slug": "google-tag-manager",
            "categories": [
                {
                    "id": 42,
                    "slug": "tag-managers",
                    "groups": [
                        8
                    ],
                    "name": "Tag managers",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google Tag Manager.svg",
            "website": "https://www.google.com/tagmanager",
            "pricing": [],
            "cpe": null
        },
        "Google Publisher Tag": {
            "name": "Google Publisher Tag",
            "description": "Google Publisher Tag (GPT) is an ad tagging library for Google Ad Manager which is used to dynamically build ad requests.",
            "slug": "google-publisher-tag",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google Developers.svg",
            "website": "https://developers.google.com/publisher-tag/guides/get-started",
            "pricing": [],
            "cpe": null
        },
        "Google Analytics": {
            "name": "Google Analytics",
            "description": "Google Analytics is a free web analytics service that tracks and reports website traffic.",
            "slug": "google-analytics",
            "categories": [
                {
                    "id": 10,
                    "slug": "analytics",
                    "groups": [
                        8
                    ],
                    "name": "Analytics",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google Analytics.svg",
            "website": "https://google.com/analytics",
            "pricing": [],
            "cpe": null
        },
        "Google AdSense": {
            "name": "Google AdSense",
            "description": "Google AdSense is a program run by Google through which website publishers serve advertisements that are targeted to the site content and audience.",
            "slug": "google-adsense",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Google AdSense.svg",
            "website": "https://www.google.com/adsense/start/",
            "pricing": [],
            "cpe": null
        },
        "DoubleClick Campaign Manager (DCM)": {
            "name": "DoubleClick Campaign Manager (DCM)",
            "description": null,
            "slug": "doubleclick-campaign-manager-dcm",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "DoubleClick.svg",
            "website": "https://www.doubleclickbygoogle.com/solutions/digital-marketing/campaign-manager/",
            "pricing": [],
            "cpe": null
        },
        "Cloudflare Bot Management": {
            "name": "Cloudflare Bot Management",
            "description": "Cloudflare bot management solution identifies and mitigates automated traffic to protect websites from bad bots.",
            "slug": "cloudflare-bot-management",
            "categories": [
                {
                    "id": 16,
                    "slug": "security",
                    "groups": [
                        11
                    ],
                    "name": "Security",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "CloudFlare.svg",
            "website": "https://www.cloudflare.com/en-gb/products/bot-management/",
            "pricing": [],
            "cpe": null
        },
        "Amazon Advertising": {
            "name": "Amazon Advertising",
            "description": "Amazon Advertising (formerly AMS or Amazon Marketing Services) is a service that works in a similar way to pay-per-click ads on Google.",
            "slug": "amazon-advertising",
            "categories": [
                {
                    "id": 36,
                    "slug": "advertising",
                    "groups": [
                        2
                    ],
                    "name": "Advertising",
                    "priority": 9
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Amazon.svg",
            "website": "https://advertising.amazon.com",
            "pricing": [
                "payg"
            ],
            "cpe": null
        },
        "Webpack": {
            "name": "Webpack",
            "description": "Webpack is an open-source JavaScript module bundler.",
            "slug": "webpack",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Webpack.svg",
            "website": "https://webpack.js.org/",
            "pricing": [],
            "cpe": null
        },
        "RSS": {
            "name": "RSS",
            "description": "RSS is a family of web feed formats used to publish frequently updated works—such as blog entries, news headlines, audio, and video—in a standardized format.",
            "slug": "rss",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "RSS.svg",
            "website": "https://www.rssboard.org/rss-specification",
            "pricing": [],
            "cpe": null
        },
        "PWA": {
            "name": "PWA",
            "description": "Progressive Web Apps (PWAs) are web apps built and enhanced with modern APIs to deliver enhanced capabilities, reliability, and installability while reaching anyone, anywhere, on any device, all with a single codebase.",
            "slug": "pwa",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "PWA.svg",
            "website": "https://web.dev/progressive-web-apps/",
            "pricing": [],
            "cpe": null
        },
        "Open Graph": {
            "name": "Open Graph",
            "description": "Open Graph is a protocol that is used to integrate any web page into the social graph.",
            "slug": "open-graph",
            "categories": [
                {
                    "id": 19,
                    "slug": "miscellaneous",
                    "groups": [
                        6
                    ],
                    "name": "Miscellaneous",
                    "priority": 10
                }
            ],
            "confidence": 100,
            "version": "",
            "icon": "Open Graph.png",
            "website": "https://ogp.me",
            "pricing": [],
            "cpe": null
        }
    }
}

@tunetheweb
Copy link
Member

It's really helpful to test rules one by one.

Yeah it would be nice to be able to do that. I've still no idea if the scriptSrc rule is right because the js would pick it up anyway. Oh well.

@max-ostapenko
Copy link
Author

Yeah it would be nice to be able to do that. I've still no idea if the scriptSrc rule is right because the js would pick it up anyway. Oh well.

Only now that I've tested it - I'm sure.

@max-ostapenko max-ostapenko merged commit cc724e0 into main Sep 23, 2024
3 checks passed
@max-ostapenko max-ostapenko deleted the utiq branch September 23, 2024 21:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants