Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chrome extension code cleanup #4

Closed
wants to merge 87 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
87 commits
Select commit Hold shift + click to select a range
4ab1185
Add support for PubTech CMP
gilbertococchi Sep 22, 2023
be9b9e6
Add PubTech CMP Icon
gilbertococchi Sep 22, 2023
28a88cc
Update src/technologies/p.json
gilbertococchi Sep 25, 2023
d4f67cf
Update src/technologies/p.json
gilbertococchi Sep 25, 2023
c2a24ee
Merge pull request #1 from gilbertococchi/patch-1
rviscomi Sep 25, 2023
28d3c57
Remove DNS TXT Match fron OneTrust CMP
gilbertococchi Sep 26, 2023
fe8c861
Merge pull request #2 from gilbertococchi/patch-2
tunetheweb Nov 10, 2023
cdd0b56
recurring, allow for free scriptSrc as well
rlankhorst Nov 20, 2023
cf2da11
json for Burst Statistics
rlankhorst Nov 20, 2023
66f3f73
changed pattern
rlankhorst Nov 20, 2023
3c39ef4
Measure Next.js App Router separately
tunetheweb Dec 12, 2023
6906a82
Update src/technologies/n.json
tunetheweb Dec 12, 2023
05e1e31
Merge pull request #6 from HTTPArchive/measure-nextjs-app-router-sepa…
tunetheweb Dec 12, 2023
5c663b2
Add SSR and SSG detection for Next.js
tunetheweb Dec 13, 2023
f044a7d
Categories
tunetheweb Dec 13, 2023
8e849da
Merge pull request #4 from rlankhorst/json-for-Burst-Statistics
tunetheweb Dec 13, 2023
2c55af9
Update src/technologies/n.json
tunetheweb Jan 5, 2024
db8cf0c
Merge pull request #7 from HTTPArchive/more-next-detections
tunetheweb Jan 8, 2024
f0690bc
split into free & premium
rlankhorst Jan 9, 2024
f712f41
Added 'Klaviyo Reviews' and updated 'Shop Pay' related stuff
rockeynebhwani Jan 14, 2024
c755b03
Merge branch 'HTTPArchive:main' into main
rockeynebhwani Jan 14, 2024
fb1c854
Updated AEM Franklin with branding and scripts
meryllblanchet Jan 17, 2024
7fc444d
Adobe Experience Manager Edge Delivery services
meryllblanchet Jan 17, 2024
fdcc558
AEM Edge Delivery services: exclude preview env
meryllblanchet Jan 17, 2024
e529d6a
Typos and rephrasing
meryllblanchet Jan 17, 2024
f649287
Capitalized "Services"
meryllblanchet Jan 17, 2024
b473360
Revert "split into free & premium"
rlankhorst Jan 31, 2024
60dd0bc
added freemium pricing
rlankhorst Jan 31, 2024
ea14040
Update src/technologies/c.json
tunetheweb Jan 31, 2024
ecd177b
Merge pull request #3 from rlankhorst/Complianz-recognize-free-as-well
tunetheweb Jan 31, 2024
dfd09b4
Fix validations
tunetheweb Jan 31, 2024
5cb290e
More fixes
tunetheweb Jan 31, 2024
f111790
Merge pull request #9 from rockeynebhwani/main
tunetheweb Jan 31, 2024
d7ddc62
Avid it running twice
tunetheweb Jan 31, 2024
3e2974a
Merge pull request #11 from HTTPArchive/validations
tunetheweb Jan 31, 2024
ba8634e
Merge lint and prettify
tunetheweb Jan 31, 2024
4b50e0f
Revert "Merge lint and prettify"
tunetheweb Jan 31, 2024
77f0443
Merge pull request #12 from HTTPArchive/revert-accidential-push
tunetheweb Jan 31, 2024
bde5cd3
Merge preity and lint
tunetheweb Jan 31, 2024
3d1392c
Merge pull request #13 from HTTPArchive/remove-prettify
tunetheweb Feb 1, 2024
fd0bbaa
add new svelte 4+ detection method
kara Feb 2, 2024
5e8d489
Merge pull request #14 from kara/svelte
tunetheweb Feb 2, 2024
66639b3
icon
rlankhorst Feb 29, 2024
1a73c0d
use dom as detection
rlankhorst Feb 29, 2024
daf99a6
add wakecommerce icon
nilsocjr Mar 7, 2024
a3d67d0
Merge pull request #18 from nilsocjr/wake-commerce-img
tunetheweb Mar 9, 2024
48a9df7
Rename Fbits to Wake
tunetheweb Mar 9, 2024
32eeecf
Merge pull request #19 from HTTPArchive/fbits-wake
tunetheweb Mar 9, 2024
01dfff9
Merge pull request #17 from rlankhorst/really-simple-ssl
tunetheweb Mar 9, 2024
5399ae6
Fixed Shopify Chat Detection
rockeynebhwani Mar 25, 2024
16f1a17
Updated ROUTE app
rockeynebhwani Mar 25, 2024
1d9d062
Updated Global-e detection
rockeynebhwani Mar 27, 2024
da8ce8b
Fixed Shopify Hydrogen Detection
rockeynebhwani Mar 27, 2024
5cd5e89
Added more Global-e cookies
rockeynebhwani Mar 27, 2024
4075752
Merge pull request #20 from rockeynebhwani/main
rviscomi Apr 1, 2024
8b46da9
Update detection for Performance Lab WordPress plugin.
felixarntz Apr 4, 2024
ea605b9
Merge pull request #22 from felixarntz/update/performance-lab-detection
rviscomi Apr 4, 2024
ce9cba1
Added Sendlane, ConstructorIO, MonkCommerce
rockeynebhwani Apr 7, 2024
23d5940
Updated Judge.me
rockeynebhwani Apr 7, 2024
3613f84
Merge branch 'main' into main
rockeynebhwani Apr 7, 2024
06d2528
Add Slim SEO (WordPress plugin)
rilwis Apr 8, 2024
8670666
Removed Adobe Experience Manager Edge Delivery Services Preview
meryllblanchet Apr 10, 2024
e8593d9
remove __googlefc from funding choices detection
adamsilverstein Apr 10, 2024
7139c94
Merge branch 'main' into fox/funding-choices-detection
adamsilverstein Apr 10, 2024
2ab7581
Merge branch 'main' into aem-edge-delivery-services-update
tunetheweb Apr 10, 2024
5d6db35
Update src/technologies/a.json
tunetheweb Apr 10, 2024
790c869
Merge pull request #10 from meryllblanchet/aem-edge-delivery-services…
tunetheweb Apr 10, 2024
c5e52b3
Merge pull request #23 from rockeynebhwani/main
tunetheweb Apr 10, 2024
cc20ff8
Rename Slim SEO.svg to Slim-SEO.svg
tunetheweb Apr 10, 2024
e058a68
Update s.json
tunetheweb Apr 10, 2024
e9ef002
Merge pull request #24 from rilwis/main
tunetheweb Apr 10, 2024
57464ed
Fix invalid regex for Judge.me
msmith Apr 13, 2024
343b0cf
framer: update technologies
kurtextrem Apr 25, 2024
ed6482c
Update src/technologies/j.json
tunetheweb May 5, 2024
e6b5898
Merge pull request #26 from msmith/patch-1
tunetheweb May 5, 2024
fc02ee4
Merge branch 'main' into fox/funding-choices-detection
tunetheweb May 5, 2024
bdb6645
Merge pull request #25 from adamsilverstein/fox/funding-choices-detec…
tunetheweb May 5, 2024
b5d5561
Merge branch 'main' into patch-1
tunetheweb May 5, 2024
bde58b8
Update src/technologies/f.json
tunetheweb May 5, 2024
48f5a44
fix meta & sort
kurtextrem May 7, 2024
3f5ac0c
Apply suggestions from code review
tunetheweb May 7, 2024
dd79e63
Merge pull request #27 from kurtextrem/patch-1
tunetheweb May 7, 2024
f8899dc
Fix linting sort issues
tunetheweb May 7, 2024
414e2b3
Merge pull request #30 from HTTPArchive/fix-linting-sort-issues
tunetheweb May 7, 2024
6645e65
src cleanup
max-ostapenko May 19, 2024
a28c555
PandaCSS icon moved
max-ostapenko May 19, 2024
253e4e4
repo name update
max-ostapenko May 19, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/technology-request.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,4 +7,4 @@ assignees: ''

---

You may request a new technology to be added but chances of having it included are greatly improved if you submit a pull request. Please refer to the [contributing guide](https://github.com/AliasIO/wappalyzer/blob/master/CONTRIBUTING.md).
You may request a new technology to be added but chances of having it included are greatly improved if you submit a pull request. Please refer to the [contributing guide](https://github.com/HTTPArchive/wappalyzer/blob/main/CONTRIBUTING.md).
2 changes: 2 additions & 0 deletions .github/workflows/validate.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,8 @@
name: Validate
on:
push:
branches:
- main
pull_request:

permissions:
Expand Down
12 changes: 0 additions & 12 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,22 +1,10 @@
/build/*
/src/images/icons/converted/*
/src/manifest.json
/src/manifest.bak.json

node_modules
package-lock.json

!.gitkeep

Thumbs.db
Desktop.ini
*.DS_Store
*.log
._*
tags
tags.*
.idea
/nbproject/private/
src/out.json

keys.json
20 changes: 8 additions & 12 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
# Contributing

Wappalyzer is an [GPLv3 licensed](https://github.com/wappalyzer/wappalyzer/blob/master/LICENSE), open source project written in JavaScript. Anyone is welcome to contribute.
Wappalyzer is an [GPLv3 licensed](https://github.com/HTTPArchive/wappalyzer/blob/main/LICENSE), open source project written in JavaScript. Anyone is welcome to contribute.

## Getting started

To get started, see the [README](https://github.com/wappalyzer/wappalyzer/blob/master/README.md).
To get started, see the [README](https://github.com/HTTPArchive/wappalyzer/blob/main/README.md).

## Submitting changes

Expand All @@ -15,23 +15,19 @@ To get started, see the [README](https://github.com/wappalyzer/wappalyzer/blob/m

## Adding a new technology

Wappalyzer uses [regular expressions](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Guide/Regular_Expressions) to fingerprint technologies. Refer to the [specification](https://github.com/wappalyzer/wappalyzer/blob/master/README.md#specification) for detail.
Wappalyzer uses [regular expressions](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Guide/Regular_Expressions) to fingerprint technologies. Refer to the [specification](https://github.com/HTTPArchive/wappalyzer/blob/main/README.md#specification) for detail.

- Add a new block to [`src/technologies/*.json`](https://github.com/wappalyzer/wappalyzer/blob/master/src/technologies). The filename should match the first letter of the technology name (a-z). Use `_.json` if the first character is a number or symbol.
- Add an icon to [`src/images/icons`](https://github.com/wappalyzer/wappalyzer/tree/master/src/images/icons). The image must be square, either SVG or PNG (32 x 32 pixels).
- Add a new block to [`src/technologies/*.json`](https://github.com/HTTPArchive/wappalyzer/blob/main/src/technologies). The filename should match the first letter of the technology name (a-z). Use `_.json` if the first character is a number or symbol.
- Add an icon to [`src/images/icons`](https://github.com/HTTPArchive/wappalyzer/tree/master/src/images/icons). The image must be square, either SVG or PNG (32 x 32 pixels).

Only widely used technologies are accepted. When creating a pull request, include ten or more links to websites that use the application, a GitHub page with at least 1,000 stars or anything that will help establish the size of the user base.

## Adding a new category

Please [open an issue on GitHub](https://github.com/wappalyzer/wappalyzer/issues) first to discuss the need for a new category.
Please [open an issue on GitHub](https://github.com/HTTPArchive/wappalyzer/issues) first to discuss the need for a new category.

To add a category, edit [`src/categories.json`](https://github.com/wappalyzer/wappalyzer/blob/master/src/categories.json) and update every [locale](https://github.com/wappalyzer/wappalyzer/tree/master/src/_locales). You may use the English category name in all of them.

## Adding a new translation

To add a new translation, copy the `en` folder in [`src/_locales`](https://github.com/wappalyzer/wappalyzer/tree/master/src/_locales), rename it to the relevant two-letter country code and update the containing `messages.json` file.
To add a category, edit [`src/categories.json`](https://github.com/HTTPArchive/wappalyzer/blob/main/src/categories.json) and update every [locale](https://github.com/HTTPArchive/wappalyzer/tree/master/src/_locales). You may use the English category name in all of them.

## Adding a new feature

Please [open an issue on GitHub](https://github.com/wappalyzer/wappalyzer/issues) first. New features and large changes are rarely accepted without prior discussion.
Please [open an issue on GitHub](https://github.com/HTTPArchive/wappalyzer/issues) first. New features and large changes are rarely accepted without prior discussion.
19 changes: 6 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
[![Validate](https://github.com/wappalyzer/wappalyzer/actions/workflows/validate.yml/badge.svg)](https://github.com/wappalyzer/wappalyzer/actions/workflows/validate.yml)
[![Validate](https://github.com/HTTPArchive/wappalyzer/actions/workflows/validate.yml/badge.svg)](https://github.com/HTTPArchive/wappalyzer/actions/workflows/validate.yml)
[![Github Sponsor](https://img.shields.io/static/v1?label=Sponsor&message=%E2%9D%A4&logo=GitHub&link=https://github.com/sponsors/AliasIO)](https://github.com/sponsors/AliasIO)

<a href="https://www.wappalyzer.com/?utm_source=readme&utm_medium=github&utm_campaign=wappalyzer"><img src="https://www.wappalyzer.com/images/logo/icon_192.png" height="72" alt="Wappalyzer" align="left" /></a>
Expand All @@ -13,12 +13,11 @@

- [Git](https://git-scm.com)
- [Node.js](https://nodejs.org) version 14 or higher
- [Yarn](https://yarnpkg.com)

## Quick start

```sh
git clone https://github.com/wappalyzer/wappalyzer.git
git clone https://github.com/HTTPArchive/wappalyzer.git
cd wappalyzer
yarn install
```
Expand All @@ -27,24 +26,18 @@ yarn install

### Chrome extension

- Go to `about:extensions`
- Go to `chrome:extensions`
- Enable 'Developer mode'
- Click 'Load unpacked'
- Select `src`

### Firefox extension

- Go to `about:debugging#/runtime/this-firefox`
- Click 'Load Temporary Add-on'
- Select `src/manifest.json`

## Specification

A long list of [regular expressions](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Guide/Regular_Expressions) is used to identify technologies on web pages. Wappalyzer inspects HTML code, as well as JavaScript variables, response headers and more.

Patterns (regular expressions) are kept in [`src/technologies/`](https://github.com/wappalyzer/wappalyzer/blob/master/src/technologies). The following is an example of an application fingerprint.
Patterns (regular expressions) are kept in [`src/technologies/`](https://github.com/HTTPArchive/wappalyzer/tree/main/src/technologies). The following is an example of an application fingerprint.

#### Example
### Example

```json
"Example": {
Expand Down Expand Up @@ -104,7 +97,7 @@ Patterns (regular expressions) are kept in [`src/technologies/`](https://github.

## JSON fields

Find the JSON schema at [`schema.json`](https://github.com/wappalyzer/wappalyzer/blob/master/schema.json).
Find the JSON schema at [`schema.json`](https://github.com/HTTPArchive/wappalyzer/blob/main/schema.json).

### Required properties

Expand Down
22 changes: 4 additions & 18 deletions bin/build.js
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ const fs = require('fs')
const Zip = require('adm-zip')

const currentVersion = JSON.parse(
fs.readFileSync('./src/manifest-v3.json')
fs.readFileSync('./src/manifest.json')
).version

const version = process.argv[2]
Expand All @@ -16,30 +16,16 @@ if (!version) {
process.exit(1)
}

;['./src/manifest-v2.json', './src/manifest-v3.json'].forEach((file) => {
;['./src/manifest.json'].forEach((file) => {
const json = JSON.parse(fs.readFileSync(file))

json.version = version

fs.writeFileSync(file, JSON.stringify(json, null, 2))
})

fs.copyFileSync(`./src/manifest.json`, './src/manifest.bak.json')

fs.copyFileSync(`./src/manifest-v2.json`, './src/manifest.json')

let zip = new Zip()

zip.addLocalFolder('./src', '')

zip.writeZip('./build/webextension-v2.zip')

fs.copyFileSync(`./src/manifest-v3.json`, './src/manifest.json')

zip = new Zip()
const zip = new Zip()

zip.addLocalFolder('./src', '')

zip.writeZip('./build/webextension-v3.zip')

fs.copyFileSync(`./src/manifest.bak.json`, './src/manifest.json')
zip.writeZip('./build/webextension.zip')
12 changes: 0 additions & 12 deletions bin/manifest.js

This file was deleted.

9 changes: 4 additions & 5 deletions package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"dependencies": {
"@prantlf/jsonlint": "^10.2.0",
"@prantlf/jsonlint": "^14.0.3",
"adm-zip": "^0.4.16",
"convert-svg-to-png": "^0.5.0"
},
Expand All @@ -17,11 +17,10 @@
"terminal-overwrite": "^2.0.1"
},
"scripts": {
"lint": "eslint src/**/*.{js,json}",
"lint:fix": "eslint --fix src/**/*.{js,json}",
"validate": "yarn run lint && jsonlint -qV ./schema.json ./src/technologies/ && node ./bin/validate.js",
"lint": "eslint src/**/*.{js,json} && jsonlint -jsV ./schema.json --trim-trailing-commas --enforce-double-quotes ./src/technologies/ && jsonlint -js --trim-trailing-commas --enforce-double-quotes ./src/categories.json",
"lint:fix": "eslint --fix src/**/*.{js,json} && jsonlint -isV ./schema.json --trim-trailing-commas --enforce-double-quotes ./src/technologies/ && jsonlint -is --trim-trailing-commas --enforce-double-quotes ./src/categories.json",
"validate": "yarn run lint && node ./bin/validate.js",
"convert": "node --no-warnings ./bin/convert.js",
"prettify": "jsonlint -si --trim-trailing-commas --enforce-double-quotes ./src/categories.json ./src/technologies/*.json",
"build": "yarn run validate && yarn run prettify && yarn run convert && node ./bin/build.js",
"build:safari": "xcrun safari-web-extension-converter --swift --project-location build --force src",
"manifest": "node ./bin/manifest.js"
Expand Down
1 change: 1 addition & 0 deletions schema.json
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@
},
"type": "object",
"additionalProperties": {
"type": "object",
"additionalProperties": false,
"required": ["cats","website"],
"properties": {
Expand Down
Loading
Loading