(Gaps in the VT output at image above are because public VT API key, which allows only 4 searches per minute).
Copyright (C) 2018-2019 Alexandre Borges <ab at blackstormsecurity dot com>
This program is free software: you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation, either version 3 of the License, or
(at your option) any later version.
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.
See GNU Public License on <http://www.gnu.org/licenses/>.
Important note: Malwoverview does NOT submit samples to Virus Total or Hybrid Analysis by default. It submits only hashes, so respecting Non-Disclosure Agreements (NDAs). Nonetheless, if you use the "-V" (uppercase) or "-A" (uppercase), so Malwoverview SUBMITS your malware sample to Virus Total or Hybrid Analysis, respectively.
Malwoverview.py is a simple tool to perform an initial and quick triage on a directory containing malware samples (not zipped).
This tool aims to :
-
Determining similar executable malware samples (PE/PE+) according to the import table (imphash) and group them by different colors (pay attention to the second column from output). Thus, colors matter!
-
Determining whether executable malware samples are packed or not packed according to the following rules:
2a. Two or more sections with Entropy > 7.0 or < 1.0 ==> Packed. 2b. One one section with Entropy > 7.0 or two sections with SizeOfRawData ==> Likely packed. 2c. None section with Entropy > 7.0 or SizeOfRawData ==> not packed. -
Determining whether the malware samples contain overlay.
-
Determining the .text section entropy.
Malwoverview.py only examines PE/PE+ files, skipping everything else. -
Checking each malware sample against Virus Total.
This tool was tested on a Kali Linux 2018 system and Windows 10. Therefore, it will be necessary to install:
-
Python version 2.7.x.
$ apt-get install python -
Python-magic.
To install python-magic package you can execute the following command:
$ pip install python-magicOr compiling it from the github repository:
$ git clone https://github.com/ahupp/python-magic $ cd python-magic/ $ python setup.py build $ python setup.py installAs there are serious problems about existing two versions of python-magic package, my recommendation is to install it from github (second procedure above) and copy the magic.py file to the SAME directory of malwoverview tool.
-
Pefile and colorama packages:
$ pip install pefile $ pip install colorama $ pip install simple-json $ pip install requests $ pip install validators
-
Install the Python version 2.7.x. from https://www.python.org/downloads/windows/
-
Python-magic.
To install python-magic package you can execute the following command:
C:\> pip install python-magicOr compiling it from the github repository:
C:\> git clone https://github.com/ahupp/python-magic C:\> cd python-magic/ C:\> python setup.py build C:\> python setup.py install -
Pefile and colorama packages:
C:\> pip install pefile C:\> pip install colorama C:\> pip install simple-json C:\> pip install requests C:\> pip install validators -
(IMPORTANT) Remove the magic.py file from malwoverview directory.
-
Install the python-magic DLLs by executing the following command:
C:\> pip install python-magic-bin==0.4.14
You must edit the malwoverview.py and insert your APIs and secret to enable Virus Total and Hybrid-Analysis checking:
VT:
VTAPI = '<----ENTER YOUR API HERE and UNCOMMENT THE LINE---->'
Hybrid-Analysis:
HAAPI = '<----ENTER YOUR API HERE and UNCOMMENT THE LINE---->'
To use the malwoverview, execute the command as shown below:
Usage: malwoverview -d <directory> -f <fullpath> -i <0|1> -b <0|1> -v <0|1> -a <0|1> -p <0|1> -s <0|1>
-x <0|1> -w <|1> -u <url> -H <hash file> -V <filename> -D <0|1> -e<0|1|2|3|4> -A <filename> -g <job_id>
-r <domain>
where:
Usage: malwoverview -d <directory> -f <fullpath> -i <0|1> -b <0|1> -v <0|1> -a <0|1> -p <0|1> -s <0|1>
-x <0|1> -w <|1> -u <url> -H <hash file> -V <filename> -D <0|1> -e<0|1|2|3|4> -A <filename> -g <job_id>
-r <domain>
Options:
-h, --help show this help message and exit
-d DIRECT specify directory containing malware samples.
-f FPNAME specify a full path to a file. Shows general information
about the file (any filetype)
-b BACKG (optional) adapts the output colors to black window.
-i IMPSEXTS (optional) show imports and exports (it is used with -f
option).
-x OVER (optional) extract overlay (it is used with -f option).
-s SHOWVT (optional) show antivirus reports from the main players.
This option is used with the -f option (any filetype).
-v VIRUSTOTAL (optional) query Virus Total database for positives and
totals.Thus, you need to edit the malwoverview.py and
insert your VT API.
-a HYBRIDANALYSIS (optional) query Hybrid Analysis database for general
report. Use the -e option to specify which environment
are looking for the associate report because the sample
can have been submitted to a different environment that
you are looking for. Thus, you need to edit the
malwoverview.py and insert your HA API and secret.
-p PUBKEY (optional) use this option if you have a public Virus
Total API. It forces a one minute wait every 4 malware
samples, but allows obtaining a complete evaluation of
the malware repository.
-w WIN (optional) used when the OS is Microsoft Windows.
-u URLX SUBMIT a URL for the Virus Total scanning.
-r DOMAINX GET a domain's report from Virus Total.
-H FILEHASH Hash to be checked on Virus Total and Hybrid Analysis.
For the Hybrid Analysis report you must use it together
-e option.
-V FILENAMEVT SUBMIT a FILE(up to 32MB) to Virus Total scanning and
read the report. Attention: use forward slash to specify
the target file even on Windows systems. Furthermore, the
minimum waiting time is set up in 90 seconds because the
Virus Total queue. If an error occurs, so wait few
minutes and try to access the report by using -f option.
-A FILENAMEHA SUBMIT a FILE(up to 32MB) to be scanned by Hybrid
Analysis engine. Use the -e option to specify the best
environment to run the suspicious file.
-g REPORTHA Check the report's status of submitted samples to Hybrid
Analysis engine by providing the job ID. Possible
returned status values are: IN_QUEUE, SUCCESS, ERROR,
IN_PROGRESS and PARTIAL_SUCCESS.
-D DOWNLOAD (optional) Download the sample from Hybrid Analysis.
Option -H must be specified.
-e SYSENVIRON (optional) This option specified the used environment to
be used to test the samlple on Hybrid Analysis: <0>
Windows 7 32-bits; <1> Windows 7 32-bits (with HWP
Support); <2> Windows 7 64-bits; <3> Android; <4> Linux
64-bits environment. This option is used together either
-H option or the -A option or -a option.
If you use Virus Total option, so it is necessary to edit the malwoverview.py and insert your VT API.
Remember that public VT API only allows 4 searches per second (as shown at the image above). Therefore,
if you are willing to wait some minutes, so you can use the -p option, which forces a one minute wait
every 4 malware samples, but allows obtaining a complete evaluation of the repository.
* ATTENTION: if the directory contains many malware samples while using -d option, so malwoverview.py could
take some time. :)
** ATTENTION 2: The public Hybrid Analysis API enforces a quota of submission per day!
Version 1.7.5:
This version:
* It has been fixed a problem related to sample submission to Hybrid Analysis on Windows operating
system. Additionally, file name handling has been also fixed.
Version 1.7.3:
This version:
* Malwoverview has been adapted to API version 2.6.0 of Hybrid Analysis.
* -A option has been fixed according to new version (2.6.0) of Hybrid Analysis.
* -a option has been modified to work together with -e option.
* help information has been modified.
Version 1.7.2:
This version:
* A small fix related to -g option has been included.
Version 1.7.1:
This version:
* Relevant fix of a problem related to options -A and -H options.
* Includes a new Hybrid Analysis environment to the -e option (Windows 7 32-bits with HWP support).
* Updates the Malwoverview to support Hybrid Analysis API version 2.5.0.
Version 1.7.0:
This version:
* Includes -A option for submitting a sample to Hybrid Analysis.
* Includes -g option for checking the status a submission of a sample to Hybrid Analysis.
* Includes -e option for specifying the testing environment on the Hybrid Analysis.
* Includes -r option for getting a complete domain report from Virus Total.
* Modifies the -H options for working together the -e option.
* Modifies several functions of the tool to prepare it for version 1.8.0
Version 1.6.3:
This version:
* Includes creation of new functions aiming 1.7.0 version.
* Includes new exception handling blocks.
Version 1.6.2:
This version:
* Includes small fixes.
* For the Hybrid Analysis API version 2.40 is not longer necessary to include the API Secret.
Version 1.6.1:
This version:
* Includes small format fixes.
Version 1.6.0:
This version:
* It is using the Hybrid Analysis API version 2.4.0.
* Includes certificate information in the Hybrid Analysis report.
* Includes MITRE information in the Hybrid Analysis report.
* Includes an option to download samples from Hybrid Analysis.
Version 1.5.1:
This version:
* Small change to fix format issue in -d option.
Version 1.5.0:
This version:
* Includes the -u option to check URLs against Virus Total and associated engines.
* Includes the -H option to find existing reports on Virus Total and Hybrid Analysis through the hash.
* Includes the -V option to submit a file to Virus Total. Additionally, the report is shown afer few
minutes.
* Includes two small fixes.
Version 1.4.5.2:
This version:
* Includes two small fixes.
Version 1.4.5.1:
This version:
* Includes one small fix.
Version 1.4.5:
This version:
* Adds the -w option to use malwoverview in Windows systems.
* Improves and fixes colors when using -b option with black window.
Version 1.4:
This version:
* Adds the -a option for getting the Hybrid Analysis summary report.
* Adds the -i option for listing imported and exported functions. Therefore, imported/exported
function report was decoupled for a separated option.
Version 1.3:
This version:
* Adds the -p option for public Virus Total API.
Version 1.2:
This version includes:
* evaluates a single file (any filetype)
* shows PE sessions.
* shows imported functions.
* shows exported function.
* extracts overlay.
* shows AV report from the main players. (any filetype)
Version 1.1:
This version:
* Adds the VT checking feature.
Version 1.0:
Malwoverview is a tool to perform a first triage of malware samples in a directory and group them
according to their import functions (imphash) using colors. This version:
* Shows the imphash information classified by color.
* Checks whether malware samples are packed.
* Checks whether malware samples have overlay.
* Shows the entropy of the malware samples.