- ACTION REQUIRED
sudo apt install zpaq- as cape user:
poetry install
- Monitor fixes: address new issue affecting procdump and add check in compileMethod hook
- Monitor update:
- Unpacker: reduce/filter unwanted .NET payloads
- Formbook updates
- Monitor updates:
- NtContinueEx hook
- Debugger action enhancements: setptr, patch, sleep, exit
- Software breakpoint handler enhancement
- Misc fixes/improvements
- Formbook config extraction
- Monitor updates:
- GetComputerNameExW hook added, PostThreadMessage hook enhancement
- Debugger action enhancements
- Misc fixes
- When doing search by
capeyarawe expose button to download files that only matches that search criteria.- For @fumik0_ with love.
- IMPORTANT. If you using https please update config to use new field for CSRF in
conf/web.conf.- Before:
[general]->hostname. - Now:
[security]->csrf_trusted_origins
- Before:
- Storage of file data in MongoDB
- Store the parts of a report's file data that is independent of a detonation in a separate collection to conserve disk space.
- ACTION REQUIRED
- It is recommended to add a regular cron job to call
cd /opt/CAPEv2 && sudo -u cape poetry run python ./utils/cleaners.py --delete-unused-file-data-in-mongoto prune these entries that are no longer needed.
- It is recommended to add a regular cron job to call
- Monitor updates:
- .NET JIT native cache handling improvements
- New debugger action 'string' to capture decrypted strings
- Fix issue in procname_watch_init() with non-null-terminated unicode paths - thanks Proofpoint for the report
- Monitor update:
- .NET JIT native cache scanning & dumping
- Monitor updates:
- Fix missing browser hooks config setting for Edge & Chrome
- Trace: add config option to try and skip loops which flood trace logs (loopskip=1)
- Monitor update: Upgrade monitor Yara to 4.3.2 (thanks Michael Weiser)
- Monitor update: fix memcpy hook logging issue
- Monitor updates:
- Filter uninteresting process dumps via new VerifyCodeSection() function checking code section for modification
- Fix issue with process path-based options being set too late (after yara init)
- YaraScan: do not call SetInitialBreakpoints() unless DebuggerInitialised flag is set
- Monitor updates:
- Fix for NtQueueApcThread hook: do not send thread handle in 'process' message
- Add WmiPrvSE.exe to services hookset to fix Win10 WMI/interop detonation issues
- Minimal YARA version now is 4.3.1
file_extra_infomodules autoload, see example inlib/cuckoo/common/file_extra_info_modules- Initial compatibility with x64 python version in guests.
- In
agent.pyaddis_adminvalue.
- New anti-direct-syscall feature: 'syscall breakpoints' (64-bit only)
- redirect syscalls back through traditional hooks
- via monitor yara & updated monitor
- Monitor updates:
- Unpacker: add dumping of decrypted PEs from CryptDecrypt(), NCryptDecrypt(), BCryptDecrypt()
- NtOpenProcessToken, NtQueryInformationToken, RtlWow64GetThreadContext hooks
- Syscall breakpoint implementation (64-bit)
- Fix hook issues with NtQueueApcThread, GetWriteWatch
- Misc fixes & improvements (see capemon repo for details)
- Allows to scan all new file tasks with YARA. Must be enabled in
web.conf->[general]->yara_recon.- This allows you to set CAPE arguments, as tags for example for proper VM pickup.
- YARA name must ends with
Crypter,Packer,ObfuscatororLoaderand havecape_nameandcape_optionsin meta. Example: - See
def reconinCAPEv2/lib/cuckoo/common/web_utils.py
rule X_cryptor {
meta:
author = "doomedraven"
description = "New X Crypter"
cape_type = "New X Crypter"
cape_options = "tags=win10"
strings:
$a = "New awesome crypter <3" fullword
condition:
$a
}
- Syscall hooks now enabled by default
- Monitor updates:
- improved syscall hook logging, unpacker & debugger integration
- new debugger actions "call" & "setbpX"
- misc improvements
- FLARE CAPA v6 support. Is now uniq supported version. They doing breaking changes.
- Monitor update: Add hook for LoadLibraryExW
- UPX-type dynamic unpacker in yara sig
- Monitor updates:
- New debugger action 'Step2OEP' for packers like UPX
- Deprecate obsolete UPX unpacker code
- misc improvements & fixes
- .inf detonation. Requires
sflock2==0.3.50 - New admin/admin.py - Cluster edition - Documentation
- New dependency. Run
cd /opt/CAPEv2 && poetry install
- Monitor update: misc improvements & fixes
- Monitor update: fix issue with Microsoft Edge not launching properly (#1587)
- Stealc detection update
- Monitor update: Fix NtWriteFile hook issue by removing critical sections - thanks to @RazviOverflow for report
- Monitor updates:
- Add GetWriteWatch & UpdateProcThreadAttribute hooks which allow Pikabot detonation - thanks @enzok!
- CoCreateInstance(Ex) hook improvements - thanks @heck-gd!
- PostThreadMessage hooks - thanks @nblog!
- PikaBot detection update
- URL default analysis package selection in web.conf
- SQLAlchemy2 migration started
- MSIX extract
- Fix issue with Rhadamanthys & BumbleBeeLoader FPs due to monitor sigs in process dumps
- Monitor update: Debugger hardening & new actions
- Monitor updates: Misc fixes (see capemon repo) & hooks for CreateProcessA/W to reduce noise
- Monitor update: Add hook for WinExec()
- Simplifing the configuration
- Do NOT edit any config that ends on
.defaultas it will be default config. - For more details read readme inside of
conffolder.
- Do NOT edit any config that ends on
- RedLine config extraction - thanks @Gi7w0rm
- Monitor fixes:
- Harden GetExportAddress() against malformed PE images
- Add fallback payload metadata in ProcessTrackedRegions
- New feature (beta):
- Syscall hooks on Win10+ (via InstrumentationCallback) via submission checkbox or option: syscall=1
- Ursnif/ISFB detection & config extraction update
- Monitor fixes:
- Unpacker: Improve ProcessTrackedRegion() to allow yara scans of mapped modules
- Disable sleep skips prior to thread creation (rather than after) and upon CoCreateInstance (WMI etc)
- New config
conf/logging.conf. Remember to copy it tocustom/conf/logging.conffor moddifications.- Syslog handler for
cuckoo.pyandprocess.pycan be on/off in config. Useful for global monitoring tools or cloud setups. - Allow to create logs per analysis in analysis folder. Useful for distributed setup to show on webgui if enabled and have logs in main server.
- Syslog handler for
- Monitor fixes:
- Prevent unpacker initialisation from adding imagebase to tracked regions, allow yara scans on caller
- CoGetClassObject hook: remove modification of dwClsContext parameter causing detonation failures
- Monitor updates:
- Remove cryptsp 'double' hooks in Office processes due to detonation failures (e.g. Word 2016)
- Prevent following child processes of WerSvc (to prevent werfault.exe producing mini dumps that are detected by yara due to in-memory monitor sigs)
- Virtual machine tags: For Windows only. Please set windows version in tag, any of: winxp, win7, win8, win10, win11.
- This is required for proper detonation for packages like MsiX.
- New feature. In
web.confthere is section[packages]:- It allows to create new packages and push them to correct VMs.
- Or in case you want to detonate some of the packages only on specific VMs you can specify it there like:
package:vm_tag1,vm_tagX
- MsiX file proper recognization requires upgrade to
sflock2==0.3.48, otherwise it will push it as zip or extract and add each file as separated job.
- Msix/MsixBundle package works only on Windows >= 10
- Quarantine is integrated into normal file submission so you don't need to know if file is normal or quarantined.
- New Unpacker option:
unpacker=2 - Deprecated:
- submitCAPE.py - no more additional jobs
- Staging branch:
- We want to have CAPE stable. So new features will go to staging branch for 1-2 weeks before merged to master.
- If you want to help us to spot any possible issue use that branch on your dev side.
- We need help to add as much tests as possible to cover all possible cases to prevent broken code.
- Stop using
conf/folder. All config should be incustom/conf/. This will simplify your life on CAPE updates when new entry added to base templates. Details
- Scheduler update:
- A machine may be configured with
reserved = yesin<machinery>.conf. For such machines, the scheduler will not use it for tasks unless the user specifically requests it by its label.
- A machine may be configured with
- Database update:
- The 'name' of all machines defined in
<machinery>.confmust be unique. The same goes for their 'label' fields.
- The 'name' of all machines defined in
- Monitor update: Hooking engine stability fix for detonation issues (e.g. Word)
- Monitor updates:
- Extend svchost hookset to Winmgmt (netsvcs) service
- Fix for bug in get_full_keyvalue_pathUS() (thanks oalieno)
- Monitor update: Process dump improvements & 'export' option to allow DLL export to be defined by monitor yara signature
- Monitor update: Disable spawning WER processes (werfault.exe etc) via RtlReportSilentProcessExit hook
- Add
utils/fstab.pyutils which is used byutils/dist.pywhen NFS mode is used.- Check configure NFS in documentation:
- Now when you register new server in distributed cluster that uses NFS, it will automatically:
- Create worker folder
- Add NFS entry to
/etc/fstab. Ex:192.168.1.1:/opt/CAPEv2 /opt/CAPEv2/workers/192.168.1.1 nfs, auto,user,users,nofail,noatime,nolock,intr,tcp,actimeo=1800, 0 0
- Mount folder
- Please read this to simplify your life with configs managment
- Google Cloud Platform (GCP) support in distributed CAPE aka dist.py
- Big duplicated code cleanup. Context: CAPE.py module processing all the files so it calling File(x).get_all() which is pretty heavy.
- Deprecated standalone modules. They are moved inside of CAPE.py. Data will be under the same keys.
- Target info
- Dropped
- ProcDump
- Url analysis moved to
nodules/processing/url_analysis.py
- Monitor update: Fix 32-bit stack recursion hook issue (affecting, for example, golang binaries)
- Integrated deobfuscator and unpacker for Eziriz .NET Reactor. Source.
- You need to download version for your CPU and extract it to
data/NETReactorSlayer.CLI- In case if you are on x64 host, then just run:
poetry run python utils/community.py -waf
- In case if you are on x64 host, then just run:
- Add execution permission with
chmod a+x data/NETReactorSlayer.CLI
- You need to download version for your CPU and extract it to
- Now each section inside of
selfextract.confhas timeout value. Default is 60 seconds
- Monitor updates: Fix NtAllocateVirtualMemoryEx & NtMapViewOfSectionEx hooks and rebuild with Visual Studio 2022
- Monitor updates: add 32-bit hook compatibility to allow hooking of GetCommandLine APIs (and add GetCommandLineA hook)
- QakBot config extraction update
- Emotet detection & config extractor updates
- Monitor fixes:
- Fixes for CreateTimerQueueTimer hook affecting Emotet detonation
- Remove function name resolving via ScyllaGetExportNameByAddress() in thread & process hooks due to issues
- Monitor fixes:
- hook recursion issue in 64-bit monitor
- UNICODE_STRING comparison issue in add_all_dlls_to_dll_ranges()
- Monitor updates: misc fixes & improvements (see capemon repo for details)
- Fix merging of split configs per family in CAPE processing module
- archive package by @cccs-kevin with a nice talk explaining how to detonate some kind of malware properly here. Thank you Kevin and CCCS team for this contribution. Documentation.
- Some not core dependencies are commented out and won't be installed anympore by default.
- Our idea is to leave CAPE core with core dependencies to avoid conflicts with another libraries.
- Monitor update: GetSystemInfo anti-vm improvement & 64-bit hooking engine fix
- Monitor update: Per-api total cap (api-cap=X) and Javascript (wscript) hookset
- Monitor update: misc fixes (see capemon repo for details)
- Monitor update: TLSdump on Win10 & other improvements (see capemon repo for details)
- Monitor update: Fix issue with incorrect prototype for NtCreateThreadEx hook
[28-08-2022] Maco - Malware config extractor framework
- Interactive mode thanks to @enzok based on his guac-session. Docs
- Function
yara_detectednow returns 4 arguments. 4th is file metadata
- Monitor updates:
- Enable enhanced .NET dumps
- Misc updates & fixes (see capemon repo)
- Details here
- ACTION REQUIRED
cd /opt/CAPEv2/utils/db_migration && alembic upgrade head- Restart:
- CAPE service
systemctl restart cape cape-processor - Web: uwsgi or cape-web
- CAPE service
- Monitor updates:
- MSI detonation (Win10)
- Misc updates & fixes (see capemon repo)
- FLARE-CAPA fix, you must install it from
GitHub. Pip version is different. - FLOSS 2.0 integration.
- BinGraph requires CAPE's version:
poetry run pip install git+https://github.com/CAPESandbox/binGraph on_demandfixed.- ACTION REQUIRED
- Now that CAPA and Floss uses the same signatures we renamed
capa-signaturestoflare-signatures python3 utils/community.py -cr
- Now that CAPA and Floss uses the same signatures we renamed
- Azure machinery by @cccs-kevin
- Use poetry to handle dependencies
- requirements.txt is still present to continue support for pip
- Added pre-commit hooks
- Add community blocklist to avoid pulling some undesired modules/signatures/etc.
- Added AWS machinery and ReversingLabs file lookup by @JaminB
- Monitor updates:
- Increase GlobalMemoryStatusEx faked return value
- Loosen requirements in TestPERequirements to allow zero-sized sections
- Fix issue with missing dropped files (e.g. 64-bit Al-khaser log.txt)
- Crypto hooks: add buffer length to logs, add dump-crypto to NCrypt APIs & use DumpMemoryRaw()
- Trace improvements (64-bit set register range and DoStepOver function)
- Debugger improvements (NoSetThreadContext for Win 10 breakpoints)
- Fix off-by-one in ReverseScanForNonZero()
- lnkparse3 integration
- Emotet E5 update
- Monitor updates:
- New hooks: LdrGetProcedureAddressForCaller, GetCommandLineW
- Fix issue with payload metadata incorrectly set in certain conditions
- Emotet E4 update (new 64-bit)
- Monitor update: Fix issue with attempted dll load notifications in tlsdump mode causing lsass to crash
- Monitor updates:
- dump-crypto option: add dumping of Bcrypt encrypt/decrypt apis
- Add general typestring to options, overrides type codes
- Monitor: Fix issue causing some exceptions in VirtualProtectEx and NtProtectVirtualMemory hooks
- Unittests for core enabled on GitHub. Please help us cover as much as we can to make CAPE more stable than never.
- Monitor updates:
- Add 'Unwind' debugger action for x86
- Fix for NtCreateThreadEx hook not initialising thread breakpoints
- Filter dlls alongside target process executable in add_all_dlls_to_dll_ranges()
- Fix issues with WriteMemoryHandler invocation in hooks, update NtWow64 function prototypes
- Show dll load notifications in behavior log, use already_hooked() on load check
- Add module name to debugger log exception output
- Do RestoreHeaders() at end of init
- Add Yara logging switch
- Rewritten detection.
- Now if you have many different detections it will show all of them, not only 1. Details about each detection is in CAPE signature
- This is not backward compatible feature, so search won't return old matches
- Emotet updates
- Loader update: fix check for previous IAT patch with corrected size (fixes #748 - Obsidium packers)
- PlugX updates
- Emotet updates
[20-02-2022] UnAutoIt by @x0r19x91
- You need to compile it by yourself and put binary under
/opt/CAPEv2/data/UnAutoIt
cd /opt/CAPEv2/data/
snap install go --classic
git clone https://github.com/x0r19x91/UnAutoIt && cd UnAutoIt
GOOS="linux" GOARCH="amd64" go build -o UnAutoIt
[19-02-2022] Detect It Easy by @horsicq
- To install it you can download installer from here
sudo apt install libqt5opengl5 libqt5script5 libqt5scripttools5 -y
wget "https://github.com/horsicq/DIE-engine/releases/download/${DIE_VERSION}/die_${DIE_VERSION}_Ubuntu_${UBUNTU_VERSION}_amd64.deb" -O DIE.deb
sudo dpkg -i DIE.deb
- To be able to generate the same info as was generated for initial binary under static tab. We decided to depricate static module and make it reusable for any other files like dropped, downloaded, etc.
- So now you will be able all file static info on each file to speedup your analysis
- Monitor updates:
- Do not call notify_successful_load() if tlsdump mode (avoid lsass being added to analyzer process list)
- Fix: ensure module (ntdll) is writeable before calling restore_hooks_on_range()
- peepdf isn't installed anymore by default, python3 version is pretty buggy, so if you want to fix it you are more than welcome!
- Monitor updates:
- Add hooks for NtAllocateVirtualMemoryEx, NtMapViewOfSectionEx, NtUnmapViewOfSectionEx (Win10+)
- Extend ntdll protection to cover VirtualProtectEx, make more stealthy
- Make standard file key for all
pathkeys. No more:file,path, etc. Now justx["path"] - MWCP, malwareconfigs, and malduck are not part of requirements.txt anymore! They bring their own dependencies that not everyone needs. If you enable that framework in processing.conf you need to install that dependencies.
- TIP: You need to figurate the proper version(is another reason why we abondone them)
poetry run pip install git+https://github.com/Defense-Cyber-Crime-Center/DC3-MWCPpoetry run pip install git+https://github.com/kevthehermit/RATDecoderspoetry run pip install git+https://github.com/CERT-Polska/malduck/
- TIP: You need to figurate the proper version(is another reason why we abondone them)
PyCryptoreplaced with PyCryptoDoMeX- ACTION REQUIRED
poetry run pip install pycryptodomex==3.14.0- Restart:
- CAPE service
systemctl restart cape-processor
- CAPE service
- Monitor updates:
- Dump-on-API bug fix
- YaraHarness: fix issue with delta variable
- End yara later during shutdown
- Prevent unloading core modules (fix #531)
- New crypto hooks: CryptDeriveKey, CryptDestroyKey, CryptDestroyHash
- YaraInit: log number of loaded sigs rather than a list
- Debugger push & pop actions
- WriteMemoryHandler: tiny code clean
- CreateProcessHandler: improve logging
- Fix evasion techniques reported by (& many thanks to) Alexey Bukhteyev of Checkpoint, writeup
- Update 'GetTickCount' anti-vm bypass with latest IcedID packers
- MongoDB abstraction for easier upgrades when they depricate some apis + code cleanup
- Monitor: PE dumping more tolerant of inaccessible sections (e.g. recent Emotet)
- Updates for latest Emotet Epoch 4
- Feature: AMSI dumps (enabled by default for Win10+)
- Monitor: x64 debugger updates & improvements
- Al-khaser bypass
- ElasticSearch to store reports support by @CorraMatte
- Add new field to DB
arch. To avoid problems with pendings tasks when user didn't read config and set tags - If you using
dist.pyensure next:- If you have
x64andx86VMs:x64VMs should have bothx64andx86tags. Otherwise onlyx64tag
x86VMs should have onlyx86tag.- You can use any other tags, just to work properly you need those two.
- Tags requires update in
machinetable in distributed database if your server contains only x64 VMs. - Probably will be improved in future for better solution
- If you have
- ACTION REQUIRED
cd /opt/CAPEv2/utils/db_migration && alembic upgrade head- Restart:
- CAPE service
systemctl restart cape - Web: uwsgi or cape-web
- CAPE service
- Monitor: Add Add debugger actions: 'nop' and 'wret' to patch instructions with nop and ret
- Yara dynamic bypass for latest Emotet packer anti-vm trick
- Monitor: Add RDTSCP NOP option as alternative for when emulation is too slow (and timestamp counter value not needed)
- Yara signature to enable RDTSCP NOP dynamically for recent Emotet/ISFB packers
- VBE/JSE/BATCH decoded and shown on WebGui
- ACTION REQUIRED
poetry run pip install -U git+https://github.com/DissectMalware/batch_deobfuscator
- Monitor: Add support for parent pid in payload capture (thanks to Intezer)
- We spot that pyzipper adds huge overhead specially to distributed cape.
- Repors now are just zips, screens also now zips, anything that is not contains malicious code is just pure zip, the rest is keeps the same.
- Monitor: Bcrypt hooks, disable yara scans in IE, silent rdtscp emulation, other misc tweaks
- Integrate Kixtart-Detokenizer
- Simplify integration of another tools to unpack/extract files
- Add RichHeader MD5
- Improve Suricata family detection
- Extract strings on demand feature
- Monitor: rdtscp emulation, optional exception & breakpoint logging
- Move Office hook options from packages to monitor
- Monitor: Disable NtWaitForSingleObject hook for 32-bit Windows 8+ due to crashes
- Add MongoDB multifield index for all SHA256 fields.
- if you using any other fields for frequent lookup, add indexes for that on your side to speedup database
- Allow download reports as zip via API
- Fix python analysis support in Windows
- POC: AntiRansomware:
- Can be enabled in
processing.confit will disable processing of files with extensions that are not in allowed list, seemodules/processing/antiransomware.py - Specially useful to disable them in CAPE.py that gather all the metadata, yara etc and can consume a lot of ram
- Can be enabled in
- Monitor update: Monitor fix for scan crashes in e.g. Equation Editor/Cmd (thanks Will)
- Monitor update: Monitor fix for NtSuspendThread hook issue (thanks Intezer)
- For full description read
- Monitor update: Win10x64 deadlock fix & other misc fixes (see capemon repo for details)
- Add test module to extraction framework to ensure that they are loaded properly: CAPE, MWCP, RATDecoders, Malduck
- Monitor update: Fixes/hardening of dumps (PE & memory) and yara scans (e.g. SquirrelWaffle)
- Handled errors that was giving problem to use
init_yarasometime, used in Qakbot extractorOSError: /opt/CAPEv2/lib/cuckoo/common/blzpack_lib.so: failed to map segment from shared object
- Bingraph:
- matplotlib
forwarddeprication fixed - moved to external dependency, we host CAPE's version here https://github.com/CAPESandbox/binGraph.
- ACTION REQUIRED
poetry run pip install -U git+https://github.com/CAPESandbox/binGraph
- matplotlib
- Monitor update: Add CLSIDs and IsValidUrl hook for CVE-2021-40444
- SquirrelWaffle detection & config extraction
- Monitor improvements:
- Dumping stability improvements (ScanForDisguisedPE, IsDisguisedPEHeader, DumpMemory, DumpRegion)
- Add config option to allow enable/disable scans/dumps while loader lock held
- Monitor updates: dump/scan stability improvements, configurable loader lock scans/dumps, window hook fixes
- Update Lockbit yara sig
- Update Bazar yara sig
- We spot that some extractors only works with
mwcp==3.2.1, requirements updated - FLARE-CAPA v3
- Monitor improvements:
- Restrict debugger breakpoint protection to current process (NtSetContextThread)
- Limit "Dropped file limit reached" messages to just one per process
- Monitor fixes:
- Some dropped files being missed (file_handle_terminate())
- Disable ntdll write-protection for Office processes
- Sflock update with more PE checks, as in many cases PE has other formats strings inside
- ACTION REQUIRED
poetry run pip install -U sflock2
- Monitor: Remove case-sensitivity from check for dll path (e.g. Hancitor maldoc-spawned dlls)
- Monitor: revert changes to IsPeImageRaw() while crashes (e.g. BazarLoader) are investigated
- ACTION REQUIRED
poetry run pip install -U pyattck
- Move office settings from package options to in-monitor (automatic)
- Fix issue with tlsdump/lsass being assigned 'first process' in analyzer
- Usage graph moved to under statistics block
- Monitor update: stability fixes (window hooks, ...) & debugger improvements
- Distributed. Master node stop picking pending tasks when
node=Xis specified and master_storage_only=False
- Monitor update: Remove unnecessary check in TestPERequirements causing failed PE dumps
- Search by hash now will cover any file in CAPE that contains hash.
- It searches in binary/Dropped files/CAPE payloads/ProcessDump
- payloads: md5 <- as example not needed anymore and will be deprecated in next month
- Monitor update: debugger improvements
- Loader: fix debug output for shellcode start address including offset
- Allow start offsets into shellcode to be set for Shellcode packages (offset=x)
- Monitor update: fix issue causing occasional crashes on x64 when calling ScyllaGetExportDirectory on apphelp.dll
- XLMMacroDeobfuscator moved to
on_demand
- bzip archives was replaced with zip with password, default infected, can be changes in conf/web.conf -> zipped_download -> zip_pwd
- use 7zip or pyzipper to extract
- Add hability to have different exit nodes on each cape worker in cluster, that will auto pickup proper worker server based on route.
- To update current nodes details on main db server, do the request with pull request
[21-07-2021] Xll support
- ACTION REQUIRED
poetry run pip install -U sflock2
- Allow to execute one specific signature, loading data from mongo or json report. Specially useful for signature based extractors.
- python3 utils/process.py -r ID -sig -sn cape_detected_threat
[06-07-2021] Malduck
- Integration of part of mwcfg-modules by @c3rb3ru5d3d53c
- Add support for archives in static extraction, so you don't need to submit them one by one
[20-06-2021] enter the sandman @doomedraven moved to CAPEv2
- Expect more fixes :)
- Updates to processing module & monitor to allow type strings to replace old type codes
- Updates to 'dump' Debugger action
- Hit counts added to debugger breakpoints
- add
usernamefield to be used for custom auth - ACTION REQUIRED if you using dist.py
cd utils/db_migration && alembic upgrade head
- Introdiced checker of available space in process.py to prevent system run out of memory and generate a lot of troubles
- Migrates from ht_user/ht_pass to apikey for proper apiv2 integration
- ACTION REQUIRED if you using dist.py
cd utils/db_migration_dist && alembic upgrade head
- As TMPFS is better and modernish, and it was a naming typo
# only if you using volatility to speedup IO
mkdir -p /mnt/tmpfs
mount -t tmpfs -o size=50g tmpfs /mnt/tmpfs
chown cape:cape /mnt/tmpfs
vim /etc/fstab
tmpfs /mnt/tmpfs tmpfs nodev,nosuid,noexec,nodiratime,size=50g 0 0
- ORJson library is now used for json report if installed
- orjson is a fast JSON library for Python. It benchmarks as the fastest Python library for JSON. Its serialization performance is 2x to 3x the nearest other library and 4.5x to 11.5x the standard library.
use admin
# To Create root user
use admin
db.createUser(
{
user: "username",
pwd: passwordPrompt(), // or cleartext password
roles: [ "root" ]
}
)
# To create user with perm RW on db
db.createUser(
{
user: "WORKER_USERNAME",
pwd: passwordPrompt(), // or cleartext password
roles: [{ role: "readWrite", db: "cuckoo" }]
}
)
- Reintroduce ratelimit to control abuses
- Allow anon users list reports and view them
conf/web.conf -> general -> anon_viewable
- Monitor updates:
- Fixes for NtCreateProcessEx hook, regsvr32 arg parsing, branch tracing (debugger)
- Remove instruction filtering from ntdll protection
- Add more debug logging to YaraHarness
- Reports download moved to main page, under file info as Strings, VirusTotal, Mitre
[02-05-2021] Square Hammer
- Add button to ban user and their pending tasks on admin tab
- ACTION REQUIRED!
cd utils/db_migration/ && alembic upgrade headsudo systemctl restart cape.service cape-web.service
- ACTION REQUIRED!
- Dirty cluster admin utils helper ->
admin/admin.py, see-h
- Strings tab are under the file info on main page
- VirusTotal tab are also under the file info on main page
- VT apiv3 integrated
- Pyattck v3.0.1 support
- If you are using alternative location to
/opt/CAPEv2and wants to useMITRE TTPsnext action is required:- you need to update value of
data_pathin configdata/mitre/config.yml
- you need to update value of
- Move MITRE ATT&CK from tab to collapse table after signatures
- Allow pass search patter in url:
analysis/search/detections:<family>/
- Add example how to add custom auth, see
web/web/middleware.py
- New dependecy
ujson- REQUIRED ACTION: ->
poetry run pip install ujson -U
- REQUIRED ACTION: ->
-
Default 5/m, it can be changed using Django Admin in user profile. ratelimit is deprecated
-
This was done with huge help from those writeups
-
REQUIRED ACTION: ->
cd web && python3 manage.py migrate
- Allow enable/disable all new users to activate them by hand
- Disable new users after email verification if set
manual_approveinconf/web.conf - REQUIRED ACTION: ->
poetry run pip install django-extensions
-
ToDo: pass yara file to exec yarascan
-
Thanks to Xabier Ugarte-Pedrero and dadokkio for their work
-
poetry run pip install volatility3, then checkconf/processing.conf->[memory]conf/memory.conffor the plugins
-
You will need to download
symbols, see volatility3 readme for details
- ratelimit 4 upgrade ->
poetry run pip install django-ratelimit -U
- Link task to user_id, to be able to ban spammers and bad users
- REQUIRED ACTION: ->
cd /opt/CAPEv2/utils/db_migration && alembic upgrade head - Instead of Volatility3 integration planned for today you got this, thanks spammers
- If registration enabled, allow to set manual approve of users and set them inactive by default
- APIv2 - Django REST Framework + Token AUTH
- just replace
/api/to/apiv2/in your urls
- just replace
- Current API will be removed in future, so move toward new one
- Updated API documentation
- New dependency:
poetry run pip install djangorestframework - REQUIRED ACTION: ->
cd /opt/CAPEv2/web/python3 manage.py migrate && python3 manage.py collectstatic
- To enable it see
[registration]inweb.conf - List of domains can be placed in
data/safelist/disposable_domain_list.txt - Allow enable ReCaptcha for user registration to avoid bots
- Integrated stopforumspam domain list
sed -i 's|#ja3-fingerprints: auto|ja3-fingerprints: yes|g' /etc/suricata/suricata.yaml && sudo systemctl restart suricata
- TLSH hashing - Trend Micro Locality Sensitive Hash
- sha3-384
[14-01-2021] Headers Quality
- Content Security Policy - writeup
- 2FA for Django Admin
- New dependency:
poetry run pip install django-otp qrcodeREQUIRED ACTION: ->cd /opt/CAPEv2/web/python3 manage.py migrateif no you will getno such table: otp_totp_totpdevice
- Adding bootstrap-social to simplify sign buttons integration
- Move SSO providers config to from
web/web/settings.pytoweb/web/local_settings.py [oauth]added toconf/web.conffor future on/off of the buttons- New dependency:
poetry run pip install django-settings-export
- Add Web signup/SSO, email verification - more details - Amazing writeup was used for integration
- ReCaptcha protected admin
- New dependencies ->
poetry run pip install django-allauth django-recaptcha==2.0.6 django-crispy-forms git+https://github.com/CAPESandbox/httpreplay.git - REQUIRED ACTION: ->
cd /opt/CAPEv2/web/python3 manage.py migrateif no you will getNo such table as django_sitepython3 manage.py collectstatic-> to enable django admin css -> requires web/web/local_settings.py modifiySTATIC_ROOT
- Allow download http(s) Request/Response and Response 48bytes hex preview
- auth_only in api.conf to allow apikey/autentificated users hit the rest api
- YARA integrated to capemon, this allows to bypass anti-* aka capemon scripting, more here
- Docs and more anti bypasses and examples coming soon
- TLS decrypt integration, huge thanks to Hatching team to release their code. WEBGUI integration isn't finished yet, but you already can see https requests there
- Safelists moved from network.py to
data/safelist/{domains,ips}.py
- Add uniq submission limitation, can be enabled in
conf/web.confto disable the same submission during X hours - Bingraph, FLARE CAPA, vba2graph on demand
- Added
on_demandfeature.- This funcions aim to speedup processing but allow to user to generate parts of analysis that takes some time to finish and not used frequently. Example scripted submissions
- Malduck integration
- Bootrstarp 4.5.3 & font awesome 5
- Statistics
- Tag_tasks - allows you tag your jobs
- self.pefiles: introduced to prcessing/signatures modules, you can get PEFILE object by sha256 self.pefiles.get(sha256)
- Pending page now is much useful and show hashes to easilly spot duplicated
- Submission of file or resubmission will show all the jobs and detection for that file
- Flare capa integrated under static tab for original binary, procdump and cape (should be enabled in processing.conf), Rules can be pulled from community, but we will leave it community driven to sync them. So you can copy them from https://github.com/fireeye/capa-rules and place under
data/flare-capa - More soon ;)
utils/cleaners.pyoption--delete-older-than-daysmoved to bulk remove 10 in 10, to improve performance and decrease IO
- cape.py rewrite so it affects
api/tasks/get/config/so before it was list of configs and it hascape_name, now its like[{malware_family:{config}}]
- static config extraction lookup in database before scan file with yara and extract
- resubmit added to CAPE/procdump tabs
- Huge code unification and cleanup between
submission/views.pyandapi/views.py - Improve error messages on bulk submission, for failed samples/hashes
- Physical machinery updated by @hariomenkel, you can read details in his writeup
- Static extraction fix, thanks for testing it @nikhilh-20
- Static endpoint now will return config apart of the task id
- Create zip files in memory (requires pyzipper) instead of using 7z and write them to temp folder
- Simplified parsing of arguments between submission/api views
- Created docs on how to test
CurtainandSuricata - Static extraction api added
- Curtain module updated
- Code clenup
- Massive useless IO improved, read config once instead of on each file submit
- Added ability to enable/disable some of 3rd part services for malware detection, like: VirusTotal, ClamAV, Suricata
- Enable ratelimit on download any file, to avoid scrapping, to change limits, edit:
api.conf->download_file - Error message for ratelimit can be configured in
web/web/settings.py - Fixed a lot of bugs/typos, thanks Flake8 + GitHub Actions :)
- Update suricata socket path in processing.conf as in cape2.sh from
/var/run/to/tmp/ - Fix pebble pool restart on timeout
- Zip package reintroduced but it should be only used with option
file=Xwhen we need side load files
- Scan extracted macro with yara from macro/CAPE folder
- Show url from where file was downloaded when using Download'n'Exec
- Zip package is depricate as it doesn't support AES etc, to upload with side files use file=X and submit in zip archive, for rest you have sflock <3
- Restore original dump file, don't dump inmediatelly
- CAPE tab now also loaded via ajax request
- Extended api search changed, now instead of return only ids, return some basic info, as detection, etc
- Rewrite /api/ ratelimit implementation to allow unlimited api for existing users(htpasswd), just set username and password as get/post arguments
- XLMMacroDeobfuscator from @DissectMalware integrated
- Yara now compiled once at processing start or reprocessing
- pyattck upgrade to >= 2.0.2
- moved many files from
/data/tocommunity->python3 utils/community.py -h
- Behavior data/tab is now loaded via ajax request, to speedup webgui
- Add parent sample details to analysis
- Add Yara author to webgui, useful when yara name overlap with private yara
- All not core yara moved to community repo
- Dark theme is default now, to set old one just do
- Backup current:
cp /opt/CAPEv2/web/templates/header.html /opt/CAPEv2/web/templates/header-dark.html - Set old theme:
cp /opt/CAPEv2/web/templates/header-light.html /opt/CAPEv2/web/templates/header.html
- Backup current:
- TLP implemented for analysis, thanks @enzok
- /configdownload/ is moved to /api/tasks/get/config/<task_id>/ or /api/tasks/get/config/<task_id>/Family/
- Anti-api-spamming feature in monitor
- webgui optimizations(mongo queries improved a lot), thanks MongoDB university for free cources :)
- CAPE 2.1 ;)
- A lot of small bug fixes, code cleanup, gui fixes, and monitor improvements
- Now insted if "None matched" we just hide field
- All VMs now are disabled on submission you need to enable it in web.conf
- To submit ZIP file for analisis you need to specify zip package, if no it will be extracted
- Big update of suricata name extraction/detection
- malscore now is off by default, can be enabled in conf/reporting.conf
- MalFamily renamed to detections
- community.py reintroduced to simplify everything
- now all signatures and not core modules are moved to specific repo, please see
python3 utils/community.py -h
- now all signatures and not core modules are moved to specific repo, please see
- SIGHUP handling to stop submitting tasks and stop cuckoo.py, useful for when you need to reload it without breaking running jobs
ps aux|grep "python3 cuckoo.py"|cut -d" " -f 5| xargs kill -1
- Add qemu.py with support for x64/x86/MIPS/MIPSEL/ARM/ARMWRT/ARM64/PowerPC/PowerPC64/Sparc/Sparc64
- Basic linux integration is done thanks to @enzok
- Bson data compression to remove api spamming, details, thanks @mabj
- Many bug fixes in cleaners.py, thanks @Enzok
- Fix local_settings
- move all in 1 dlls, example option to capemon: combo=1,extraction=1,injection=1,compression=1
- Fix ratelimit enabled/disabled in /api/
- Agent now by default set outout to StringIO to make it works with pythonw without extra args
- Screenshot deduplicacion algorithm is configurable now and default set to ahash, pr #10, thanks @wmetcalf
- Fixed pythonw compability problem, pr #7, thanks @wmetcalf
- Pillow 7 compatible, pr #9, thanks @wmetcalf
- Upgrade ClamAV support, pr #11, thanks @wmetcalf
- All cleaners from cuckoo.py and some from utils folder are moved to unique file utils/cleaners.py, see, -h @doomedraven
- distributed CAPE documentation updated
- m2crypto+swig replaced with cryptography library
- CAPEv2 is Python3 based
- Django 3 tested
- ASGI support - async "wsgi"
- All found memleaks fixed
- A lot of code improved and bug fixed
- Malware parsers/extractors moved to use upstream libraries instead of include them to the project, to simplify maintaining and code bug fixes
- User experience improved
- Still might contain some bugs, so please let us know if you see any
- Thanks NaxoneZ for all your bug reports and hard testing <3