18 tools with mixed quality. Naming is generally verb-first and clear (list_files, run_strings, get_hash). Descriptions present but often terse (10-50 chars) and lack context on WHEN to use tools or what they return. Input schemas visible and mostly typed, but many lack parameter descriptions or constraints. Output schemas undocumented. Error handling minimal, no recovery guidance or actionable error messages. Security: path traversal checks in file_tools.py are good, but command injection risks in run_* tools (grep, find, strings) accepting raw argument arrays without validation. Composition is reasonable, tools are single-purpose, but chains require manual ID passing.
Add a new analyst note
Download a symbol map from the Abyss-W4tcher/volatility3-symbols repository
Downloads windows symbols for volatility to `/symbols`
Get the history of all commands that have been run
Allows for parsing of the command result with options for head, tail, regex filtering, and byte limiting
Calculate hash of a file using specified algorithm
List files in a specified directory (artifacts, symbols, or evidence)
Command injection risk in run_strings, run_grep, run_find: accept raw argument arrays without validation or escaping. LLM could pass shell metacharacters (;, |, &&, >, <) that execute unintended commands.
Descriptions too terse (10 - 50 chars) for LLM tool selection. run_strings: 'Runs: strings <arguments>' does not explain WHEN to use it (extract printable strings from binaries), what it returns, or prerequisites. LLMs cannot distinguish between similar tools.
Output schemas undocumented. Tools return CommandRecordSummary or other objects, but LLM does not know what fields to expect. Agents cannot plan downstream calls or extract required IDs.
Inferred effective spec: <=2025-11-25.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | F | 49 | <=2025-11-25 | v2 |
Runs: find <arguments>
Runs: grep <arguments>
Run sleuthkit commands for disk forensics: <tool> <arguments> blkcalc - Converts between unallocated disk unit numbers and regular disk unit numbers. blkcat - Display the contents of file system data unit in a disk image. blkls - List or output file system data units. blkstat - Display details of a file system data unit (i.e. block or sector). fcat - Output the contents of a file based on its name. ffind - Finds the name of the file or directory using a given inode. fiwalk - print the filesystem statistics and exit. fls - List file and directory names in a disk image. fsstat - Display general details of a file system. hfind - Lookup a hash value in a hash database. icat - Output the contents of a file based on its inode number. ifind - Find the meta-data structure that has allocated a given disk unit or file name. ils - List inode information. img_cat - Output contents of an image file. img_stat - Display details of an image file. istat - Display details of a meta-data structure (i.e. inode). jcat - Show the contents of a block in the file system journal. jls - List the contents of a file system journal. jpeg_extract - jpeg extractor. mactime - Create an ASCII time line of file activity. mmcat - Output the contents of a partition to stdout. mmls - Display the partition layout of a volume system (partition tables). mmstat - Display details about the volume system (partition tables). sigfind - Find a binary signature in a file. sorter - Sort files in an image into categories based on file type. srch_strings - Display printable strings in files. tsk_comparedir - compare the contents of a directory with the contents of an image or local device. tsk_gettimes - Collect MAC times from a disk image into a body file. tsk_loaddb - populate a SQLite database with metadata from a disk image. tsk_recover - Export files from an image into a local directory.
Runs: strings <arguments>
Runs volatility3: vol -s /symbols -r jsonl <arguments> - To analyze a file you must specify the path using `-f /evidence/example.mem` - Volatility3 does not come with many built-in symbols so they may need to be manually downloaded
Load linux symbol map from Abyss-W4tcher/volatility3-symbols and search for symbols matching the regex
Get the full content of a specific analyst note
Get a summary of all analyst notes
Runs: tar -xf <SOURCE_FILE> -C /artifacts/<DESTINATION_FILE_NAME>
Runs: unzip -X -K <SOURCE_FILE> -d /artifacts/<DESTINATION_FILE_NAME>
Update an existing analyst note
Parameter descriptions missing or minimal. 'arguments' in run_strings/run_grep/run_find lacks format guidance (array of strings, but what format? flags only? file paths?). LLMs guess and pass invalid syntax.
No error recovery guidance. Tools do not document what errors are retryable, user-fixable, or fatal. LLM receives raw exception and has no next step.