BPS Indonesia Statistical Data Agent & Academic Research AI Agent — search and query BPS data via AllStats Search Engine and WebAPI
Server has 13 tools with basic schemas and descriptions, but significant gaps limit production readiness. Tool names lack consistent verb-noun structure (e.g., 'time_series_analysis' vs 'analyze_time_series'). Most descriptions are present but generic, many under 100 chars and lacking WHEN/WHY context. Parameter descriptions exist but are minimal. No output schemas documented. Error handling is absent, no recovery guidance, no categorization of retryable vs fatal errors. Security concerns: bash tool accepts arbitrary shell commands with no sanitization or permission gates. File tools (read/write/edit) lack path traversal protection. No audit logging visible. Composition issues: bash tool is too powerful and generic; should be split by use case. Analysis tools bundle multiple statistical methods into single tools rather than separate, focused tools.
Automatic visualization suggestion and creation
Comprehensive EDA report generation
Execute shell commands in foreground or background. Automatically detects OS and uses appropriate shell: Windows: PowerShell, Unix/Linux/macOS: bash
Bayesian regression with posterior summaries and HDI
Causal inference analysis: ATE, propensity score matching, IV, DiD, RDD
Check statistical validity: Normality, homoscedasticity, VIF, autocorrelation
Natural language data queries via pandas
Edit existing files
bash tool accepts arbitrary shell commands with no input sanitization, permission gates, or command whitelisting. Agents can execute destructive commands (rm -rf /, kill processes, exfiltrate data). No dry-run or confirmation pattern.
File tools (read, write, edit) lack path traversal protection. No validation that paths stay within allowed directories. Agents could read /etc/passwd or write to /root/.ssh/authorized_keys.
No output schemas documented for any tool. LLMs cannot predict response structure, forcing them to guess field names and types. Breaks tool chaining and increases hallucination risk.
| Scored | Grade | Overall | Spec posture | Rubric |
|---|---|---|---|---|
| 2026-09-23 | D | 51 | 2026-07-28+ | v2 |
Read file contents
Survival analysis: Kaplan-Meier, Cox PH, log-rank, AFT
Perform time series analysis: unit root tests (ADF, KPSS), ARIMA/SARIMAX modeling, VAR multivariate models, Granger causality, and Johansen/Engle-Granger cointegration tests. Returns APA-formatted results with information criteria and residual diagnostics.
Data quality validation with schema checks
Create new files
Tool names lack consistent verb-noun structure. 'time_series_analysis', 'bayesian_analysis', 'causal_inference' are noun-heavy; should be 'analyze_time_series', 'analyze_bayesian', 'infer_causal'. 'conversational_analysis' is vague, does it query, analyze, or chat?
No error handling or recovery guidance. Tools fail silently or return raw exceptions. No categorization of retryable vs fatal errors. LLMs cannot self-correct or know when to ask the user.