ToolTrust
D65/100
Smithery

ia-qa-api

mcpsmithery

@Smithery

IA-QA as an MCP Server Use IA-QA's developer tools to test your llm agents RAG ai tools, directly from Cursor, Claude Desktop, Windsurf, or any AI agent without leaving your IDE. Many classical testing tools too ! Enjoy ! No API key. No signup. Free.

By Smithery | 293 findings | Scanned 6/3/2026 | tooltrust-scanner/v0.3.13

9 Critical69 High26 Medium55 Low134 Info

Risk Summary

Block in Production

Dep Visibility + Excessive Permissions risk is significant. Avoid using this in production agents.

Potential impact: This finding indicates the tool should be reviewed before it is trusted.

Recommended action: This tool should stay disabled in production agents until the flagged risks are fixed and the scan is clean.

{
  "mcpServers": {
    "ia-qa-api": {
      "disabled": true
    }
  }
}

Security Findings (293)

  • CriticalAS-006

    đŸ’ģArbitrary Code Execution ×9

    heuristic signal

    tool name or description implies arbitrary script/code execution (evaluate_script, execute javascript, etc.)

    mcp_server_evaluatepr_gatekeeperrerank_evaluateweb_security_auditsimilarity_scorelist_local_testsrun_eval_contractgenerate_eval_yamlget_testing_guidelines

    Fix: This tool can execute arbitrary code or shell commands on the host system. Remove it unless strictly required. If kept: (1) restrict access to trusted users/agents only, (2) require human approval before each invocation (Claude Desktop: set approval_required: true; other clients: enable equivalent confirmation), (3) use the most restrictive sandbox or read-only mode available, and (4) never expose this tool to untrusted input sources.

  • HighAS-002

    ⚠ī¸Excessive Permissions ×45

    tool declares network permission

    base64_encodeurl_encodeurl_decodegenerate_slugfetch_veille_feedmcp_server_evaluatevalidate_urllatency_benchmarkhttp_status_lookupparse_http_headersgenerate_curlextract_linkssecurity_headers_checkssl_certificate_checkcors_testcors_checkerwebhook_endpoint_createwebhook_endpoint_requestscookie_security_auditweb_security_auditsecret_scanrun_vlm_test_suitemultimodal_eval_guiderun_vlm_test_suite_batch

    tool declares exec permission

    text_statsprompt_test_suitemcp_server_evaluatecron_validatorcalculate_readabilityembedding_similarityrag_relevance_rankcot_analyzervector_similaritybuild_rag_promptcount_code_linespr_gatekeeperrerank_evaluatesimilarity_scoreneedle_haystack_generatelist_local_testsrun_eval_contractgenerate_html_reportmultimodal_eval_guidegenerate_eval_yamlget_testing_guidelines

    Fix: Tool requests broad permissions (exec/fs/network). Validate input parameters using Enums where possible, and restrict file system operations to explicit allowed directories.

  • HighAS-010

    🔑Insecure Secret Handling ×22

    input parameter "token" appears to accept a secret or credential

    decode_jwt

    input parameter "max_tokens" appears to accept a secret or credential

    truncate_to_tokensprompt_test_suitellm_generate

    input parameter "chunk_tokens" appears to accept a secret or credential

    split_chunks

    input parameter "input_tokens" appears to accept a secret or credential

    estimate_llm_cost

    input parameter "output_tokens" appears to accept a secret or credential

    estimate_llm_cost

    input parameter "context_tokens" appears to accept a secret or credential

    token_budget_calculator

    input parameter "user_input_tokens" appears to accept a secret or credential

    token_budget_calculator

    input parameter "system_prompt_tokens" appears to accept a secret or credential

    token_budget_calculator

    input parameter "expected_output_tokens" appears to accept a secret or credential

    token_budget_calculator

    input parameter "max_output_tokens" appears to accept a secret or credential

    context_window_check

    input parameter "max_context_tokens" appears to accept a secret or credential

    build_rag_prompt

    input parameter "secret" appears to accept a secret or credential

    generate_hmac

    input parameter "tokens" appears to accept a secret or credential

    needle_haystack_generate

    input parameter "tokens_per_day" appears to accept a secret or credential

    llm_fit_finder

    input parameter "api_keys" appears to accept a secret or credential

    run_eval_contractrun_vlm_test_suite_batch

    input parameter "api_key" appears to accept a secret or credential

    run_vlm_test_suitemultimodal_eval_guiderun_semantic_teststest_skill

    Fix: Avoid accepting raw credentials as input parameters. Use secret managers (e.g. 1Password CLI, AWS Secrets Manager) and ensure credentials are never logged or stored in agent traces.

  • HighAS-003

    🔀Scope Mismatch ×2

    tool name "list_local_tests" implies read-only operation but declares exec permission

    list_local_tests

    tool name "get_testing_guidelines" implies read-only operation but declares exec permission

    get_testing_guidelines

    Fix: Ensure tool names, descriptions, and permission declarations are internally consistent. Use explicit naming conventions that fully reflect actual capabilities.

  • MediumAS-002

    ⚠ī¸Excessive Permissions ×26

    tool declares db permission

    generate_uuidurl_encodeurl_decodeunescape_htmlvalidate_urlrag_relevance_rankbm25_scorebuild_rag_promptdetect_secretsrerank_evaluatewebhook_endpoint_requestssecret_scanget_testing_guidelines

    tool declares fs permission

    base64_decodegenerate_slugminify_jsstrip_markdownextract_json_pathtransform_json_arraysort_linesnormalize_whitespacegenerate_curldetect_secretswebhook_endpoint_createlist_local_testsrun_eval_contract

    Fix: Tool requests broad permissions (exec/fs/network). Validate input parameters using Enums where possible, and restrict file system operations to explicit allowed directories.

  • LowAS-011

    ℹī¸Missing Rate-Limit / Timeout ×45

    tool performs network or execution operations but declares no rate-limit, timeout, or retry configuration

    base64_encodeurl_encodeurl_decodegenerate_slugtext_statsfetch_veille_feedprompt_test_suitemcp_server_evaluatejson_to_csvvalidate_urlcron_validatorcalculate_readabilityembedding_similaritylatency_benchmarkrag_relevance_rankcot_analyzervector_similaritybuild_rag_prompthttp_status_lookupparse_http_headersgenerate_curlcount_code_linesextract_linksgenerate_hmacpr_gatekeeperrerank_evaluatesecurity_headers_checkssl_certificate_checkcors_testcors_checkerwebhook_endpoint_createwebhook_endpoint_requestscookie_security_auditweb_security_auditsecret_scansimilarity_scoreneedle_haystack_generatelist_local_testsrun_eval_contractgenerate_html_reportrun_vlm_test_suitemultimodal_eval_guiderun_vlm_test_suite_batchgenerate_eval_yamlget_testing_guidelines

    Fix: Declare explicit rate-limit, timeout, and retry configuration for all network and execution tools. Implement exponential back-off and surface resource state to the calling agent.

  • LowAS-002

    ⚠ī¸Excessive Permissions ×10

    tool declares http permission

    json_to_csvembedding_similarityvector_similarityparse_http_headersgenerate_curlgenerate_hmaccors_checkerwebhook_endpoint_createwebhook_endpoint_requests

    input schema exposes 16 properties (threshold: 10)

    multimodal_eval_guide

    Fix: Tool requests broad permissions (exec/fs/network). Validate input parameters using Enums where possible, and restrict file system operations to explicit allowed directories.

  • InfoAS-014

    ℹī¸Dependency Inventory Unavailable ×134

    Tool did not expose metadata.dependencies or repo_url, so supply-chain coverage is limited.

    format_jsongenerate_uuidhash_textcount_tokensbase64_encodebase64_decodeurl_encodeurl_decodegenerate_slugvalidate_emailminify_jsdecode_jwttext_statsgenerate_passwordparse_csvcolor_convertregex_testlorem_ipsumtimestamp_convertdiff_texttruncate_to_tokenssplit_chunksextract_json_from_textstrip_markdownestimate_llm_costescape_htmlunescape_htmlfetch_veille_feedscore_geo_signalsextract_json_pathgenerate_json_ldanalyze_diff_bugsgenerate_test_casesrun_pr_gate_pipelinevalidate_mcp_responsellm_output_validatorcompare_responsesprompt_test_suitemcp_server_health_checkmcp_server_evaluatejson_schema_validateflatten_jsonxml_to_jsonredact_piimock_from_schematransform_json_arrayjson_to_csvcase_convertsort_linesnumber_base_convertvalidate_urlcheck_contrast_ratiohtml_to_markdowncron_parsecron_validatorcalculate_readabilitynormalize_whitespaceembedding_similarityllm_format_checkhallucination_checkprompt_injection_scantoken_budget_calculatorconsistency_checkllm_json_schema_checklatency_benchmarkresponse_quality_scorerag_relevance_ranktoxicity_scanguardrail_testfunction_call_validateconversation_analyzemcp_schema_lintcot_analyzerab_test_reportcontext_window_checkvector_similaritynormalize_vectorvector_quantizevector_statsbm25_scorebuild_rag_promptprompt_template_fillfew_shot_formattersystem_prompt_buildermodel_infocompare_modelshttp_status_lookupparse_http_headersgenerate_curlextract_todosdetect_secretscount_code_lineslint_commit_messageword_frequencyextract_linkslevenshtein_distancejson_diffmerge_jsonjson_to_yamlgenerate_hmacformat_bytesdetect_languagepr_gatekeeperlist_llm_modelsllm_generatererank_evaluateshield_analyzesecurity_headers_checkssl_certificate_checkcors_testcors_checkerwebhook_endpoint_createwebhook_endpoint_requestscookie_security_auditweb_security_auditsecret_scansimilarity_scoreneedle_haystack_generateoptimize_prompt_tokensbias_detectllm_fit_finderfind_toollist_local_testsrun_eval_contractgenerate_html_reportrun_vlm_test_suitemultimodal_eval_guiderun_vlm_test_suite_batchgenerate_eval_yamlvalidate_agent_trajectoryrun_semantic_testsget_testing_guidelinestest_skillidentify_caller

    Fix: Review and remediate the identified issue.

Scan this tool yourself

Reproduce this audit locally, integrate into CI, or let your agent audit its own tools.

Install once, then scan any MCP server:

$ curl -sfL https://raw.githubusercontent.com/AgentSafe-AI/tooltrust-scanner/main/install.sh | bash
$ tooltrust-scanner scan --server "npx -y ia-qa-api"

Adjust the package name if your npm registry name differs from the tool ID. View source

Add badge to your README

Copy this Markdown to show your ToolTrust grade on GitHub.

[![ToolTrust Grade D](https://raw.githubusercontent.com/AgentSafe-AI/tooltrust-directory/main/docs/badges/grade-d.svg)](https://github.com/AgentSafe-AI/tooltrust-directory)