{"domain":"www.aidatatools.dev","count":2,"changes":[{"captured_at":"2026-08-12T20:02:18","card_hash":"e6e6496c3746e50766c41c7f88ca3de4e769a2a6589a0c7cbd5fa785774a9db5","previous_card_hash":"d85fc1335a12fce43f19d2cb42303035815a6002409f07fdf812e2d274cd56ae","diff":{"skills_added":[],"skills_removed":[],"skills_changed":[{"id":"check_dataset_quality","fields":["description","tags"]}],"fields_changed":[{"field":"description","before":"Deterministic dataset-reliability checker for AI agents. Given a JSON dataset, returns exact facts (completeness, nulls, type consistency, impossible values, exact/near duplicates, statistical outliers, cardinality) plus a 0-100 score and a RELIABLE / USABLE_WITH_CLEANING / UNRELIABLE verdict. Additional facts-only signals report alongside without affecting that score: cross-source price divergence, text-extraction artifacts (leftover HTML, mojibake, placeholders like \"N/A\"), and a robust MAD cross-check that surfaces outliers the Tukey fence structurally cannot see. 100% deterministic, no LLM: identical input always produces an identical output. Works on any tabular JSON dataset in any domain.","after":"Deterministic post-scrape data cleaner and quality gate for AI agents. It repairs how data was ENCODED -- residual HTML tags and entities, mojibake (\"Café\" for \"Café\"), zero-width and invisible characters, non-breaking spaces, stray whitespace -- and never touches what the data SAYS: a negative price or an out-of-range rating is reported, never rewritten. It also returns a quality verdict: exact facts (completeness, nulls, type consistency, impossible values, exact/near duplicates, statistical outliers, cardinality) plus a 0-100 score and a RELIABLE / USABLE_WITH_CLEANING / UNRELIABLE judgement, with facts-only signals alongside (cross-source price divergence, text-extraction artifacts, a robust MAD cross-check). 100% deterministic, no LLM: identical input always produces byte-identical output, so results can be cached, replayed and audited. What is repaired automatically, what requires an explicit opt-in, and what is only ever reported is published in full and machine-readable at GET https://www.aidatatools.dev/api/clean -- readable before paying. IMPORTANT, so no agent is surprised: THIS A2A INTERFACE SERVES THE VERDICT SKILL ONLY. Repair is available over plain REST (POST https://www.aidatatools.dev/api/clean, $0.04 via x402; /api/clean/audit adds a replayable, reversible ledger, $0.12) and is discoverable over MCP at https://www.aidatatools.dev/api/mcp_server."},{"field":"version","before":"0.1.0","after":"0.2.0"}],"other_changed":true,"is_empty":false,"human_summary":"updated 1 skill · description Deterministic dataset-reliability checke → Deterministic post-scrape data cleaner a · version 0.1.0 → 0.2.0"}},{"captured_at":"2026-08-10T09:30:05","card_hash":"d85fc1335a12fce43f19d2cb42303035815a6002409f07fdf812e2d274cd56ae","previous_card_hash":null,"diff":{"skills_added":[{"id":"check_dataset_quality","name":"Check Dataset Quality","description":"Deterministically verifies the reliability of a tabular JSON dataset before an agent acts on it. Runs 8 checks -- structural homogeneity, completeness, null rate, type consistency, impossible/out-of-range values, exact and near (fuzzy) duplicate detection, statistical outliers (Tukey fence), and field cardinality -- and returns a transparent, recomputable 0-100 score plus a RELIABLE / USABLE_WITH_CLEANING / UNRELIABLE verdict with ranked reasons and a concrete cleanup recommendation. No LLM is involved: the same dataset always produces the exact same facts, score, and verdict. Three further signals report alongside the score without ever moving it. On financial/trading data -- a symbol/ticker/asset field paired with a price/cost/rate field -- it detects cross-source price divergence for the same entity (e.g. the same trading pair quoted very differently by two exchanges), grouped per entity rather than compared globally. On scraped or aggregated text it reports extraction artifacts: leftover HTML and boilerplate, mojibake from wrong-codec decoding, invisible characters, and placeholders such as \"N/A\" or \"null\" that completeness counts as present and types counts as a valid string. And inside the outlier check it reports a robust median/MAD cross-check, surfacing anomalies the Tukey fence structurally cannot see once a cluster of corrupted values widens its bounds. All three are additional facts for review, deliberately not factored into score or verdict. Call it right after scraping, before loading data into a RAG pipeline, before a trading agent acts on aggregated market data, or whenever a dataset comes from an unverified source. Built to be called repeatedly -- once per batch -- as a recurring step in a pipeline, not a one-off check and not a real-time/streaming feed.","tags":["data quality","data validation","dataset validation","reliability","verification","deterministic","duplicates","duplicate detection","nulls","missing values","outliers","anomaly detection","data cleaning","data profiling","scraper output validation","RAG pipeline guardrail","pre-ingestion check","per-batch validation","pipeline quality gate","recurring data check","financial data validation","trading data quality","on-chain data verification","pre-trade data check","market data validation","price divergence detection","text quality","encoding validation","scraper artifact detection"],"inputModes":["application/json"],"outputModes":["application/json"]}],"skills_removed":[],"skills_changed":[],"fields_changed":[{"field":"name","before":null,"after":"Data Quality Gate"},{"field":"description","before":null,"after":"Deterministic dataset-reliability checker for AI agents. Given a JSON dataset, returns exact facts (completeness, nulls, type consistency, impossible values, exact/near duplicates, statistical outliers, cardinality) plus a 0-100 score and a RELIABLE / USABLE_WITH_CLEANING / UNRELIABLE verdict. Additional facts-only signals report alongside without affecting that score: cross-source price divergence, text-extraction artifacts (leftover HTML, mojibake, placeholders like \"N/A\"), and a robust MAD cross-check that surfaces outliers the Tukey fence structurally cannot see. 100% deterministic, no LLM: identical input always produces an identical output. Works on any tabular JSON dataset in any domain."},{"field":"version","before":null,"after":"0.1.0"},{"field":"documentationUrl","before":null,"after":"https://www.aidatatools.dev/llms-full.txt"}],"other_changed":true,"is_empty":false,"human_summary":"added 1 skill · name ∅ → Data Quality Gate · description ∅ → Deterministic dataset-reliability checke · version ∅ → 0.1.0 · documentationUrl ∅ → https://www.aidatatools.dev/llms-full.tx"}}]}