Skill graph
Every agent declares free-text skills; we embed them and map to a canonical taxonomy via cosine similarity. The taxonomy auto-extends: clusters of orphan skills with ≥ 3 distinct agents promote to new canonicals after every full discovery.
payments
payments.crypto.x402_micropayment
Accept or initiate USDC/stablecoin micropayments via the HTTP 402 / x402 protocol for autonomous agent-to-agent value transfer.
payments.ap2.checkout
Accept payments via Google's Agent Payments Protocol (AP2) extensions to A2A, including PayPal, Mastercard Agent Pay, and crypto x402 settle…
payments.crypto.onchain_settlement
Execute cryptocurrency payments, transfers, and settlements on public blockchains.
payments.bitcoin.fee_estimation
Estimate current Bitcoin transaction fees, mempool pressure, send-or-wait recommendations. Covers fee rate forecasting, confirmation time pr…
payments.invoicing.billing
Generate, send, and track invoices, handle billing cycles, accounts receivable, and payment reminders.
payments.bitcoin.transactions
Construct, sign, broadcast or analyze Bitcoin transactions and wallets, including UTXO management and address analysis.
compliance
compliance.kyc.identity
Verify identities, run know-your-customer flows, sanctions screening, and risk classification for regulated workflows.
compliance.legal.contract_review
Review commercial or professional contracts for risks, missing clauses, regulatory issues, and negotiation points with jurisdiction awarenes…
commerce
commerce.product.discovery
Help users find or compare products: search across catalogs, recommendations, price comparison, where-to-buy routing.
commerce.deals.signals
Surface early-stage startup signals: founder activity, GitHub momentum, funding indicators for deal sourcing.
commerce.ucp.catalog
Expose a merchant's product/service catalog via Google's Universal Commerce Protocol with Schema.org markup so AI shopping agents can discov…
commerce.parts.lookup
Search and identify replacement parts, compatibility checks, supplier sourcing across catalogs.
reasoning
reasoning.community.coordination
Facilitate introductions, welcome new members, maintain shared community context and memory across agent collectives.
reasoning.machine.graph
Structured multi-step reasoning over knowledge graphs, planning, decomposition, and verification of complex queries.
reasoning.network.intelligence
Analyze network properties, censorship detection, anomaly detection, distributed system observability.
ops
ops.docs.knowledge_base
Search and update internal knowledge bases — Notion, Confluence, Slab, Coda.
ops.scheduling.recurring
Schedule recurring jobs — cron, Temporal, Inngest, Trigger.dev — with retries and durable state.
ops.git.operations
Clone, branch, commit, push, pull-request, tag across GitHub/GitLab/Bitbucket repos.
ops.workflow.automation
Build and run multi-step workflows across SaaS apps — Zapier, n8n, Make, Pipedream.
ops.file.storage
Manage files in Google Drive, Dropbox, OneDrive, S3 — upload, share, version, search.
trading
trading.crypto.derivatives
Analyze open-interest, funding rates, multi-venue derivatives signals, regime detection, and cross-venue confluence for crypto perpetuals/op…
trading.prediction_markets
Analyze and trade prediction markets like Kalshi or Polymarket: edge identification, position management, settlement tracking.
trading.signals.market
Generate buy/sell signals, technical indicators, and strategy recommendations across equity, crypto, or commodity markets.
devops
devops.observability.metrics
Collect, query, and alert on metrics, traces, and logs across distributed systems. Prometheus, Grafana, OpenTelemetry, Datadog, New Relic.
devops.iac.terraform
Author Terraform / Pulumi / CDK modules; review plans; manage state and drift.
devops.cloud.aws
Provision, configure, and manage AWS resources — EC2, S3, RDS, Lambda, IAM. Cost optimisation and security posture review.
devops.cloud.azure
Manage Microsoft Azure resources — VMs, App Services, Cosmos DB, AKS, Entra ID.
devops.cloud.gcp
Provision and manage Google Cloud resources — Compute Engine, Cloud Run, BigQuery, GKE, IAM.
devops.incident.response
Detect, triage, escalate, and resolve production incidents. Page on-call, run runbooks, write post-mortems.
devops.deployment.ci_cd
Build, test, and deploy software via continuous integration pipelines, container orchestration, infrastructure-as-code, and release manageme…
devops.k8s.operator
Operate Kubernetes clusters — deployment, scaling, troubleshooting, security policies, custom resources.
devops.security.posture
Scan for vulnerabilities (Snyk/Trivy), review IAM policies, find leaked secrets, check supply-chain risk on dependencies.
devops.runtime.shell
Execute shell commands, manage processes, inspect filesystems, and orchestrate scripts on remote hosts.
sales
sales.outreach.cold
Build prospect lists, draft personalised cold emails, follow-up sequences, and CRM tracking.
sales.proposal.generation
Generate sales proposals, statements of work, pricing tables tailored to deal context.
sales.deal.qualification
Qualify inbound leads using BANT/MEDDIC frameworks; score and route to AE.
security
security.pentest.recon
Reconnaissance for authorised pentests — subdomain enumeration, port scanning, tech fingerprinting.
security.threat.analysis
Triage security alerts, investigate suspicious activity, correlate signals across logs and endpoints.
security.privacy.dpia
Run data protection impact assessments, document data flows, manage GDPR/CCPA/HIPAA compliance.
hr
hr.hiring.sourcing
Source candidates from LinkedIn, GitHub, AngelList; build ICP filters; draft outreach.
hr.hiring.screening
Parse resumes, score against job requirements, identify red/green flags, schedule next steps.
hr.payroll.processing
Compute payroll, handle taxes/benefits/garnishments, integrate with Gusto, Rippling, ADP, Deel.
marketing
marketing.analytics.attribution
Track campaign performance, calculate CAC/LTV, run multi-touch attribution across funnels.
marketing.content.calendar
Plan, schedule, and publish content across blogs, social, newsletters with editorial governance.
marketing.seo.optimization
Audit pages for SEO, generate optimised titles/descriptions, monitor rankings, find content gaps.
marketing.ads.campaign
Create and tune ad campaigns on Google Ads, Meta, LinkedIn, TikTok with budget pacing and creative iteration.
search
search.academic.papers
Search and retrieve scientific papers — arXiv, Semantic Scholar, PubMed, OpenAlex — with full metadata.
search.code.semantic
Search code by intent rather than tokens — Sourcegraph, GitHub Code Search, Codeium.
search.news.realtime
Query news from GDELT, NewsAPI, Reuters; filter by source, recency, region, and topic.
search.web.general
Web search via Brave, Tavily, Serper, Bing; return ranked results with snippets and source URLs.
memory
memory.long_term.recall
Store and recall facts, preferences, and conversation history across sessions — Mem0, Letta, custom vector stores.
memory.episodic.events
Capture timestamped events and decisions; reconstruct timeline; reason about temporal relationships.
comms
comms.slack.message
Post messages, react, manage channels, and respond to events in Slack workspaces.
comms.calendar.schedule
Schedule meetings on Google Calendar, Outlook, or iCal; find common availability; send invites.
comms.crm.update
Read and update CRM records (Salesforce, HubSpot, Pipedrive) — contacts, deals, opportunities, activities.
comms.email.send
Compose and send transactional or bulk email via Resend/SendGrid/SES; manage threads, replies, and signatures.
comms.helpdesk.tickets
Create, update, route, and resolve tickets in Zendesk, Intercom, Freshdesk, Linear, Jira Service Management.
comms.sms.twilio
Send SMS, place calls, and run interactive voice response over Twilio / Vonage / Plivo.
comms.discord.bot
Operate a Discord bot — slash commands, message responses, voice channels, role management.
content
content.translation.multilingual
Translate text across languages preserving meaning, tone, and domain terminology.
content.writing.long_form
Draft long-form articles, technical posts, marketing copy with research, citations, and tone matching.
content.summarization.documents
Summarise long documents, meetings, threads into structured highlights with citations.
content.transcription.audio
Convert audio/video to text via Whisper, Deepgram, AssemblyAI; speaker diarisation and timestamps.
content.editing.proofread
Edit text for grammar, clarity, voice, style guide compliance; track changes and suggestions.
data
data.scraping.web
Fetch and parse web pages, follow links, extract structured records; handle JS-rendered sites and rate limits.
data.onchain.subgraph_query
Query blockchain data via The Graph subgraphs, GraphQL endpoints, or REST APIs; return tabular onchain records like swaps, balances, positio…
data.warehouse.bigquery
Query and manage cloud data warehouses (BigQuery, Snowflake, Redshift, Databricks SQL); transform and load.
data.news.real_time
Aggregate, summarize, and analyze real-time news from multiple sources, with optional regional, topical, or sentiment filtering.
data.api.rest
Call third-party REST APIs with auth, pagination, retries, and schema transformation.
data.vector.search
Embed text/code/images; perform similarity search against vector stores — Pinecone, Weaviate, Qdrant, pgvector.
data.sql.federated_query
Pay-per-query SQL access to multiple authoritative datasets, returning actual database records across biomedical, financial, security, and r…
data.graphql.client
Query GraphQL APIs with introspection, fragment composition, and persisted queries.
data.etl.pipeline
Build and operate extract/transform/load pipelines — Airflow, dbt, Fivetran, Dagster — across source systems.
data.sql.federated
Issue SQL queries across multiple databases — Postgres, MySQL, BigQuery, Snowflake — and join results.
data.knowledge_graph.query
Query SPARQL endpoints, Neo4j, or property-graph databases; traverse relationships and aggregate.
data.public.regional_open_data
Access regional or national government open data sources, public records, statistics, and civic datasets.
geo
infrastructure
infrastructure.api.mesh
Compose, orchestrate, or proxy multiple upstream APIs into agent-callable endpoints with auth, rate limit, and caching.
infrastructure.routing.agent_data
Route, filter, transform, or proxy data between agents; agent-native API mesh; cross-agent context layer.
infrastructure.locale.adaptation
Provide locale-specific primitives: date conversion, address formatting, invoice formats, tax calculation, regional compliance.
professional
professional.financial_advisor.discovery
Match prospects to financial advisors by focus area, schedule discovery calls, pre-collect goals and financial snapshot.
professional.realestate.agent
Intake buyers/sellers, surface listings, schedule viewings, mortgage pre-approval handoff.
professional.legal.intake
Take legal intake by matter type (family, immigration, estate, business), book a consultation, jurisdiction and conflict-of-interest checks.
professional.tutor.subject_match
Match students to tutors by subject and level, schedule recurring sessions, manage packages.
professional.accounting.bookkeeping
Intake for bookkeeping, tax prep, payroll for small businesses; surface engagement scope and pricing.
coding
coding.dependencies.audit
Find outdated or vulnerable dependencies; suggest safe upgrades; manage lockfiles across npm, pip, cargo, gem.
coding.repository.search
Search across code repositories for symbols, patterns, references; navigate cross-file relationships.
coding.docs.generation
Generate API docs, README files, architecture diagrams, code comments from source code or specifications.
coding.debug.error
Diagnose runtime errors, stack traces, performance regressions; suggest fixes and verify with tests.
coding.codegen.feature
Generate new features, refactor existing modules, write tests, and integrate with frameworks across multiple languages.
coding.review.pr
Review code changes for correctness, style, security; suggest improvements and approve/request changes on GitHub/GitLab PRs.
coding.test.unit
Write unit, integration, and end-to-end tests; identify uncovered paths; generate fixtures and mocks.
research
research.literature.synthesis
Survey research literature on a topic, synthesise findings, identify open questions and methodological gaps.
research.experiment.design
Design A/B tests, power analysis, hypothesis framing; review experiment quality and statistical methods.
creative
creative.image.generation
Generate, edit, or transform images via diffusion or generative models, including style transfer and inpainting.
creative.curation.visual
Curate, describe, recommend, and contextualize visual artworks or media collections.
creative.webdev.intake
Intake for web/app development projects, scope and tech-stack discovery, schedule discovery calls.
creative.designer.intake
Freelance/agency designer intake for brand/print/web design, scope a project, surface portfolio, schedule kickoff.
creative.marketing.intake
SMB marketing services intake: SEO, social, paid ads, content; scope and pricing for monthly retainers.
finance
finance.budgeting.forecast
Build budgets, run scenario analysis, forecast revenue and cash flow with sensitivity inputs.
finance.investing.analysis
Analyse public equities, ETFs, real estate; build watchlists; backtest strategies.
finance.bookkeeping.ledger
Record transactions, reconcile bank feeds, manage chart of accounts — QuickBooks, Xero, NetSuite.
finance.tax.compliance
Compute tax liability, file VAT/sales tax/withholding, generate tax reports across jurisdictions.
ml
ml.eval.benchmark
Run evals on language/vision models — accuracy, bias, latency, cost — using LangSmith, OpenAI Evals, custom rubrics.
ml.inference.serve
Serve ML model predictions over HTTP/gRPC with batching, autoscaling, and GPU acceleration.
ml.dataset.curation
Build, clean, label, and version training datasets; deduplicate; balance class distributions.
ml.training.finetune
Fine-tune language or vision models on custom datasets; manage runs, hyperparameters, and checkpoints.
media
media.image.generation
Generate images from prompts via Stable Diffusion, DALL-E, Imagen, Flux; edit, inpaint, upscale.
media.audio.tts
Synthesise speech with voice cloning — ElevenLabs, Play.ht, Azure, OpenAI TTS.
media.video.generation
Generate or edit video — Runway, Sora, Pika, Veo; clip splicing, captions, b-roll synthesis.
media.design.figma
Read, modify, and generate Figma frames; export assets; sync design tokens.
browser
browser.session.persistent
Maintain authenticated browser sessions across calls — cookies, local storage, MFA — for operating on logged-in apps.
browser.automation.test
Drive browsers (Playwright, Puppeteer, Selenium) for testing, scraping, or task automation against real web apps.
education
education.curriculum.design
Design lesson plans, learning objectives, assessments aligned to standards (CCSS, IB, A-level).
education.tutoring.adaptive
One-on-one tutoring with adaptive difficulty, error analysis, and progress tracking across subjects.
iot
iot.sensor.read
Read sensor telemetry and actuate devices over MQTT, Matter, Zigbee, HomeKit, AWS IoT.
iot.smart_home.routine
Compose multi-device routines — lights, locks, climate, media — across Home Assistant, SmartThings, Alexa.
operations
operations.empathy.b2b
Sense and respond to customer signals, anomalies, churn risk, and operational friction across B2B SaaS workflows.
operations.customer_support.tier1
Handle inbound inquiries for a small business: FAQ answering, appointment booking, intake routing, after-hours coverage.
operations.advertising.media_buying
Manage ad campaigns, bidding strategies, audience targeting, creative optimization across Google Ads, Meta, and other ad platforms.
personal
personal.spa.massage
Spa treatment booking, modality selection (deep tissue, prenatal, etc.), package upsell, intake form pre-collection.
personal.salon.haircut_booking
Book hair appointments, surface stylists' specialties and availability, manage cuts/colors/treatments, deposit and cancellation rules.
personal.tattoo.consult
Match clients to tattoo artists by style, schedule consultations, manage deposits and design briefs.
personal.barber.appointments
Walk-in queue status and appointment booking for barbershops, with barber preference and service-time estimates.
personal.nails.salon
Book manicure/pedicure/nail art services with service-duration awareness, technician preference, and add-on selection.
verticals
verticals.travel.flights
Search and book flights across global carriers and OTAs with multi-city and flexible-date options.
verticals.real_estate.listings
Search property listings (Zillow, Funda, Rightmove, Idealista) with filters, mortgage estimates, comparable sales.
verticals.public_data.government
Access public-sector datasets — census, judiciary, parliament, statistics offices, transit — across countries.
verticals.travel.lodging
Search and book hotels, vacation rentals, and short-term stays across providers.
food
food.grocery.local
Surface a corner grocery / neighborhood market's current inventory, build pickup orders, answer stock questions, weekly specials.
food.cafe.orders
Handle coffee, pastry, and light-meal orders for cafés and bakeries: customizations, loyalty rewards, and pre-orders for pickup.
food.catering.events
Build catering menus for parties, weddings, corporate events; produce quotes, manage dietary restrictions and headcounts.
food.delivery.takeout
Accept takeout/delivery orders, dispatch couriers, track ETAs, handle special requests across restaurants and ghost-kitchens.
food.pizzeria.ordering
Take pizza and Italian-cuisine orders, customize toppings, calculate prices, schedule pickup or delivery, and answer menu questions for pizz…
health
health.dentist.scheduling
Schedule cleanings, exams, urgent appointments at a dental practice; surface insurance acceptance and new-patient flow.
health.dietitian.coaching
Intake and goal-setting for nutrition coaching, meal-plan options, recurring check-in scheduling, insurance/reimbursement guidance.
health.mentalhealth.intake
Match clients to therapists by modality/insurance/availability, conduct intake, schedule first session for solo or group practices.
health.physio.appointments
Triage symptoms, schedule physiotherapy/PT appointments, pre-collect injury history, manage referrals.
health.veterinary.appointments
Book vet visits, vaccinations, surgeries; surface pet records, urgent triage, and clinic-specific protocols.
home
home.hvac.service
HVAC maintenance plans, urgent service calls, seasonal tune-ups, system replacement quotes.
home.electrician.dispatch
Electrical-service intake, quote ranges by job type, scheduled site visits, panel/wiring/installation work.
home.moving.dispatch
Moving company quotes by inventory and distance, schedule the move, packing add-ons, insurance options.
home.cleaning.recurring
One-time and recurring home/office cleaning bookings, customization (deep clean, move-in/out), team dispatch.
home.lawn.landscaping
Lawn mowing, landscaping design, seasonal cleanups, snow removal scheduling for residential properties.
home.plumber.dispatch
Emergency plumber dispatch, rough-estimate quotes by problem type, scheduled service for renovations.
hospitality
hospitality.hotel.reservations
Manage hotel booking inquiries, availability checks, rate quotes, room selection, and confirmation across direct and indirect channels.
hospitality.golf.tee_times
Manage tee time bookings, golf shop sales, lesson scheduling, and player inquiries at golf resorts and clubs.
hospitality.fnb.restaurant
Restaurant reservations, menu inquiries, dietary accommodations, room service, and food and beverage operations.
hospitality.events.planning
Plan, coordinate, and execute corporate meetings, social events, conferences within a venue, handling logistics and client requirements.
events
events.dj.bookings
Book DJs or live performers for events, song-list intake, equipment requirements, set-time scheduling.
events.photographer.bookings
Wedding/portrait/event photographer booking, package selection, location scouting, recurring shoot scheduling.
events.venue.rental
Surface venue availability, capacity and amenities, schedule tours and walk-throughs, manage holds and contracts.
retail
retail.optical.eyewear
Eyewear selection, frame style guidance, lens options, prescription handling, and appointment booking for optical shops.
retail.florist.bouquets
Take bouquet/arrangement orders for occasions, delivery scheduling, sympathy/wedding/birthday options, same-day cutoff awareness.
retail.boutique.catalog
Surface a small boutique's clothing/lifestyle catalog, size and fit guidance, in-store availability, hold-for-pickup.
retail.hardware.parts
Identify the right part or tool for a DIY problem, check stock at the local hardware store, give basic how-to guidance.
retail.bookstore.recommendations
Help shoppers find books at a specific independent bookstore, check stock, place holds, surface staff picks and events.
auto
auto.mechanic.repair
Take repair-shop intake by symptom/vehicle, produce rough quotes, schedule diagnostics or service appointments.
auto.carwash.appointments
Wash/detail package selection, scheduling, mobile-detailing dispatch, recurring subscription handling.
auto.tire.installation
Tire selection by vehicle, installation appointment, seasonal storage, and alignment add-on.
fitness
fitness.gym.memberships
Membership signup, class schedule, drop-in passes, trial-pass conversion for local gyms and studios.
fitness.yoga.studio
Class booking, package/credit management, instructor preferences, waitlist handling for yoga and Pilates studios.
fitness.personal_trainer.sessions
Schedule one-on-one or small-group personal training, manage packages, intake fitness goals and limitations.
pet
pet.dogwalker.dispatch
On-demand and scheduled dog walking, recurring walks, key-handoff coordination, photo updates.
pet.boarding.kennel
Book overnight boarding or doggy daycare, surface availability and special-needs accommodations.
pet.groomer.appointments
Schedule pet grooming by breed/size/coat type, pre-collect vaccination records, manage recurring grooming schedules.
agent_skills
agent_skills.identity
Topological identity verification, Sybil-check, zero-trust attestation, and UCAN-style delegation validation
agent_skills.cite_article
Return formatted citation strings (AMA, APA, Chicago) for an article slug. Useful when an agent needs a verifiable source line.
agent_skills.get_article
Fetch a single article by slug — full intro, body, FAQ, references, embedded reviewers + authors with credentials, and pre-formatted citatio…
agent_skills.get_crisis_resources
Returns the canonical crisis-resource payload (911, 988 Suicide & Crisis Lifeline, Crisis Text Line). Call any time the user mentions self-h…
agent_skills.get_microsite_info
Identity, audience, focus, sponsor relationship, crisis routing, and links for Psychiatry for Children. Always safe to call when the agent n…
agent_skills.list_articles
Paginated list of all native articles on this microsite (clinician-reviewed). Returns lightweight summaries — call get_article for full body…
agent_skills.search_articles
Full-text search of clinician-reviewed pediatric psychiatry articles published on Psychiatry for Children, ranked by relevance. Use to find …
agent_skills.search
Google search results as structured JSON. Returns titles, URLs, snippets, and metadata.
agent_skills.payments
Request and verify on-chain payments using the x402 micropayment protocol.
hf_tasks
hf_tasks.any_to_any
Any-to-any models can understand two or more modalities and output two or more modalities.
hf_tasks.audio_classification
Audio classification is the task of assigning a label or class to a given audio. It can be used for recognizing which command a user is givi…
hf_tasks.audio_text_to_text
Audio-text-to-text models take both an audio clip and a text prompt as input, and generate natural language text as output. These models can…
hf_tasks.audio_to_audio
Audio-to-Audio is a family of tasks in which the input is an audio and the output is one or multiple generated audios. Some example tasks ar…
hf_tasks.automatic_speech_recognition
Automatic Speech Recognition (ASR), also known as Speech to Text (STT), is the task of transcribing a given audio to text. It has many appli…
hf_tasks.depth_estimation
Depth estimation is the task of predicting depth of the objects present in an image.
hf_tasks.document_question_answering
Document Question Answering (also known as Document Visual Question Answering) is the task of answering questions on document images. Docume…
hf_tasks.feature_extraction
Feature extraction is the task of extracting features learnt in a model.
hf_tasks.fill_mask
Masked language modeling is the task of masking some of the words in a sentence and predicting which words should replace those masks. These…
hf_tasks.image_classification
Image classification is the task of assigning a label or class to an entire image. Images are expected to have only one class for each image…
hf_tasks.image_feature_extraction
Image feature extraction is the task of extracting features learnt in a computer vision model.
hf_tasks.image_segmentation
Image Segmentation divides an image into segments where each pixel in the image is mapped to an object. This task has multiple variants such…
hf_tasks.image_text_to_image
Image-text-to-image models take an image and a text prompt as input and generate a new image based on the reference image and text instructi…
hf_tasks.image_text_to_text
Image-text-to-text models take in an image and text prompt and output text. These models are also called vision-language models, or VLMs. Th…
hf_tasks.image_text_to_video
Image-text-to-video models take an reference image and a text instructions as and generate a video based on them. These models are useful fo…
hf_tasks.image_to_3d
Image-to-3D models take in image input and produce 3D output.
hf_tasks.image_to_image
Image-to-image is the task of transforming an input image through a variety of possible manipulations and enhancements, such as super-resolu…
hf_tasks.image_to_text
Image to text models output a text from a given image. Image captioning or optical character recognition can be considered as the most commo…
hf_tasks.image_to_video
Image-to-video models take a still image as input and generate a video. These models can be guided by text prompts to influence the content …
hf_tasks.keypoint_detection
Keypoint detection is the task of identifying meaningful distinctive points or features in an image.
hf_tasks.mask_generation
Mask generation is the task of generating masks that identify a specific object or region of interest in a given image. Masks are often used…
hf_tasks.object_detection
Object Detection models allow users to identify objects of certain defined classes. Object detection models receive an image as input and ou…
hf_tasks.question_answering
Question Answering models can retrieve the answer to a question from a given text, which is useful for searching for an answer in a document…
hf_tasks.reinforcement_learning
Reinforcement learning is the computational approach of learning from action by interacting with an environment through trial and error and …
hf_tasks.sentence_similarity
Sentence Similarity is the task of determining how similar two texts are. Sentence similarity models convert input texts into vectors (embed…
hf_tasks.summarization
Summarization is the task of producing a shorter version of a document while preserving its important information. Some models can extract t…
hf_tasks.table_question_answering
Table Question Answering (Table QA) is the answering a question about an information on a given table.
hf_tasks.tabular_classification
Tabular classification is the task of classifying a target category (a group) based on set of attributes.
hf_tasks.tabular_regression
Tabular regression is the task of predicting a numerical value given a set of attributes.
hf_tasks.text_classification
Text Classification is the task of assigning a label or class to a given text. Some use cases are sentiment analysis, natural language infer…
hf_tasks.text_generation
Generating text is the task of generating new text given another text. These models can, for example, fill in incomplete text or paraphrase.
hf_tasks.text_ranking
Text Ranking is the task of ranking a set of texts based on their relevance to a query. Text ranking models are trained on large datasets of…
hf_tasks.text_to_3d
Text-to-3D models take in text input and produce 3D output.
hf_tasks.text_to_image
Text-to-image is the task of generating images from input text. These pipelines can also be used to modify and edit images based on text pro…
hf_tasks.text_to_speech
Text-to-Speech (TTS) is the task of generating natural sounding speech given text input. TTS models can be extended to have a single model t…
hf_tasks.text_to_video
Text-to-video models can be used in any application that requires generating consistent sequence of images from text.
hf_tasks.token_classification
Token classification is a natural language understanding task in which a label is assigned to some tokens in a text. Some popular token clas…
hf_tasks.translation
Translation is the task of converting text from one language to another.
hf_tasks.unconditional_image_generation
Unconditional image generation is the task of generating images with no condition in any context (like a prompt text or another image). Once…
hf_tasks.video_classification
Video classification is the task of assigning a label or class to an entire video. Videos are expected to have only one class for each video…
hf_tasks.video_text_to_text
Video-text-to-text models take in a video and a text prompt and output text. These models are also called video-language models.
hf_tasks.video_to_video
Video-to-video models take one or more videos as input and generate new videos as output. They can enhance quality, interpolate frames, modi…
hf_tasks.visual_document_retrieval
Visual document retrieval is the task of searching for relevant image-based documents, such as PDFs. These models take a text query and mult…
hf_tasks.visual_question_answering
Visual Question Answering is the task of answering open-ended questions based on an image. They output natural language responses to natural…
hf_tasks.zero_shot_classification
Zero-shot text classification is a task in natural language processing where a model is trained on a set of labeled examples but is then abl…
hf_tasks.zero_shot_image_classification
Zero-shot image classification is the task of classifying previously unseen classes during training of a model.
hf_tasks.zero_shot_object_detection
Zero-shot object detection is a computer vision task to detect objects and their classes in images, without any prior training or knowledge …
oasf
oasf.advanced_reasoning_planning.advanced_reasoning_planning
oasf.agent_orchestration.agent_coordination
Managing real-time collaboration and state synchronization among agents.
oasf.agent_orchestration.agent_orchestration
oasf.analytical_skills.analytical_skills
oasf.base_skill.annotations
Additional metadata associated with the skill.
oasf.evaluation_monitoring.anomaly_detection
Identifying unusual patterns, drifts, or deviations in data or model outputs.
oasf.multi_modal.any_to_any
Converting between any supported modalities (text, image, audio, video, or 3D).
oasf.tool_interaction.api_schema_understanding
Interpreting and explaining API specifications, endpoints, parameters, and expected payloads.
oasf.audio.audio
oasf.audio.audio_classification
Assigning labels or classes to audio content based on its characteristics.
oasf.audio.audio_to_audio
Transforming audio through various manipulations including cutting, filtering, and mixing.
oasf.governance_compliance.audit_trail_summarization
Condensing system event or transaction logs into human-readable compliance or oversight summaries.
oasf.base_skill
The base skill is a generic skill defining a set of attributes for skill classes; not meant to be used as an actual skill.
oasf.evaluation_monitoring.benchmark_execution
Running standardized benchmarks or evaluation suites and summarizing results.
oasf.advanced_reasoning_planning.chain_of_thought_structuring
Organizing intermediate reasoning steps into clear, justifiable sequences.
oasf.devops_mlops.ci_cd_configuration
Designing or modifying continuous integration and delivery workflows and pipelines.
oasf.governance_compliance.compliance_assessment
Evaluating processes or outputs against defined standards (e.g., GDPR, HIPAA) and identifying gaps.
oasf.data_engineering.data_cleaning
Detecting and correcting errors, inconsistencies, and missing values to improve dataset quality.
oasf.data_engineering.data_engineering
oasf.data_engineering.data_quality_assessment
Evaluating datasets for completeness, validity, consistency, and timeliness.
oasf.data_engineering.data_transformation_pipeline
Designing or explaining multi-step sequences that extract, transform, and load datasets.
oasf.devops_mlops.deployment_orchestration
Coordinating multi-stage application or model deployments, rollbacks, and version transitions.
oasf.images_computer_vision.depth_estimation
Predicting the distance or depth of objects within a scene from a single image or multiple images.
oasf.devops_mlops.devops_mlops
oasf.retrieval_augmented_generation.document_or_database_question_answering
Document or database question answering is the process of retrieving and using information from a document or database to answer a specific …
oasf.evaluation_monitoring.evaluation_monitoring
oasf.data_engineering.feature_engineering
Constructing informative transformed variables to improve downstream model performance.
oasf.retrieval_augmented_generation.generation_of_any
Generation of any is augmenting the creation of text, images, audio, or other media by incorporating retrieved information to improve or gui…
oasf.governance_compliance.governance_compliance
oasf.advanced_reasoning_planning.hypothesis_generation
Proposing plausible explanations or solution pathways for incomplete or uncertain scenarios.
oasf.base_skill.id
The id as a unique identifier of the skill.
oasf.images_computer_vision.image_classification
Assigning labels or categories to images based on their visual content.
oasf.images_computer_vision.image_feature_extraction
Identifying and isolating key characteristics or patterns from an image to aid in tasks like classification or recognition.
oasf.images_computer_vision.image_generation
Creating new images from learned patterns or data using machine learning models.
oasf.images_computer_vision.image_segmentation
Assigning labels or categories to images based on their visual content.
oasf.images_computer_vision.image_to_3d
The process of converting a 2D image into a 3D representation or model, often by inferring depth and spatial relationships.
oasf.images_computer_vision.image_to_image
Transforming one image into another using a learned mapping, often for tasks like style transfer, colorization, or image enhancement.
oasf.images_computer_vision.images_computer_vision
oasf.devops_mlops.infrastructure_provisioning
Defining or explaining steps to allocate and configure compute, storage, and networking resources.
oasf.images_computer_vision.keypoint_detection
Identifying and locating specific points of interest within an image or object.
oasf.advanced_reasoning_planning.long_horizon_reasoning
Maintaining coherent reasoning chains over extended sequences of steps or time.
oasf.images_computer_vision.mask_generation
Producing segmented regions in an image to highlight specific areas or objects, typically represented as separate layers or overlays.
oasf.devops_mlops.model_versioning
Tracking, promoting, and documenting different iterations of models and their artifacts.
oasf.devops_mlops.monitoring_alerting
Configuring and interpreting telemetry signals, thresholds, and alerts for operational health.
oasf.agent_orchestration.multi_agent_planning
Coordinating plans across multiple agents, resolving dependencies and optimizing sequencing.
oasf.multi_modal.multi_modal
Capabilities for transforming content between different modalities (text, image, audio, video, or 3D).
oasf.base_skill.name
The name as a unique identifier of the skill.
oasf.natural_language_processing.natural_language_processing
oasf.agent_orchestration.negotiation_resolution
Facilitating negotiation, conflict handling, and consensus-building between agents.
oasf.images_computer_vision.object_detection
Identifying and locating specific objects within an image or video, often by drawing bounding boxes around them.
oasf.evaluation_monitoring.performance_monitoring
Tracking latency, throughput, resource utilization, and service reliability over time.
oasf.governance_compliance.policy_mapping
Translating organizational or regulatory policies into structured, enforceable rules or checklists.
oasf.security_privacy.privacy_risk_assessment
Evaluating data handling or user flows to surface potential privacy risks and recommend mitigations.
oasf.evaluation_monitoring.quality_evaluation
Assessing outputs for accuracy, relevance, coherence, safety, and style adherence.
oasf.retrieval_augmented_generation.retrieval_augmented_generation
oasf.governance_compliance.risk_classification
Categorizing potential operational or data-related risks by impact and likelihood for prioritization.
oasf.agent_orchestration.role_assignment
Allocating responsibilities to agents based on capabilities and task requirements.
oasf.data_engineering.schema_inference
Deriving structural metadata (fields, types, relationships) from raw or semi-structured data.
oasf.tool_interaction.script_integration
Linking custom scripts or functions with external tools to extend capabilities.
oasf.security_privacy.secret_leak_detection
Scanning artifacts (code, logs, documents) to identify exposed credentials, tokens, or other sensitive secrets.
oasf.security_privacy.security_privacy
oasf.advanced_reasoning_planning.strategic_planning
Formulating high-level multi-phase strategies aligned with long-term objectives.
oasf.tabular_text.tabular_classification
Classifying data based on attributes using classical machine learning approaches.
oasf.tabular_text.tabular_regression
Predicting numerical values based on tabular attributes and features.
oasf.tabular_text.tabular_text
oasf.agent_orchestration.task_decomposition
Breaking complex objectives into structured, atomic subtasks.
oasf.evaluation_monitoring.test_case_generation
Creating targeted test inputs or scenarios to probe system behavior and edge cases.
oasf.security_privacy.threat_detection
Identifying indicators of malicious activity, suspicious patterns, or emerging threats across logs and data sources.
oasf.tool_interaction.tool_interaction
oasf.tool_interaction.tool_use_planning
Selecting and ordering tool invocations to accomplish a specified goal efficiently.
oasf.images_computer_vision.video_classification
Assigning labels or categories to entire videos or segments based on their visual and audio content.
oasf.security_privacy.vulnerability_analysis
Reviewing code, configurations, or dependency manifests to surface potential security weaknesses and misconfigurations.
oasf.tool_interaction.workflow_automation
Designing or describing automated sequences integrating multiple tools or services.
schema_org
schema_org.acceptaction
The act of committing to/adopting an object.\n\nRelated actions:\n\n* [[RejectAction]]: The antonym of AcceptAction.
schema_org.achieveaction
The act of accomplishing something via previous efforts. It is an instantaneous action rather than an ongoing process.
schema_org.activateaction
The act of starting or activating a device or application (e.g. starting a timer or turning on a flashlight).
schema_org.addaction
The act of editing by adding an object to a collection.
schema_org.agreeaction
The act of expressing a consistency of opinion with the object. An agent agrees to/about an object (a proposition, topic or theme) with part…
schema_org.allocateaction
The act of organizing tasks/objects/events by associating resources to it.
schema_org.appendaction
The act of inserting at the end if an ordered collection.
schema_org.applyaction
The act of registering to an organization/service without the guarantee to receive it.\n\nRelated actions:\n\n* [[RegisterAction]]: Unlike R…
schema_org.arriveaction
The act of arriving at a place. An agent arrives at a destination from a fromLocation, optionally with participants.
schema_org.askaction
The act of posing a question / favor to someone.\n\nRelated actions:\n\n* [[ReplyAction]]: Appears generally as a response to AskAction.
schema_org.assessaction
The act of forming one's opinion, reaction or sentiment.
schema_org.assignaction
The act of allocating an action/event/task to some destination (someone or something).
schema_org.authenticateaction
The action of authenticating into a device or application.
schema_org.authorizeaction
The act of granting permission to an object.
schema_org.befriendaction
The act of forming a personal connection with someone (object) mutually/bidirectionally/symmetrically.\n\nRelated actions:\n\n* [[FollowActi…
schema_org.bookmarkaction
An agent bookmarks/flags/labels/tags/marks an object.
schema_org.borrowaction
The act of obtaining an object under an agreement to return it at a later date. Reciprocal of LendAction.\n\nRelated actions:\n\n* [[LendAct…
schema_org.buyaction
The act of giving money to a seller in exchange for goods or services rendered. An agent buys an object, product, or service from a seller f…
schema_org.cancelaction
The act of asserting that a future event/action is no longer going to happen.\n\nRelated actions:\n\n* [[ConfirmAction]]: The antonym of Can…
schema_org.checkaction
An agent inspects, determines, investigates, inquires, or examines an object's accuracy, quality, condition, or state.
schema_org.checkinaction
The act of an agent communicating (service provider, social media, etc) their arrival by registering/confirming for a previously reserved se…
schema_org.checkoutaction
The act of an agent communicating (service provider, social media, etc) their departure of a previously reserved service (e.g. flight check-…
schema_org.chooseaction
The act of expressing a preference from a set of options or a large or unbounded set of choices/options.
schema_org.commentaction
The act of generating a comment about a subject.
schema_org.communicateaction
The act of conveying information to another person via a communication medium (instrument) such as speech, email, or telephone conversation.
schema_org.confirmaction
The act of notifying someone that a future event/action is going to happen as expected.\n\nRelated actions:\n\n* [[CancelAction]]: The anton…
schema_org.consumeaction
The act of ingesting information/resources/food.
schema_org.controlaction
An agent controls a device or application.
schema_org.cookaction
The act of producing/preparing food.
schema_org.createaction
The act of deliberately creating/producing/generating/building a result out of the agent.
schema_org.deactivateaction
The act of stopping or deactivating a device or application (e.g. stopping a timer or turning off a flashlight).
schema_org.deleteaction
The act of editing a recipient by removing one of its objects.
schema_org.departaction
The act of departing from a place. An agent departs from a fromLocation for a destination, optionally with participants.
schema_org.disagreeaction
The act of expressing a difference of opinion with the object. An agent disagrees to/about an object (a proposition, topic or theme) with pa…
schema_org.discoveraction
The act of discovering/finding an object.
schema_org.dislikeaction
The act of expressing a negative sentiment about the object. An agent dislikes an object (a proposition, topic or theme) with participants.
schema_org.donateaction
The act of providing goods, services, or money without compensation, often for philanthropic reasons.
schema_org.downloadaction
The act of downloading an object.
schema_org.drawaction
The act of producing a visual/graphical representation of an object, typically with a pen/pencil and paper as instruments.
schema_org.drinkaction
The act of swallowing liquids.
schema_org.eataction
The act of swallowing solid objects.
schema_org.endorseaction
An agent approves/certifies/likes/supports/sanctions an object.
schema_org.exerciseaction
The act of participating in exertive activity for the purposes of improving health and fitness.
schema_org.filmaction
The act of capturing sound and moving images on film, video, or digitally.
schema_org.findaction
The act of finding an object.\n\nRelated actions:\n\n* [[SearchAction]]: FindAction is generally lead by a SearchAction, but not necessarily…
schema_org.followaction
The act of forming a personal connection with someone/something (object) unidirectionally/asymmetrically to get updates polled from.\n\nRela…
schema_org.giveaction
The act of transferring ownership of an object to a destination. Reciprocal of TakeAction.\n\nRelated actions:\n\n* [[TakeAction]]: Reciproc…
schema_org.ignoreaction
The act of intentionally disregarding the object. An agent ignores an object.
schema_org.informaction
The act of notifying someone of information pertinent to them, with no expectation of a response.
schema_org.insertaction
The act of adding at a specific location in an ordered collection.
schema_org.installaction
The act of installing an application.
schema_org.interactaction
The act of interacting with another person or organization.
schema_org.inviteaction
The act of asking someone to attend an event. Reciprocal of RsvpAction.
schema_org.joinaction
An agent joins an event/group with participants/friends at a location.\n\nRelated actions:\n\n* [[RegisterAction]]: Unlike RegisterAction, J…
schema_org.leaveaction
An agent leaves an event / group with participants/friends at a location.\n\nRelated actions:\n\n* [[JoinAction]]: The antonym of LeaveActio…
schema_org.lendaction
The act of providing an object under an agreement that it will be returned at a later date. Reciprocal of BorrowAction.\n\nRelated actions:\…
schema_org.likeaction
The act of expressing a positive sentiment about the object. An agent likes an object (a proposition, topic or theme) with participants.
schema_org.listenaction
The act of consuming audio content.
schema_org.loginaction
The action of logging into a device or application.
schema_org.loseaction
The act of being defeated in a competitive activity.
schema_org.marryaction
The act of marrying a person.
schema_org.moneytransfer
The act of transferring money from one place to another place. This may occur electronically or physically.
schema_org.moveaction
The act of an agent relocating to a place.\n\nRelated actions:\n\n* [[TransferAction]]: Unlike TransferAction, the subject of the move is a …
schema_org.orderaction
An agent orders an object/product/service to be delivered/sent.
schema_org.organizeaction
The act of manipulating/administering/supervising/controlling one or more objects.
schema_org.paintaction
The act of producing a painting, typically with paint and canvas as instruments.
schema_org.payaction
An agent pays a price to a participant.
schema_org.performaction
The act of participating in performance arts.
schema_org.photographaction
The act of capturing still images of objects using a camera.
schema_org.planaction
The act of planning the execution of an event/task/action/reservation/plan to a future date.
schema_org.playaction
The act of playing/exercising/training/performing for enjoyment, leisure, recreation, competition or exercise.\n\nRelated actions:\n\n* [[Li…
schema_org.playgameaction
The act of playing a video game.
schema_org.preorderaction
An agent orders a (not yet released) object/product/service to be delivered/sent.
schema_org.prependaction
The act of inserting at the beginning if an ordered collection.
schema_org.quoteaction
An agent quotes/estimates/appraises an object/product/service with a price at a location/store.
schema_org.reactaction
The act of responding instinctively and emotionally to an object, expressing a sentiment.
schema_org.readaction
The act of consuming written content.
schema_org.receiveaction
The act of physically/electronically taking delivery of an object that has been transferred from an origin to a destination. Reciprocal of S…
schema_org.registeraction
The act of registering to be a user of a service, product or web page.\n\nRelated actions:\n\n* [[JoinAction]]: Unlike JoinAction, RegisterA…
schema_org.rejectaction
The act of rejecting to/adopting an object.\n\nRelated actions:\n\n* [[AcceptAction]]: The antonym of RejectAction.
schema_org.rentaction
The act of giving money in return for temporary use, but not ownership, of an object such as a vehicle or property. For example, an agent re…
schema_org.replaceaction
The act of editing a recipient by replacing an old object with a new object.
schema_org.replyaction
The act of responding to a question/message asked/sent by the object. Related to [[AskAction]].\n\nRelated actions:\n\n* [[AskAction]]: Appe…
schema_org.reserveaction
Reserving a concrete object.\n\nRelated actions:\n\n* [[ScheduleAction]]: Unlike ScheduleAction, ReserveAction reserves concrete objects (e.…
schema_org.resetpasswordaction
The action of resetting the password of a device or application.
schema_org.resumeaction
The act of resuming a device or application which was formerly paused (e.g. resume music playback or resume a timer).
schema_org.returnaction
The act of returning to the origin that which was previously received (concrete objects) or taken (ownership).
schema_org.reviewaction
The act of producing a balanced opinion about the object for an audience. An agent reviews an object with participants resulting in a review…
schema_org.rsvpaction
The act of notifying an event organizer as to whether you expect to attend the event.
schema_org.scheduleaction
Scheduling future actions, events, or tasks.\n\nRelated actions:\n\n* [[ReserveAction]]: Unlike ReserveAction, ScheduleAction allocates futu…
schema_org.searchaction
The act of searching for an object.\n\nRelated actions:\n\n* [[FindAction]]: SearchAction generally leads to a FindAction, but not necessari…
schema_org.seektoaction
This is the [[Action]] of navigating to a specific [[startOffset]] timestamp within a [[VideoObject]], typically represented with a URL temp…
schema_org.sellaction
The act of taking money from a buyer in exchange for goods or services rendered. An agent sells an object, product, or service to a buyer fo…
schema_org.sendaction
The act of physically/electronically dispatching an object for transfer from an origin to a destination. Related actions:\n\n* [[ReceiveActi…
schema_org.shareaction
The act of distributing content to people for their amusement or edification.
schema_org.solvemathaction
The action that takes in a math expression and directs users to a page potentially capable of solving/simplifying that expression.
schema_org.subscribeaction
The act of forming a personal connection with someone/something (object) unidirectionally/asymmetrically to get updates pushed to.\n\nRelate…
schema_org.suspendaction
The act of momentarily pausing a device or application (e.g. pause music playback or pause a timer).
schema_org.takeaction
The act of gaining ownership of an object from an origin. Reciprocal of GiveAction.\n\nRelated actions:\n\n* [[GiveAction]]: The reciprocal …
schema_org.tieaction
The act of reaching a draw in a competitive activity.
schema_org.tipaction
The act of giving money voluntarily to a beneficiary in recognition of services rendered.
schema_org.trackaction
An agent tracks an object for updates.\n\nRelated actions:\n\n* [[FollowAction]]: Unlike FollowAction, TrackAction refers to the interest on…
schema_org.tradeaction
The act of participating in an exchange of goods and services for monetary compensation. An agent trades an object, product or service with …
schema_org.transferaction
The act of transferring/moving (abstract or concrete) animate or inanimate objects from one place to another.
schema_org.travelaction
The act of traveling from a fromLocation to a destination by a specified mode of transport, optionally with participants.
schema_org.unregisteraction
The act of un-registering from a service.\n\nRelated actions:\n\n* [[RegisterAction]]: antonym of UnRegisterAction.\n* [[LeaveAction]]: Unli…
schema_org.updateaction
The act of managing by changing/editing the state of the object.
schema_org.useaction
The act of applying an object to its intended purpose.
schema_org.viewaction
The act of consuming static visual content.
schema_org.voteaction
The act of expressing a preference from a fixed/finite/structured set of choices/options.
schema_org.wantaction
The act of expressing a desire about the object. An agent wants an object.
schema_org.watchaction
The act of consuming dynamic/moving visual content.
schema_org.wearaction
The act of dressing oneself in clothing.
schema_org.winaction
The act of achieving victory in a competitive activity.
schema_org.writeaction
The act of authoring written creative content.