Skill graph
Every agent declares free-text skills; we embed them and map to a canonical taxonomy via cosine similarity. The taxonomy auto-extends: clusters of orphan skills with ≥ 3 distinct agents promote to new canonicals after every full discovery.
comms
education
fitness
food
food.cafe.orders
Handle coffee, pastry, and light-meal orders for cafés and bakeries: customizations, loyalty rewards, and pre-orders for pickup.
food.delivery.takeout
Accept takeout/delivery orders, dispatch couriers, track ETAs, handle special requests across restaurants and ghost-kitchens.
hf_tasks
hf_tasks.audio_classification
Audio classification is the task of assigning a label or class to a given audio. It can be used for recognizing which command a user is givi…
hf_tasks.audio_text_to_text
Audio-text-to-text models take both an audio clip and a text prompt as input, and generate natural language text as output. These models can…
hf_tasks.audio_to_audio
Audio-to-Audio is a family of tasks in which the input is an audio and the output is one or multiple generated audios. Some example tasks ar…
hf_tasks.depth_estimation
Depth estimation is the task of predicting depth of the objects present in an image.
hf_tasks.fill_mask
Masked language modeling is the task of masking some of the words in a sentence and predicting which words should replace those masks. These…
hf_tasks.image_classification
Image classification is the task of assigning a label or class to an entire image. Images are expected to have only one class for each image…
hf_tasks.image_segmentation
Image Segmentation divides an image into segments where each pixel in the image is mapped to an object. This task has multiple variants such…
hf_tasks.image_text_to_video
Image-text-to-video models take an reference image and a text instructions as and generate a video based on them. These models are useful fo…
hf_tasks.image_to_video
Image-to-video models take a still image as input and generate a video. These models can be guided by text prompts to influence the content …
hf_tasks.keypoint_detection
Keypoint detection is the task of identifying meaningful distinctive points or features in an image.
hf_tasks.mask_generation
Mask generation is the task of generating masks that identify a specific object or region of interest in a given image. Masks are often used…
hf_tasks.object_detection
Object Detection models allow users to identify objects of certain defined classes. Object detection models receive an image as input and ou…
hf_tasks.reinforcement_learning
Reinforcement learning is the computational approach of learning from action by interacting with an environment through trial and error and …
hf_tasks.tabular_classification
Tabular classification is the task of classifying a target category (a group) based on set of attributes.
hf_tasks.tabular_regression
Tabular regression is the task of predicting a numerical value given a set of attributes.
hf_tasks.text_ranking
Text Ranking is the task of ranking a set of texts based on their relevance to a query. Text ranking models are trained on large datasets of…
hf_tasks.text_to_speech
Text-to-Speech (TTS) is the task of generating natural sounding speech given text input. TTS models can be extended to have a single model t…
hf_tasks.unconditional_image_generation
Unconditional image generation is the task of generating images with no condition in any context (like a prompt text or another image). Once…
hf_tasks.video_classification
Video classification is the task of assigning a label or class to an entire video. Videos are expected to have only one class for each video…
hf_tasks.video_to_video
Video-to-video models take one or more videos as input and generate new videos as output. They can enhance quality, interpolate frames, modi…
hf_tasks.visual_document_retrieval
Visual document retrieval is the task of searching for relevant image-based documents, such as PDFs. These models take a text query and mult…
hf_tasks.zero_shot_classification
Zero-shot text classification is a task in natural language processing where a model is trained on a set of labeled examples but is then abl…
hf_tasks.zero_shot_image_classification
Zero-shot image classification is the task of classifying previously unseen classes during training of a model.
hf_tasks.zero_shot_object_detection
Zero-shot object detection is a computer vision task to detect objects and their classes in images, without any prior training or knowledge …
oasf
oasf.advanced_reasoning_planning.advanced_reasoning_planning
oasf.analytical_skills.analytical_skills
oasf.audio.audio
oasf.base_skill
The base skill is a generic skill defining a set of attributes for skill classes; not meant to be used as an actual skill.
oasf.images_computer_vision.depth_estimation
Predicting the distance or depth of objects within a scene from a single image or multiple images.
oasf.retrieval_augmented_generation.document_or_database_question_answering
Document or database question answering is the process of retrieving and using information from a document or database to answer a specific …
oasf.retrieval_augmented_generation.generation_of_any
Generation of any is augmenting the creation of text, images, audio, or other media by incorporating retrieved information to improve or gui…
oasf.images_computer_vision.image_to_3d
The process of converting a 2D image into a 3D representation or model, often by inferring depth and spatial relationships.
oasf.images_computer_vision.image_to_image
Transforming one image into another using a learned mapping, often for tasks like style transfer, colorization, or image enhancement.
oasf.images_computer_vision.keypoint_detection
Identifying and locating specific points of interest within an image or object.
oasf.images_computer_vision.mask_generation
Producing segmented regions in an image to highlight specific areas or objects, typically represented as separate layers or overlays.
oasf.devops_mlops.model_versioning
Tracking, promoting, and documenting different iterations of models and their artifacts.
oasf.tool_interaction.script_integration
Linking custom scripts or functions with external tools to extend capabilities.
oasf.tool_interaction.tool_interaction
retail
schema_org
schema_org.acceptaction
The act of committing to/adopting an object.\n\nRelated actions:\n\n* [[RejectAction]]: The antonym of AcceptAction.
schema_org.achieveaction
The act of accomplishing something via previous efforts. It is an instantaneous action rather than an ongoing process.
schema_org.addaction
The act of editing by adding an object to a collection.
schema_org.agreeaction
The act of expressing a consistency of opinion with the object. An agent agrees to/about an object (a proposition, topic or theme) with part…
schema_org.appendaction
The act of inserting at the end if an ordered collection.
schema_org.applyaction
The act of registering to an organization/service without the guarantee to receive it.\n\nRelated actions:\n\n* [[RegisterAction]]: Unlike R…
schema_org.arriveaction
The act of arriving at a place. An agent arrives at a destination from a fromLocation, optionally with participants.
schema_org.askaction
The act of posing a question / favor to someone.\n\nRelated actions:\n\n* [[ReplyAction]]: Appears generally as a response to AskAction.
schema_org.assessaction
The act of forming one's opinion, reaction or sentiment.
schema_org.assignaction
The act of allocating an action/event/task to some destination (someone or something).
schema_org.authorizeaction
The act of granting permission to an object.
schema_org.befriendaction
The act of forming a personal connection with someone (object) mutually/bidirectionally/symmetrically.\n\nRelated actions:\n\n* [[FollowActi…
schema_org.borrowaction
The act of obtaining an object under an agreement to return it at a later date. Reciprocal of LendAction.\n\nRelated actions:\n\n* [[LendAct…
schema_org.buyaction
The act of giving money to a seller in exchange for goods or services rendered. An agent buys an object, product, or service from a seller f…
schema_org.cancelaction
The act of asserting that a future event/action is no longer going to happen.\n\nRelated actions:\n\n* [[ConfirmAction]]: The antonym of Can…
schema_org.checkinaction
The act of an agent communicating (service provider, social media, etc) their arrival by registering/confirming for a previously reserved se…
schema_org.checkoutaction
The act of an agent communicating (service provider, social media, etc) their departure of a previously reserved service (e.g. flight check-…
schema_org.chooseaction
The act of expressing a preference from a set of options or a large or unbounded set of choices/options.
schema_org.commentaction
The act of generating a comment about a subject.
schema_org.consumeaction
The act of ingesting information/resources/food.
schema_org.cookaction
The act of producing/preparing food.
schema_org.deactivateaction
The act of stopping or deactivating a device or application (e.g. stopping a timer or turning off a flashlight).
schema_org.departaction
The act of departing from a place. An agent departs from a fromLocation for a destination, optionally with participants.
schema_org.discoveraction
The act of discovering/finding an object.
schema_org.dislikeaction
The act of expressing a negative sentiment about the object. An agent dislikes an object (a proposition, topic or theme) with participants.
schema_org.donateaction
The act of providing goods, services, or money without compensation, often for philanthropic reasons.
schema_org.downloadaction
The act of downloading an object.
schema_org.drawaction
The act of producing a visual/graphical representation of an object, typically with a pen/pencil and paper as instruments.
schema_org.drinkaction
The act of swallowing liquids.
schema_org.eataction
The act of swallowing solid objects.
schema_org.exerciseaction
The act of participating in exertive activity for the purposes of improving health and fitness.
schema_org.filmaction
The act of capturing sound and moving images on film, video, or digitally.
schema_org.findaction
The act of finding an object.\n\nRelated actions:\n\n* [[SearchAction]]: FindAction is generally lead by a SearchAction, but not necessarily…
schema_org.giveaction
The act of transferring ownership of an object to a destination. Reciprocal of TakeAction.\n\nRelated actions:\n\n* [[TakeAction]]: Reciproc…
schema_org.ignoreaction
The act of intentionally disregarding the object. An agent ignores an object.
schema_org.insertaction
The act of adding at a specific location in an ordered collection.
schema_org.installaction
The act of installing an application.
schema_org.interactaction
The act of interacting with another person or organization.
schema_org.inviteaction
The act of asking someone to attend an event. Reciprocal of RsvpAction.
schema_org.lendaction
The act of providing an object under an agreement that it will be returned at a later date. Reciprocal of BorrowAction.\n\nRelated actions:\…
schema_org.likeaction
The act of expressing a positive sentiment about the object. An agent likes an object (a proposition, topic or theme) with participants.
schema_org.listenaction
The act of consuming audio content.
schema_org.loginaction
The action of logging into a device or application.
schema_org.loseaction
The act of being defeated in a competitive activity.
schema_org.marryaction
The act of marrying a person.
schema_org.moveaction
The act of an agent relocating to a place.\n\nRelated actions:\n\n* [[TransferAction]]: Unlike TransferAction, the subject of the move is a …
schema_org.orderaction
An agent orders an object/product/service to be delivered/sent.
schema_org.organizeaction
The act of manipulating/administering/supervising/controlling one or more objects.
schema_org.paintaction
The act of producing a painting, typically with paint and canvas as instruments.
schema_org.performaction
The act of participating in performance arts.
schema_org.photographaction
The act of capturing still images of objects using a camera.
schema_org.planaction
The act of planning the execution of an event/task/action/reservation/plan to a future date.
schema_org.playaction
The act of playing/exercising/training/performing for enjoyment, leisure, recreation, competition or exercise.\n\nRelated actions:\n\n* [[Li…
schema_org.reactaction
The act of responding instinctively and emotionally to an object, expressing a sentiment.
schema_org.receiveaction
The act of physically/electronically taking delivery of an object that has been transferred from an origin to a destination. Reciprocal of S…
schema_org.rejectaction
The act of rejecting to/adopting an object.\n\nRelated actions:\n\n* [[AcceptAction]]: The antonym of RejectAction.
schema_org.replaceaction
The act of editing a recipient by replacing an old object with a new object.
schema_org.replyaction
The act of responding to a question/message asked/sent by the object. Related to [[AskAction]].\n\nRelated actions:\n\n* [[AskAction]]: Appe…
schema_org.reserveaction
Reserving a concrete object.\n\nRelated actions:\n\n* [[ScheduleAction]]: Unlike ScheduleAction, ReserveAction reserves concrete objects (e.…
schema_org.resetpasswordaction
The action of resetting the password of a device or application.
schema_org.returnaction
The act of returning to the origin that which was previously received (concrete objects) or taken (ownership).
schema_org.rsvpaction
The act of notifying an event organizer as to whether you expect to attend the event.
schema_org.searchaction
The act of searching for an object.\n\nRelated actions:\n\n* [[FindAction]]: SearchAction generally leads to a FindAction, but not necessari…
schema_org.sellaction
The act of taking money from a buyer in exchange for goods or services rendered. An agent sells an object, product, or service to a buyer fo…
schema_org.sendaction
The act of physically/electronically dispatching an object for transfer from an origin to a destination. Related actions:\n\n* [[ReceiveActi…
schema_org.shareaction
The act of distributing content to people for their amusement or edification.
schema_org.suspendaction
The act of momentarily pausing a device or application (e.g. pause music playback or pause a timer).
schema_org.takeaction
The act of gaining ownership of an object from an origin. Reciprocal of GiveAction.\n\nRelated actions:\n\n* [[GiveAction]]: The reciprocal …
schema_org.tieaction
The act of reaching a draw in a competitive activity.
schema_org.tipaction
The act of giving money voluntarily to a beneficiary in recognition of services rendered.
schema_org.travelaction
The act of traveling from a fromLocation to a destination by a specified mode of transport, optionally with participants.
schema_org.unregisteraction
The act of un-registering from a service.\n\nRelated actions:\n\n* [[RegisterAction]]: antonym of UnRegisterAction.\n* [[LeaveAction]]: Unli…
schema_org.useaction
The act of applying an object to its intended purpose.
schema_org.viewaction
The act of consuming static visual content.
schema_org.wantaction
The act of expressing a desire about the object. An agent wants an object.
schema_org.watchaction
The act of consuming dynamic/moving visual content.
schema_org.wearaction
The act of dressing oneself in clothing.
schema_org.winaction
The act of achieving victory in a competitive activity.
schema_org.writeaction
The act of authoring written creative content.