Step Reasoning Tool

class labelbox.schema.tool_building.step_reasoning_tool.IncorrectStepReasoningVariant(id: int, name: str, regenerate_steps: bool | None = True, generate_and_rate_alternative_steps: bool | None = True, rewrite_step: bool | None = True, justification: bool | None = True)[source]

Bases: object

class labelbox.schema.tool_building.step_reasoning_tool.StepReasoningDefinition(variants: labelbox.schema.tool_building.step_reasoning_tool.StepReasoningVariants = <factory>, version: int = 1, title: Optional[str] = None, value: Optional[str] = None)[source]

Bases: object

class labelbox.schema.tool_building.step_reasoning_tool.StepReasoningTool(name: str, required: bool = False, schema_id: str | None = None, feature_schema_id: str | None = None, color: str | None = None, definition: ~labelbox.schema.tool_building.step_reasoning_tool.StepReasoningDefinition = <factory>)[source]

Bases: object

Use this class in OntologyBuilder to create a tool for step reasoning The definition field lists the possible options to evaulate a step

reset_generate_and_rate_alternative_steps()[source]

For live models, will require labelers to rate the alternatives generated by the model

reset_justification()[source]

For live models, will require labelers to provide a justification for their evaluation

reset_regenerate_steps()[source]

For live models, the default acation will invoke the model to generate alternatives if a step is marked as incorrect This method will reset the action to not regenerate the conversation

reset_rewrite_step()[source]

For live models, will require labelers to rewrite the conversation

class labelbox.schema.tool_building.step_reasoning_tool.StepReasoningVariant(id: int, name: str, actions: List[str] = <factory>)[source]

Bases: object

class labelbox.schema.tool_building.step_reasoning_tool.StepReasoningVariants(correct_step: ~labelbox.schema.tool_building.step_reasoning_tool.StepReasoningVariant = <factory>, neutral_step: ~labelbox.schema.tool_building.step_reasoning_tool.StepReasoningVariant = <factory>, incorrect_step: ~labelbox.schema.tool_building.step_reasoning_tool.IncorrectStepReasoningVariant = <factory>)[source]

Bases: object

This class is used to define the possible options for evaluating a step Currently the options are correct, neutral, and incorrect